-- Logs begin at Sat 2022-08-06 20:01:12 UTC, end at Sat 2022-08-06 22:19:50 UTC. -- Aug 06 20:43:10.808256 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 20:43:10.817205 ncdv-master-1 devstack@n-api.service[126618]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 20:43:10 2022] *** Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: nodename: ncdv-master-1 Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: machine: x86_64 Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: clock source: unix Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: pcre jit disabled Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: detected number of CPU cores: 4 Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: current working directory: / Aug 06 20:43:10.819212 ncdv-master-1 devstack@n-api.service[126618]: detected binary path: /usr/bin/uwsgi-core Aug 06 20:43:10.819919 ncdv-master-1 devstack@n-api.service[126618]: your processes number limit is 47680 Aug 06 20:43:10.819919 ncdv-master-1 devstack@n-api.service[126618]: your memory page size is 4096 bytes Aug 06 20:43:10.819919 ncdv-master-1 devstack@n-api.service[126618]: detected max file descriptor number: 2048 Aug 06 20:43:10.819919 ncdv-master-1 devstack@n-api.service[126618]: lock engine: pthread robust mutexes Aug 06 20:43:10.819919 ncdv-master-1 devstack@n-api.service[126618]: thunder lock: enabled Aug 06 20:43:10.819919 ncdv-master-1 devstack@n-api.service[126618]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 20:43:10.819919 ncdv-master-1 devstack@n-api.service[126618]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 20:43:10.864385 ncdv-master-1 devstack@n-api.service[126618]: Python main interpreter initialized at 0x55ce852019c0 Aug 06 20:43:10.864385 ncdv-master-1 devstack@n-api.service[126618]: python threads support enabled Aug 06 20:43:10.864385 ncdv-master-1 devstack@n-api.service[126618]: your server socket listen backlog is limited to 100 connections Aug 06 20:43:10.864385 ncdv-master-1 devstack@n-api.service[126618]: your mercy for graceful operations on workers is 90 seconds Aug 06 20:43:10.864734 ncdv-master-1 devstack@n-api.service[126618]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 20:43:10.864810 ncdv-master-1 devstack@n-api.service[126618]: *** Operational MODE: preforking *** Aug 06 20:43:10.865025 ncdv-master-1 devstack@n-api.service[126618]: *** uWSGI is running in multiple interpreter mode *** Aug 06 20:43:10.865025 ncdv-master-1 devstack@n-api.service[126618]: spawned uWSGI master process (pid: 126618) Aug 06 20:43:10.865213 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 06 20:43:10.868087 ncdv-master-1 devstack@n-api.service[126618]: spawned uWSGI worker 1 (pid: 126619, cores: 1) Aug 06 20:43:10.868087 ncdv-master-1 devstack@n-api.service[126618]: spawned uWSGI worker 2 (pid: 126620, cores: 1) Aug 06 20:43:10.868087 ncdv-master-1 devstack@n-api.service[126618]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 20:43:12.111815 ncdv-master-1 devstack@n-api.service[126619]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 20:43:12.163032 ncdv-master-1 devstack@n-api.service[126620]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 20:43:12.797426 ncdv-master-1 devstack@n-api.service[126619]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:43:12.797426 ncdv-master-1 devstack@n-api.service[126619]: from cryptography.utils import int_from_bytes Aug 06 20:43:12.797741 ncdv-master-1 devstack@n-api.service[126619]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:43:12.797741 ncdv-master-1 devstack@n-api.service[126619]: from cryptography.utils import int_from_bytes Aug 06 20:43:12.846996 ncdv-master-1 devstack@n-api.service[126620]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:43:12.846996 ncdv-master-1 devstack@n-api.service[126620]: from cryptography.utils import int_from_bytes Aug 06 20:43:12.847331 ncdv-master-1 devstack@n-api.service[126620]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:43:12.847331 ncdv-master-1 devstack@n-api.service[126620]: from cryptography.utils import int_from_bytes Aug 06 20:43:15.397422 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:43:15.397983 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:43:15.398187 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:43:15.398571 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:43:15.398832 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:43:15.399221 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.399549 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.399875 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.400196 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.400529 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.400843 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.401165 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.401256 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:43:15.401599 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:43:15.401688 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.401804 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.401968 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:43:15.402055 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.402331 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:43:15.402425 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.402605 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:43:15.402712 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.402990 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.403082 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.403314 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.403400 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.403632 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.403725 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.403948 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.404086 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.404255 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.404381 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.404570 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.404708 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.404879 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.405009 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.405191 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.405379 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.405535 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.406668 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.406813 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.406938 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.407059 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.407195 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.407327 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.407465 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.407590 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.407720 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.407849 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.407980 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.408587 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.408708 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.408829 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.408956 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.409159 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.409289 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.409418 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.409530 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.409650 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.409771 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.409905 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.410038 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.410162 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.410283 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.410402 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.410523 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.410722 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.410857 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.410991 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.411126 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.411247 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.411368 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.411496 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.411615 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.411767 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.411980 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.412136 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.412266 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.412388 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.412523 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.412704 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.412867 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.413029 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.413168 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.413353 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.413483 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.413678 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.413812 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.413983 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.414164 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.414300 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.414474 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.414631 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.414811 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.414938 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.415131 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.415259 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.415452 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.415577 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.415745 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.415883 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.416054 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.416186 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.416373 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.416498 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.416691 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.416827 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.417007 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.417133 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.417259 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.417391 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.417521 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.417656 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.417804 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.417930 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.418130 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.418511 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.418682 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.418815 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.418946 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.419070 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.419199 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.419321 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.419451 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.419581 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.419705 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.419901 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.420028 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.420228 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.420393 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.420521 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.420831 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.420960 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.421146 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.421281 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.421470 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.421597 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.421779 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.422003 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.422138 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.422432 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.422616 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.422742 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.422864 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.423051 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.423270 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.423398 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.423782 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.423914 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.424591 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.424917 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.425072 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.425244 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.425511 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.425637 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.425850 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.425984 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.426159 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.426287 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.426483 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.426631 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.426838 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.426965 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.427151 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.427278 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.427400 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.427559 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.427694 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.427871 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.428006 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.428195 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.428320 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.428592 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.428717 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.428851 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.428985 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.429144 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.429277 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.429483 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.429608 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.429790 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.429924 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.430353 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.430482 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.430689 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.430816 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.431001 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.431136 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.431304 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.431429 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.431613 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.431748 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.431915 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.432016 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.432219 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.432315 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.432526 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.432666 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.432828 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.432960 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.433084 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.433206 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.433361 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.433496 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.433663 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.433790 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.433983 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.434088 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.434285 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.434382 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.434610 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.434702 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.434915 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.435000 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.435210 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.435323 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.435517 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.435656 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.435818 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.435946 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.436121 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.436257 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.436422 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.436548 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.436723 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.436864 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.437024 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.437160 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.437325 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.437451 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.437625 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.437759 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.437925 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.438059 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.438271 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.438404 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.438526 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.438676 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.438878 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.439013 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.439161 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.439287 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.439495 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.439699 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.439833 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.440106 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.440233 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.440355 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.440477 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.440619 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.440755 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.440924 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.441051 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.441244 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.441374 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.441550 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.441690 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.441852 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.441978 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.442167 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.442294 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.442472 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.442641 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.442800 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.442936 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.443118 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.443245 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.443417 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.443550 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.443719 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.443844 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.444033 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.444158 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.444334 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.444459 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.444625 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.444757 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.444926 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.445069 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.445227 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.445407 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.445523 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.445677 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.445803 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.446013 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.446147 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.446333 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.446460 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.446675 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.446801 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.447001 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.447127 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.447325 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.447449 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.447632 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.447763 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.447935 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.448062 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.448238 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.448363 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.448554 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:43:15.448680 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.448887 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.449018 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.449205 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.449335 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.449525 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.449660 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.449845 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.449970 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.450171 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.450301 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.450487 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.450684 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.450821 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.450952 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.451134 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.451267 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.451447 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.451576 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.451775 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.451914 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.452088 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.452215 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.452399 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.452536 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.452711 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.452845 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.453028 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.453154 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.453345 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.453480 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.453674 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.453810 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.453989 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.454113 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.454301 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.454434 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.454637 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.454764 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.454980 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.455286 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.455416 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.455532 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.455662 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.455787 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.455908 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.456030 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.456225 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.456353 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.456544 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.456676 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.456870 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.457005 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.457189 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.457315 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.457511 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.457638 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.457828 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.457962 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.458147 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.458274 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.458463 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.458655 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.458804 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.458932 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.459116 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.459243 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.459426 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.459552 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.459734 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.459872 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.460041 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.460174 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.460349 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.460474 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.460660 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.460870 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.460996 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.461119 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.461265 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.461399 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.461606 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.461739 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.461923 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.462190 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.462316 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.462560 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.462688 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.462871 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.463021 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.463186 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.463342 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.463502 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.463664 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.463798 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.463988 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.464114 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.464403 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.464529 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.464722 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.464849 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.465048 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.465304 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.465431 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.465654 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.465792 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.465974 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.466249 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.466377 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.466614 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.466767 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.466936 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.467177 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.467305 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.467565 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.467692 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.467883 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.468010 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.468199 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.468370 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.468539 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.468736 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.468871 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.469051 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.469177 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.469371 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.469499 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.469689 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.469825 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.470004 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.470130 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.470314 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.470451 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.471174 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.471322 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.471492 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.471726 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.471865 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.472048 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.472182 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.472359 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.472493 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.472676 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.472806 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.472985 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.473131 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.473297 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.473423 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.473604 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.473731 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.473913 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.474049 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.474222 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.474347 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.474534 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.474706 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.474866 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.475003 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.475174 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.475301 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.475482 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.475609 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.475789 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.475916 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.476099 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.476223 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.476434 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.476559 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.476760 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.476893 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.477065 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.477201 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.477390 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.477517 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.477714 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.477843 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.478030 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.478169 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.478336 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.478470 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.478675 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.478803 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.478982 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.479106 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.479293 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.479420 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.479597 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.479731 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.479906 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.480033 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.480209 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.480344 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.480513 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.480647 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.480817 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.480944 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.481121 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.481262 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.481424 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.481550 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.481746 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.481884 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.482052 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.482186 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.482354 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.482478 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.482682 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.482810 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.482986 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.483118 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.483328 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.483463 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.483633 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.483759 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.483973 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.484100 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.484293 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.484420 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.484609 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.484733 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.484921 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.485053 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.485232 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.485357 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.485544 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.485668 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.485850 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.485975 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.486212 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.487062 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.487198 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.487406 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.487546 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.487782 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.487910 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.488096 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.488223 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.488418 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.488553 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.488729 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.488855 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.489039 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.489164 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.489360 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.489494 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.489681 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.489807 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.489987 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.490115 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.490303 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.490432 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.490648 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.490776 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.490979 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.491106 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.491293 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.491421 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.491607 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.491740 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.491916 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.492035 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.492234 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.492358 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.492523 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.492650 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.492829 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.492963 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.493138 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.493265 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.493447 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.493583 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.493761 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.493904 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.494067 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.494192 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.494384 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.494519 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.494719 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.494857 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.495031 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.495157 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.495338 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.495470 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.495654 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.495792 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.495957 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.496082 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.496270 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.496397 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.496593 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.496722 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.496920 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.497038 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.497227 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.497352 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.497535 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.497662 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.497854 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.497978 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.498169 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.498292 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.498473 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.498594 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.498813 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.498925 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.499121 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.499208 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.499425 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.499518 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.499734 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.499820 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.500049 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.500143 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.500360 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.500452 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.500672 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.500757 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.500976 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.501071 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.501291 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.501376 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.501597 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.501689 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.502020 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.502611 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.502702 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.502781 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.502871 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.502952 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.503029 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.503120 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.503225 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.503376 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.503510 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.503701 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.503825 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.504027 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.504139 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.504334 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.504467 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.504641 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.504783 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.504966 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.505095 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.505278 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.505410 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.505582 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.505718 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.505887 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.506032 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.506196 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.506356 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.506540 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.506874 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.507019 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.507169 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.507307 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.507486 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.507643 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.507807 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.507959 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.508114 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.508260 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.508418 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.508576 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.508714 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.508849 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.509031 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.509176 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.509353 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.509505 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.509651 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.509797 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.509961 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.510115 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.510258 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.510407 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.510605 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.510750 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.510887 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.511073 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.511218 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.511387 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.511546 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.511684 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.511830 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.511996 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.512182 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.512326 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.512471 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.512609 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.512744 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.512905 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.513049 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.513215 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.513381 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.513531 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.513807 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.513958 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.514123 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.514284 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.514422 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.514600 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.514744 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.514880 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.515074 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.515229 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.515389 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.515540 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.515700 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.515843 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.516010 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.516172 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.516310 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.516444 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.516647 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.516873 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.517021 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.517156 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.517301 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.517436 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.517572 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.517747 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.517897 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.518157 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.518318 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.518457 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.518617 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.518782 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.518926 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.519099 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.519486 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.519631 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.519768 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.519903 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.520048 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.520199 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.520336 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.520482 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.520618 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.520618 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.520896 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.521046 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.521183 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.521319 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.521526 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.521678 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.521828 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.521965 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.522137 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.522298 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.522436 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.522599 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.522760 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.522907 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.523066 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.523210 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.523388 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.523531 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.523705 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.524006 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.524151 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.524312 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.524500 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.524651 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.524911 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.525057 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.525200 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.525433 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.525583 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.525813 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.525978 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.526123 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.526382 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.526534 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.526730 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.526885 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.527022 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.527228 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.527378 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.527576 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.527720 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.527933 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.528076 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.528264 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.528415 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.528587 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.528742 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.528893 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.529049 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.529187 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.529322 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.529490 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.529645 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.529782 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.529918 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.530095 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.530250 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.530412 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.530615 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.530760 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.530911 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.531048 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.531194 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.531338 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.531484 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.531650 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.531795 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.531961 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.532105 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.532272 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.532424 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.532569 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.532704 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.532874 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.533526 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.533694 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.533832 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.533996 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.534217 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.534402 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.534564 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.534723 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.534862 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.534998 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.535132 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.535267 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.535437 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.535595 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.535755 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.535899 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.536067 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.536246 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.536392 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.536539 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.536676 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.536819 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.536996 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.537137 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.537306 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.537457 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.537595 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.537729 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.537897 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.538050 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.538198 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.538342 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.538479 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.538645 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.538821 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.538964 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.539134 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.539278 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.539462 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.539614 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.539779 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.539922 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.540067 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.540205 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.540379 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.540521 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.540682 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.540839 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.540977 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.541112 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.541275 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.541418 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.541576 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.541728 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.541873 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.542010 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.542167 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.542310 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.542470 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.542669 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.542814 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.542958 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.543095 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.543251 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.543389 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.543533 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.543699 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.543843 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.544003 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.544147 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.544308 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.544464 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.544602 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.544738 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.544939 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.545091 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.545247 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.545385 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.545589 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.545740 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.545899 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.546043 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.546258 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.546394 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.546530 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.546748 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.546841 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.546925 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.547134 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.547228 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.547444 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.547547 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.547751 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.547840 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.548066 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.548155 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.548376 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.548462 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.548733 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.549840 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.549933 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.550013 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.550090 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.550175 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.550255 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.550381 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.550470 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.550649 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.550894 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.551039 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.551215 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.551372 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.551532 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.551684 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.551832 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.551975 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.552144 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.552298 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.552460 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.552611 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.552779 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.552929 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.553075 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.553219 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.553384 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.553528 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.553693 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.553847 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.553993 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.554139 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.554300 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.554444 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.554642 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.554799 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.554948 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.555341 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.555506 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.555650 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.555812 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.555955 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.556110 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.556248 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.556407 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.556551 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.556695 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.556844 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.557019 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.557162 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.557331 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.557482 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.557643 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.557793 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.557937 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.558088 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.558224 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.558396 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.558600 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.558763 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.558902 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.559037 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.559246 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.559446 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.559600 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.559771 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.559912 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.560058 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.560193 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.560376 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.560532 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.560704 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.560847 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.561032 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.561175 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.561341 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.561497 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.561634 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.561776 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.561960 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.562118 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.562289 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.562442 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.562639 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.562787 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.562957 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.563100 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.563276 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.563429 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.563573 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.563900 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.564058 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.564405 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.564572 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.564712 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.564861 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.565110 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.565259 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.565506 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.565666 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.565861 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.566148 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.566314 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.566468 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.566672 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.566832 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.566986 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.567141 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.567285 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.567436 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.567670 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.567822 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.568042 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.568201 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.568354 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.568664 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.568815 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.568958 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.569277 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.569436 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.569582 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.569754 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.569904 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.570175 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.570335 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.570503 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.570679 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.570857 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.571065 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.571225 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.571458 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.571622 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.571765 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.571915 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.572085 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.572243 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.572397 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.572548 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.572717 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.572865 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.573047 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.573196 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.573349 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.573491 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.573647 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.573789 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.573939 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.574098 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.574243 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.574397 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.574592 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.574748 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.574891 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.575045 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.575215 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.575368 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.575550 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.575702 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.575884 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.576048 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.576193 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.576335 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.576523 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.576681 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.576838 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.576983 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.577162 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.577312 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.577456 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.577608 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.577771 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.577928 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.578073 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.578221 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.578365 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.578515 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.578725 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.578872 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.579015 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.579158 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.579300 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.579442 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.579605 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.579757 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.579924 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.580143 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.580292 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.580442 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.580596 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.580741 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.580884 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.581027 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.581175 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.581333 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.581489 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.581633 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.581775 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.581917 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.582059 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.582213 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.582363 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.582506 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.582702 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.582846 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.582989 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.583142 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.583293 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.583455 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.583599 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.583749 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.583901 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.584053 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.584179 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.584366 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.584471 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.584697 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.584799 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.585021 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.585110 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.585342 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.585431 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.585662 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.585761 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.585982 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.586072 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.586301 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.586432 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.586641 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.586746 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.586960 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.587062 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.587277 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.587362 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.587598 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.587761 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.587918 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.588008 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.588210 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.588305 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.588523 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.588741 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.588827 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.589075 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.589161 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.589399 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.589493 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.589711 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.589796 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.590017 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.590102 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.590322 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.590420 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.590650 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.590740 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.590977 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.591079 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.591284 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.591370 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.591599 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.591685 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.591908 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.591993 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.592213 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.592307 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.592519 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.592605 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.592821 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.592915 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.593163 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.593251 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.593470 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.593555 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.593798 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.593883 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.594110 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.594211 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.594426 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.594512 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.594767 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.594876 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.595082 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.595169 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.595397 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.595482 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.596259 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.596816 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.596909 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.596997 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.597077 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.597151 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.597226 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.597393 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.597586 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.597745 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.597892 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.598046 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.598199 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.598416 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.598588 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.598739 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.598917 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.599069 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.599247 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.599399 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.599564 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.599715 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.599883 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.600044 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.600201 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.600347 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.600499 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.600644 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.600786 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.600936 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.601086 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.601326 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.601477 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.601621 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.601793 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.601948 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.602103 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.602247 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.602396 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.602608 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.602764 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.602944 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.603096 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.603275 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.603425 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.603582 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.603735 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.603886 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.604040 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.604183 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.604365 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.604520 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.604674 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.604819 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.604960 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.605105 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.605248 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.605403 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.605554 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.605699 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.605852 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.606025 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.606184 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.606337 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.606492 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.606668 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.606824 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.606968 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.607110 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.607287 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.607433 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.607584 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.607851 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.608012 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.608164 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.608317 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.608461 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.608603 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.608744 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.608894 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.609068 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.609228 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.609402 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.609566 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.609711 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.609863 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.610020 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.610165 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.610314 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.610464 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.610737 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.610900 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.611251 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.612017 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.612175 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.612175 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.612392 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.612808 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.612991 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.613341 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.613341 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.613661 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.614003 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.614003 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.614308 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.614631 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.614833 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.614980 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.614980 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.615262 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.615422 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.615566 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.615716 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.615859 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.616007 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.616007 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.616290 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.616444 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.616588 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.616730 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.616730 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.617017 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.617167 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.617333 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.617483 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.617626 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.617777 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.617927 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.618069 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.618211 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.618404 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.618579 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.618812 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.618960 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.619102 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.619251 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.619406 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.619643 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.619801 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.620007 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.620157 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.620545 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.620695 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.620847 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.620992 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.621141 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.621285 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.621428 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.621570 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.621732 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.621876 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.622035 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.622183 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.622326 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.622468 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.622684 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.622840 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.622984 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.623127 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.623279 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.623423 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.623590 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.623734 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.623876 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.624017 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.624159 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.624317 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.624462 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.624629 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.624787 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.624931 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.625073 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.625254 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.625405 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.625559 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.625703 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.625878 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.626035 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.626191 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.626335 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.626476 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.626674 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.626847 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.627432 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.627547 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.627635 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.627714 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.627793 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.627871 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.627959 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.628119 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.628218 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.628385 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.628474 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.628697 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.628808 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.629007 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.629095 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.629314 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.629403 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.629625 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.629720 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.629928 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.630014 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.630237 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.630324 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.630561 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.630652 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.630891 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.630979 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.631199 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.631293 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.631539 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.631626 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.631854 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.631943 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.632167 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.632337 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.632492 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.632635 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.632776 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.632917 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.633083 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.633234 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.633419 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.633584 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.633728 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.633868 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.634041 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.634232 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.634466 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.634636 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.634811 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.634972 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.635125 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.635277 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.635450 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.635612 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.635762 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.635905 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.636086 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.636246 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.636420 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.636571 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.636738 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.636889 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.637040 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.637184 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.637347 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.637508 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.637678 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.637822 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.637973 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.638123 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.638268 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.638410 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.638585 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.638736 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.638896 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.639054 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.639198 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.639340 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.639492 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.639635 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.639785 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.639929 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.640071 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.640213 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.640356 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.640505 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.640649 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.640791 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.640942 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.641092 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.641253 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.641406 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.641550 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.641692 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.641841 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.641985 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.642163 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.642296 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.643019 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.643435 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.643540 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.643628 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.643708 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.643825 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.643914 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.644135 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.644228 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.644447 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.644542 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.644761 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.644859 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.645069 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.645155 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.645378 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.645477 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.645692 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.645778 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.646001 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.646115 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.646312 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.646431 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.646643 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.646775 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.646955 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.647096 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.647264 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.647409 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.647668 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.647759 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.647943 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.648028 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.648264 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.648351 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.648591 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.648675 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.648909 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.648993 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.649239 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.649331 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.649555 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.649652 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.649882 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.649974 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.650210 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.650293 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.650517 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.650615 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.650846 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.650942 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.651149 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.651235 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.651457 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.651541 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.651773 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.651867 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.652083 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.652167 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.652387 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.652478 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.652689 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.652782 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.652996 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.653095 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.653299 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.653382 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.653599 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.653691 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.653900 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.653992 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.654201 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.654285 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.654507 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.654635 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.654835 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.655005 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.655154 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.655298 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.655452 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.655607 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.655750 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.655891 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.656034 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.656191 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.656335 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.656477 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.656626 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.656770 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.656912 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.657062 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.657214 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.657365 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.657527 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.657671 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.657840 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.658027 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.658765 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.658854 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.658921 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.659120 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.659248 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.659442 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.659565 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.659774 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.659891 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.660114 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.660212 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.660431 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.660522 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.660762 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.660846 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.661094 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.661191 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.661437 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.661521 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.661753 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.661844 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.662062 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.662153 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.662392 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.662473 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.662730 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.662898 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.663062 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.663294 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.663446 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.663634 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.663634 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126619) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:43:15.663919 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.663919 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.664222 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.664548 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.665103 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.665255 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.665481 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.667862 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.667862 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.667862 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.667862 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.667862 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.667862 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.670488 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.670488 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.670488 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.670488 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.670488 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.670488 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.671923 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.671923 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.671923 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.672360 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.672545 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.672844 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.673279 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.673615 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.674016 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.674338 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.674890 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.675233 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.675554 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.675870 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.676180 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:43:15.676425 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126620) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:43:15.729384 ncdv-master-1 devstack@n-api.service[126619]: INFO dbcounter [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Registered counter for database nova_api Aug 06 20:43:15.743717 ncdv-master-1 devstack@n-api.service[126620]: INFO dbcounter [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Registered counter for database nova_api Aug 06 20:43:15.749031 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_db.sqlalchemy.engines [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:43:15.755557 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writer thread running {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:43:15.763894 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_db.sqlalchemy.engines [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:43:15.772563 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writer thread running {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:43:15.813072 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.context [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) {{(pid=126619) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 20:43:15.817161 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:15.817637 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:15.819243 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:15.819980 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:15.820432 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:15.822399 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:15.824396 ncdv-master-1 devstack@n-api.service[126619]: INFO dbcounter [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Registered counter for database nova_cell0 Aug 06 20:43:15.828416 ncdv-master-1 devstack@n-api.service[126619]: INFO dbcounter [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Registered counter for database nova_cell1 Aug 06 20:43:15.831373 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.context [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) {{(pid=126620) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 20:43:15.835551 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_concurrency.lockutils [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:15.836029 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_concurrency.lockutils [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:15.836241 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_db.sqlalchemy.engines [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:43:15.837623 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_concurrency.lockutils [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:15.837797 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_db.sqlalchemy.engines [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:43:15.838368 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_concurrency.lockutils [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:15.838840 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_concurrency.lockutils [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:15.840810 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_concurrency.lockutils [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126620) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:15.842842 ncdv-master-1 devstack@n-api.service[126620]: INFO dbcounter [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Registered counter for database nova_cell0 Aug 06 20:43:15.843275 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writer thread running {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:43:15.846342 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writer thread running {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:43:15.847424 ncdv-master-1 devstack@n-api.service[126620]: INFO dbcounter [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Registered counter for database nova_cell1 Aug 06 20:43:15.854842 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_db.sqlalchemy.engines [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:43:15.858416 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_db.sqlalchemy.engines [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:43:15.862986 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writer thread running {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:43:15.989174 ncdv-master-1 devstack@n-api.service[126619]: INFO dbcounter [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Registered counter for database nova_cell0 Aug 06 20:43:15.995882 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_db.sqlalchemy.engines [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126619) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:43:16.000120 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writer thread running {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:43:16.003957 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writer thread running {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:43:16.012945 ncdv-master-1 devstack@n-api.service[126620]: INFO dbcounter [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Registered counter for database nova_cell0 Aug 06 20:43:16.022206 ncdv-master-1 devstack@n-api.service[126620]: DEBUG oslo_db.sqlalchemy.engines [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126620) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:43:16.026761 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writer thread running {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:43:16.343764 ncdv-master-1 devstack@n-api.service[126619]: WARNING keystonemiddleware.auth_token [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:43:16.351586 ncdv-master-1 devstack@n-api.service[126619]: WARNING keystonemiddleware.auth_token [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:43:16.353464 ncdv-master-1 devstack@n-api.service[126620]: WARNING keystonemiddleware.auth_token [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:43:16.360692 ncdv-master-1 devstack@n-api.service[126620]: WARNING keystonemiddleware.auth_token [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:43:16.696580 ncdv-master-1 devstack@n-api.service[126619]: WARNING keystonemiddleware.auth_token [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:43:16.702569 ncdv-master-1 devstack@n-api.service[126619]: WARNING keystonemiddleware.auth_token [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:43:16.708080 ncdv-master-1 devstack@n-api.service[126619]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce852019c0 pid: 126619 (default app) Aug 06 20:43:16.710150 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:16.711358 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Aug 06 20:43:16.712097 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Sat Aug 6 20:43:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:43:16.712793 ncdv-master-1 devstack@n-api.service[126620]: WARNING keystonemiddleware.auth_token [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:43:16.718783 ncdv-master-1 devstack@n-api.service[126620]: WARNING keystonemiddleware.auth_token [None req-9ed43ba6-5ef8-49e4-bb4b-1a7b4c15dc25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:43:16.726370 ncdv-master-1 devstack@n-api.service[126620]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce852019c0 pid: 126620 (default app) Aug 06 20:44:37.099663 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:37.101265 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Aug 06 20:44:37.101656 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:44:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:37.114308 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writing DB stats nova_api:SELECT=3 {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:37.115429 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writing DB stats nova_cell0:SELECT=3 {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:37.116596 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writing DB stats nova_cell1:SELECT=3 {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:37.117385 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writing DB stats nova_cell0:SELECT=3 {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:37.993472 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-7d750397-f773-406e-8554-155f2d17d108 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:38.026025 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-7d750397-f773-406e-8554-155f2d17d108 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917547 Aug 06 20:44:38.026784 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Aug 6 20:44:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:40.481678 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:40.482705 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-9af4aa04-a5ab-4739-a446-3f9dd6f9e369 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 06 20:44:40.483270 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:44:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:40.956091 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-182b2c0c-ae80-40d5-ad25-81bd923cc553 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:40.977268 ncdv-master-1 devstack@n-api.service[126620]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:40.977268 ncdv-master-1 devstack@n-api.service[126620]: warnings.warn(msg) Aug 06 20:44:41.009151 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-182b2c0c-ae80-40d5-ad25-81bd923cc553 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.519964 Aug 06 20:44:41.013337 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:44:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:44:41.238306 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-7695a709-0325-4c5f-a3f2-314f7c484b2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:41.242763 ncdv-master-1 devstack@n-api.service[126619]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:41.242763 ncdv-master-1 devstack@n-api.service[126619]: warnings.warn(msg) Aug 06 20:44:41.245405 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writing DB stats nova_api:SELECT=3 {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:41.246516 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writing DB stats nova_cell1:SELECT=3 {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:41.247465 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writing DB stats nova_cell0:SELECT=3 {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:41.248162 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:41.307748 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-7695a709-0325-4c5f-a3f2-314f7c484b2a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288164 Aug 06 20:44:41.308917 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Aug 6 20:44:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:43.792163 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-182b2c0c-ae80-40d5-ad25-81bd923cc553 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:43.793214 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-182b2c0c-ae80-40d5-ad25-81bd923cc553 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 06 20:44:43.793613 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:44:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:44.529986 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-39ebbb5f-825b-48de-a005-46633fbbd139 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "swap": 0, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:44.550086 ncdv-master-1 devstack@n-api.service[126619]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:44.550086 ncdv-master-1 devstack@n-api.service[126619]: warnings.warn(msg) Aug 06 20:44:44.569776 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-39ebbb5f-825b-48de-a005-46633fbbd139 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.768599 Aug 06 20:44:44.570337 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:44:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:44:44.582717 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-3ad70b59-04fe-472b-a4f6-bc1a64667f31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:44.589637 ncdv-master-1 devstack@n-api.service[126620]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:44:44.589637 ncdv-master-1 devstack@n-api.service[126620]: warnings.warn(msg) Aug 06 20:44:44.626175 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-3ad70b59-04fe-472b-a4f6-bc1a64667f31 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047493 Aug 06 20:44:44.627216 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Aug 6 20:44:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:44:47.481694 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-39ebbb5f-825b-48de-a005-46633fbbd139 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:47.482673 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-39ebbb5f-825b-48de-a005-46633fbbd139 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 06 20:44:47.483280 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:44:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:48.049724 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-6d5f9b30-7ccc-4eee-9063-70b22c2d8953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "swap": 0, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:48.074869 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-6d5f9b30-7ccc-4eee-9063-70b22c2d8953 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.585269 Aug 06 20:44:48.088153 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-ec8f682f-1e7f-4670-a51b-816fbc609dfd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:48.093360 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:44:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:44:48.120205 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-ec8f682f-1e7f-4670-a51b-816fbc609dfd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035990 Aug 06 20:44:48.121119 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Aug 6 20:44:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:50.691047 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-6d5f9b30-7ccc-4eee-9063-70b22c2d8953 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:50.692060 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-6d5f9b30-7ccc-4eee-9063-70b22c2d8953 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 06 20:44:50.692450 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:44:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:51.213027 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-3ce22237-af37-4dc6-8654-319e4e410d84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:51.227903 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-3ce22237-af37-4dc6-8654-319e4e410d84 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.528957 Aug 06 20:44:51.228449 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:44:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:44:51.240210 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-13d3dbc3-b93b-4dcf-8a48-81e08d9496a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:51.274136 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-13d3dbc3-b93b-4dcf-8a48-81e08d9496a5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037780 Aug 06 20:44:51.274753 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Aug 6 20:44:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:53.827350 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-3ce22237-af37-4dc6-8654-319e4e410d84 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:53.828366 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-3ce22237-af37-4dc6-8654-319e4e410d84 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 06 20:44:53.828791 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:44:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:54.323566 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-8bbf2961-ef87-4ed1-8ef2-28412617e95a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4"}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:54.342886 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-8bbf2961-ef87-4ed1-8ef2-28412617e95a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.507310 Aug 06 20:44:54.343766 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:44:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:44:54.356488 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-47f0abb6-9412-4552-8ab9-d1572a9951da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:54.381144 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-47f0abb6-9412-4552-8ab9-d1572a9951da admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028120 Aug 06 20:44:54.382613 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Sat Aug 6 20:44:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:44:56.835563 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-8bbf2961-ef87-4ed1-8ef2-28412617e95a admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:56.836707 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-8bbf2961-ef87-4ed1-8ef2-28412617e95a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001834 Aug 06 20:44:56.837211 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:44:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:57.288345 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-018b53cf-0ca8-482b-a62d-9040983d2d4c admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:57.314990 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-018b53cf-0ca8-482b-a62d-9040983d2d4c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470809 Aug 06 20:44:57.315677 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Aug 6 20:44:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:00.151721 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-8bbf2961-ef87-4ed1-8ef2-28412617e95a admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:00.153060 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-8bbf2961-ef87-4ed1-8ef2-28412617e95a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001860 Aug 06 20:45:00.153617 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:00.644314 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-da2fb521-76f1-4a7b-bbfd-aa303f26bc9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "ram": 512, "swap": 0, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:00.663083 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-da2fb521-76f1-4a7b-bbfd-aa303f26bc9a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.501574 Aug 06 20:45:00.663661 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:45:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:45:00.676913 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-4bd7fb73-8d37-4834-a276-aada19d98f8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:00.703692 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-4bd7fb73-8d37-4834-a276-aada19d98f8c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031551 Aug 06 20:45:00.704262 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Aug 6 20:45:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:45:03.771089 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-da2fb521-76f1-4a7b-bbfd-aa303f26bc9a admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:03.772109 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-da2fb521-76f1-4a7b-bbfd-aa303f26bc9a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 06 20:45:03.772510 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:45:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:04.224563 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-0a4becb0-2e06-4370-a981-58ba38e8ac0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "disk": 20, "vcpus": 1}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:04.244130 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-0a4becb0-2e06-4370-a981-58ba38e8ac0d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.465432 Aug 06 20:45:04.244679 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:45:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:45:04.257659 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-477db458-a076-4970-a9d6-1f64f1aeaea3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:04.281714 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-477db458-a076-4970-a9d6-1f64f1aeaea3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027627 Aug 06 20:45:04.282283 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Aug 6 20:45:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:06.699179 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-0a4becb0-2e06-4370-a981-58ba38e8ac0d admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:06.700177 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-0a4becb0-2e06-4370-a981-58ba38e8ac0d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 06 20:45:06.700571 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:07.074593 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-4acdffa2-fb43-44dc-9ecf-a9e0424224fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:07.093623 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-4acdffa2-fb43-44dc-9ecf-a9e0424224fb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.386499 Aug 06 20:45:07.094170 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:45:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:45:07.106026 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-c1a5dedb-536e-4d0e-a917-860fcfffd9a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:07.131413 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-c1a5dedb-536e-4d0e-a917-860fcfffd9a9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028921 Aug 06 20:45:07.131978 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Aug 6 20:45:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:09.648259 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-4acdffa2-fb43-44dc-9ecf-a9e0424224fb admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:09.649282 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-4acdffa2-fb43-44dc-9ecf-a9e0424224fb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 06 20:45:09.649683 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:45:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:10.097601 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-bcf3452e-0d5e-49b3-8f3d-5f1d64413dc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "swap": 0, "vcpus": 4}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:10.103313 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:10.119004 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-bcf3452e-0d5e-49b3-8f3d-5f1d64413dc7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.463168 Aug 06 20:45:10.119830 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:45:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:45:10.137123 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-dc77794f-c029-49f0-ae0d-e3a08f5dae20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:10.164222 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-dc77794f-c029-49f0-ae0d-e3a08f5dae20 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035486 Aug 06 20:45:10.165467 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Aug 6 20:45:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:12.680389 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-bcf3452e-0d5e-49b3-8f3d-5f1d64413dc7 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:12.681414 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-bcf3452e-0d5e-49b3-8f3d-5f1d64413dc7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 06 20:45:12.681820 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:45:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:13.154719 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-5d912f5c-ebd4-4a4e-b168-53a1cb9eeee7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge"}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:13.163658 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:13.181629 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-5d912f5c-ebd4-4a4e-b168-53a1cb9eeee7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.493657 Aug 06 20:45:13.182464 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Sat Aug 6 20:45:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:45:13.195198 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-5fa49d5e-000e-442f-ba0a-35a89ed4d832 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:13.224740 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-5fa49d5e-000e-442f-ba0a-35a89ed4d832 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033156 Aug 06 20:45:13.225318 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Sat Aug 6 20:45:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:35.145332 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-5d912f5c-ebd4-4a4e-b168-53a1cb9eeee7 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:35.146384 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-5d912f5c-ebd4-4a4e-b168-53a1cb9eeee7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 06 20:45:35.146841 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:35.158115 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:35.540901 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-4644ca81-9527-4ee4-991b-1c350dbb0904 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:35.558697 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-4644ca81-9527-4ee4-991b-1c350dbb0904 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405632 Aug 06 20:45:35.559406 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Aug 6 20:45:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:36.756393 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-5d912f5c-ebd4-4a4e-b168-53a1cb9eeee7 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:36.757405 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-5d912f5c-ebd4-4a4e-b168-53a1cb9eeee7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 06 20:45:36.757801 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:45:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:37.339680 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-5ecc318c-b2bd-4fdd-8f8d-2895947a7d1b admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:37.345377 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.wsgi [None req-5ecc318c-b2bd-4fdd-8f8d-2895947a7d1b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-5ecc318c-b2bd-4fdd-8f8d-2895947a7d1b admin admin] Request method failure captured: Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: Accept: application/json Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: Accept-Encoding: gzip, deflate Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: Connection: keep-alive Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: Content-Length: 0 Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: Host: 10.222.0.33 Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: Openstack-Api-Version: compute 2.90 Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: Openstack-System-Scope: None Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: User-Agent: python-novaclient Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Auth-Token: gAAAAABi7tLw5x45psWO7SscDMv-3TUniJ-pBq7QS6bgjevsY-lidqwF-CkXdIvUbtvuSgwvQ7fCvXBCJKfDoZAGReXsqFESxxKfR1SzDKyoy3buN7_Bosa1Y9Dlf7Xg9trW9rt-tGxDTSau65vXRXJO1wRex7PRwFvCRLtO6MO-9WR-yRkUrJQ Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Domain-Id: None Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Domain-Name: None Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Identity-Status: Confirmed Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Is-Admin-Project: True Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Domain-Id: default Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Domain-Name: Default Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Name: admin Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Role: admin,member,reader Aug 06 20:45:37.357914 ncdv-master-1 devstack@n-api.service[126620]: X-Roles: admin,member,reader Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_39f3affb323c4555adb3a84fee8265cf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: X-Tenant: admin Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: X-Tenant-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: X-Tenant-Name: admin Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: X-User: admin Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: X-User-Domain-Id: default Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: X-User-Domain-Name: Default Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: X-User-Id: 051007d94d8d4d818b5d4705a31e110b Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: X-User-Name: admin Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: method: > Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: exception: Flavor 42 could not be found. Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: action_args: {'id': '42'} Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:45:37.359548 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:37.360608 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.361999 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-5ecc318c-b2bd-4fdd-8f8d-2895947a7d1b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=126620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:45:37.363691 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-5ecc318c-b2bd-4fdd-8f8d-2895947a7d1b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.399377 Aug 06 20:45:37.363691 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Aug 6 20:45:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:37.369671 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-62400278-251d-4d7c-9697-4313fe1d170b admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:37.392266 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-62400278-251d-4d7c-9697-4313fe1d170b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026099 Aug 06 20:45:37.392814 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Aug 6 20:45:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:37.405184 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-e86a38a9-d640-490b-8baa-6c5eedb3df0a admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:37.427734 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-e86a38a9-d640-490b-8baa-6c5eedb3df0a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026268 Aug 06 20:45:37.428297 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Aug 6 20:45:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:37.437942 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-332a959b-75b5-477c-88f5-d70b90354cb8 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:37.443608 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.wsgi [None req-332a959b-75b5-477c-88f5-d70b90354cb8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-332a959b-75b5-477c-88f5-d70b90354cb8 admin admin] Request method failure captured: Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: Accept: application/json Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: Accept-Encoding: gzip, deflate Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: Connection: keep-alive Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: Content-Length: 0 Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: Host: 10.222.0.33 Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: Openstack-Api-Version: compute 2.90 Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: Openstack-System-Scope: None Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: User-Agent: python-novaclient Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Auth-Token: gAAAAABi7tLw5x45psWO7SscDMv-3TUniJ-pBq7QS6bgjevsY-lidqwF-CkXdIvUbtvuSgwvQ7fCvXBCJKfDoZAGReXsqFESxxKfR1SzDKyoy3buN7_Bosa1Y9Dlf7Xg9trW9rt-tGxDTSau65vXRXJO1wRex7PRwFvCRLtO6MO-9WR-yRkUrJQ Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Domain-Id: None Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Domain-Name: None Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Identity-Status: Confirmed Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Is-Admin-Project: True Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Domain-Id: default Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Domain-Name: Default Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Name: admin Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Role: admin,member,reader Aug 06 20:45:37.446927 ncdv-master-1 devstack@n-api.service[126619]: X-Roles: admin,member,reader Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_39f3affb323c4555adb3a84fee8265cf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: X-Tenant: admin Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: X-Tenant-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: X-Tenant-Name: admin Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: X-User: admin Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: X-User-Domain-Id: default Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: X-User-Domain-Name: Default Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: X-User-Id: 051007d94d8d4d818b5d4705a31e110b Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: X-User-Name: admin Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: method: > Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: exception: Flavor 42 could not be found. Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: action_args: {'id': '42'} Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:45:37.448398 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:37.449408 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:37.450821 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-332a959b-75b5-477c-88f5-d70b90354cb8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=126619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:45:37.452070 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-332a959b-75b5-477c-88f5-d70b90354cb8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014122 Aug 06 20:45:37.452070 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Aug 6 20:45:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:38.431074 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-e86a38a9-d640-490b-8baa-6c5eedb3df0a admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:38.432092 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-e86a38a9-d640-490b-8baa-6c5eedb3df0a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 06 20:45:38.432517 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:45:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:38.978317 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-79914836-7849-42b1-8017-d602111281e8 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:38.983617 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.wsgi [None req-79914836-7849-42b1-8017-d602111281e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-79914836-7849-42b1-8017-d602111281e8 admin admin] Request method failure captured: Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: Accept: application/json Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: Accept-Encoding: gzip, deflate Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: Connection: keep-alive Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: Content-Length: 0 Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: Host: 10.222.0.33 Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: Openstack-Api-Version: compute 2.90 Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: Openstack-System-Scope: None Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: User-Agent: python-novaclient Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Auth-Token: gAAAAABi7tLyLEqmq1PwKeQY9oUkUZYUgeBgu_fTWUnp6qConbtD5JxWYrvH-rlM3QX1Xx5FfVh_qHfZqDZRfpEGQjtoMKWCJuWHxAcFZ8dqE5f1LJw0adxo4B0PheelQmDQXP8OvIakdcIgzBVPvSv_MDxyt2lCNZ3iEezvKTHLMDaBTq5xAXk Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Domain-Id: None Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Domain-Name: None Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Identity-Status: Confirmed Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Is-Admin-Project: True Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Domain-Id: default Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Domain-Name: Default Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Name: admin Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Role: admin,member,reader Aug 06 20:45:38.985108 ncdv-master-1 devstack@n-api.service[126619]: X-Roles: admin,member,reader Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_39f3affb323c4555adb3a84fee8265cf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: X-Tenant: admin Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: X-Tenant-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: X-Tenant-Name: admin Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: X-User: admin Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: X-User-Domain-Id: default Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: X-User-Domain-Name: Default Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: X-User-Id: 051007d94d8d4d818b5d4705a31e110b Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: X-User-Name: admin Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: method: > Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: exception: Flavor 84 could not be found. Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: action_args: {'id': '84'} Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:45:38.986539 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:38.987642 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:38.988910 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-79914836-7849-42b1-8017-d602111281e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=126619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:45:38.990616 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-79914836-7849-42b1-8017-d602111281e8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.401395 Aug 06 20:45:38.990616 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Aug 6 20:45:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:38.997627 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-b2a9b2ce-828b-482d-a9d3-e15aac668980 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:39.013006 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-b2a9b2ce-828b-482d-a9d3-e15aac668980 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018939 Aug 06 20:45:39.013532 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Aug 6 20:45:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:39.023065 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-8d9711b5-1242-4f61-9b5e-d998e8418250 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:39.037681 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-8d9711b5-1242-4f61-9b5e-d998e8418250 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018233 Aug 06 20:45:39.038188 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Aug 6 20:45:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:39.047235 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-0d7d0ce8-3880-4a46-a121-daf3a212f973 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:39.053082 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.wsgi [None req-0d7d0ce8-3880-4a46-a121-daf3a212f973 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-0d7d0ce8-3880-4a46-a121-daf3a212f973 admin admin] Request method failure captured: Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: Accept: application/json Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: Accept-Encoding: gzip, deflate Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: Connection: keep-alive Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: Content-Length: 0 Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: Host: 10.222.0.33 Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: Openstack-Api-Version: compute 2.90 Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: Openstack-System-Scope: None Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: User-Agent: python-novaclient Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Auth-Token: gAAAAABi7tLyLEqmq1PwKeQY9oUkUZYUgeBgu_fTWUnp6qConbtD5JxWYrvH-rlM3QX1Xx5FfVh_qHfZqDZRfpEGQjtoMKWCJuWHxAcFZ8dqE5f1LJw0adxo4B0PheelQmDQXP8OvIakdcIgzBVPvSv_MDxyt2lCNZ3iEezvKTHLMDaBTq5xAXk Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Domain-Id: None Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Domain-Name: None Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Identity-Status: Confirmed Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Is-Admin-Project: True Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Domain-Id: default Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Domain-Name: Default Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Name: admin Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Role: admin,member,reader Aug 06 20:45:39.054591 ncdv-master-1 devstack@n-api.service[126620]: X-Roles: admin,member,reader Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_39f3affb323c4555adb3a84fee8265cf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: X-Tenant: admin Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: X-Tenant-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: X-Tenant-Name: admin Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: X-User: admin Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: X-User-Domain-Id: default Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: X-User-Domain-Name: Default Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: X-User-Id: 051007d94d8d4d818b5d4705a31e110b Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: X-User-Name: admin Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: method: > Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: exception: Flavor 84 could not be found. Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: action_args: {'id': '84'} Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:45:39.056115 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:39.057142 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.058560 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-0d7d0ce8-3880-4a46-a121-daf3a212f973 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=126620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:45:39.060152 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-0d7d0ce8-3880-4a46-a121-daf3a212f973 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012235 Aug 06 20:45:39.060152 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Aug 6 20:45:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:40.046804 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-8d9711b5-1242-4f61-9b5e-d998e8418250 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:40.047827 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-8d9711b5-1242-4f61-9b5e-d998e8418250 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 06 20:45:40.048198 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:45:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:40.591709 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-b8f8b9b1-e2ae-42c4-81e0-d98ade6d25b1 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:40.597381 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.wsgi [None req-b8f8b9b1-e2ae-42c4-81e0-d98ade6d25b1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-b8f8b9b1-e2ae-42c4-81e0-d98ade6d25b1 admin admin] Request method failure captured: Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: Accept: application/json Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: Accept-Encoding: gzip, deflate Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: Connection: keep-alive Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: Content-Length: 0 Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: Host: 10.222.0.33 Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: Openstack-Api-Version: compute 2.90 Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: Openstack-System-Scope: None Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: User-Agent: python-novaclient Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Auth-Token: gAAAAABi7tLznwxtZfITlA1snqmIFYXiJV85ipaly6_MhowyiAZlvQsYUOi8mcrMIOy4EhZtwzG7lUO-JkTxMQfL6dKizBrw-Z7uYM3cnR3zoeWUgkE0NUUKLqHxQiSvaDiMby81ysHUsts2OagFSQIJkHRixael3L4ST49MscNHgDOkwuFm78g Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Domain-Id: None Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Domain-Name: None Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Identity-Status: Confirmed Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Is-Admin-Project: True Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Domain-Id: default Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Domain-Name: Default Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Project-Name: admin Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Role: admin,member,reader Aug 06 20:45:40.598923 ncdv-master-1 devstack@n-api.service[126620]: X-Roles: admin,member,reader Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_39f3affb323c4555adb3a84fee8265cf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: X-Tenant: admin Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: X-Tenant-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: X-Tenant-Name: admin Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: X-User: admin Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: X-User-Domain-Id: default Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: X-User-Domain-Name: Default Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: X-User-Id: 051007d94d8d4d818b5d4705a31e110b Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: X-User-Name: admin Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: method: > Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: exception: Flavor 451 could not be found. Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: action_args: {'id': '451'} Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:45:40.600507 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:40.601364 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.602420 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-b8f8b9b1-e2ae-42c4-81e0-d98ade6d25b1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=126620) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:45:40.603486 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-b8f8b9b1-e2ae-42c4-81e0-d98ade6d25b1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.406549 Aug 06 20:45:40.603486 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Aug 6 20:45:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:40.610028 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-9da85b8f-b1e3-4593-852e-29f5d033658b admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:40.625121 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-9da85b8f-b1e3-4593-852e-29f5d033658b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018765 Aug 06 20:45:40.625652 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Aug 6 20:45:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:40.635664 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:40.650507 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018350 Aug 06 20:45:40.651061 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Sat Aug 6 20:45:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:40.660080 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-4fdf88bb-e8e6-4c00-b38a-874bcf7881dc admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:40.666478 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.wsgi [None req-4fdf88bb-e8e6-4c00-b38a-874bcf7881dc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-4fdf88bb-e8e6-4c00-b38a-874bcf7881dc admin admin] Request method failure captured: Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: Accept: application/json Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: Accept-Encoding: gzip, deflate Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: Connection: keep-alive Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: Content-Length: 0 Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: Host: 10.222.0.33 Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: Openstack-Api-Version: compute 2.90 Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: Openstack-System-Scope: None Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: User-Agent: python-novaclient Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Auth-Token: gAAAAABi7tLznwxtZfITlA1snqmIFYXiJV85ipaly6_MhowyiAZlvQsYUOi8mcrMIOy4EhZtwzG7lUO-JkTxMQfL6dKizBrw-Z7uYM3cnR3zoeWUgkE0NUUKLqHxQiSvaDiMby81ysHUsts2OagFSQIJkHRixael3L4ST49MscNHgDOkwuFm78g Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Domain-Id: None Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Domain-Name: None Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Identity-Status: Confirmed Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Is-Admin-Project: True Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Domain-Id: default Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Domain-Name: Default Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Project-Name: admin Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Role: admin,member,reader Aug 06 20:45:40.668029 ncdv-master-1 devstack@n-api.service[126619]: X-Roles: admin,member,reader Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_39f3affb323c4555adb3a84fee8265cf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39f3affb323c4555adb3a84fee8265cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: X-Tenant: admin Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: X-Tenant-Id: 39f3affb323c4555adb3a84fee8265cf Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: X-Tenant-Name: admin Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: X-User: admin Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: X-User-Domain-Id: default Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: X-User-Domain-Name: Default Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: X-User-Id: 051007d94d8d4d818b5d4705a31e110b Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: X-User-Name: admin Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: method: > Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: exception: Flavor 451 could not be found. Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: action_args: {'id': '451'} Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:45:40.669370 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:40.670359 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: ERROR nova.api.openstack.wsgi Aug 06 20:45:40.671991 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-4fdf88bb-e8e6-4c00-b38a-874bcf7881dc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=126619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:45:40.673020 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-4fdf88bb-e8e6-4c00-b38a-874bcf7881dc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012841 Aug 06 20:45:40.673020 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Aug 6 20:45:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 06 20:45:41.642725 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:41.643743 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 06 20:45:41.644166 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:45:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:42.179970 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-22946ebe-f8ab-4605-b73e-71a1068aa7d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:42.198958 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-22946ebe-f8ab-4605-b73e-71a1068aa7d2 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.407922 Aug 06 20:45:42.199487 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Sat Aug 6 20:45:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:45:43.184206 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:43.185501 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Aug 06 20:45:43.185896 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:45:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:43.725810 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-b3fc6510-000a-4325-9586-3d7a0711b015 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:43.744273 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-b3fc6510-000a-4325-9586-3d7a0711b015 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.409026 Aug 06 20:45:43.744747 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Sat Aug 6 20:45:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:45:44.743437 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:44.744453 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 06 20:45:44.744848 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:45.278314 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-e1c63fd9-977a-4b77-8b32-c6c473f21dd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:45.297260 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-e1c63fd9-977a-4b77-8b32-c6c473f21dd3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.401932 Aug 06 20:45:45.297796 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Sat Aug 6 20:45:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:45:46.273823 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:46.274904 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 06 20:45:46.275301 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:45:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:46.809671 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-fb6bb6ab-0f17-4268-bf1f-ac14a0b749fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:46.828961 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-fb6bb6ab-0f17-4268-bf1f-ac14a0b749fc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407352 Aug 06 20:45:46.829500 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Sat Aug 6 20:45:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:45:47.824540 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:47.825539 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 06 20:45:47.825930 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:48.350445 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-665607e8-2e3d-4950-9707-e7265d3f4e48 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:48.371485 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-665607e8-2e3d-4950-9707-e7265d3f4e48 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401190 Aug 06 20:45:48.372018 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Sat Aug 6 20:45:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:46:47.199538 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:47.200587 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-42341cb6-d3b3-4dcd-9cf0-6451de774921 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 06 20:46:47.200987 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Sat Aug 6 20:46:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:46:47.211641 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:47.599815 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-1f2f6abe-134d-450c-aacc-e1f503cf5c92 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:47.620215 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-1f2f6abe-134d-450c-aacc-e1f503cf5c92 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412942 Aug 06 20:46:47.620678 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Aug 6 20:46:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:46:47.646680 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-66b0030c-151f-4261-a578-2808fc946e41 admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:47.650160 ncdv-master-1 devstack@n-api.service[126620]: DEBUG dbcounter [-] [126620] Writing DB stats nova_api:SELECT=14 {{(pid=126620) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:47.655310 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-66b0030c-151f-4261-a578-2808fc946e41 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013009 Aug 06 20:46:47.655826 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Sat Aug 6 20:46:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:46:47.668005 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-067d05a1-eb5e-473c-8116-435d838d7946 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:47.676688 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-067d05a1-eb5e-473c-8116-435d838d7946 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012289 Aug 06 20:46:47.677209 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Sat Aug 6 20:46:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:46:47.689179 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-6d77e3ad-ecd6-42fb-b82b-d221c79b8f1c admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:47.696857 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-6d77e3ad-ecd6-42fb-b82b-d221c79b8f1c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011265 Aug 06 20:46:47.697365 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Sat Aug 6 20:46:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:46:47.708563 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-87b35f80-95d1-4362-b331-b400157634c7 admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:47.716123 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-87b35f80-95d1-4362-b331-b400157634c7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011137 Aug 06 20:46:47.716630 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Sat Aug 6 20:46:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:04.136230 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-6d77e3ad-ecd6-42fb-b82b-d221c79b8f1c admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:04.137291 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-6d77e3ad-ecd6-42fb-b82b-d221c79b8f1c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 06 20:52:04.137685 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:52:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:52:04.288828 ncdv-master-1 devstack@n-api.service[126619]: DEBUG dbcounter [-] [126619] Writing DB stats nova_api:SELECT=6 {{(pid=126619) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:04.432032 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-6323355a-68f5-476c-900e-92e2ce193ccd admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:04.434495 ncdv-master-1 devstack@n-api.service[126619]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:52:04.434495 ncdv-master-1 devstack@n-api.service[126619]: warnings.warn(msg) Aug 06 20:52:04.435626 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-6323355a-68f5-476c-900e-92e2ce193ccd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:04.436130 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-6323355a-68f5-476c-900e-92e2ce193ccd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:04.436556 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-6323355a-68f5-476c-900e-92e2ce193ccd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:04.437263 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-6323355a-68f5-476c-900e-92e2ce193ccd admin admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:04.437707 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-6323355a-68f5-476c-900e-92e2ce193ccd admin admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:04.438118 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-6323355a-68f5-476c-900e-92e2ce193ccd admin admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:04.479087 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-6323355a-68f5-476c-900e-92e2ce193ccd admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.191741 Aug 06 20:52:04.479640 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Aug 6 20:52:04 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:52:05.315954 ncdv-master-1 devstack@n-api.service[126620]: DEBUG nova.api.openstack.wsgi [None req-6d77e3ad-ecd6-42fb-b82b-d221c79b8f1c admin admin] Calling method '>' {{(pid=126620) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:05.316992 ncdv-master-1 devstack@n-api.service[126620]: INFO nova.api.openstack.requestlog [None req-6d77e3ad-ecd6-42fb-b82b-d221c79b8f1c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 06 20:52:05.317543 ncdv-master-1 devstack@n-api.service[126620]: [pid: 126620|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Sat Aug 6 20:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:52:05.519884 ncdv-master-1 devstack@n-api.service[126619]: DEBUG nova.api.openstack.wsgi [None req-a2cd5755-9d68-458d-9490-fea9e344f14c admin admin] Calling method '>' {{(pid=126619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:05.522465 ncdv-master-1 devstack@n-api.service[126619]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:52:05.522465 ncdv-master-1 devstack@n-api.service[126619]: warnings.warn(msg) Aug 06 20:52:05.523600 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-a2cd5755-9d68-458d-9490-fea9e344f14c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:05.524080 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-a2cd5755-9d68-458d-9490-fea9e344f14c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:05.524511 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-a2cd5755-9d68-458d-9490-fea9e344f14c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:05.525221 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-a2cd5755-9d68-458d-9490-fea9e344f14c admin admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:05.525671 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-a2cd5755-9d68-458d-9490-fea9e344f14c admin admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:05.526087 ncdv-master-1 devstack@n-api.service[126619]: DEBUG oslo_concurrency.lockutils [None req-a2cd5755-9d68-458d-9490-fea9e344f14c admin admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126619) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:05.548607 ncdv-master-1 devstack@n-api.service[126619]: INFO nova.api.openstack.requestlog [None req-a2cd5755-9d68-458d-9490-fea9e344f14c admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.080217 Aug 06 20:52:05.549145 ncdv-master-1 devstack@n-api.service[126619]: [pid: 126619|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Aug 6 20:52:05 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:52:52.963584 ncdv-master-1 devstack@n-api.service[126618]: Sat Aug 6 20:52:52 2022 - graceful shutdown triggered... Aug 06 20:52:52.964145 ncdv-master-1 devstack@n-api.service[126620]: Gracefully killing worker 2 (pid: 126620)... Aug 06 20:52:52.963710 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 06 20:52:52.964992 ncdv-master-1 devstack@n-api.service[126619]: Gracefully killing worker 1 (pid: 126619)... Aug 06 20:52:53.964614 ncdv-master-1 devstack@n-api.service[126618]: worker 1 buried after 1 seconds Aug 06 20:52:53.965127 ncdv-master-1 devstack@n-api.service[126618]: worker 2 buried after 1 seconds Aug 06 20:52:53.965127 ncdv-master-1 devstack@n-api.service[126618]: goodbye to uWSGI. Aug 06 20:52:53.966202 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Aug 06 20:52:53.966811 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 06 20:52:53.969535 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 20:52:54.017457 ncdv-master-1 devstack@n-api.service[142449]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 20:52:54 2022] *** Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: nodename: ncdv-master-1 Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: machine: x86_64 Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: clock source: unix Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: pcre jit disabled Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: detected number of CPU cores: 4 Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: current working directory: / Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: detected binary path: /usr/bin/uwsgi-core Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: your processes number limit is 47680 Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: your memory page size is 4096 bytes Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: detected max file descriptor number: 2048 Aug 06 20:52:54.028947 ncdv-master-1 devstack@n-api.service[142449]: lock engine: pthread robust mutexes Aug 06 20:52:54.030061 ncdv-master-1 devstack@n-api.service[142449]: thunder lock: enabled Aug 06 20:52:54.030061 ncdv-master-1 devstack@n-api.service[142449]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 20:52:54.030061 ncdv-master-1 devstack@n-api.service[142449]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 20:52:54.075396 ncdv-master-1 devstack@n-api.service[142449]: Python main interpreter initialized at 0x564e91c219c0 Aug 06 20:52:54.075396 ncdv-master-1 devstack@n-api.service[142449]: python threads support enabled Aug 06 20:52:54.075396 ncdv-master-1 devstack@n-api.service[142449]: your server socket listen backlog is limited to 100 connections Aug 06 20:52:54.075396 ncdv-master-1 devstack@n-api.service[142449]: your mercy for graceful operations on workers is 90 seconds Aug 06 20:52:54.075815 ncdv-master-1 devstack@n-api.service[142449]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 20:52:54.075815 ncdv-master-1 devstack@n-api.service[142449]: *** Operational MODE: preforking *** Aug 06 20:52:54.076060 ncdv-master-1 devstack@n-api.service[142449]: *** uWSGI is running in multiple interpreter mode *** Aug 06 20:52:54.076060 ncdv-master-1 devstack@n-api.service[142449]: spawned uWSGI master process (pid: 142449) Aug 06 20:52:54.076263 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 06 20:52:54.076834 ncdv-master-1 devstack@n-api.service[142449]: spawned uWSGI worker 1 (pid: 142461, cores: 1) Aug 06 20:52:54.077380 ncdv-master-1 devstack@n-api.service[142449]: spawned uWSGI worker 2 (pid: 142462, cores: 1) Aug 06 20:52:54.077649 ncdv-master-1 devstack@n-api.service[142449]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 20:52:55.357230 ncdv-master-1 devstack@n-api.service[142461]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 20:52:55.357789 ncdv-master-1 devstack@n-api.service[142462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 20:52:56.113004 ncdv-master-1 devstack@n-api.service[142462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:52:56.113004 ncdv-master-1 devstack@n-api.service[142462]: from cryptography.utils import int_from_bytes Aug 06 20:52:56.113326 ncdv-master-1 devstack@n-api.service[142462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:52:56.113326 ncdv-master-1 devstack@n-api.service[142462]: from cryptography.utils import int_from_bytes Aug 06 20:52:56.115183 ncdv-master-1 devstack@n-api.service[142461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:52:56.115183 ncdv-master-1 devstack@n-api.service[142461]: from cryptography.utils import int_from_bytes Aug 06 20:52:56.115521 ncdv-master-1 devstack@n-api.service[142461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:52:56.115521 ncdv-master-1 devstack@n-api.service[142461]: from cryptography.utils import int_from_bytes Aug 06 20:52:58.563829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:52:58.564504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:52:58.564602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:52:58.564980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:52:58.565244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:52:58.565643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.565983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.566316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.566641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:52:58.567646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.567754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:52:58.567853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.568092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:52:58.568247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.568431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.568552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:52:58.568712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:52:58.568841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.569093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.569199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.569370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.569485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.569701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.569798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.570037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.570143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.570369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.570466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.570709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.570807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.571031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.571190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.571350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.571499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.571662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.571807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.571957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.572110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.572264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.572413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.572559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.572775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.572949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.573142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.573336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.573503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.573645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.573796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.573959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.574119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.574262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.574413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.574597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.574747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.574921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.575252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.575427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.575612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.575756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.575896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.576049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.576191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.576332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.576481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.576630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.576780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.576936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.577085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.577233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.577393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.577551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.577692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.577843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.577992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.578146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.578294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.578448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.578630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.578788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.578940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.579275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.579450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.579601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.579751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.579899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.580731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.580893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.581046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.581194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.581337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.581485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.581634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.581776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.581926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.582082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.582222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.582369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.582568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.582870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.583066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.583216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.583414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.583563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.583563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.583856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.585068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.585264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.585264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.585788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.585941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.586100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.586251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.586401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.586625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.586777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.586937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.587085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.587235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.587398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.587547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.587695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.588039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.588195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.588376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.588624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.588774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.588986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.589136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.589287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.589437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.589592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.589734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.589890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.590040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.590193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.590342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.590490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.590671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.590824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.590967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.590967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.591245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.591403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.591553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.591701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.591843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.591983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.592133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.592282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.592432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.592574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.592724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.592865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.593005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.593145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.593303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.593496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.593645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.593785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.593926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.594073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.594285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.594435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.594607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.594760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.594908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.595058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.595206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.595358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.595520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.595877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.596019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.596171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.596327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.596479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.596621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.596761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.596908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.597059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.597209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.597370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.597513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.597661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.597810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.597966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.598132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.598369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.598613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.598779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.598939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.599082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.599222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.599377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.599539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.599680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.599838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.599980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.600129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.600279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.600420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.600560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.600714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.600902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.601049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.601288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.601450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.601620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.601776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.601918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.602065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.602206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.602346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.602486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.602671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.602824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.602972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.603113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.603252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.603405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.603609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.603758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.603909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.604061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.604210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.604351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.604501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.604650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.604807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.604948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.605088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.605237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.605384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.605555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.605923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.606075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.606075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.606361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.606510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.606693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.606845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.606993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.607134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.607288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.607430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.607581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.607730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.607880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.608028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.608184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.608336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.608486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.608635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.608784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.608939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.609081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.609221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.609368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.609661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.609815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.609966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.610108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.610249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.610398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.610539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.610886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.611040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.611191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.611332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.611472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.611806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.611985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.612140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.612282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.612430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.612571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.612719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.612874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.613017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.613158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.613310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.613451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.613668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.614328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.614490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.614658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.614802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.614943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.615094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:52:58.615250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.615393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.615544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.615694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.616400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.616511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.616610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.616698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.616780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.616863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.616938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.617973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.618892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.619954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.620914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.621023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.621118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.621357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.621461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.621682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.621777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.622001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.622103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.622323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.622429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.623356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.623527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.623527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.623817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.623970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.624114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.624267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.624419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.624573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.624718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.624860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.625012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.625164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.625327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.625480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.625633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.625786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.625940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.626091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.626241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.626432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.626611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.626762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.626928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.627075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.627225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.627379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.627522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.627666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.627822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.627966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.628109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.628251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.628394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.628536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.628691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.628844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.628996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.629139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.629299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.630017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.630759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.630941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.631098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.631244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.631564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.631564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.632157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.632336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.632516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.632662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.634670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.634875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.635034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.635184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.635339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.635486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.635678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.635846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.635993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.636136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.636280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.636432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.636585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.636795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.636957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.637104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.637247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.637390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.637547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.637700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.637844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.637988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.638131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.638307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.638466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.638644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.638805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.638950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.639105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.641344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.642189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.642329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.642518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.642747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.642913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.643062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.643215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.643215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.643523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.643677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.643832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.643976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.644118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.644268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.644430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.644579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.644738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.644738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.645013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.646435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.646815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.646815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.647116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.647275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.647421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.647575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.647736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.647880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.648039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.648183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.648326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.648478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.649764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.649936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.650094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.650241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.650386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.650537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.650755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.650911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.651234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.651399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.651614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.651772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.651986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.652154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.652308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.652821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.652986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.653298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.653715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.653874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.654021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.654778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.654942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.655171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.655372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.655553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.657599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.657599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.657870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.658004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.658130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.658253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.658366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.658477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.658608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.658854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.658976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.658976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.659185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.659294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.659405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.659561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.659680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.659813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.659925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.660044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.660169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.660303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.660428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.660541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.660724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.660841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.661115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.661286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.661408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.661520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.661638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.661749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.661867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.661987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.662101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.662220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.662332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.666990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.667167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.667296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.667420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.667542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.667665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.667794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.667907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.671878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.672020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.672020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.672275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.674665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.674824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.674967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.675102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.675247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.675394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.675543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.675685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.675823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.675965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.676096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.676760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.677159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.677300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.677300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.677549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.677678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.677817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.677960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.680617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.681351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.681493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.681646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.681789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.681922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.682043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.682173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.682303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.682443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.682609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.682744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.682874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.683013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.683144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.683283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.683422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.683562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.683705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.683846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.683986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.684116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.684248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.684378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.684507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.684644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.684792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.684928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.685068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.685199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.685338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.685477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.685617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.685749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.685887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.686017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.686146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.686284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.686425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.686572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.686704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.686833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.686974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.687113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.687255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.687395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.687395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.687395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.687395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.687395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.687395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.688167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.688307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.688307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.688570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.688713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.688845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.688974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.689112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.689250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.689388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.689529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.689660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.689788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.689788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.690363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.690501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.690501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.690802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.690931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.691060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.691188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.691332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.691472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.691612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.691743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.691926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.692585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.692585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.692585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.692585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.693194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.693360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.693493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.693639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.693639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.693897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.694025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.694025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.694282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.694422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.694570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.694688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.694801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.694936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.695079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.695222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.695354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.695482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.695612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.695743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.695743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.695978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.696096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.696226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.696347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.696347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.696566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.696696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.696696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.696969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.697108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.697237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.697377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.697515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.697653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.697792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.698013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.698147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.698283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.698413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.698587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.698587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.698842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.698955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.698955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.699220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.699359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.699507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.699648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.699648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.699895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.700938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.701793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.701793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.702056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.702186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.702324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.702462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.702462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.702756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.702894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.702894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.703159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.703298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.703428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.703556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.703556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.703809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.703946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.703946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.704210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.704339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.704476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.704611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.704740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.704889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.704889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.705152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.705293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.705293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.705547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.705547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.705547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.705547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.706049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.706188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.706329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.706329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.706632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.706765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.706908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.706908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.706908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.707305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.707451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.707628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.707825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.708044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.708044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.708396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.708538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.708538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.708804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.708962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.709221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.709221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.709500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.709500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.709764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.709906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.710046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.710185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.710185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.710459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.710898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.711051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.711193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.711193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.711449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.711571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.711700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.711927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.711927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.712212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.712344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.712344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.712611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.712750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.712750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.712997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.713135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.713266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.713404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.713404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.713662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.713792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.713929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.714060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.714060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.714317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.714454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.714664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.714803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.714803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.715060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.715200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.715200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.715454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.715594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.715737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.715869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.715869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.716115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.716251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.716391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.716531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.716531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.716788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.716918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.716918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.717174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.717313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.717313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.717570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.717699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.717830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.717968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.717968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.718231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.718361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.718491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.718648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.718648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.718967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.719098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.719098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.719344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.719473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.719618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.719749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.719749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.719995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.720125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.720263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.720407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.720407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.720688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.721127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.721127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.721392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.721533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.721533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.721789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.721921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.721921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.722194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.722333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.722463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.722699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.722699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.722951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.723125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.723315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.723601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.723601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.723991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.724139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.724139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.724406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.724543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.724688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.724862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.725004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.725151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.725284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.725413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.725413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.725667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.725927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.726072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.726206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.726206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.726460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.726606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.726606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.726924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.727056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.727056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.727311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.727443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.727586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.727725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.727865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.728033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.728033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.728310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.728456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.728595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.728735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.728874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.729054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.729197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.729487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.729622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.729808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.729995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.730169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.730441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.730611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.731206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.731363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.731506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.731645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.731786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.731927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.732058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.732218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.732375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.732520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.732719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.732853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.733029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.733410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.733736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.733959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.734101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.734319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.734462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.734706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.734842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.735021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.735281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.735415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.735636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.735770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.735967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.736227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.736362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.736571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.736713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.737013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.737156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.737477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.737630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.737799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.738014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.738163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.738467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.738647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.739414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.739644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.739878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.740097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.740254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.740437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.740572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.740754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.740934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.741083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.741563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.741698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.741698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.741987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.742118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.742319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.742493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.742729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.742861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.743005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.743507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.743663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.743806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.743947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.744202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.744336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.744523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.744701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.744859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.745151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.745287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.745495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.745663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.745815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.746077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.746222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.746557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.746711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.746983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.747144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.747358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.747495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.747706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.747923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.748068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.748316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.748450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.748634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.748882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.749025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.749246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.749389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.749576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.749828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.749989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.750191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.750335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.750507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.750796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.750931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.751146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.751603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.751763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.751895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.752025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.752155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.752284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.752425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.752619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.752754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.753000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.753250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.753395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.753753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.753907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.754190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.754353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.755207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.755421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.755570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.755774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.755922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.756055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.756194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.756398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.756634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.756780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.757131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.757276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.757418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.757572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.757821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.758131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.758267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.758472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.758643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.758835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.759094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.759243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.759472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.759613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.759802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.760032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.760174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.760407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.760540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.760723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.760953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.761097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.761331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.761488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.761910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.762132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.762267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.762398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.762528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.762528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.762859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.763003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.763163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.763375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.763519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.763863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.764020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.764311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.764454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.764627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.764931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.765066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.765239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.765433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.765576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.765875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.766015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.766207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.766486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.766639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.766869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.767004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.767277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.767451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.767597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.767949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.768091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.768277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.768510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.768645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.768911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.769046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.769233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.769441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.769577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.769861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.770027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.770215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.770439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.770834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.771419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.771833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.772075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.772270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.772397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.772641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.772732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.772985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.773071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.773331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.773414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.773647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.773728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.774065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.774198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.774413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.774530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.774778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.775124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.775408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.775567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.775755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.775911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.776089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.776241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.776424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.776587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.776775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.776932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.777106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.777257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.777461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.777580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.777887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.777972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.778218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.778311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.778538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.778668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.778916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.779006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.779226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.779317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.779548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.779640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.779870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.779969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.780190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.780273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.780507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.780589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.780819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.780915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.781138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.781221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.781454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.781538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.781920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.782029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.782166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.782261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.782393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.782491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.782737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.782844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.783071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.783158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.783408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.783499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.783732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.783824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.784151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.784255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.784426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.784510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.784751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.784842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.785110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.785336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.785419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.786230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.786344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.786731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.786836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.787066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.787155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.787404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.787501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.787754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.787858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.788129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.788218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.788504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.788588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.788823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.788913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.789136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.789218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.789455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.789547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.789773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.789861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.790103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.790202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.790457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.790618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.790814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.791116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.791217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.791370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.791608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.791816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.791939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.792233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.792636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.792761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.792915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.793099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.793237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.793519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.793635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.794445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.794595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.794595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.794762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.794931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.795041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.795431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.795588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.795880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.795975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.796202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.796490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.796950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.797369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.797908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.798248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.798742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.799176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.799608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.800040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.800477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.800939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.801143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.802265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.802750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.802875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.803184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.803310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.803657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.803820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.804140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.804411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.804768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.804875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.805268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.805364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.805714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.806182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.806300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.806656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.806769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.807139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.807261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.807621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.807763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.808085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.808278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.808405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.808723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.808925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.809034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.809363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.809482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.809669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.809941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.810044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.810290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.810525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.810972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.811254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.811486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.811592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.811925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.812096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.812358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.812557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.812677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.812900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.813218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.813324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.813585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.813911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.814016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.814231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.814529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.814728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.815015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.815154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.815333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.815605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.815708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.816011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.816183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.816582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.816729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.817012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.817278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.817382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.817775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.817870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.818200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.818359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.818491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.818851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.818955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.819171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.819456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.819566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.819813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.820055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.820158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.820439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.820668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.820773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.821067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.821250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.821385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.821702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.821799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.822021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.822317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.822429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.822669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.822974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.823098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.823294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.823515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.823617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.823913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.824099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.824248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.824640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.824748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.825000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.825232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.825339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.825645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.825826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.825953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.826891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.827005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.827097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.827191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.827287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.827287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.827550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.827654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.827907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.828229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.828480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.828598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.828963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.829058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.829299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.829577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.829674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.829920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.830170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.830302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.830570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.830810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.830907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.831223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.831395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.831553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.831873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.831973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.832210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.832514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.832621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.833104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.833382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.833382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.833579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.833692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.834005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.834185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.834331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.834775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.834899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.835115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.835312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.835534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.835868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.835976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.836227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.836467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.836572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.836847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.837064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.837190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.837463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.837682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.837784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.838087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.878842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.879018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.879093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.879183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.879355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.879950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.880964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.881989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.882108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.882216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.882359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.882469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.882784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.882903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.883984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.884060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.884134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.884204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.884363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.884444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.884609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.884740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.884850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.884959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.885090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.885227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.885335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.885427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.885498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.885576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.885647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.885735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.885981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.886954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.887928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.888976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=142462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:52:58.889493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.889493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.890942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.891460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.891460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.891460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.891460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.891460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.891460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.891460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.891460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.892268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.892268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.892268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.892268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.892268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.892268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.892268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.892268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.893570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.894350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.894350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.894350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.894350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.894350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.894350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.894350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.894350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.895679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.895679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.895679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.895679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.895679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.895679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.895679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.895679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.896276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.896276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.896276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.896276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.896276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.896276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.896792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.897205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.897826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.898377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.898815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.899224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.899689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.900410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.900914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.901335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.901748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.902174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.902853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.903553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.906566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.906566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.906566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.906566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.906566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.906566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.906566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.906566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.909566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.909935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.914568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.914568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.914568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.914568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.914568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.914568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.914568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.914568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.915119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.915119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.915119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.915119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.915458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:52:58.915735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=142461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:52:58.931323 ncdv-master-1 devstack@n-api.service[142462]: INFO dbcounter [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Registered counter for database nova_api Aug 06 20:52:58.952792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_db.sqlalchemy.engines [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:52:58.960640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writer thread running {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:52:58.985125 ncdv-master-1 devstack@n-api.service[142461]: INFO dbcounter [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Registered counter for database nova_api Aug 06 20:52:59.005906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_db.sqlalchemy.engines [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:52:59.012538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writer thread running {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:52:59.021234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.context [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) {{(pid=142462) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 20:52:59.025826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.026450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.028276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.029243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.029833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.032089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.034237 ncdv-master-1 devstack@n-api.service[142462]: INFO dbcounter [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Registered counter for database nova_cell0 Aug 06 20:52:59.039550 ncdv-master-1 devstack@n-api.service[142462]: INFO dbcounter [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Registered counter for database nova_cell1 Aug 06 20:52:59.047488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_db.sqlalchemy.engines [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:52:59.049995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_db.sqlalchemy.engines [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:52:59.056043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writer thread running {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:52:59.061412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writer thread running {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:52:59.072521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.context [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) {{(pid=142461) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 20:52:59.076598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.077084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.078725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.079457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.079913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.081940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.084187 ncdv-master-1 devstack@n-api.service[142461]: INFO dbcounter [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Registered counter for database nova_cell0 Aug 06 20:52:59.088442 ncdv-master-1 devstack@n-api.service[142461]: INFO dbcounter [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Registered counter for database nova_cell1 Aug 06 20:52:59.095917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_db.sqlalchemy.engines [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:52:59.099082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_db.sqlalchemy.engines [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:52:59.106463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writer thread running {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:52:59.108461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writer thread running {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:52:59.210845 ncdv-master-1 devstack@n-api.service[142462]: INFO dbcounter [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Registered counter for database nova_cell0 Aug 06 20:52:59.217941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_db.sqlalchemy.engines [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:52:59.222836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writer thread running {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:52:59.265308 ncdv-master-1 devstack@n-api.service[142461]: INFO dbcounter [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Registered counter for database nova_cell0 Aug 06 20:52:59.275108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_db.sqlalchemy.engines [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=142461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:52:59.279701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writer thread running {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:52:59.549538 ncdv-master-1 devstack@n-api.service[142462]: WARNING keystonemiddleware.auth_token [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:52:59.557294 ncdv-master-1 devstack@n-api.service[142462]: WARNING keystonemiddleware.auth_token [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:52:59.604830 ncdv-master-1 devstack@n-api.service[142461]: WARNING keystonemiddleware.auth_token [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:52:59.612727 ncdv-master-1 devstack@n-api.service[142461]: WARNING keystonemiddleware.auth_token [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:52:59.910799 ncdv-master-1 devstack@n-api.service[142462]: WARNING keystonemiddleware.auth_token [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:52:59.917243 ncdv-master-1 devstack@n-api.service[142462]: WARNING keystonemiddleware.auth_token [None req-b3f7166b-d3b2-402e-9464-7f1fc59c9f1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:52:59.922597 ncdv-master-1 devstack@n-api.service[142462]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564e91c219c0 pid: 142462 (default app) Aug 06 20:52:59.958313 ncdv-master-1 devstack@n-api.service[142461]: WARNING keystonemiddleware.auth_token [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:52:59.964546 ncdv-master-1 devstack@n-api.service[142461]: WARNING keystonemiddleware.auth_token [None req-cfb0dc65-6264-4c15-a3de-44c9fc65ac85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:52:59.969835 ncdv-master-1 devstack@n-api.service[142461]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564e91c219c0 pid: 142461 (default app) Aug 06 20:53:41.959315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:41.960257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:41.961275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:41.962509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.079126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.081008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.081751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:42.083009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:43.039337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '.version_select at 0x7f72a0650ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:43.040823 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:43.040823 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:43.047057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) {{(pid=142462) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 06 20:53:43.047805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:43.048453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:43.049063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:43.090386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:43.091015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:43.091607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:43.107987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:43.108646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:43.109214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:43.117845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33f0250e-84c6-42d0-b85e-de36d40d23fe tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.164737 Aug 06 20:53:43.118997 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1/1] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Aug 6 20:53:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:43.461006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e570c88-f47a-44ad-aea5-7831cd3dc2c6 tempest-QuotaClassesAdminTestJSON-1518274175 tempest-QuotaClassesAdminTestJSON-1518274175-project-admin] Calling method '.version_select at 0x7f72a06b4f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:43.463682 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:43.463682 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:43.480779 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e570c88-f47a-44ad-aea5-7831cd3dc2c6 tempest-QuotaClassesAdminTestJSON-1518274175 tempest-QuotaClassesAdminTestJSON-1518274175-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 1.408319 Aug 06 20:53:43.481957 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1/2] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Aug 6 20:53:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:53:43.487471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e04b80f-c963-4fb6-a58f-0a8e9e594dca tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1131970404", "name": "tempest-test_aggregate-108167817"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:43.523323 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:43.523323 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:43.524750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-8e04b80f-c963-4fb6-a58f-0a8e9e594dca tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Generated uuid ab024dfe-6595-4d15-92f9-753380aba58f for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:53:43.562851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-62db02ae-1702-42f0-acf8-772a46751644 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:43.567296 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:43.567296 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:43.568672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62db02ae-1702-42f0-acf8-772a46751644 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:43.569176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62db02ae-1702-42f0-acf8-772a46751644 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:43.569691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62db02ae-1702-42f0-acf8-772a46751644 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:43.570613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62db02ae-1702-42f0-acf8-772a46751644 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:43.571076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62db02ae-1702-42f0-acf8-772a46751644 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:43.571502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62db02ae-1702-42f0-acf8-772a46751644 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:43.601416 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e04b80f-c963-4fb6-a58f-0a8e9e594dca tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.117628 Aug 06 20:53:43.602917 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1165 bytes} [Sat Aug 6 20:53:43 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:43.624014 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-62db02ae-1702-42f0-acf8-772a46751644 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.503674 Aug 06 20:53:43.624608 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Aug 6 20:53:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:43.792245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8094fe04-b0c7-46a8-8e06-f29361796dcc tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-190452225", "ram": 512, "vcpus": 1, "disk": 10, "id": 301997015, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:43.795298 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:43.795298 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:43.828456 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8094fe04-b0c7-46a8-8e06-f29361796dcc tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.224208 Aug 06 20:53:43.829064 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3/5] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:53:43 2022] POST /compute/v2.1/flavors => generated 412 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:43.838619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bd435e2c-ae33-4ad3-8505-29b7f514df3f tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:43.841118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd435e2c-ae33-4ad3-8505-29b7f514df3f tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:43.841745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd435e2c-ae33-4ad3-8505-29b7f514df3f tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:43.842276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd435e2c-ae33-4ad3-8505-29b7f514df3f tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:43.843260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd435e2c-ae33-4ad3-8505-29b7f514df3f tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:43.843826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd435e2c-ae33-4ad3-8505-29b7f514df3f tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:43.844441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd435e2c-ae33-4ad3-8505-29b7f514df3f tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:43.869499 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bd435e2c-ae33-4ad3-8505-29b7f514df3f tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.243684 Aug 06 20:53:43.870448 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1164 bytes} [Sat Aug 6 20:53:43 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:43.968027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40403453-93fe-4e86-9521-8b6563a696a6 tempest-FlavorsV261TestJSON-67122913 tempest-FlavorsV261TestJSON-67122913-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1410704682", "id": 775036503, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:43.989590 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40403453-93fe-4e86-9521-8b6563a696a6 tempest-FlavorsV261TestJSON-67122913 tempest-FlavorsV261TestJSON-67122913-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.158741 Aug 06 20:53:43.990286 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 4/7] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 20:53:43 2022] POST /compute/v2.1/flavors => generated 465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:53:43.999381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-31db7f88-894a-4a00-a0be-598e697948b4 tempest-QuotaClassesAdminTestJSON-1518274175 tempest-QuotaClassesAdminTestJSON-1518274175-project-admin] Action: 'update', calling method: .version_select at 0x7f729ec4aa60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:43.999381 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:43.999381 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:44.010097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Calling method '.version_select at 0x7f72a047af70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:44.012978 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:44.012978 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:44.014227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:44.014931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:44.015441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:44.036147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:44.036729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:44.037261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:44.055604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:44.056342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:44.057006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:44.064736 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f640fd0-79a8-4c34-a12a-6586e5e9dac3 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.193179 Aug 06 20:53:44.065417 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 4/8] 10.222.0.33 () {60 vars in 1208 bytes} [Sat Aug 6 20:53:43 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:53:44.079167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9c224e93-7a6d-47e0-9236-45d7de5fe419 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:44.080058 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:44.080058 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:44.093872 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9c224e93-7a6d-47e0-9236-45d7de5fe419 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.027131 Aug 06 20:53:44.095757 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 20:53:44 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:44.100992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e5b439c-337e-45aa-97f4-566e1294dd50 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:44.103982 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:44.103982 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:44.162365 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e5b439c-337e-45aa-97f4-566e1294dd50 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/301997015/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065089 Aug 06 20:53:44.163634 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 6/10] 10.222.0.33 () {60 vars in 1221 bytes} [Sat Aug 6 20:53:44 2022] POST /compute/v2.1/flavors/301997015/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:44.168701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71706e75-3ce7-4e24-b12a-eda438a7b8d7 tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:44.169560 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:44.169560 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:44.170775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71706e75-3ce7-4e24-b12a-eda438a7b8d7 tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:44.171340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71706e75-3ce7-4e24-b12a-eda438a7b8d7 tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:44.171858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71706e75-3ce7-4e24-b12a-eda438a7b8d7 tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:44.172666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71706e75-3ce7-4e24-b12a-eda438a7b8d7 tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:44.173871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71706e75-3ce7-4e24-b12a-eda438a7b8d7 tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:44.174468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71706e75-3ce7-4e24-b12a-eda438a7b8d7 tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:44.200381 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71706e75-3ce7-4e24-b12a-eda438a7b8d7 tempest-AZAdminV2TestJSON-764259765 tempest-AZAdminV2TestJSON-764259765-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.035551 Aug 06 20:53:44.201248 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 7/11] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Aug 6 20:53:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:44.331332 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-31db7f88-894a-4a00-a0be-598e697948b4 tempest-QuotaClassesAdminTestJSON-1518274175 tempest-QuotaClassesAdminTestJSON-1518274175-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.339789 Aug 06 20:53:44.332202 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 5/12] 10.222.0.33 () {60 vars in 1206 bytes} [Sat Aug 6 20:53:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:44.338181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-61893d08-690b-4ce9-9abc-53e7e2dd4323 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:44.341971 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:44.341971 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:44.359541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61893d08-690b-4ce9-9abc-53e7e2dd4323 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:44.360047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61893d08-690b-4ce9-9abc-53e7e2dd4323 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:44.361109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61893d08-690b-4ce9-9abc-53e7e2dd4323 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:44.394409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a539662-93a5-4e78-a81e-90b46bc8a519 tempest-FlavorsV261TestJSON-765500879 tempest-FlavorsV261TestJSON-765500879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:44.415796 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a539662-93a5-4e78-a81e-90b46bc8a519 tempest-FlavorsV261TestJSON-765500879 tempest-FlavorsV261TestJSON-765500879-project] 10.222.0.33 "GET /compute/v2.1/flavors/775036503" status: 200 len: 465 microversion: 2.61 time: 0.213500 Aug 06 20:53:44.416833 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 8/13] 10.222.0.33 () {60 vars in 1196 bytes} [Sat Aug 6 20:53:44 2022] GET /compute/v2.1/flavors/775036503 => generated 465 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:53:44.650342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-60b7c147-e4a7-4e36-91f0-41d8b8cb71e7 tempest-FlavorsExtraSpecsTestJSON-287236351 tempest-FlavorsExtraSpecsTestJSON-287236351-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:44.660457 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-60b7c147-e4a7-4e36-91f0-41d8b8cb71e7 tempest-FlavorsExtraSpecsTestJSON-287236351 tempest-FlavorsExtraSpecsTestJSON-287236351-project] 10.222.0.33 "GET /compute/v2.1/flavors/301997015/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.242483 Aug 06 20:53:44.668502 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 9/14] 10.222.0.33 () {58 vars in 1200 bytes} [Sat Aug 6 20:53:44 2022] GET /compute/v2.1/flavors/301997015/os-extra_specs => generated 66 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:44.671607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15751ff9-8e10-4498-817a-98a251ec15d2 tempest-QuotaClassesAdminTestJSON-1518274175 tempest-QuotaClassesAdminTestJSON-1518274175-project-admin] Calling method '.version_select at 0x7f72a03f2b80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:44.672422 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:44.672422 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:44.691005 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15751ff9-8e10-4498-817a-98a251ec15d2 tempest-QuotaClassesAdminTestJSON-1518274175 tempest-QuotaClassesAdminTestJSON-1518274175-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.022841 Aug 06 20:53:44.691741 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 10/15] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Aug 6 20:53:44 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:44.697296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5731ac1b-0669-4626-b708-46532c4e274b tempest-FlavorsV261TestJSON-67122913 tempest-FlavorsV261TestJSON-67122913-project-admin] Action: 'update', calling method: .version_select at 0x7f72a0a28e50>, body: {"flavor": {"description": "new"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:44.719692 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:44.719692 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:44.749401 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5731ac1b-0669-4626-b708-46532c4e274b tempest-FlavorsV261TestJSON-67122913 tempest-FlavorsV261TestJSON-67122913-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/775036503" status: 200 len: 466 microversion: 2.61 time: 0.056135 Aug 06 20:53:44.750187 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 11/16] 10.222.0.33 () {62 vars in 1216 bytes} [Sat Aug 6 20:53:44 2022] PUT /compute/v2.1/flavors/775036503 => generated 466 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:53:44.755438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-50635c4a-5145-4e5a-af0e-fa13438a6e52 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:44.757866 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:44.757866 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:44.785640 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-50635c4a-5145-4e5a-af0e-fa13438a6e52 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/301997015/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034228 Aug 06 20:53:44.786398 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 12/17] 10.222.0.33 () {60 vars in 1221 bytes} [Sat Aug 6 20:53:44 2022] POST /compute/v2.1/flavors/301997015/os-extra_specs => generated 66 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:44.790964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a38aebd-7185-4094-9027-058cace86820 tempest-QuotaClassesAdminTestJSON-1518274175 tempest-QuotaClassesAdminTestJSON-1518274175-project-admin] Action: 'update', calling method: .version_select at 0x7f72a04185e0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:44.794417 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:44.794417 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:44.904315 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a38aebd-7185-4094-9027-058cace86820 tempest-QuotaClassesAdminTestJSON-1518274175 tempest-QuotaClassesAdminTestJSON-1518274175-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.116685 Aug 06 20:53:44.912998 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 13/18] 10.222.0.33 () {60 vars in 1206 bytes} [Sat Aug 6 20:53:44 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:44.912998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef554464-8060-4a32-8dc1-2f08eaceec48 tempest-FlavorsV261TestJSON-765500879 tempest-FlavorsV261TestJSON-765500879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:44.973728 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ef554464-8060-4a32-8dc1-2f08eaceec48 tempest-FlavorsV261TestJSON-765500879 tempest-FlavorsV261TestJSON-765500879-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6736 microversion: 2.61 time: 0.063095 Aug 06 20:53:44.974902 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 14/19] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Aug 6 20:53:44 2022] GET /compute/v2.1/flavors/detail => generated 6736 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:53:44.988665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a079ddf3-1b9a-465e-ab8e-397f7fbd20cf tempest-FlavorsExtraSpecsTestJSON-287236351 tempest-FlavorsExtraSpecsTestJSON-287236351-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:44.999759 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a079ddf3-1b9a-465e-ab8e-397f7fbd20cf tempest-FlavorsExtraSpecsTestJSON-287236351 tempest-FlavorsExtraSpecsTestJSON-287236351-project] 10.222.0.33 "GET /compute/v2.1/flavors/301997015/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.023583 Aug 06 20:53:45.004903 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 15/20] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 20:53:44 2022] GET /compute/v2.1/flavors/301997015/os-extra_specs/hw:numa_nodes => generated 22 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:45.022722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e43f1330-88c4-4eec-a996-0fdd0db398b5 tempest-FlavorsV261TestJSON-765500879 tempest-FlavorsV261TestJSON-765500879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.047443 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e43f1330-88c4-4eec-a996-0fdd0db398b5 tempest-FlavorsV261TestJSON-765500879 tempest-FlavorsV261TestJSON-765500879-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3403 microversion: 2.61 time: 0.032493 Aug 06 20:53:45.048676 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 16/21] 10.222.0.33 () {60 vars in 1166 bytes} [Sat Aug 6 20:53:45 2022] GET /compute/v2.1/flavors => generated 3403 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:53:45.064601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-140ce1d6-d6da-47d9-8d4c-ae9b41d6fd73 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:45.069065 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-61893d08-690b-4ce9-9abc-53e7e2dd4323 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 0.734614 Aug 06 20:53:45.075182 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 6/22] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:53:44 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:45.091952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=73,nova_api:SAVEPOINT=6,nova_api:INSERT=2,nova_api:RELEASE=6,nova_api:UPDATE=13 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:45.094779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71423a31-d119-4d81-af5f-80fe86b9a4c9 tempest-FlavorsV261TestJSON-67122913 tempest-FlavorsV261TestJSON-67122913-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.098147 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:45.098147 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:45.098917 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-140ce1d6-d6da-47d9-8d4c-ae9b41d6fd73 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/301997015/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048332 Aug 06 20:53:45.099754 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 17/23] 10.222.0.33 () {60 vars in 1221 bytes} [Sat Aug 6 20:53:45 2022] POST /compute/v2.1/flavors/301997015/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:45.113052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-30bc23d1-3199-43b6-9ffc-f3bce1fcfe51 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.132779 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-30bc23d1-3199-43b6-9ffc-f3bce1fcfe51 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/301997015/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026034 Aug 06 20:53:45.134028 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 18/24] 10.222.0.33 () {58 vars in 1200 bytes} [Sat Aug 6 20:53:45 2022] GET /compute/v2.1/flavors/301997015/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:45.135930 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71423a31-d119-4d81-af5f-80fe86b9a4c9 tempest-FlavorsV261TestJSON-67122913 tempest-FlavorsV261TestJSON-67122913-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/775036503" status: 202 len: 0 microversion: 2.61 time: 0.059002 Aug 06 20:53:45.140547 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 7/25] 10.222.0.33 () {60 vars in 1199 bytes} [Sat Aug 6 20:53:45 2022] DELETE /compute/v2.1/flavors/775036503 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:53:45.147283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-25ffb47a-c202-47a4-b62e-752db245e3db tempest-FlavorsV261TestJSON-67122913 tempest-FlavorsV261TestJSON-67122913-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.149881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9e9421ca-d3f1-463d-88a8-54d59579fd88 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:45.158527 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:45.158527 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:45.169404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=17,nova_api:UPDATE=12,nova_api:DELETE=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:45.191544 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-25ffb47a-c202-47a4-b62e-752db245e3db tempest-FlavorsV261TestJSON-67122913 tempest-FlavorsV261TestJSON-67122913-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6280 microversion: 2.61 time: 0.049518 Aug 06 20:53:45.194671 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 8/26] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Aug 6 20:53:45 2022] GET /compute/v2.1/flavors/detail => generated 6280 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:53:45.202325 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9e9421ca-d3f1-463d-88a8-54d59579fd88 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/301997015/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.062323 Aug 06 20:53:45.204954 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 19/27] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 20:53:45 2022] PUT /compute/v2.1/flavors/301997015/os-extra_specs/hw:numa_nodes => generated 22 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:45.213997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-41ec9afd-7575-4987-b335-a3cdd598963d tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.237802 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-41ec9afd-7575-4987-b335-a3cdd598963d tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/301997015/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027716 Aug 06 20:53:45.243853 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 9/28] 10.222.0.33 () {58 vars in 1200 bytes} [Sat Aug 6 20:53:45 2022] GET /compute/v2.1/flavors/301997015/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:45.248533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9c9a842-7b32-4f80-b482-f27932e7b7bb tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.250014 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:45.250014 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:45.282845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c9c9a842-7b32-4f80-b482-f27932e7b7bb tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/301997015/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.037507 Aug 06 20:53:45.283911 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 20/29] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 20:53:45 2022] DELETE /compute/v2.1/flavors/301997015/os-extra_specs/hw:numa_nodes => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 06 20:53:45.293454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b8b648b-aa8d-4fe1-a392-f85641955959 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.294229 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:45.294229 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:45.333155 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b8b648b-aa8d-4fe1-a392-f85641955959 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/301997015/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.044798 Aug 06 20:53:45.335873 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 10/30] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 20:53:45 2022] DELETE /compute/v2.1/flavors/301997015/os-extra_specs/hw:cpu_policy => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:53:45.343394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f889ecd7-8c9a-43d0-8f6d-3b7a8b9a71f5 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.361500 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f889ecd7-8c9a-43d0-8f6d-3b7a8b9a71f5 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/301997015/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018599 Aug 06 20:53:45.361500 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 11/31] 10.222.0.33 () {58 vars in 1200 bytes} [Sat Aug 6 20:53:45 2022] GET /compute/v2.1/flavors/301997015/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:45.372429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a7163e87-86f4-4d0a-ac82-c3e325e4c654 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.399839 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a7163e87-86f4-4d0a-ac82-c3e325e4c654 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/301997015" status: 202 len: 0 microversion: 2.1 time: 0.030977 Aug 06 20:53:45.403656 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 12/32] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:53:45 2022] DELETE /compute/v2.1/flavors/301997015 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:53:45.411019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e285cc24-e1e2-41b1-9509-e95b86b3b7d6 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:45.436151 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e285cc24-e1e2-41b1-9509-e95b86b3b7d6 tempest-FlavorsExtraSpecsTestJSON-524933287 tempest-FlavorsExtraSpecsTestJSON-524933287-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031050 Aug 06 20:53:45.436742 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 13/33] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:53:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:45.515487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1293879166", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "availability_zone": "tempest-test_az-1131970404"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:45.546566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:45.547093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:45.547530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:45.548838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:45.549454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:45.549879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:46.706179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:53:47.018229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:53:47.018683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:53:47.019356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:53:47.019909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:53:47.020492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:53:47.039353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:47.039999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:47.040587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:47.041535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:47.042137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:47.042909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:47.079633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Getting quotas for project e95c49afa6f7467fb74adef67a9b4910. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:53:47.086185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Getting quotas for user 07d2a43d97f242e5a725eb5e12ba1cc2 and project e95c49afa6f7467fb74adef67a9b4910. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:53:47.106914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:53:47.111396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:53:47.196256 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fcef31c9-f4e2-41e4-92a9-2310a17764a8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.878158 Aug 06 20:53:47.197245 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 21/34] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:53:47.211085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6f48170-fadf-458e-9103-fb75a16eed2a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:47.214223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d6f48170-fadf-458e-9103-fb75a16eed2a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:47.757758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1184381333", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:47.893957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:53:48.133791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:53:48.134290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:53:48.134817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:53:48.135241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:53:48.135770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:53:48.149197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:48.150847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:48.151396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:48.152403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:48.152972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:48.153553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:48.173553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Getting quotas for project 3f0afc603122424da744092d8ac29cee. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:53:48.179428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Getting quotas for user f5f7743570b2465ea4d4397840485758 and project 3f0afc603122424da744092d8ac29cee. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:53:48.194232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:53:48.196767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:53:48.258095 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9d3421c2-a084-4a3b-aa37-5606bd358769 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978510 Aug 06 20:53:48.259427 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 22/35] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:53:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:53:48.273182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-605d08f1-60db-434a-a714-c5ad2f151503 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:48.273813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-605d08f1-60db-434a-a714-c5ad2f151503 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:48.369535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-605d08f1-60db-434a-a714-c5ad2f151503 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:48.384686 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-605d08f1-60db-434a-a714-c5ad2f151503 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1220 microversion: 2.1 time: 0.116820 Aug 06 20:53:48.385910 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 23/36] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:48 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:48.539785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d6f48170-fadf-458e-9103-fb75a16eed2a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:48.562262 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d6f48170-fadf-458e-9103-fb75a16eed2a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1243 microversion: 2.1 time: 1.356944 Aug 06 20:53:48.563045 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 14/37] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:47 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1243 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:49.409280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b26ddc8-c281-4151-9fb7-c37f9aea8619 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:49.410163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5b26ddc8-c281-4151-9fb7-c37f9aea8619 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:49.479479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5b26ddc8-c281-4151-9fb7-c37f9aea8619 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:49.496695 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b26ddc8-c281-4151-9fb7-c37f9aea8619 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1220 microversion: 2.1 time: 0.092849 Aug 06 20:53:49.497963 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 24/38] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:49 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:49.588185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:49.588937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:49.597221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:49.598020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:49.598471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:49.599421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:49.600034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:49.600825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:49.773664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:49.787307 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-953a42d6-85f8-442f-a5ca-35928262901c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1235 microversion: 2.1 time: 0.206403 Aug 06 20:53:49.788590 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 15/39] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:49 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1235 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:50.520283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:50.520905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:50.530500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:50.531066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:50.531515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:50.533284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:50.550378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:50.551537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:50.783033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:50.799794 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ceb792d8-3728-4815-be83-b71bc01d43a8 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1278 microversion: 2.1 time: 0.284976 Aug 06 20:53:50.800848 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 25/40] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:50 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:50.814521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:50.816527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:50.831263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:50.833118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:50.833776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:50.835427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:50.836773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:50.837812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:51.082884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:51.094235 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4163538f-52e8-461e-9c2b-f8cbd534882c tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1297 microversion: 2.1 time: 0.287796 Aug 06 20:53:51.097134 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 16/41] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:50 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1297 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:51.835938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:51.836648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:51.866697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:51.870692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:51.873509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:51.878758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:51.879558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:51.880862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:52.020483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42601622-7065-4721-814c-e2804950a636 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1380437516", "id": 666682239, "os-flavor-access:is_public": "False"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:52.023527 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:52.023527 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:53:52.046923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:52.061428 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c3c2f192-efcc-484f-9cb0-ef285afa4b15 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1278 microversion: 2.1 time: 0.241256 Aug 06 20:53:52.078573 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 17/42] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:51 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:52.092707 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-42601622-7065-4721-814c-e2804950a636 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.894373 Aug 06 20:53:52.106326 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 26/43] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:53:51 2022] POST /compute/v2.1/flavors => generated 428 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:52.109973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5677bd8b-0601-4759-b696-e89665315288 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "473c326e84db4af9bd35a553fe9a2204"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:52.117418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:52.121838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:52.130284 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:52.130284 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:52.138374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:52.142676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:52.144119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:52.146941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:52.148277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:52.150703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:52.727982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:52.753016 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2384e6cc-0be0-446f-b04a-56098539d319 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.639288 Aug 06 20:53:52.756254 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 27/44] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:52 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:53:53.310245 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5677bd8b-0601-4759-b696-e89665315288 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/666682239/action" status: 200 len: 96 microversion: 2.1 time: 1.206867 Aug 06 20:53:53.315995 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 18/45] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Aug 6 20:53:52 2022] POST /compute/v2.1/flavors/666682239/action => generated 96 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 20:53:53.323905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5677bd8b-0601-4759-b696-e89665315288 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:53.328254 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5677bd8b-0601-4759-b696-e89665315288 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004651 Aug 06 20:53:53.333246 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 19/46] 10.222.0.33 () {56 vars in 886 bytes} [Sat Aug 6 20:53:53 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 06 20:53:53.338833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:53.348049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:53.358653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:53.360514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:53.362624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:53.363781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:53.365074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:53.365841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:53.488532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-155455147", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:53.759048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:53.773214 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-533128c6-e4ad-4a69-984e-1d5e68f4b0a6 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.438069 Aug 06 20:53:53.776638 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 20/47] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:53 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:53.881443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Calling method '.version_select at 0x7f729ea5c9d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:53.882489 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:53.882489 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:53.899894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) {{(pid=142461) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 06 20:53:53.902410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:53.904302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:53.904752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:53.964032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:53.964762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:53.968308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:53.990017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:53.993541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:53.994206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:54.010039 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-287d51d0-a321-4c11-b906-29bfe52b46f7 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.232243 Aug 06 20:53:54.019639 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 21/48] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:53:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:54.514456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8aa4d692-270b-4125-8b2d-b77912312bd4 tempest-FlavorsAccessTestJSON-513123709 tempest-FlavorsAccessTestJSON-513123709-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:54.615547 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8aa4d692-270b-4125-8b2d-b77912312bd4 tempest-FlavorsAccessTestJSON-513123709 tempest-FlavorsAccessTestJSON-513123709-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.594619 Aug 06 20:53:54.616166 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 22/49] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:53:54 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:54.635034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:54.636139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:54.654198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:54.656160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:54.657343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:54.660979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:54.661460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:54.662136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:55.135884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:55.144484 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-245bcf58-8dbc-4b0f-9749-d9353664e263 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.520431 Aug 06 20:53:55.159215 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 23/50] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:54 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:55.166256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Calling method '.version_select at 0x7f729ea8c550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:55.168074 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:55.168074 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:55.184441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:55.185677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:55.186298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:55.212263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:55.212994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:55.213624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:55.264004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:55.265573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:55.266835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:55.276462 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e0d867b7-c4d9-4a94-b884-42e928af5914 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.115458 Aug 06 20:53:55.279797 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 24/51] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Aug 6 20:53:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:55.289479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-205067be-153a-4945-ab47-5b0a6ff983ce tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "473c326e84db4af9bd35a553fe9a2204"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:55.294648 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:55.294648 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:55.656875 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-205067be-153a-4945-ab47-5b0a6ff983ce tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/666682239/action" status: 200 len: 21 microversion: 2.1 time: 0.373567 Aug 06 20:53:55.658900 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 25/52] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Aug 6 20:53:55 2022] POST /compute/v2.1/flavors/666682239/action => generated 21 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:55.666388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:55.667361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:55.680959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:55.681747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:55.683893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:55.685327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:55.686061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:55.686873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:56.207781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:56.218493 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d8956c32-bcb9-4113-a261-68b47ffdb36d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.558260 Aug 06 20:53:56.220148 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 26/53] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:55 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:56.225842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Calling method '.version_select at 0x7f729ea5c430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:56.226714 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:56.226714 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:56.227943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:56.228452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:56.228876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:56.284649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:56.285804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:56.286457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:56.321828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:56.323122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:56.324052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:56.333198 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8c06a14e-8925-4b79-93cd-aaf0bba796b6 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.111757 Aug 06 20:53:56.335466 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 27/54] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:53:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:56.774473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-50b65cc2-587b-4838-82cc-899f7176a56d req-5f98fa3f-7e23-43ae-beb9-b8d616ed469e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "342b8e9c-dd9d-4311-a62e-1eae78811008", "tag": "a39262f5-8248-4478-8584-16ce1baa4f14"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:56.798567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-50b65cc2-587b-4838-82cc-899f7176a56d req-5f98fa3f-7e23-43ae-beb9-b8d616ed469e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:56.799121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-50b65cc2-587b-4838-82cc-899f7176a56d req-5f98fa3f-7e23-43ae-beb9-b8d616ed469e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:56.806127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-50b65cc2-587b-4838-82cc-899f7176a56d req-5f98fa3f-7e23-43ae-beb9-b8d616ed469e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:56.857001 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-50b65cc2-587b-4838-82cc-899f7176a56d req-5f98fa3f-7e23-43ae-beb9-b8d616ed469e service nova] Creating event network-changed:a39262f5-8248-4478-8584-16ce1baa4f14 for instance 342b8e9c-dd9d-4311-a62e-1eae78811008 on nch1-master-1 Aug 06 20:53:56.858040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-50b65cc2-587b-4838-82cc-899f7176a56d req-5f98fa3f-7e23-43ae-beb9-b8d616ed469e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 20:53:56.858873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-50b65cc2-587b-4838-82cc-899f7176a56d req-5f98fa3f-7e23-43ae-beb9-b8d616ed469e service nova] Acquired lock "compute-rpcapi-router" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 20:53:56.860484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03637329-2339-4407-a3ba-aadfadb404cb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:56.861108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03637329-2339-4407-a3ba-aadfadb404cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:56.861637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03637329-2339-4407-a3ba-aadfadb404cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:56.862670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03637329-2339-4407-a3ba-aadfadb404cb None None] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:56.863253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03637329-2339-4407-a3ba-aadfadb404cb None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:56.863829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03637329-2339-4407-a3ba-aadfadb404cb None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:56.874186 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.compute.rpcapi [None req-03637329-2339-4407-a3ba-aadfadb404cb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 20:53:56.876385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03637329-2339-4407-a3ba-aadfadb404cb None None] Releasing lock "compute-rpcapi-router" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 20:53:56.919315 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-03637329-2339-4407-a3ba-aadfadb404cb None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.581987 Aug 06 20:53:56.921037 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 28/55] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:57.134169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b5581c8b-ca9c-4ccd-b551-d7c5c9c27104 req-ce45f100-2c65-488f-92b3-befc66c772db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b3df46-1527-4dfa-bca8-696627205e57", "tag": "0dc350f2-0e79-4d57-861c-b899ed64f302"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:57.148002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b5581c8b-ca9c-4ccd-b551-d7c5c9c27104 req-ce45f100-2c65-488f-92b3-befc66c772db service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:57.149067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b5581c8b-ca9c-4ccd-b551-d7c5c9c27104 req-ce45f100-2c65-488f-92b3-befc66c772db service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:57.149819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b5581c8b-ca9c-4ccd-b551-d7c5c9c27104 req-ce45f100-2c65-488f-92b3-befc66c772db service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:57.173158 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b5581c8b-ca9c-4ccd-b551-d7c5c9c27104 req-ce45f100-2c65-488f-92b3-befc66c772db service nova] Creating event network-changed:0dc350f2-0e79-4d57-861c-b899ed64f302 for instance 03b3df46-1527-4dfa-bca8-696627205e57 on nch2-master-1 Aug 06 20:53:57.180022 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b5581c8b-ca9c-4ccd-b551-d7c5c9c27104 req-ce45f100-2c65-488f-92b3-befc66c772db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257137 Aug 06 20:53:57.184534 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:57.192226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2a69c5bd-4367-4a84-8e2d-03207d43763a tempest-FlavorsAccessTestJSON-513123709 tempest-FlavorsAccessTestJSON-513123709-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:57.237356 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2a69c5bd-4367-4a84-8e2d-03207d43763a tempest-FlavorsAccessTestJSON-513123709 tempest-FlavorsAccessTestJSON-513123709-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041179 Aug 06 20:53:57.240212 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 30/57] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:53:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:57.264250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:57.267372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:57.277183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:57.279347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:57.283790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:57.285985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:57.287104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:57.288229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:57.587427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:57.597246 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-96cc50a3-c3b3-4d35-89c0-d21ab6e48b20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.341036 Aug 06 20:53:57.613025 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 31/58] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:57 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:57.618039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f4f4d397-7e73-41b6-8911-1e3c56c2d3bb tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Calling method '.version_select at 0x7f729ea12af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:57.619926 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:57.619926 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:57.621403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4f4d397-7e73-41b6-8911-1e3c56c2d3bb tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:57.622196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4f4d397-7e73-41b6-8911-1e3c56c2d3bb tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:57.623178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4f4d397-7e73-41b6-8911-1e3c56c2d3bb tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:57.823013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4f4d397-7e73-41b6-8911-1e3c56c2d3bb tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:57.823772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4f4d397-7e73-41b6-8911-1e3c56c2d3bb tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:57.824011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4f4d397-7e73-41b6-8911-1e3c56c2d3bb tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:57.831497 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f4f4d397-7e73-41b6-8911-1e3c56c2d3bb tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.217158 Aug 06 20:53:57.842045 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 32/59] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:53:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:57.842045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:57.842045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:57.850305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:57.850810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:57.851661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:57.852413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:57.852838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:57.853293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:58.171822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=12 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:58.237300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:58.247498 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4ceab8f7-6ae2-4abd-a03b-6fca84f6b992 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.413998 Aug 06 20:53:58.265106 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 33/60] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:57 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:58.270786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40e297c4-6b5f-4858-bed7-c9853316f7d7 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:58.274417 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:58.274417 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:58.318228 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40e297c4-6b5f-4858-bed7-c9853316f7d7 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/666682239" status: 202 len: 0 microversion: 2.1 time: 0.051651 Aug 06 20:53:58.321906 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 34/61] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:53:58 2022] DELETE /compute/v2.1/flavors/666682239 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:53:58.327627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78fec83a-4adf-4257-a5b8-02cd86f0f95e tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Calling method '.version_select at 0x7f72a0d24700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:58.329242 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:58.329242 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:58.330513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78fec83a-4adf-4257-a5b8-02cd86f0f95e tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:58.331020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78fec83a-4adf-4257-a5b8-02cd86f0f95e tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:58.331520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78fec83a-4adf-4257-a5b8-02cd86f0f95e tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:58.353108 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78fec83a-4adf-4257-a5b8-02cd86f0f95e tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.032585 Aug 06 20:53:58.361422 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 35/62] 10.222.0.33 () {58 vars in 1179 bytes} [Sat Aug 6 20:53:58 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:58.370258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e58b9362-9ad5-4829-a15f-aef5764ef0d9 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:58.393060 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e58b9362-9ad5-4829-a15f-aef5764ef0d9 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038035 Aug 06 20:53:58.406573 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 36/63] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:53:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:58.414231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Calling method '.version_select at 0x7f729eaf4dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:58.415405 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:58.415405 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:58.416846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:58.417563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:58.418467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:58.467101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:58.467744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:58.468194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:58.484105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:58.485286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:58.485812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:58.495277 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-886b5551-6697-408c-95ed-68ed4c98c7fa tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.100039 Aug 06 20:53:58.496838 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 37/64] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:53:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:58.504041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd1b38f2-2eb5-4f01-8519-9fc468ec34fd tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-666831483", "id": 1007512303, "os-flavor-access:is_public": "False"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:58.507527 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:58.507527 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:58.539937 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd1b38f2-2eb5-4f01-8519-9fc468ec34fd tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.041478 Aug 06 20:53:58.543826 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 38/65] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:53:58 2022] POST /compute/v2.1/flavors => generated 430 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:58.555092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-51b64f66-97c7-4dc9-b6e1-fc995158c687 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Calling method '.version_select at 0x7f729ea8ce50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:58.559760 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:58.559760 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:58.560698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51b64f66-97c7-4dc9-b6e1-fc995158c687 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:58.561201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51b64f66-97c7-4dc9-b6e1-fc995158c687 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:58.565642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51b64f66-97c7-4dc9-b6e1-fc995158c687 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:58.572113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=42,nova_cell0:UPDATE=12 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:58.605223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51b64f66-97c7-4dc9-b6e1-fc995158c687 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:58.610203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51b64f66-97c7-4dc9-b6e1-fc995158c687 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:58.610629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51b64f66-97c7-4dc9-b6e1-fc995158c687 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:58.627254 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-51b64f66-97c7-4dc9-b6e1-fc995158c687 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.078969 Aug 06 20:53:58.628004 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 39/66] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:53:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:58.641992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dafeb0af-3e2e-4527-b6a5-7f466f68fff5 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:58.642871 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:58.642871 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:58.686155 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dafeb0af-3e2e-4527-b6a5-7f466f68fff5 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1007512303/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.057048 Aug 06 20:53:58.691056 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 40/67] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Aug 6 20:53:58 2022] GET /compute/v2.1/flavors/1007512303/os-flavor-access => generated 21 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:53:58.697681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:58.698304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:58.714675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=8,nova_api:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:58.727723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:58.728193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:58.728620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:58.729351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:58.729777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:58.730310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:59.092748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:59.105818 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b2ec1725-dd64-4dde-a846-f495aed774b0 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.413586 Aug 06 20:53:59.108601 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 41/68] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:58 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:59.120817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-29ab9089-d030-4be4-8440-83af73744674 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Calling method '.version_select at 0x7f729ea8c550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:59.121829 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:59.121829 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:59.122951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ab9089-d030-4be4-8440-83af73744674 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:59.123469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ab9089-d030-4be4-8440-83af73744674 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:59.123905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ab9089-d030-4be4-8440-83af73744674 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:59.129574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:59.161038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ab9089-d030-4be4-8440-83af73744674 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:59.171141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ab9089-d030-4be4-8440-83af73744674 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:59.171702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ab9089-d030-4be4-8440-83af73744674 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:59.181351 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-29ab9089-d030-4be4-8440-83af73744674 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.071500 Aug 06 20:53:59.182570 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 42/69] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:53:59 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:59.192661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ebd7217d-f63f-4d6f-8e54-538d276ec1c5 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:59.193713 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:59.193713 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:59.213509 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ebd7217d-f63f-4d6f-8e54-538d276ec1c5 tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1007512303" status: 202 len: 0 microversion: 2.1 time: 0.029516 Aug 06 20:53:59.214413 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 43/70] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:53:59 2022] DELETE /compute/v2.1/flavors/1007512303 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:53:59.219762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Calling method '.version_select at 0x7f729ea12c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:59.221007 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:53:59.221007 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:53:59.222650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:59.223279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:59.223871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:59.240453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:59.241443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:59.242013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:59.256064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:59.256789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:59.257837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:59.303823 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1c62c0fa-00a8-4c29-8013-b90efe75b1f8 tempest-HypervisorAdminTestJSON-321736394 tempest-HypervisorAdminTestJSON-321736394-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.087817 Aug 06 20:53:59.305064 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 44/71] 10.222.0.33 () {58 vars in 1173 bytes} [Sat Aug 6 20:53:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:59.312180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc029ed7-215d-4b04-b225-7926bc3542ae tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:59.346350 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc029ed7-215d-4b04-b225-7926bc3542ae tempest-FlavorsAccessTestJSON-1193632277 tempest-FlavorsAccessTestJSON-1193632277-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039648 Aug 06 20:53:59.347328 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 45/72] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:53:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:59.354255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:59.355910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:59.374333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:59.375801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:59.377039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:59.380923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:59.381553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:59.381987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:59.495553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=20 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:59.739381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:59.744797 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0760791f-a500-4178-a395-ef44bf79f939 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.396384 Aug 06 20:53:59.759538 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 46/73] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:59 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:00.367236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bc93eb1-28d4-4ce8-ac72-570a63f99586 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Calling method '.version_select at 0x7f729e996790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:00.370535 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:00.370535 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:00.371991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bc93eb1-28d4-4ce8-ac72-570a63f99586 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:00.374140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bc93eb1-28d4-4ce8-ac72-570a63f99586 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:00.374829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bc93eb1-28d4-4ce8-ac72-570a63f99586 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:00.379411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bc93eb1-28d4-4ce8-ac72-570a63f99586 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:00.381215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bc93eb1-28d4-4ce8-ac72-570a63f99586 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:00.382760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bc93eb1-28d4-4ce8-ac72-570a63f99586 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:00.435103 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8bc93eb1-28d4-4ce8-ac72-570a63f99586 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.674283 Aug 06 20:54:00.436209 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 47/74] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 20:53:59 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:00.442892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:00.442892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:00.450471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:00.451029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:00.451491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:00.452806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:00.452915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:00.464497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:00.878881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:00.888493 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a70ae81f-db39-4aac-875f-67ec00fabaaa tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.451215 Aug 06 20:54:00.893897 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 48/75] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:00 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:00.910736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-00d2f327-8cca-489f-ae18-72a439bdad6f tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Calling method '.version_select at 0x7f729ea12c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:00.913290 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:00.913290 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:00.914386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00d2f327-8cca-489f-ae18-72a439bdad6f tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:00.920062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00d2f327-8cca-489f-ae18-72a439bdad6f tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:00.920543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00d2f327-8cca-489f-ae18-72a439bdad6f tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:00.921354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00d2f327-8cca-489f-ae18-72a439bdad6f tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:00.923735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00d2f327-8cca-489f-ae18-72a439bdad6f tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:00.924206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00d2f327-8cca-489f-ae18-72a439bdad6f tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:00.958947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-00d2f327-8cca-489f-ae18-72a439bdad6f tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.062991 Aug 06 20:54:00.960243 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 49/76] 10.222.0.33 () {58 vars in 1139 bytes} [Sat Aug 6 20:54:00 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:00.972021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:00.973081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:00.982038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:00.982971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:00.983622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:00.985249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:00.986098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:00.986763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:01.232396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:01.246380 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4b9cce4a-9a36-4459-94c0-448bb6447846 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.284836 Aug 06 20:54:01.252406 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 50/77] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:00 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:01.270324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3f93ab1d-278e-4f1c-aae4-8d2dbdc23169 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Calling method '.version_select at 0x7f729e9e8af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:01.277588 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:01.277588 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:01.279683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1d-278e-4f1c-aae4-8d2dbdc23169 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:01.283322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1d-278e-4f1c-aae4-8d2dbdc23169 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:01.284768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1d-278e-4f1c-aae4-8d2dbdc23169 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:01.287394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1d-278e-4f1c-aae4-8d2dbdc23169 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:01.288727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1d-278e-4f1c-aae4-8d2dbdc23169 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:01.290815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1d-278e-4f1c-aae4-8d2dbdc23169 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:01.355899 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3f93ab1d-278e-4f1c-aae4-8d2dbdc23169 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.100437 Aug 06 20:54:01.364447 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 51/78] 10.222.0.33 () {58 vars in 1145 bytes} [Sat Aug 6 20:54:01 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:54:01.917482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:01.918309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:01.937019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:01.937667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:01.939678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:01.940576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:01.941445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:01.942992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:02.349925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:02.358270 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a5da1e6-e7ec-4815-a488-fb08b6a54ef7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.446366 Aug 06 20:54:02.371257 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 52/79] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:01 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:02.386874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:02.388138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:02.402381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:02.404296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:02.404762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:02.406813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:02.407356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:02.409013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:02.707038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:02.718058 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-88347224-abe3-4461-8c95-80c22800ac82 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.345533 Aug 06 20:54:02.733479 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 53/80] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:02 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:02.735557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=36 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:02.947833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:54:03.304487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:54:03.304995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:54:03.305588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:54:03.306096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:54:03.306653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:54:03.319540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:03.320736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:03.321461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:03.322885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:03.323949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:03.325065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:03.351150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Getting quotas for project 35ffa77d7887486dbb30387455757c32. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:54:03.358513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Getting quotas for user 012f20ffe53640a3be67f9d3cff4e28a and project 35ffa77d7887486dbb30387455757c32. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:54:03.378017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:54:03.381664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:54:03.400267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:03.401823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:03.432844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:03.434096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:03.435311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:03.438772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:03.441009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:03.442098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:03.455752 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b4d5271c-9316-406f-b32c-1c2b3c4643de tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.694796 Aug 06 20:54:03.465062 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 28/81] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:53:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 10707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:54:03.471873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ad796620-8580-4271-9368-9980ed5beb0c tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:03.472533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ad796620-8580-4271-9368-9980ed5beb0c tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:03.571689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ad796620-8580-4271-9368-9980ed5beb0c tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:03.579957 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ad796620-8580-4271-9368-9980ed5beb0c tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1222 microversion: 2.1 time: 0.113746 Aug 06 20:54:03.594968 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 29/82] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:03 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:03.697204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:03.706373 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c196a3e7-cef4-4a17-816d-fb7f4b5a254a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.326141 Aug 06 20:54:03.721122 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 54/83] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:03 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:03.744807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:03.746539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:03.757540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:03.758454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:03.759518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:03.760848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:03.761913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:03.762495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:03.935408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:03.944443 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a5be319-ae18-4d8c-be2e-a6b1dd13ba65 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.207431 Aug 06 20:54:03.950597 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 30/84] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:03 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:04.389805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b4b30c1-4391-4b71-a420-d8cb403cc79c tempest-InstanceUsageAuditLogTestJSON-1030852167 tempest-InstanceUsageAuditLogTestJSON-1030852167-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:04.391171 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:04.391171 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:04.410776 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b4b30c1-4391-4b71-a420-d8cb403cc79c tempest-InstanceUsageAuditLogTestJSON-1030852167 tempest-InstanceUsageAuditLogTestJSON-1030852167-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-06 20:54:04" status: 200 len: 318 microversion: 2.1 time: 0.145605 Aug 06 20:54:04.411448 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 55/85] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 20:54:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-06%2020%3A54%3A04 => generated 318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:04.424502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f7c2ded-3df9-431b-ad6e-70682b334082 tempest-InstanceUsageAuditLogTestJSON-1030852167 tempest-InstanceUsageAuditLogTestJSON-1030852167-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:04.425850 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:04.425850 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:04.448497 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f7c2ded-3df9-431b-ad6e-70682b334082 tempest-InstanceUsageAuditLogTestJSON-1030852167 tempest-InstanceUsageAuditLogTestJSON-1030852167-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.028053 Aug 06 20:54:04.448923 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 31/86] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Aug 6 20:54:04 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:04.600646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:04.601319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:04.607649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:04.608139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:04.608581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:04.609952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:04.610435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:04.611055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:04.677858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:04.685421 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-82e25c58-ccbf-4106-8cdb-12b00f9c3b0f tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1274 microversion: 2.1 time: 0.088624 Aug 06 20:54:04.686045 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 56/87] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:04 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:04.727787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:04.728408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:04.731416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=82,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=10 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:04.735537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:04.736013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:04.736545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:04.737414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:04.737876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:04.738344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:04.967960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:04.969137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:04.975597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:04.976536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:04.977195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:04.978333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:04.979036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:04.979769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:05.029640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:05.035716 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-311280d9-e738-4658-bed3-960c77acbd4a tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.311918 Aug 06 20:54:05.036548 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 32/88] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:04 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:05.135623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:05.144014 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32f4d847-ddf6-475e-aed4-6b5b2e2c6c26 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.180201 Aug 06 20:54:05.144789 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 57/89] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:04 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:05.353740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-168d92de-b0a9-4472-a2a2-19b412f2817b tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1353693696", "id": 215071858, "os-flavor-access:is_public": "False"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:05.357169 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:05.357169 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:05.375724 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-168d92de-b0a9-4472-a2a2-19b412f2817b tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.218702 Aug 06 20:54:05.376331 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 33/90] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:05 2022] POST /compute/v2.1/flavors => generated 436 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:05.388281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4bbf49b2-1906-4fa4-bdc2-2359807bf024 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:05.390969 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:05.390969 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:05.532061 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4bbf49b2-1906-4fa4-bdc2-2359807bf024 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/215071858/action" status: 200 len: 96 microversion: 2.1 time: 0.146512 Aug 06 20:54:05.532860 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 58/91] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Aug 6 20:54:05 2022] POST /compute/v2.1/flavors/215071858/action => generated 96 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:54:05.542475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db08bfa4-4e79-42a4-94cf-a3b3fa9b9c29 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:05.544948 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:05.544948 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:05.709647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:05.710866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:05.718996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:05.720595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:05.734388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:05.735913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:05.737344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:05.738948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:05.773287 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-db08bfa4-4e79-42a4-94cf-a3b3fa9b9c29 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] HTTP exception thrown: Flavor access already exists for flavor 19 and project a9a98197762f43ebb2d16b69afd05a23 combination. Aug 06 20:54:05.842660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:05.851840 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8a0f0b48-c4c5-4eac-b650-0a3d5d550c54 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1282 microversion: 2.1 time: 0.146101 Aug 06 20:54:05.852937 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 59/92] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:05 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db08bfa4-4e79-42a4-94cf-a3b3fa9b9c29 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Request method failure captured: Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/flavors/215071858/action HTTP/1.1 Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 67 Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTsU_nwf124K8XOoisAfBTLKU_3ggq9lQaAHQRzqsPYF_SLQOhAAtyrJdNlelxm7DcFspjFEbtEzKW1QZJZbR0aTXfdhGuIvq-rNxwIbTlVvgo0kJQcvIAUzL7hhFpUZ8IQuqKlMqkmiIb3YIe8usoOErRrN8et6nvim_UXhTAd8nA Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 2edd3df091ee4fd391c170332ab3ade4 Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-92023163 Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:54:05.862474 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2edd3df091ee4fd391c170332ab3ade4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2edd3df091ee4fd391c170332ab3ade4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2edd3df091ee4fd391c170332ab3ade4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2edd3df091ee4fd391c170332ab3ade4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-92023163 Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 2edd3df091ee4fd391c170332ab3ade4 Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-92023163 Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3d0382d1018f4878b5f64679164b3350 Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: {"addTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} Aug 06 20:54:05.863922 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: exception: Flavor access already exists for flavor 19 and project a9a98197762f43ebb2d16b69afd05a23 combination. Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '215071858', 'body': {'addTenantAccess': {'tenant': 'a9a98197762f43ebb2d16b69afd05a23'}}} Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result.read() Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:54:05.864590 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '19-a9a98197762f43ebb2d16b69afd05a23' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi session.flush() Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:54:05.865493 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:54:05.866643 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:54:05.867627 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result.read() Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '19-a9a98197762f43ebb2d16b69afd05a23' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 6, 20, 54, 5, 766222), 'updated_at': None, 'flavor_id': 19, 'project_id': 'a9a98197762f43ebb2d16b69afd05a23'}] Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:05.868741 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 19 and project a9a98197762f43ebb2d16b69afd05a23 combination. Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:05.869817 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 19 and project a9a98197762f43ebb2d16b69afd05a23 combination. Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:05.871005 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:05.872236 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 19 and project a9a98197762f43ebb2d16b69afd05a23 combination. Aug 06 20:54:05.872236 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:05.873613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db08bfa4-4e79-42a4-94cf-a3b3fa9b9c29 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Returning 409 to user: Flavor access already exists for flavor 19 and project a9a98197762f43ebb2d16b69afd05a23 combination. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:05.874484 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-db08bfa4-4e79-42a4-94cf-a3b3fa9b9c29 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/215071858/action" status: 409 len: 152 microversion: 2.1 time: 0.335715 Aug 06 20:54:05.875841 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 34/93] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Aug 6 20:54:05 2022] POST /compute/v2.1/flavors/215071858/action => generated 152 bytes in 338 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:54:05.884745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0483f9c2-4e3e-4b53-8ab5-2b2c7b1f64b4 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:05.887290 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:05.887290 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:06.046990 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0483f9c2-4e3e-4b53-8ab5-2b2c7b1f64b4 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/215071858/action" status: 200 len: 21 microversion: 2.1 time: 0.165836 Aug 06 20:54:06.047734 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 60/94] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Aug 6 20:54:05 2022] POST /compute/v2.1/flavors/215071858/action => generated 21 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:54:06.058052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-96e27533-c7e8-474a-9af1-9d4e2636b543 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.058897 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:06.058897 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:06.060224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.060851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:06.068168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:06.068670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:06.069279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:06.070283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:06.070952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:06.071561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:06.096574 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-96e27533-c7e8-474a-9af1-9d4e2636b543 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/215071858" status: 202 len: 0 microversion: 2.1 time: 0.039209 Aug 06 20:54:06.097595 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 35/95] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:54:06 2022] DELETE /compute/v2.1/flavors/215071858 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:06.107435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7f8c5d5-5c7b-47aa-821b-080b85e5fa1c tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.144945 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7f8c5d5-5c7b-47aa-821b-080b85e5fa1c tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042950 Aug 06 20:54:06.145829 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 36/96] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:06.167034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.167832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:06.175024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:06.175505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:06.175949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:06.176663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:06.177128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:06.177602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:06.279950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:06.290106 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78ba9ff0-c3c7-4dc3-a754-b9285d870faf tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.235554 Aug 06 20:54:06.307635 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 61/97] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:06 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:06.313891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-505efe74-d2c9-42ec-bdfd-bed9fd62c8d6 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-634418269", "id": 1351572201, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:06.319172 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:06.319172 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:06.333021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:06.341369 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-505efe74-d2c9-42ec-bdfd-bed9fd62c8d6 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.033191 Aug 06 20:54:06.342043 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 62/98] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:06 2022] POST /compute/v2.1/flavors => generated 437 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:06.342117 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e22faa3b-4534-4b72-8e67-82ee769b90c4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.178922 Aug 06 20:54:06.356043 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 37/99] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:06 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:06.361666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd3367ad-6e1b-4aee-abb6-dc672c242710 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.362460 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:06.362460 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:06.369241 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-cd3367ad-6e1b-4aee-abb6-dc672c242710 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd3367ad-6e1b-4aee-abb6-dc672c242710 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Request method failure captured: Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/flavors/1351572201/os-flavor-access HTTP/1.1 Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTsU_nwf124K8XOoisAfBTLKU_3ggq9lQaAHQRzqsPYF_SLQOhAAtyrJdNlelxm7DcFspjFEbtEzKW1QZJZbR0aTXfdhGuIvq-rNxwIbTlVvgo0kJQcvIAUzL7hhFpUZ8IQuqKlMqkmiIb3YIe8usoOErRrN8et6nvim_UXhTAd8nA Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 2edd3df091ee4fd391c170332ab3ade4 Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-92023163 Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:06.371526 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2edd3df091ee4fd391c170332ab3ade4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2edd3df091ee4fd391c170332ab3ade4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2edd3df091ee4fd391c170332ab3ade4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2edd3df091ee4fd391c170332ab3ade4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-92023163 Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 2edd3df091ee4fd391c170332ab3ade4 Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-92023163 Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3d0382d1018f4878b5f64679164b3350 Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: exception: Access list not available for public flavors. Aug 06 20:54:06.372831 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'flavor_id': '1351572201'} Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 06 20:54:06.373529 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:06.374911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd3367ad-6e1b-4aee-abb6-dc672c242710 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:06.374911 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd3367ad-6e1b-4aee-abb6-dc672c242710 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1351572201/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.016347 Aug 06 20:54:06.377103 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 63/100] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Aug 6 20:54:06 2022] GET /compute/v2.1/flavors/1351572201/os-flavor-access => generated 91 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 06 20:54:06.382689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b487fe69-55ff-478d-8c85-1c47560ce898 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.383478 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:06.383478 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:06.400892 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b487fe69-55ff-478d-8c85-1c47560ce898 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1351572201" status: 202 len: 0 microversion: 2.1 time: 0.021880 Aug 06 20:54:06.402242 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 38/101] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:54:06 2022] DELETE /compute/v2.1/flavors/1351572201 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:06.413407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4bb4c7ea-8e2d-4de2-9672-277bbfe31bdb tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.437021 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4bb4c7ea-8e2d-4de2-9672-277bbfe31bdb tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028765 Aug 06 20:54:06.438405 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 64/102] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:06.464688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f2b4491-a086-4fcd-b1ec-13962c27223a tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-367556376", "id": 2073830068, "os-flavor-access:is_public": "False"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:06.467575 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:06.467575 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:06.486648 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f2b4491-a086-4fcd-b1ec-13962c27223a tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.025533 Aug 06 20:54:06.487473 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 39/103] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:06 2022] POST /compute/v2.1/flavors => generated 438 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:06.784982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80b398cf-32a5-458f-9205-1c41b8d7965a tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:06.787788 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:06.787788 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:06.788664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-80b398cf-32a5-458f-9205-1c41b8d7965a tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '59c31f71a22b43b5ba8c98b831147fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a98197762f43ebb2d16b69afd05a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80b398cf-32a5-458f-9205-1c41b8d7965a tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] Request method failure captured: Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/flavors/2073830068/action HTTP/1.1 Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 67 Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTsmdYjH05k5UYjAROJfdSuszUxkr5mgZriItB-5oWEpNG-oSkpqBwMX-wkKaK9ezhM2hImhLC1Yw65XRDPHE0RpqHVjVL_v0IrIjCJoPpVRYGogjcX1_nu45p9VI8qYBMKmqzkE0EpeOAW2FPb-y0b8iZ3Gr8OkGidVBYOuvBf4Kk Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: a9a98197762f43ebb2d16b69afd05a23 Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-93107051 Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:06.803912 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a9a98197762f43ebb2d16b69afd05a23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a9a98197762f43ebb2d16b69afd05a23", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9a98197762f43ebb2d16b69afd05a23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9a98197762f43ebb2d16b69afd05a23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-93107051 Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: a9a98197762f43ebb2d16b69afd05a23 Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-93107051 Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FlavorsAccessNegativeTestJSON-93107051-project Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 59c31f71a22b43b5ba8c98b831147fbd Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-93107051-project Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: {"addTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} Aug 06 20:54:06.805053 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '2073830068', 'body': {'addTenantAccess': {'tenant': 'a9a98197762f43ebb2d16b69afd05a23'}}} Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:06.805762 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 06 20:54:06.807377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:06.808838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80b398cf-32a5-458f-9205-1c41b8d7965a tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:06.808838 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80b398cf-32a5-458f-9205-1c41b8d7965a tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] 10.222.0.33 "POST /compute/v2.1/flavors/2073830068/action" status: 403 len: 130 microversion: 2.1 time: 0.309523 Aug 06 20:54:06.809778 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 65/104] 10.222.0.33 () {60 vars in 1200 bytes} [Sat Aug 6 20:54:06 2022] POST /compute/v2.1/flavors/2073830068/action => generated 130 bytes in 315 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:54:06.815280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f8de0ee-cb49-4212-8291-08584d34de31 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.832557 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f8de0ee-cb49-4212-8291-08584d34de31 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/2073830068" status: 202 len: 0 microversion: 2.1 time: 0.021881 Aug 06 20:54:06.833424 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 40/105] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:54:06 2022] DELETE /compute/v2.1/flavors/2073830068 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:54:06.841475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ab61216-f6c0-49b0-80c9-54422a147d6b tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.862155 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ab61216-f6c0-49b0-80c9-54422a147d6b tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024250 Aug 06 20:54:06.862756 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 66/106] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:06.879980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:06.880827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:06.895424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-420e718c-5e69-4638-88f8-9687ab9c9e90 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2145926738", "id": 1341563138, "os-flavor-access:is_public": "False"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:06.936288 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-420e718c-5e69-4638-88f8-9687ab9c9e90 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.044144 Aug 06 20:54:06.937307 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 67/107] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:06 2022] POST /compute/v2.1/flavors => generated 439 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:06.949131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1e818ec-8413-4b19-8683-62a06632f601 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:07.097527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:07.098819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:07.099454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:07.100346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:07.100959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:07.101689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:07.251926 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1e818ec-8413-4b19-8683-62a06632f601 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1341563138/action" status: 200 len: 97 microversion: 2.1 time: 0.306527 Aug 06 20:54:07.252543 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 68/108] 10.222.0.33 () {60 vars in 1200 bytes} [Sat Aug 6 20:54:06 2022] POST /compute/v2.1/flavors/1341563138/action => generated 97 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 20:54:07.268880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b404b923-502d-4a24-bcb9-5d977131bdf6 tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:07.274001 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:07.274001 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:07.283216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b404b923-502d-4a24-bcb9-5d977131bdf6 tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '59c31f71a22b43b5ba8c98b831147fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a98197762f43ebb2d16b69afd05a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b404b923-502d-4a24-bcb9-5d977131bdf6 tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] Request method failure captured: Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/flavors/1341563138/action HTTP/1.1 Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 70 Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTsmdYjH05k5UYjAROJfdSuszUxkr5mgZriItB-5oWEpNG-oSkpqBwMX-wkKaK9ezhM2hImhLC1Yw65XRDPHE0RpqHVjVL_v0IrIjCJoPpVRYGogjcX1_nu45p9VI8qYBMKmqzkE0EpeOAW2FPb-y0b8iZ3Gr8OkGidVBYOuvBf4Kk Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: a9a98197762f43ebb2d16b69afd05a23 Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-93107051 Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:07.285092 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a9a98197762f43ebb2d16b69afd05a23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a9a98197762f43ebb2d16b69afd05a23", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9a98197762f43ebb2d16b69afd05a23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a9a98197762f43ebb2d16b69afd05a23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-93107051 Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: a9a98197762f43ebb2d16b69afd05a23 Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-93107051 Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FlavorsAccessNegativeTestJSON-93107051-project Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 59c31f71a22b43b5ba8c98b831147fbd Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-93107051-project Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: {"removeTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} Aug 06 20:54:07.286574 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '1341563138', 'body': {'removeTenantAccess': {'tenant': 'a9a98197762f43ebb2d16b69afd05a23'}}} Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can( Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:07.287490 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 06 20:54:07.288884 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:07.290260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b404b923-502d-4a24-bcb9-5d977131bdf6 tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:07.290260 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b404b923-502d-4a24-bcb9-5d977131bdf6 tempest-FlavorsAccessNegativeTestJSON-93107051 tempest-FlavorsAccessNegativeTestJSON-93107051-project] 10.222.0.33 "POST /compute/v2.1/flavors/1341563138/action" status: 403 len: 133 microversion: 2.1 time: 0.027614 Aug 06 20:54:07.290260 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 69/109] 10.222.0.33 () {60 vars in 1200 bytes} [Sat Aug 6 20:54:07 2022] POST /compute/v2.1/flavors/1341563138/action => generated 133 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:07.297833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-99da0dca-7eda-47cc-8b97-98fceb1a82a6 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a9a98197762f43ebb2d16b69afd05a23"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:07.399274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:07.409699 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-245211d8-bc16-4ec7-850a-f87c018a76ba tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1322 microversion: 2.1 time: 0.540364 Aug 06 20:54:07.410690 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 41/110] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:06 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:07.424721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:07.427740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:07.445913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:07.446450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:07.446986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:07.448310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:07.448791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:07.449232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:07.637127 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-99da0dca-7eda-47cc-8b97-98fceb1a82a6 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1341563138/action" status: 200 len: 21 microversion: 2.1 time: 0.345021 Aug 06 20:54:07.643093 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 70/111] 10.222.0.33 () {60 vars in 1200 bytes} [Sat Aug 6 20:54:07 2022] POST /compute/v2.1/flavors/1341563138/action => generated 21 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:54:07.650670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:07.651522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:07.665299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:07.665788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:07.667159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:07.667972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:07.673437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:07.674151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:07.709270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:07.719133 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-85f39f3d-a5e6-4885-8e45-57bc3aefe7e5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.306095 Aug 06 20:54:07.730941 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 42/112] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:07 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:07.737142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-37caf453-2cca-419c-9744-4c72bc43b5e6 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:07.738149 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:07.738149 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:07.761773 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-37caf453-2cca-419c-9744-4c72bc43b5e6 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1341563138" status: 202 len: 0 microversion: 2.1 time: 0.029122 Aug 06 20:54:07.766324 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 43/113] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:54:07 2022] DELETE /compute/v2.1/flavors/1341563138 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:07.773072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c503afa8-7be4-44be-94fd-d69041022048 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:07.801356 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c503afa8-7be4-44be-94fd-d69041022048 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033499 Aug 06 20:54:07.802886 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 44/114] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:07.822140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d75d045b-4448-440c-8495-cfd683c9aa10 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1729795097", "id": 599097909, "os-flavor-access:is_public": "False"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:07.824939 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:07.824939 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:07.842701 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d75d045b-4448-440c-8495-cfd683c9aa10 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.024332 Aug 06 20:54:07.843518 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 45/115] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:07 2022] POST /compute/v2.1/flavors => generated 436 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:07.863606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-782d6df9-065b-4de5-9f92-ac1fc72abb7a tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4d138283e1c34da39c090ddf384697eb"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:07.866267 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:07.866267 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:07.951378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:07.973596 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e710685-5a98-4b37-9fc6-111e58a9ceae tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.329361 Aug 06 20:54:07.990634 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 71/116] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:07 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:08.016537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3e5e663b-286d-48ac-9c83-89860030247c req-8a469f50-b416-4c3d-af92-c7c7bb9afda8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55339407-24b2-4a9c-97db-4ece55de26b2", "tag": "5e176929-6529-4a00-a589-1fd274ae481c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:08.045935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3e5e663b-286d-48ac-9c83-89860030247c req-8a469f50-b416-4c3d-af92-c7c7bb9afda8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:08.049002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3e5e663b-286d-48ac-9c83-89860030247c req-8a469f50-b416-4c3d-af92-c7c7bb9afda8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:08.051131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3e5e663b-286d-48ac-9c83-89860030247c req-8a469f50-b416-4c3d-af92-c7c7bb9afda8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:08.080353 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3e5e663b-286d-48ac-9c83-89860030247c req-8a469f50-b416-4c3d-af92-c7c7bb9afda8 service nova] Creating event network-changed:5e176929-6529-4a00-a589-1fd274ae481c for instance 55339407-24b2-4a9c-97db-4ece55de26b2 on nch2-master-1 Aug 06 20:54:08.088875 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3e5e663b-286d-48ac-9c83-89860030247c req-8a469f50-b416-4c3d-af92-c7c7bb9afda8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082604 Aug 06 20:54:08.089888 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 72/117] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:08.152483 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-782d6df9-065b-4de5-9f92-ac1fc72abb7a tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] HTTP exception thrown: Flavor access not found for 23 / 4d138283e1c34da39c090ddf384697eb combination. Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-782d6df9-065b-4de5-9f92-ac1fc72abb7a tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Request method failure captured: Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/flavors/599097909/action HTTP/1.1 Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 70 Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTsU_nwf124K8XOoisAfBTLKU_3ggq9lQaAHQRzqsPYF_SLQOhAAtyrJdNlelxm7DcFspjFEbtEzKW1QZJZbR0aTXfdhGuIvq-rNxwIbTlVvgo0kJQcvIAUzL7hhFpUZ8IQuqKlMqkmiIb3YIe8usoOErRrN8et6nvim_UXhTAd8nA Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 2edd3df091ee4fd391c170332ab3ade4 Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-92023163 Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:54:08.155189 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2edd3df091ee4fd391c170332ab3ade4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2edd3df091ee4fd391c170332ab3ade4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2edd3df091ee4fd391c170332ab3ade4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2edd3df091ee4fd391c170332ab3ade4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-92023163 Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 2edd3df091ee4fd391c170332ab3ade4 Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-92023163 Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3d0382d1018f4878b5f64679164b3350 Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: {"removeTenantAccess": {"tenant": "4d138283e1c34da39c090ddf384697eb"}} Aug 06 20:54:08.156641 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: exception: Flavor access not found for 23 / 4d138283e1c34da39c090ddf384697eb combination. Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '599097909', 'body': {'removeTenantAccess': {'tenant': '4d138283e1c34da39c090ddf384697eb'}}} Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 06 20:54:08.157262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 23 / 4d138283e1c34da39c090ddf384697eb combination. Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 23 / 4d138283e1c34da39c090ddf384697eb combination. Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:08.158190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:08.161138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:08.161138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:08.161138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:08.161138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:08.161138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 23 / 4d138283e1c34da39c090ddf384697eb combination. Aug 06 20:54:08.161138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:08.164517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-782d6df9-065b-4de5-9f92-ac1fc72abb7a tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Returning 404 to user: Flavor access not found for 23 / 4d138283e1c34da39c090ddf384697eb combination. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:08.166283 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-782d6df9-065b-4de5-9f92-ac1fc72abb7a tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/599097909/action" status: 404 len: 124 microversion: 2.1 time: 0.314908 Aug 06 20:54:08.167448 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 46/118] 10.222.0.33 () {60 vars in 1197 bytes} [Sat Aug 6 20:54:07 2022] POST /compute/v2.1/flavors/599097909/action => generated 124 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:08.178881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-912e0ca9-de57-46b6-952c-431b8a21d278 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:08.180051 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:08.180051 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:08.210412 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-912e0ca9-de57-46b6-952c-431b8a21d278 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/599097909" status: 202 len: 0 microversion: 2.1 time: 0.037714 Aug 06 20:54:08.212313 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 73/119] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:54:08 2022] DELETE /compute/v2.1/flavors/599097909 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:08.222985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7c79c4bd-6a28-41a2-89ec-ffc3a4ee1563 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:08.247336 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7c79c4bd-6a28-41a2-89ec-ffc3a4ee1563 tempest-FlavorsAccessNegativeTestJSON-92023163 tempest-FlavorsAccessNegativeTestJSON-92023163-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031643 Aug 06 20:54:08.250099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1063015157", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:08.261793 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 74/120] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:08.309235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:54:08.435519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:08.436436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:08.441522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=8,nova_api:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:08.447285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:08.447783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:08.448293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:08.449021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:08.449487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:08.449922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:08.573655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:54:08.574617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:54:08.583274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:54:08.583791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:54:08.584224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:54:08.594024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:08.594881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:08.595215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:08.595967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:08.596448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:08.596874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:08.616295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:54:08.621622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for user 0701f31766dd4eeab9a63f6411c26d6e and project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:54:08.646507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:54:08.648753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:54:08.675780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:08.686157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f466c132-fa38-4b5b-b081-11802170bd67 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1322 microversion: 2.1 time: 0.257608 Aug 06 20:54:08.687051 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 75/121] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:08 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:08.700821 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8d3b31d-8203-4324-829a-c92b8dcb58d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513676 Aug 06 20:54:08.701722 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 47/122] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:54:08.712243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bfe0150d-1219-4e65-b078-f0fcdd85d396 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:08.712863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bfe0150d-1219-4e65-b078-f0fcdd85d396 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:08.744016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:08.744629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:08.752821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:08.753400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:08.753853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:08.758774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:08.759660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:08.760239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:08.782328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bfe0150d-1219-4e65-b078-f0fcdd85d396 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:08.792378 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bfe0150d-1219-4e65-b078-f0fcdd85d396 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1213 microversion: 2.1 time: 0.083887 Aug 06 20:54:08.805927 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 76/123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:08 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:08.967392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:08.975624 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ba480f5e-549a-487e-b0cd-6ef2886a3277 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.235779 Aug 06 20:54:08.978997 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 48/124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:08 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:09.013051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:09.014602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:09.030859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:09.031299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:09.031814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:09.032584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:09.033049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:09.034103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:09.192164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:09.203794 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-187f4b22-d4fa-4b42-b776-d605c6b826e2 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.193715 Aug 06 20:54:09.204403 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 77/125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:09 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:09.663793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-cc806a25-e6a9-4208-b456-c426112e1583 req-cbc0d31b-47b7-42e5-8503-8825f9e9d366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342b8e9c-dd9d-4311-a62e-1eae78811008", "name": "network-vif-plugged", "status": "completed", "tag": "a39262f5-8248-4478-8584-16ce1baa4f14"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:09.679247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cc806a25-e6a9-4208-b456-c426112e1583 req-cbc0d31b-47b7-42e5-8503-8825f9e9d366 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:09.679727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cc806a25-e6a9-4208-b456-c426112e1583 req-cbc0d31b-47b7-42e5-8503-8825f9e9d366 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:09.680155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cc806a25-e6a9-4208-b456-c426112e1583 req-cbc0d31b-47b7-42e5-8503-8825f9e9d366 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:09.700288 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-cc806a25-e6a9-4208-b456-c426112e1583 req-cbc0d31b-47b7-42e5-8503-8825f9e9d366 service nova] Creating event network-vif-plugged:a39262f5-8248-4478-8584-16ce1baa4f14 for instance 342b8e9c-dd9d-4311-a62e-1eae78811008 on nch1-master-1 Aug 06 20:54:09.700869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cc806a25-e6a9-4208-b456-c426112e1583 req-cbc0d31b-47b7-42e5-8503-8825f9e9d366 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 20:54:09.701266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cc806a25-e6a9-4208-b456-c426112e1583 req-cbc0d31b-47b7-42e5-8503-8825f9e9d366 service nova] Acquired lock "compute-rpcapi-router" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 20:54:09.702378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe12573-8ec9-4e02-b9b3-49aec3f5fa6b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:09.703062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe12573-8ec9-4e02-b9b3-49aec3f5fa6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:09.703742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe12573-8ec9-4e02-b9b3-49aec3f5fa6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:09.704683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe12573-8ec9-4e02-b9b3-49aec3f5fa6b None None] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:09.705206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe12573-8ec9-4e02-b9b3-49aec3f5fa6b None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:09.705793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe12573-8ec9-4e02-b9b3-49aec3f5fa6b None None] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:09.706961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:09.707573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:09.714979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:09.715115 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.compute.rpcapi [None req-efe12573-8ec9-4e02-b9b3-49aec3f5fa6b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 20:54:09.715870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe12573-8ec9-4e02-b9b3-49aec3f5fa6b None None] Releasing lock "compute-rpcapi-router" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 20:54:09.716107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:09.716822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:09.718846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:09.719607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:09.720229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:09.735974 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-efe12573-8ec9-4e02-b9b3-49aec3f5fa6b None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143549 Aug 06 20:54:09.739692 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 49/126] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:09.817308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:09.819112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:09.828968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:09.829824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:09.831104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:09.834213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:09.834915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:09.835512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:10.003519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:10.012756 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8059fc53-24b3-43ca-8fae-74aa7a6f975f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1287 microversion: 2.1 time: 0.202971 Aug 06 20:54:10.022933 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 50/127] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:09 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:10.034352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:10.036061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:10.058648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:10.059360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:10.060213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:10.061240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:10.066568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:10.067570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:10.068204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:10.079711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:10.085250 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-05bc5436-0e64-45ea-ba61-42d0111f11c0 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1322 microversion: 2.1 time: 0.381931 Aug 06 20:54:10.087376 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 78/128] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:09 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:10.233546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:10.238790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:10.268055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:10.268800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:10.270076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:10.272276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:10.274458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:10.274950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:10.431849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:10.440690 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f9fe580c-66a2-4f96-bd2f-d470501c1c6e tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.416269 Aug 06 20:54:10.441287 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 51/129] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:10 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:10.474943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:10.485341 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7caab17d-1ecb-4125-9ed9-776eaf8f8b88 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.260180 Aug 06 20:54:10.486621 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 79/130] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:10 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:11.039592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:11.040335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:11.047470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.048219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.048725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.049794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.050319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.050845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.108193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:11.108892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:11.115322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.115815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.116742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.117460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.117918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.118340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.220112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:11.227877 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-45111ed7-02db-4e4c-84bc-5fb57b284661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1335 microversion: 2.1 time: 0.194298 Aug 06 20:54:11.228670 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 52/131] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:11 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1335 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:11.303583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:11.321978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:11.334929 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b187e752-8ac6-4dd8-8b50-247c4441757e tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1322 microversion: 2.1 time: 0.231920 Aug 06 20:54:11.335512 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 80/132] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:11 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:11.467732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:11.469230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:11.476000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.476678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.477175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.477922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.478384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.478870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.505939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:11.506833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:11.521156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.521652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.522121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.522870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.523332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.523791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.673417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:11.685398 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bf84095c-c40d-493d-8e7f-0729186ae0ce tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.182737 Aug 06 20:54:11.686091 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 81/133] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:11 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:11.687936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:11.695860 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-507301f6-389e-4624-93f4-e05a553e2c20 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1339 microversion: 2.1 time: 0.235509 Aug 06 20:54:11.696438 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 53/134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:11 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1339 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:11.754991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-05491909-f63d-4217-8982-7e238e671609 req-c8eb03c6-b07c-4729-a5b3-ecae8bd87730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b3df46-1527-4dfa-bca8-696627205e57", "name": "network-vif-plugged", "status": "completed", "tag": "0dc350f2-0e79-4d57-861c-b899ed64f302"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:11.769227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-05491909-f63d-4217-8982-7e238e671609 req-c8eb03c6-b07c-4729-a5b3-ecae8bd87730 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.769702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-05491909-f63d-4217-8982-7e238e671609 req-c8eb03c6-b07c-4729-a5b3-ecae8bd87730 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.770290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-05491909-f63d-4217-8982-7e238e671609 req-c8eb03c6-b07c-4729-a5b3-ecae8bd87730 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.782709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-05491909-f63d-4217-8982-7e238e671609 req-c8eb03c6-b07c-4729-a5b3-ecae8bd87730 service nova] Creating event network-vif-plugged:0dc350f2-0e79-4d57-861c-b899ed64f302 for instance 03b3df46-1527-4dfa-bca8-696627205e57 on nch2-master-1 Aug 06 20:54:11.793042 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-05491909-f63d-4217-8982-7e238e671609 req-c8eb03c6-b07c-4729-a5b3-ecae8bd87730 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044575 Aug 06 20:54:11.793823 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 82/135] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:11.963338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e3915280-c821-4fa7-b7c0-35290ae4f9a2 req-45f28007-fd9d-42e0-bef0-1ef9be72bb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe66499-78a6-4cfe-bb3b-dd0daced441e", "tag": "002e51bc-8957-435b-bb91-05c80cbea7e1"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:11.980850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e3915280-c821-4fa7-b7c0-35290ae4f9a2 req-45f28007-fd9d-42e0-bef0-1ef9be72bb57 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:11.981647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e3915280-c821-4fa7-b7c0-35290ae4f9a2 req-45f28007-fd9d-42e0-bef0-1ef9be72bb57 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:11.982383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e3915280-c821-4fa7-b7c0-35290ae4f9a2 req-45f28007-fd9d-42e0-bef0-1ef9be72bb57 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:11.994920 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e3915280-c821-4fa7-b7c0-35290ae4f9a2 req-45f28007-fd9d-42e0-bef0-1ef9be72bb57 service nova] Creating event network-changed:002e51bc-8957-435b-bb91-05c80cbea7e1 for instance ebe66499-78a6-4cfe-bb3b-dd0daced441e on nch1-master-1 Aug 06 20:54:12.001066 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e3915280-c821-4fa7-b7c0-35290ae4f9a2 req-45f28007-fd9d-42e0-bef0-1ef9be72bb57 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049041 Aug 06 20:54:12.002020 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 54/136] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:12.252864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:12.254299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:12.279395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.282658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.283108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.283836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.284295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.284722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.357001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:12.359196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:12.366816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.368119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.369039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.370146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.370846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.371373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.475301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:12.485559 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e6d4bd77-3c38-41f3-8e1b-af11bf659055 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1335 microversion: 2.1 time: 0.239353 Aug 06 20:54:12.486327 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 83/137] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:12 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1335 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:12.620633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:12.629707 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2da0dc00-5426-4a76-8dea-a6413b488b49 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1322 microversion: 2.1 time: 0.277231 Aug 06 20:54:12.630672 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 55/138] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:12 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:12.710062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:12.711003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:12.719531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.720282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.721272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.721989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.722645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.723225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.801910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Calling method '.version_select at 0x7f729e905820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:12.802823 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:12.802823 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:12.803895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.804378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.804811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.819423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.819903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.820342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.831434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.831920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.832353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.838213 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-56e678cd-cc93-426c-90e8-c3d142e20883 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.164747 Aug 06 20:54:12.838823 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 84/139] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:12.844479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:12.845395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:12.851405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.851889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.852331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.853024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:12.853482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:12.853906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:12.864342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:12.872036 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d1da99f3-f953-44c2-a9df-35ad6b9195a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.166362 Aug 06 20:54:12.872623 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 56/140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:12 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:12.991257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:12.996353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2004b10f-8d01-46ca-ab1e-2d1ec0340b2a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] Calling method '.version_select at 0x7f729ef45940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:12.997307 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:12.997307 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:12.998512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2004b10f-8d01-46ca-ab1e-2d1ec0340b2a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd9fb424af10c4e52bca844b35f5a20f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94ccc56a7a4c0cab325094f8185e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:12.999019 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e5b5dd9-53b0-4a51-8181-11718c9529ad tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1489 microversion: 2.1 time: 0.159212 Aug 06 20:54:13.000361 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 85/141] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:12 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1489 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2004b10f-8d01-46ca-ab1e-2d1ec0340b2a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] Request method failure captured: Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-hypervisors/nch1-master-1/search HTTP/1.1 Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTz8kvpDIQLGVhHqBkMQt-Z_o1NboJgvGFSUzLizFOuje1od8-ibGNaZJK-pWytfUjYJPx5sfFy_4sFIjLmv3IGq5wpysKB8EQ2sht8lWpzPDJsRpdEnuiKnQ7hNLMxNIEIOrBjMR_uU__SyvPrWyPrBUsHErUgfQSEyORPVH-Btqc Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7e94ccc56a7a4c0cab325094f8185e42 Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-821675459 Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:13.001882 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e94ccc56a7a4c0cab325094f8185e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e94ccc56a7a4c0cab325094f8185e42", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e94ccc56a7a4c0cab325094f8185e42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e94ccc56a7a4c0cab325094f8185e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-821675459 Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7e94ccc56a7a4c0cab325094f8185e42 Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-821675459 Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-821675459-project Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d9fb424af10c4e52bca844b35f5a20f2 Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-821675459-project Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 06 20:54:13.003167 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'nch1-master-1'} Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:13.003808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 06 20:54:13.004849 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.005873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2004b10f-8d01-46ca-ab1e-2d1ec0340b2a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:13.005873 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2004b10f-8d01-46ca-ab1e-2d1ec0340b2a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.129754 Aug 06 20:54:13.005873 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 57/142] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Aug 6 20:54:12 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 131 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:13.012410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c8ad595-080b-4423-8445-1dfb39c5bf15 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Calling method '.version_select at 0x7f729ea8ce50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.013200 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:13.013200 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:13.014246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c8ad595-080b-4423-8445-1dfb39c5bf15 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.014807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c8ad595-080b-4423-8445-1dfb39c5bf15 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.015254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c8ad595-080b-4423-8445-1dfb39c5bf15 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.021278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58ca3eb3-e4b7-444f-b726-2e636c28ce43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.021974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-58ca3eb3-e4b7-444f-b726-2e636c28ce43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:13.027735 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-1c8ad595-080b-4423-8445-1dfb39c5bf15 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 06 20:54:13.029189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca3eb3-e4b7-444f-b726-2e636c28ce43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c8ad595-080b-4423-8445-1dfb39c5bf15 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Request method failure captured: Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tT0zZjxokgnPRvrQz-H4oanvrgcDFUL--D-2sxXNNT0Q3qpOo42ntk1OoLaXfr1YE_1xcQh983IV-UAJdexNvQ-9k9slWjyoLQxUcZCxbbBGf1z6vTxOMC6VxyJvv1CvRxZxAA6E_kBMIZrdxONLHMQbJqHfcCup8iTs1ksxEEP1pI Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: b079de30aab04018a437e3517970f1a4 Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-970684422 Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:13.029514 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b079de30aab04018a437e3517970f1a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b079de30aab04018a437e3517970f1a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b079de30aab04018a437e3517970f1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b079de30aab04018a437e3517970f1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-970684422 Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: b079de30aab04018a437e3517970f1a4 Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-970684422 Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: cc7f8ad58b2a4c76b44b23ff539abcb3 Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 06 20:54:13.031227 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:13.031865 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:13.032880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:13.032880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:13.032880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:13.032880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 06 20:54:13.032880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.032880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c8ad595-080b-4423-8445-1dfb39c5bf15 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:13.033237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca3eb3-e4b7-444f-b726-2e636c28ce43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.033307 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1c8ad595-080b-4423-8445-1dfb39c5bf15 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.022626 Aug 06 20:54:13.033374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca3eb3-e4b7-444f-b726-2e636c28ce43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.033449 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 86/143] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 20:54:13 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:13.033516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca3eb3-e4b7-444f-b726-2e636c28ce43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.033516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca3eb3-e4b7-444f-b726-2e636c28ce43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.033516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca3eb3-e4b7-444f-b726-2e636c28ce43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.041133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Calling method '.version_select at 0x7f729e993dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.041936 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:13.041936 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:13.043045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.043536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.043978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.061026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.062239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.062795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.072962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.073437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.073872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.080169 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6756385f-dad2-4386-80c6-c236fd7bf60a tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042604 Aug 06 20:54:13.080840 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 87/144] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:13.091213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b1bb72e4-88af-4d68-8cb1-79e797e8958a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] Calling method '.version_select at 0x7f729ea5caf0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.091998 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:13.091998 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:13.093649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b1bb72e4-88af-4d68-8cb1-79e797e8958a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd9fb424af10c4e52bca844b35f5a20f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94ccc56a7a4c0cab325094f8185e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b1bb72e4-88af-4d68-8cb1-79e797e8958a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] Request method failure captured: Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTz8kvpDIQLGVhHqBkMQt-Z_o1NboJgvGFSUzLizFOuje1od8-ibGNaZJK-pWytfUjYJPx5sfFy_4sFIjLmv3IGq5wpysKB8EQ2sht8lWpzPDJsRpdEnuiKnQ7hNLMxNIEIOrBjMR_uU__SyvPrWyPrBUsHErUgfQSEyORPVH-Btqc Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7e94ccc56a7a4c0cab325094f8185e42 Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-821675459 Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:13.095193 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e94ccc56a7a4c0cab325094f8185e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e94ccc56a7a4c0cab325094f8185e42", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e94ccc56a7a4c0cab325094f8185e42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e94ccc56a7a4c0cab325094f8185e42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-821675459 Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7e94ccc56a7a4c0cab325094f8185e42 Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-821675459 Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-821675459-project Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: d9fb424af10c4e52bca844b35f5a20f2 Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-821675459-project Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 06 20:54:13.096576 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '1'} Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:13.097198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 06 20:54:13.098353 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.099632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b1bb72e4-88af-4d68-8cb1-79e797e8958a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:13.099632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b1bb72e4-88af-4d68-8cb1-79e797e8958a tempest-HypervisorAdminNegativeUnderV252Test-821675459 tempest-HypervisorAdminNegativeUnderV252Test-821675459-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009143 Aug 06 20:54:13.099951 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 88/145] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Aug 6 20:54:13 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:54:13.106000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71909372-2605-41bb-b6b5-31e786402e34 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Calling method '.version_select at 0x7f729e8c13a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.107812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71909372-2605-41bb-b6b5-31e786402e34 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.108291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71909372-2605-41bb-b6b5-31e786402e34 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.109353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71909372-2605-41bb-b6b5-31e786402e34 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.117737 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-71909372-2605-41bb-b6b5-31e786402e34 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] HTTP exception thrown: No hypervisor matching '646e23c1-5dde-4555-b3ef-85d81704cc17' could be found. Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71909372-2605-41bb-b6b5-31e786402e34 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Request method failure captured: Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hypervisors/646e23c1-5dde-4555-b3ef-85d81704cc17/servers HTTP/1.1 Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tT0zZjxokgnPRvrQz-H4oanvrgcDFUL--D-2sxXNNT0Q3qpOo42ntk1OoLaXfr1YE_1xcQh983IV-UAJdexNvQ-9k9slWjyoLQxUcZCxbbBGf1z6vTxOMC6VxyJvv1CvRxZxAA6E_kBMIZrdxONLHMQbJqHfcCup8iTs1ksxEEP1pI Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: b079de30aab04018a437e3517970f1a4 Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-970684422 Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:13.119092 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b079de30aab04018a437e3517970f1a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b079de30aab04018a437e3517970f1a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b079de30aab04018a437e3517970f1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b079de30aab04018a437e3517970f1a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-970684422 Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: b079de30aab04018a437e3517970f1a4 Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-970684422 Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: cc7f8ad58b2a4c76b44b23ff539abcb3 Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: exception: No hypervisor matching '646e23c1-5dde-4555-b3ef-85d81704cc17' could be found. Aug 06 20:54:13.120364 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '646e23c1-5dde-4555-b3ef-85d81704cc17'} Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '646e23c1-5dde-4555-b3ef-85d81704cc17' could be found. Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.121004 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:13.122350 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:13.122350 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:13.122350 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:13.122350 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:13.122350 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '646e23c1-5dde-4555-b3ef-85d81704cc17' could be found. Aug 06 20:54:13.122350 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:13.122350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71909372-2605-41bb-b6b5-31e786402e34 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] Returning 404 to user: No hypervisor matching '646e23c1-5dde-4555-b3ef-85d81704cc17' could be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:13.122350 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71909372-2605-41bb-b6b5-31e786402e34 tempest-HypervisorAdminNegativeUnderV252Test-970684422 tempest-HypervisorAdminNegativeUnderV252Test-970684422-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/646e23c1-5dde-4555-b3ef-85d81704cc17/servers" status: 404 len: 123 microversion: 2.1 time: 0.018334 Aug 06 20:54:13.122350 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 89/146] 10.222.0.33 () {58 vars in 1281 bytes} [Sat Aug 6 20:54:13 2022] GET /compute/v2.1/os-hypervisors/646e23c1-5dde-4555-b3ef-85d81704cc17/servers => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:54:13.311464 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-58ca3eb3-e4b7-444f-b726-2e636c28ce43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1640 microversion: 2.1 time: 0.293732 Aug 06 20:54:13.312582 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 58/147] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:13 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1640 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:13.333493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.334127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:13.340638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.341205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.341719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.342475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.343069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.343560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.368752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:54:13.497586 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-68ca079d-ef93-4faa-bbb6-52ed75c7f2b5 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "DELETE /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 204 len: 0 microversion: 2.1 time: 0.167387 Aug 06 20:54:13.498174 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 90/148] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:54:13 2022] DELETE /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:54:13.507508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.508217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:13.508532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.509685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:13.514907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.515640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.516079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.516780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.517096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.517468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.517889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.517990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.518418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.519815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.519815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.520258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.667484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:13.675915 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dc7bab15-36ea-476e-957f-8a5533eb275d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1335 microversion: 2.1 time: 0.172877 Aug 06 20:54:13.676502 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 59/149] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:13 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1335 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:13.682465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.683106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:13.689980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.690694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.691547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.692242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.692713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.693281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.732300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:13.740341 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a654fd8e-8545-4606-98d0-c45e1c95e3ca tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1495 microversion: 2.1 time: 0.237004 Aug 06 20:54:13.741167 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 91/150] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:13 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1495 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:13.893703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:13.894616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:13.900521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.901135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.901631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.902498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:13.902966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:13.903531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:13.928934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:13.933025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:13.939904 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a320b6f1-523c-408d-b1bd-ad0f9f1ed42b tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1322 microversion: 2.1 time: 0.261476 Aug 06 20:54:13.953947 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 60/151] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:13 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:14.093933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:14.102430 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-322d53d3-c475-429f-a407-b76385946687 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1320 microversion: 2.1 time: 0.213261 Aug 06 20:54:14.103365 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 92/152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:13 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:14.242533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-786111be-1703-4ba7-a847-ed6887cdd490 req-268ef94f-d5f5-453e-9d58-66c7d60f8864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55339407-24b2-4a9c-97db-4ece55de26b2", "name": "network-vif-plugged", "status": "completed", "tag": "5e176929-6529-4a00-a589-1fd274ae481c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:14.250677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=13 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:14.256385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-786111be-1703-4ba7-a847-ed6887cdd490 req-268ef94f-d5f5-453e-9d58-66c7d60f8864 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:14.256868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-786111be-1703-4ba7-a847-ed6887cdd490 req-268ef94f-d5f5-453e-9d58-66c7d60f8864 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:14.257309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-786111be-1703-4ba7-a847-ed6887cdd490 req-268ef94f-d5f5-453e-9d58-66c7d60f8864 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:14.271105 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-786111be-1703-4ba7-a847-ed6887cdd490 req-268ef94f-d5f5-453e-9d58-66c7d60f8864 service nova] Creating event network-vif-plugged:5e176929-6529-4a00-a589-1fd274ae481c for instance 55339407-24b2-4a9c-97db-4ece55de26b2 on nch2-master-1 Aug 06 20:54:14.276418 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-786111be-1703-4ba7-a847-ed6887cdd490 req-268ef94f-d5f5-453e-9d58-66c7d60f8864 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037397 Aug 06 20:54:14.277197 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 61/153] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:14.696245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:14.696946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:14.704060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:14.704636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:14.705138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:14.705827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:14.706280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:14.706736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:14.762099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:14.762844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:14.770907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:14.771526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:14.772128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:14.773104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:14.773701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:14.774255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:14.844293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:14.851940 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-61028687-ef04-4dec-8ace-03db83bc22cc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1335 microversion: 2.1 time: 0.159463 Aug 06 20:54:14.853017 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 93/154] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:14 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1335 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:14.965568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:14.967121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:14.981791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:14.982695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:14.984150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:14.985419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:14.986255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:14.987068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:15.039093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:15.049707 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c59eddeb-e0fa-4c2b-81f4-6a08e2754282 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1495 microversion: 2.1 time: 0.291135 Aug 06 20:54:15.050875 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 62/155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:14 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1495 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:15.130362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:15.132072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:15.145522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:15.146875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:15.148309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:15.150057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:15.150486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:15.151432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:15.153154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:15.160701 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3eb9e9f-6b74-47c1-b7c0-a42bdcddcbb4 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1322 microversion: 2.1 time: 0.203255 Aug 06 20:54:15.172886 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 94/156] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:14 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:15.574526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:15.585372 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7e90249a-33be-4b44-84c2-f4c9a8a34d9a tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1470 microversion: 2.1 time: 0.465100 Aug 06 20:54:15.586602 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 63/157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:15 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1470 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:15.877164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:15.878274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:15.887272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:15.888061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:15.888849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:15.890531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:15.891418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:15.892101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:15.955058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:15.955624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:15.963241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:15.963741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:15.964181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:15.964892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:15.965355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:15.965798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.038348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:54:16.117401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:16.194814 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d226b53-ef27-48bd-a46d-48cabac5fefa tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 204 len: 0 microversion: 2.1 time: 0.590758 Aug 06 20:54:16.195698 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 95/158] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:54:15 2022] DELETE /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:54:16.203485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:16.204853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:16.212654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.213139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.213572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.214269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.214776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.215198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.361435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:16.368961 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-58ca04aa-093a-4e73-ae12-49d14873bc6b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1335 microversion: 2.1 time: 0.498184 Aug 06 20:54:16.369752 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 64/159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:15 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1335 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:16.387136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:16.387752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:16.395565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.396055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.396492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.400311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.400999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.401439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.463309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d2a43d97f242e5a725eb5e12ba1cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e95c49afa6f7467fb74adef67a9b4910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:16.479003 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8700a1d0-0ffe-4b4a-bf10-75bfa2604486 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 200 len: 1495 microversion: 2.1 time: 0.281554 Aug 06 20:54:16.481447 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 96/160] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:16 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 1495 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:16.488238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:16.503232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:16.529255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.531450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.532068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.533518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.534299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.534995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.640429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:16.651260 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c3e763df-90fc-436e-a57a-3f42a1c45b9d tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1472 microversion: 2.1 time: 0.267802 Aug 06 20:54:16.652447 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 65/161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:16 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1472 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:16.658240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-16c08827-dc9a-4f34-a797-1e3d8830f44b req-18907b5c-2486-421f-9ed3-9644ff9e1386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342b8e9c-dd9d-4311-a62e-1eae78811008", "name": "network-vif-deleted", "tag": "a39262f5-8248-4478-8584-16ce1baa4f14"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:16.683627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-16c08827-dc9a-4f34-a797-1e3d8830f44b req-18907b5c-2486-421f-9ed3-9644ff9e1386 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.684340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-16c08827-dc9a-4f34-a797-1e3d8830f44b req-18907b5c-2486-421f-9ed3-9644ff9e1386 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.685019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-16c08827-dc9a-4f34-a797-1e3d8830f44b req-18907b5c-2486-421f-9ed3-9644ff9e1386 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.718341 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-16c08827-dc9a-4f34-a797-1e3d8830f44b req-18907b5c-2486-421f-9ed3-9644ff9e1386 service nova] Creating event network-vif-deleted:a39262f5-8248-4478-8584-16ce1baa4f14 for instance 342b8e9c-dd9d-4311-a62e-1eae78811008 on nch1-master-1 Aug 06 20:54:16.723809 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-16c08827-dc9a-4f34-a797-1e3d8830f44b req-18907b5c-2486-421f-9ed3-9644ff9e1386 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069689 Aug 06 20:54:16.724477 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 66/162] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:16.730128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:16.730818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:16.736982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:16.737610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.738325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.738992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.740128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.741515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.742129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.745307 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ddfc835c-21e4-4275-b584-d4bf468843f7 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1476 microversion: 2.1 time: 0.262171 Aug 06 20:54:16.746194 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 97/163] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:16 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:16.810388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Request method failure captured: Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2/diagnostics HTTP/1.1 Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTda9UHLBp6qVXEGnLboA2Z04ykxeiIzrrkUQfSfk4pDUZ0KGgqJ_rSa4n4XbPifzCxh0efRkkxdsG_OJI7d2bM-bOYCW5_5KE34Zs61MUeW8emJjXE-ZMVZFXo9I-HsIXbYs59-sSbkPZRP78sbcn0li7BAauZZ0eRhoJsS3ct3Js Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 35ffa77d7887486dbb30387455757c32 Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-67973195 Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:16.813298 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/35ffa77d7887486dbb30387455757c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_35ffa77d7887486dbb30387455757c32", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/35ffa77d7887486dbb30387455757c32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/35ffa77d7887486dbb30387455757c32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-67973195 Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 35ffa77d7887486dbb30387455757c32 Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-67973195 Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerDiagnosticsNegativeTest-67973195-project Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 012f20ffe53640a3be67f9d3cff4e28a Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-67973195-project Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:16.814444 ncdv-master-1 devstack@n-api.service[142462]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'server_id': '55339407-24b2-4a9c-97db-4ece55de26b2'} Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:16.815378 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:16.816441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:16.817395 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-58e97aba-869d-44b2-9493-33a2a63906ab tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.090511 Aug 06 20:54:16.817395 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 67/164] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:54:16 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2/diagnostics => generated 117 bytes in 92 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:16.826678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:16.827774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:16.833892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.834385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.834873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.835577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.836483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.836483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.863987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:54:16.962834 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-476fc8d2-0f55-4c1f-a084-9fcc4e84e526 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 204 len: 0 microversion: 2.1 time: 0.138742 Aug 06 20:54:16.963990 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 98/165] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:54:16 2022] DELETE /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:54:16.974092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:16.974709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:16.991325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.991816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.994592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:16.997671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:16.998246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:16.999428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:17.291809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:17.304342 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-275e6800-3f20-4340-b4e4-41a62aa48230 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1478 microversion: 2.1 time: 0.334754 Aug 06 20:54:17.305497 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 68/166] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:16 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1478 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:17.390839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:17.391805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:17.398172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:17.398703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:17.399336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:17.400052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:17.400515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:17.401061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:17.496993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-83b9fee3-4429-4757-87f6-48f6e0182b8b req-e1e38b84-f965-43bc-abbb-c8831d48edac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe66499-78a6-4cfe-bb3b-dd0daced441e", "name": "network-vif-plugged", "status": "completed", "tag": "002e51bc-8957-435b-bb91-05c80cbea7e1"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:17.521578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-83b9fee3-4429-4757-87f6-48f6e0182b8b req-e1e38b84-f965-43bc-abbb-c8831d48edac service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:17.522814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-83b9fee3-4429-4757-87f6-48f6e0182b8b req-e1e38b84-f965-43bc-abbb-c8831d48edac service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:17.523536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-83b9fee3-4429-4757-87f6-48f6e0182b8b req-e1e38b84-f965-43bc-abbb-c8831d48edac service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:17.543955 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-83b9fee3-4429-4757-87f6-48f6e0182b8b req-e1e38b84-f965-43bc-abbb-c8831d48edac service nova] Creating event network-vif-plugged:002e51bc-8957-435b-bb91-05c80cbea7e1 for instance ebe66499-78a6-4cfe-bb3b-dd0daced441e on nch1-master-1 Aug 06 20:54:17.551626 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-83b9fee3-4429-4757-87f6-48f6e0182b8b req-e1e38b84-f965-43bc-abbb-c8831d48edac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060566 Aug 06 20:54:17.553398 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 69/167] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:17.560814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:17.563551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:17.572053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:17.573689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:17.574332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:17.575315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:17.576053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:17.579853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:17.596967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:17.598223 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] HTTP exception thrown: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Request method failure captured: Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 HTTP/1.1 Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTTg2P1BpF8MeBvoM7s38OCBbMVUWq4wL5gAbx2ymMc-FHwRxR0L1O9tfePFcZrh1bQznd6f8yuevtmLx-J4Jqpc_HghDaELYheL03q9drY9TwBKV4a2o0dzo7q-kcHnB2IhGz-F5Mr1sPScLGqOER854h140UF6fHZ-EPUSvEAE-k Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: e95c49afa6f7467fb74adef67a9b4910 Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AggregatesAdminTestJSON-440792274 Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:17.604641 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e95c49afa6f7467fb74adef67a9b4910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e95c49afa6f7467fb74adef67a9b4910", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e95c49afa6f7467fb74adef67a9b4910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e95c49afa6f7467fb74adef67a9b4910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AggregatesAdminTestJSON-440792274 Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: e95c49afa6f7467fb74adef67a9b4910 Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-440792274 Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AggregatesAdminTestJSON-440792274-project Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 07d2a43d97f242e5a725eb5e12ba1cc2 Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AggregatesAdminTestJSON-440792274-project Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:17.605738 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '342b8e9c-dd9d-4311-a62e-1eae78811008'} Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:17.606386 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:17.607976 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:17.608947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Returning 404 to user: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:17.608947 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-acc3fb61-5462-4f2c-9502-7a87022cf4e7 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 404 len: 111 microversion: 2.1 time: 0.050844 Aug 06 20:54:17.608947 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 70/168] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:17 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:17.618134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d8c02ade-7583-4f26-a66b-7fd8d8806818 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:17.622171 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4acbe3c6-169d-4883-b0c1-982d0ac69784 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1335 microversion: 2.1 time: 0.236048 Aug 06 20:54:17.622783 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:17.622783 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:17.647710 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 99/169] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:17 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1335 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:17.669427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8c02ade-7583-4f26-a66b-7fd8d8806818 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:17.670334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8c02ade-7583-4f26-a66b-7fd8d8806818 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:17.671117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8c02ade-7583-4f26-a66b-7fd8d8806818 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:17.771980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:17.773099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:17.782043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:17.782889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:17.783766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:17.784821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:17.785840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:17.786413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:17.983885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:17.993246 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd413aeb-8d2c-4008-b0f4-f53f093dccd1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1476 microversion: 2.1 time: 0.225935 Aug 06 20:54:17.994325 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 100/170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:17 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:18.088507 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d8c02ade-7583-4f26-a66b-7fd8d8806818 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.476266 Aug 06 20:54:18.090082 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 71/171] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:18.101131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dbb1e2b2-1ac9-4265-a835-b1187255873e tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:18.101972 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.101972 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:18.124753 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dbb1e2b2-1ac9-4265-a835-b1187255873e tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.026327 Aug 06 20:54:18.125559 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 101/172] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:18 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 06 20:54:18.139175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2b90550e-399b-4e8e-91d2-616b8e74a689 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-286678262"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:18.142159 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.142159 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:18.143111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.aggregate [None req-2b90550e-399b-4e8e-91d2-616b8e74a689 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Generated uuid 46aee017-3349-4d7e-8772-c938d00797b4 for aggregate {{(pid=142462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:18.175723 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2b90550e-399b-4e8e-91d2-616b8e74a689 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.041435 Aug 06 20:54:18.177001 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 72/173] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:18.190015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1327e988-0314-4b13-b8a0-fb2beab83caa tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:18.195313 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.195313 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:18.206327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1327e988-0314-4b13-b8a0-fb2beab83caa tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:18.206867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1327e988-0314-4b13-b8a0-fb2beab83caa tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:18.207372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1327e988-0314-4b13-b8a0-fb2beab83caa tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:18.325476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:18.326614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:18.335392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:18.335909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:18.336346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:18.337055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:18.337511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:18.337938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:18.340008 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1327e988-0314-4b13-b8a0-fb2beab83caa tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.156095 Aug 06 20:54:18.340795 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 102/174] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:18 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:18.352470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-35bd7704-df7d-4780-9c7f-8417c27cc120 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:18.353699 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.353699 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:18.363010 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-35bd7704-df7d-4780-9c7f-8417c27cc120 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.014037 Aug 06 20:54:18.365176 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 103/175] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 20:54:18 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:18.376824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e1b2f3ff-2100-40d1-bb67-24f3afcf02dc tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:18.379699 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.379699 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:18.389118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e1b2f3ff-2100-40d1-bb67-24f3afcf02dc tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:18.390358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e1b2f3ff-2100-40d1-bb67-24f3afcf02dc tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:18.390928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e1b2f3ff-2100-40d1-bb67-24f3afcf02dc tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:18.554976 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e1b2f3ff-2100-40d1-bb67-24f3afcf02dc tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.182036 Aug 06 20:54:18.555519 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 104/176] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:18 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:18.572466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4511d6c9-2b93-4b78-8c87-69dc8a134345 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:18.572681 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.572681 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:18.606404 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4511d6c9-2b93-4b78-8c87-69dc8a134345 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.041039 Aug 06 20:54:18.607191 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 105/177] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:18 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:18.618139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3321a3b1-39e5-4171-ae34-970a070ed8e8 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1938897858"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:18.621138 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.621138 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:18.622351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-3321a3b1-39e5-4171-ae34-970a070ed8e8 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Generated uuid 34f7786d-b988-460b-bd83-102a7018c399 for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:18.640504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=18 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:18.652790 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3321a3b1-39e5-4171-ae34-970a070ed8e8 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038503 Aug 06 20:54:18.653879 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 106/178] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:18.659699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:18.690783 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c501c39-3b9b-4d59-9ae1-84ed723e9193 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1478 microversion: 2.1 time: 0.369275 Aug 06 20:54:18.693983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:18.694742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:18.695802 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 73/179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:18 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1478 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:18.698997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:DELETE=5,nova_api:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:18.707064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:18.708343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:18.714410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eee23d08-0e2d-4ae9-bb0b-40f0aed57cb0 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:18.718575 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.718575 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:18.721268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:18.721958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:18.722452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:18.722923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:18.760163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eee23d08-0e2d-4ae9-bb0b-40f0aed57cb0 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:18.760672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eee23d08-0e2d-4ae9-bb0b-40f0aed57cb0 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:18.761121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eee23d08-0e2d-4ae9-bb0b-40f0aed57cb0 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:18.787833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:18.925143 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eee23d08-0e2d-4ae9-bb0b-40f0aed57cb0 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.228195 Aug 06 20:54:18.930610 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 74/180] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:18 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:18.939837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-61d73d1e-cf84-4848-8e53-facc1b739cd9 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:18.941108 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.941108 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:18.949114 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-61d73d1e-cf84-4848-8e53-facc1b739cd9 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.014801 Aug 06 20:54:18.950910 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 75/181] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 20:54:18 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:18.964894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b923dd71-ca2e-4c34-9dd1-f788b506fb04 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:18.971046 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:18.971046 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:18.985054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b923dd71-ca2e-4c34-9dd1-f788b506fb04 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:18.986177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b923dd71-ca2e-4c34-9dd1-f788b506fb04 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:18.986870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b923dd71-ca2e-4c34-9dd1-f788b506fb04 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:19.209097 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b923dd71-ca2e-4c34-9dd1-f788b506fb04 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.245510 Aug 06 20:54:19.210109 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 76/182] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:18 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:19.228137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:19.228766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:19.254093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:19.270137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:19.272334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:19.275890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:19.281053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:19.282893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:19.493907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:19.513499 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f51151da-3220-4758-9a45-034c6658f6a6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1313 microversion: 2.1 time: 0.832370 Aug 06 20:54:19.516255 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 107/183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:18 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1313 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:19.543849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e87d390d-c243-4823-af29-8cce91fb810a tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:19.549404 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:19.549404 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:19.605233 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e87d390d-c243-4823-af29-8cce91fb810a tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.076557 Aug 06 20:54:19.612156 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 108/184] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:19 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:19.618070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0c57dabe-0f52-4568-91f2-b34cd5030444 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1044114835"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:19.621689 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:19.621689 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:19.623223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-0c57dabe-0f52-4568-91f2-b34cd5030444 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Generated uuid 18014fab-89bb-4200-848a-704594d49d5b for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:19.662491 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0c57dabe-0f52-4568-91f2-b34cd5030444 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048100 Aug 06 20:54:19.669511 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 109/185] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:19.687649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09662cb9-750b-47c6-8388-7c732b1acb98 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:19.691709 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:19.691709 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:19.706900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09662cb9-750b-47c6-8388-7c732b1acb98 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:19.707600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09662cb9-750b-47c6-8388-7c732b1acb98 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:19.708053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09662cb9-750b-47c6-8388-7c732b1acb98 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:19.713643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:19.880136 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-09662cb9-750b-47c6-8388-7c732b1acb98 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.199379 Aug 06 20:54:19.887284 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 110/186] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:19 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:19.887284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:19.887284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:19.899332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:19.899332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:19.899889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:19.900978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:19.902448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:19.902936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:19.992164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:20.002437 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-333ac6a1-bf10-4dd4-9676-623064c79c20 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 200 len: 1476 microversion: 2.1 time: 0.791176 Aug 06 20:54:20.003078 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 77/187] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:19 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 1476 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:20.017820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b56d0d6-8f1e-43cd-9f40-836035622a54 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:20.031262 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.031262 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:20.041013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b56d0d6-8f1e-43cd-9f40-836035622a54 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.041780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b56d0d6-8f1e-43cd-9f40-836035622a54 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.042234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b56d0d6-8f1e-43cd-9f40-836035622a54 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.271008 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6b56d0d6-8f1e-43cd-9f40-836035622a54 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.264746 Aug 06 20:54:20.278699 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 78/188] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:20 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:20.285605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-524af9b1-db4d-4704-a53a-2a76ad693d3d req-838835d5-ad40-4700-b48c-7e00a91d6d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b3df46-1527-4dfa-bca8-696627205e57", "name": "network-vif-deleted", "tag": "0dc350f2-0e79-4d57-861c-b899ed64f302"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:20.295800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-524af9b1-db4d-4704-a53a-2a76ad693d3d req-838835d5-ad40-4700-b48c-7e00a91d6d9d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.296696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-524af9b1-db4d-4704-a53a-2a76ad693d3d req-838835d5-ad40-4700-b48c-7e00a91d6d9d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.298084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-524af9b1-db4d-4704-a53a-2a76ad693d3d req-838835d5-ad40-4700-b48c-7e00a91d6d9d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.315363 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-524af9b1-db4d-4704-a53a-2a76ad693d3d req-838835d5-ad40-4700-b48c-7e00a91d6d9d service nova] Creating event network-vif-deleted:0dc350f2-0e79-4d57-861c-b899ed64f302 for instance 03b3df46-1527-4dfa-bca8-696627205e57 on nch2-master-1 Aug 06 20:54:20.323549 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-524af9b1-db4d-4704-a53a-2a76ad693d3d req-838835d5-ad40-4700-b48c-7e00a91d6d9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042172 Aug 06 20:54:20.324873 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 79/189] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:20.331837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-17049062-df70-4c49-9842-72e37ea85222 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:20.332938 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.332938 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:20.396298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012f20ffe53640a3be67f9d3cff4e28a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ffa77d7887486dbb30387455757c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:20.405618 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ca25444-99f8-4042-ab84-39508b766272 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 200 len: 1478 microversion: 2.1 time: 0.523514 Aug 06 20:54:20.407296 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 111/190] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:19 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 1478 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:20.414800 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-17049062-df70-4c49-9842-72e37ea85222 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.088106 Aug 06 20:54:20.423101 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 80/191] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:20 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:20.427989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-939df25d-deed-46f4-8460-29480506fb35 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1345486166"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:20.431138 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.431138 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:20.433862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-939df25d-deed-46f4-8460-29480506fb35 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Generated uuid 17e8db9a-de90-4698-b855-3b024597dcfd for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:20.468890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94fc7338-3908-4967-ad16-b4edf67244e1 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Calling method '.version_select at 0x7f729e553ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:20.471709 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.471709 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:20.473096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94fc7338-3908-4967-ad16-b4edf67244e1 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.475770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94fc7338-3908-4967-ad16-b4edf67244e1 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.476963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94fc7338-3908-4967-ad16-b4edf67244e1 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.479971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94fc7338-3908-4967-ad16-b4edf67244e1 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.482174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94fc7338-3908-4967-ad16-b4edf67244e1 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.483534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94fc7338-3908-4967-ad16-b4edf67244e1 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.493603 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-939df25d-deed-46f4-8460-29480506fb35 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068465 Aug 06 20:54:20.495410 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 112/192] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:20.509806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b2c26ba6-d7f2-4fab-8c97-79a4c174befa tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:20.510657 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.510657 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:20.535719 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-94fc7338-3908-4967-ad16-b4edf67244e1 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.070539 Aug 06 20:54:20.542310 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 81/193] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 20:54:20 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:20.548610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:20.549909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:20.550017 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b2c26ba6-d7f2-4fab-8c97-79a4c174befa tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.043736 Aug 06 20:54:20.552467 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 113/194] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:20 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:20.557668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.558487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.559324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.560248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.560927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.562241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.562654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c7293cc7-9791-48d5-923c-063994d88de8 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Calling method '.version_select at 0x7f729e7e9160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:20.567931 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.567931 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:20.571266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7293cc7-9791-48d5-923c-063994d88de8 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.573294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7293cc7-9791-48d5-923c-063994d88de8 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.574983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7293cc7-9791-48d5-923c-063994d88de8 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.578870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7293cc7-9791-48d5-923c-063994d88de8 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.580105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7293cc7-9791-48d5-923c-063994d88de8 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.582076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7293cc7-9791-48d5-923c-063994d88de8 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.649385 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c7293cc7-9791-48d5-923c-063994d88de8 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.095767 Aug 06 20:54:20.650026 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 114/195] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:20 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:20.655529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-46244efb-b518-4fec-9179-43bca54e981c tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:20.656414 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.656414 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:20.662688 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-46244efb-b518-4fec-9179-43bca54e981c tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-46244efb-b518-4fec-9179-43bca54e981c tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Request method failure captured: Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTV6q99ZY_2a9ceOIOkAjMXydjnjUEZv1UEEhd8jQQEFbnr_VhjHT_T1d868jdZWX_nMt5GPQiDb8_rYi6YfHIr-4-IYJxwn6I3eG0TX57tIV67fL1tZ2-eIM8Vhrz7PpxMrNur8O9gOqS8IN2txLJ76c0j6yj7gWwEM51OIahutpA Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: ae4c799b4d834fa19b81fedf13f0aa88 Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:20.668703 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ae4c799b4d834fa19b81fedf13f0aa88", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: ae4c799b4d834fa19b81fedf13f0aa88 Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminTestJSON-784884245-project-admin Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 77ba04dfce9247ac9eba07003dd45faf Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminTestJSON-784884245-project-admin Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: exception: Aggregate 5 could not be found. Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '5'} Aug 06 20:54:20.669880 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:20.671601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.672671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-46244efb-b518-4fec-9179-43bca54e981c tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:20.673652 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-46244efb-b518-4fec-9179-43bca54e981c tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.018821 Aug 06 20:54:20.673652 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 115/196] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 20:54:20 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:54:20.676405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1e9b289-65c1-4141-9e4e-30641f4924a5 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Calling method '.version_select at 0x7f729e633d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:20.679517 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.679517 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:20.683014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1e9b289-65c1-4141-9e4e-30641f4924a5 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.683014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1e9b289-65c1-4141-9e4e-30641f4924a5 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.683014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1e9b289-65c1-4141-9e4e-30641f4924a5 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.683014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1e9b289-65c1-4141-9e4e-30641f4924a5 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.683603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1e9b289-65c1-4141-9e4e-30641f4924a5 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.683603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1e9b289-65c1-4141-9e4e-30641f4924a5 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.710932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1e9b289-65c1-4141-9e4e-30641f4924a5 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.038030 Aug 06 20:54:20.711907 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 116/197] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 20:54:20 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:20.716396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b92e864a-ca64-4361-97bd-04da77787bb9 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-460481223"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:20.719330 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.719330 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:20.720474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-b92e864a-ca64-4361-97bd-04da77787bb9 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Generated uuid 800fe841-8e79-4275-a9be-f490625513e2 for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:20.753036 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b92e864a-ca64-4361-97bd-04da77787bb9 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.039438 Aug 06 20:54:20.754584 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 117/198] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:20 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:20.758556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-856477e7-3ae5-4096-9190-1be4863f6387 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:20.759333 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.759333 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:20.805699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-856477e7-3ae5-4096-9190-1be4863f6387 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-856477e7-3ae5-4096-9190-1be4863f6387 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Request method failure captured: Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTV6q99ZY_2a9ceOIOkAjMXydjnjUEZv1UEEhd8jQQEFbnr_VhjHT_T1d868jdZWX_nMt5GPQiDb8_rYi6YfHIr-4-IYJxwn6I3eG0TX57tIV67fL1tZ2-eIM8Vhrz7PpxMrNur8O9gOqS8IN2txLJ76c0j6yj7gWwEM51OIahutpA Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: ae4c799b4d834fa19b81fedf13f0aa88 Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:20.807828 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ae4c799b4d834fa19b81fedf13f0aa88", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: ae4c799b4d834fa19b81fedf13f0aa88 Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminTestJSON-784884245-project-admin Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 77ba04dfce9247ac9eba07003dd45faf Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminTestJSON-784884245-project-admin Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: exception: Aggregate 5 could not be found. Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '5'} Aug 06 20:54:20.808953 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:20.809720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:20.815819 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:20.817298 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:20.817298 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:20.817298 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:20.817298 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 06 20:54:20.817298 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:20.817298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-856477e7-3ae5-4096-9190-1be4863f6387 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:20.817298 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-856477e7-3ae5-4096-9190-1be4863f6387 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.054523 Aug 06 20:54:20.817298 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 118/199] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:20 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:54:20.822727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-06e5697d-2c36-4b77-b724-83e34c600a32 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Calling method '.version_select at 0x7f729e5f8670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:20.823711 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.823711 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:20.834525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06e5697d-2c36-4b77-b724-83e34c600a32 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.835233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06e5697d-2c36-4b77-b724-83e34c600a32 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.844557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:20.850110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06e5697d-2c36-4b77-b724-83e34c600a32 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.859479 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-87e7cc89-7cac-401f-967e-d06b71b0c9ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1463 microversion: 2.1 time: 0.315258 Aug 06 20:54:20.863139 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 82/200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:20 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1463 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:20.873191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8a529ce2-7fb1-418d-aeaa-f7072593e3c6 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:20.879322 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.879322 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:20.886170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06e5697d-2c36-4b77-b724-83e34c600a32 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.886898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06e5697d-2c36-4b77-b724-83e34c600a32 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.887520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06e5697d-2c36-4b77-b724-83e34c600a32 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.894724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a529ce2-7fb1-418d-aeaa-f7072593e3c6 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:20.895360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a529ce2-7fb1-418d-aeaa-f7072593e3c6 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:20.896442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a529ce2-7fb1-418d-aeaa-f7072593e3c6 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:20.928727 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-06e5697d-2c36-4b77-b724-83e34c600a32 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.115923 Aug 06 20:54:20.933531 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 119/201] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Aug 6 20:54:20 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:20.937854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-834888f5-3201-40f5-8097-bedbb87c06b3 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-973394976", "name": "tempest-test_aggregate-1303966835"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:20.944856 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:20.944856 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:20.945874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-834888f5-3201-40f5-8097-bedbb87c06b3 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Generated uuid b18c4c6b-cd55-4c9b-8119-2eb751fd5bdb for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:20.982053 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-834888f5-3201-40f5-8097-bedbb87c06b3 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.051672 Aug 06 20:54:20.984983 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 120/202] 10.222.0.33 () {60 vars in 1165 bytes} [Sat Aug 6 20:54:20 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:21.061274 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8a529ce2-7fb1-418d-aeaa-f7072593e3c6 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 241 microversion: 2.1 time: 0.196992 Aug 06 20:54:21.062381 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 83/203] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:20 2022] POST /compute/v2.1/os-aggregates/6/action => generated 241 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:21.067351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9e34e42e-580e-48d9-ba36-2763cf639397 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Calling method '.version_select at 0x7f729ed7a670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:21.071024 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:21.071024 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:21.090496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e34e42e-580e-48d9-ba36-2763cf639397 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.092091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e34e42e-580e-48d9-ba36-2763cf639397 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.093337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e34e42e-580e-48d9-ba36-2763cf639397 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.115231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e34e42e-580e-48d9-ba36-2763cf639397 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.116233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e34e42e-580e-48d9-ba36-2763cf639397 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.117003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e34e42e-580e-48d9-ba36-2763cf639397 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.191080 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9e34e42e-580e-48d9-ba36-2763cf639397 tempest-HostsAdminTestJSON-1878776006 tempest-HostsAdminTestJSON-1878776006-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 466 microversion: 2.1 time: 0.127389 Aug 06 20:54:21.197539 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 84/204] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Aug 6 20:54:21 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 466 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:21.209404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cbdd46bc-72bb-421c-8b62-eed0a956d0db tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:21.212565 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:21.212565 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:21.219762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3bd2d904-5368-4d9b-8dad-da99d58cb61d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:21.220407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3bd2d904-5368-4d9b-8dad-da99d58cb61d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:21.253129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bd2d904-5368-4d9b-8dad-da99d58cb61d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.253652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bd2d904-5368-4d9b-8dad-da99d58cb61d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.254101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bd2d904-5368-4d9b-8dad-da99d58cb61d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.258580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bd2d904-5368-4d9b-8dad-da99d58cb61d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.262567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bd2d904-5368-4d9b-8dad-da99d58cb61d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.263795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bd2d904-5368-4d9b-8dad-da99d58cb61d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.274634 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cbdd46bc-72bb-421c-8b62-eed0a956d0db tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.071463 Aug 06 20:54:21.275290 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 85/205] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:21 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:21.282888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:21.285163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:21.299983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.301307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.302247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.313634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.321391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.324852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.359237 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] HTTP exception thrown: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Request method failure captured: Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 HTTP/1.1 Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTYVi5AGuDYTyGzq2SS1G019QjMMRLI5VFmNwERwNPkgUnOZ46a5d_Ln0UUOrmEqU7AxEFZPCTwHrzqFKdl5RsTZrbURl7fOGRT1jxxCBJ-BCVu3FnTVVOfapiigFdKRH4bX0vlDgpP41WLfDv0GpCviOASXriWd52K8y-R2jjWE8k Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:21.364968 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0afc603122424da744092d8ac29cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0afc603122424da744092d8ac29cee", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: f5f7743570b2465ea4d4397840485758 Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:21.366219 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '03b3df46-1527-4dfa-bca8-696627205e57'} Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:21.367389 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:21.368435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.371106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Returning 404 to user: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:21.372227 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b3317ea-19d7-48f8-93e4-38e459744994 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 404 len: 111 microversion: 2.1 time: 0.095995 Aug 06 20:54:21.374883 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 86/206] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:21 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:21.389765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-afef4aed-6f83-4f04-8447-646040fcf3f8 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:21.394483 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:21.394483 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:21.405896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afef4aed-6f83-4f04-8447-646040fcf3f8 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.406703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afef4aed-6f83-4f04-8447-646040fcf3f8 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.407953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afef4aed-6f83-4f04-8447-646040fcf3f8 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.455852 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-afef4aed-6f83-4f04-8447-646040fcf3f8 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] HTTP exception thrown: Aggregate 6 already has host nch1-master-1. Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-afef4aed-6f83-4f04-8447-646040fcf3f8 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Request method failure captured: Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 39 Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTWMINfHIwY1TkmQZwoBc0oD5KkRXzYLTvy8tqEKBlitTzTH5-0GZRvAPCDvUI77BmlLn_dnpNTmn_Kf8QEDqD1PzrKJWtMADQHdedjV75SiU4Q6pax_T34r3XsOKZ3lV0dqMHrAI9LlcqqrH8_mhR-x-D0G0LgEY-QXgg0xFhOQCU Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:54:21.462095 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc8895257b064c5dafd5a756473fd31c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7cf7bbbf0c0e4bafb47caa177a0ff6fc Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: {"add_host": {"host": "nch1-master-1"}} Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:21.463600 ncdv-master-1 devstack@n-api.service[142462]: exception: Aggregate 6 already has host nch1-master-1. Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '6', 'body': {'add_host': {'host': 'nch1-master-1'}}} Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result.read() Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:54:21.464542 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch1-master-1-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi session.flush() Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:54:21.466770 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:54:21.468675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:54:21.469993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result.read() Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch1-master-1-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 6, 20, 54, 21, 433822), 'updated_at': None, 'host': 'nch1-master-1', 'aggregate_id': 6}] Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.471180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host nch1-master-1. Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.473953 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host nch1-master-1. Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:21.476342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:21.478698 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host nch1-master-1. Aug 06 20:54:21.478698 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.479776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-afef4aed-6f83-4f04-8447-646040fcf3f8 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Returning 409 to user: Aggregate 6 already has host nch1-master-1. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:21.481841 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-afef4aed-6f83-4f04-8447-646040fcf3f8 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.105687 Aug 06 20:54:21.484347 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 87/207] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:21 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 06 20:54:21.490622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43c61275-bbe8-4b37-a667-90503e316518 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:21.491394 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:21.491394 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:21.494292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:21.502354 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-43c61275-bbe8-4b37-a667-90503e316518 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43c61275-bbe8-4b37-a667-90503e316518 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Request method failure captured: Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTV6q99ZY_2a9ceOIOkAjMXydjnjUEZv1UEEhd8jQQEFbnr_VhjHT_T1d868jdZWX_nMt5GPQiDb8_rYi6YfHIr-4-IYJxwn6I3eG0TX57tIV67fL1tZ2-eIM8Vhrz7PpxMrNur8O9gOqS8IN2txLJ76c0j6yj7gWwEM51OIahutpA Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: ae4c799b4d834fa19b81fedf13f0aa88 Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:54:21.504526 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ae4c799b4d834fa19b81fedf13f0aa88", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: ae4c799b4d834fa19b81fedf13f0aa88 Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AggregatesAdminTestJSON-784884245-project-admin Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 77ba04dfce9247ac9eba07003dd45faf Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AggregatesAdminTestJSON-784884245-project-admin Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: exception: Aggregate 7 could not be found. Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7'} Aug 06 20:54:21.505983 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.507033 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.508533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43c61275-bbe8-4b37-a667-90503e316518 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:21.513235 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-43c61275-bbe8-4b37-a667-90503e316518 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.020800 Aug 06 20:54:21.513235 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 88/208] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 20:54:21 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:54:21.513676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:21.514788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] [instance: 55339407-24b2-4a9c-97db-4ece55de26b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:21.526451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.527056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.527497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.528213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.528672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.529102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.549891 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] HTTP exception thrown: Instance 55339407-24b2-4a9c-97db-4ece55de26b2 could not be found. Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Request method failure captured: Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 HTTP/1.1 Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTda9UHLBp6qVXEGnLboA2Z04ykxeiIzrrkUQfSfk4pDUZ0KGgqJ_rSa4n4XbPifzCxh0efRkkxdsG_OJI7d2bM-bOYCW5_5KE34Zs61MUeW8emJjXE-ZMVZFXo9I-HsIXbYs59-sSbkPZRP78sbcn0li7BAauZZ0eRhoJsS3ct3Js Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 35ffa77d7887486dbb30387455757c32 Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-67973195 Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:21.551737 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/35ffa77d7887486dbb30387455757c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_35ffa77d7887486dbb30387455757c32", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/35ffa77d7887486dbb30387455757c32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/35ffa77d7887486dbb30387455757c32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-67973195 Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 35ffa77d7887486dbb30387455757c32 Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-67973195 Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerDiagnosticsNegativeTest-67973195-project Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 012f20ffe53640a3be67f9d3cff4e28a Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-67973195-project Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 55339407-24b2-4a9c-97db-4ece55de26b2 could not be found. Aug 06 20:54:21.553145 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '55339407-24b2-4a9c-97db-4ece55de26b2'} Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55339407-24b2-4a9c-97db-4ece55de26b2 could not be found. Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:21.553941 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55339407-24b2-4a9c-97db-4ece55de26b2 could not be found. Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55339407-24b2-4a9c-97db-4ece55de26b2 could not be found. Aug 06 20:54:21.555599 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.557023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] Returning 404 to user: Instance 55339407-24b2-4a9c-97db-4ece55de26b2 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:21.557023 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2cdecce8-9632-4a17-b286-222833a5ae47 tempest-ServerDiagnosticsNegativeTest-67973195 tempest-ServerDiagnosticsNegativeTest-67973195-project] 10.222.0.33 "GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2" status: 404 len: 111 microversion: 2.1 time: 0.045091 Aug 06 20:54:21.557023 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 89/209] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:21 2022] GET /compute/v2.1/servers/55339407-24b2-4a9c-97db-4ece55de26b2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:21.559168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c3904952-0a91-4351-825e-fb7f95e2999f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:21.562255 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:21.562255 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:21.571297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3904952-0a91-4351-825e-fb7f95e2999f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:21.571763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3904952-0a91-4351-825e-fb7f95e2999f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:21.572203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3904952-0a91-4351-825e-fb7f95e2999f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:21.603963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:21.864835 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c3904952-0a91-4351-825e-fb7f95e2999f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.309608 Aug 06 20:54:21.882266 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 90/210] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:21 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:21.900324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e39650fa-ddee-4c09-8e0c-dd1b4a9ea354 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:21.901881 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:21.901881 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:21.941336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-e39650fa-ddee-4c09-8e0c-dd1b4a9ea354 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e39650fa-ddee-4c09-8e0c-dd1b4a9ea354 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Request method failure captured: Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTV6q99ZY_2a9ceOIOkAjMXydjnjUEZv1UEEhd8jQQEFbnr_VhjHT_T1d868jdZWX_nMt5GPQiDb8_rYi6YfHIr-4-IYJxwn6I3eG0TX57tIV67fL1tZ2-eIM8Vhrz7PpxMrNur8O9gOqS8IN2txLJ76c0j6yj7gWwEM51OIahutpA Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: ae4c799b4d834fa19b81fedf13f0aa88 Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:54:21.945078 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ae4c799b4d834fa19b81fedf13f0aa88", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae4c799b4d834fa19b81fedf13f0aa88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: ae4c799b4d834fa19b81fedf13f0aa88 Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-784884245 Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AggregatesAdminTestJSON-784884245-project-admin Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 77ba04dfce9247ac9eba07003dd45faf Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AggregatesAdminTestJSON-784884245-project-admin Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: exception: Aggregate 7 could not be found. Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7'} Aug 06 20:54:21.946795 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:21.947474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:21.948474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:21.950734 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:21.950734 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:21.950734 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:21.950734 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 06 20:54:21.950734 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:21.950734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e39650fa-ddee-4c09-8e0c-dd1b4a9ea354 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:21.953192 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e39650fa-ddee-4c09-8e0c-dd1b4a9ea354 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.059074 Aug 06 20:54:21.972420 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 91/211] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:21 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:54:21.972420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-196019926", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:22.060468 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3bd2d904-5368-4d9b-8dad-da99d58cb61d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1614 microversion: 2.1 time: 1.074515 Aug 06 20:54:22.070639 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 121/212] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:20 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1614 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:22.070639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aef7c6ed-be82-4905-a687-d301d8f2860b tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:22.078656 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:22.078656 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:22.098132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:54:22.132853 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aef7c6ed-be82-4905-a687-d301d8f2860b tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.066951 Aug 06 20:54:22.141171 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 122/213] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:22 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:22.147045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-554dd9d2-0749-4925-b3fd-7d68818714f0 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1810787187"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:22.150647 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:22.150647 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:22.153272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-554dd9d2-0749-4925-b3fd-7d68818714f0 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Generated uuid 1f7661c9-422e-45ac-8961-d55263acefba for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:22.189889 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-554dd9d2-0749-4925-b3fd-7d68818714f0 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047152 Aug 06 20:54:22.191681 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 123/214] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:22.198278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:22.199530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:22.209156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:22.210059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:22.210778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:22.213278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:22.214027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:22.214814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:22.537375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3028158d6d2f4b83815b724cd13dcb3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40902914b9a24c9e866171fbbcad74af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:22.537957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] flavor_id is None. Assuming migration. {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 06 20:54:22.544658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 20:54:22.695865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:54:22.698105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:54:22.699141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:54:22.699779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:54:22.700960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:54:22.740329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:22.740874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:22.741339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:22.744575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:22.744575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:22.748144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:22.803433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Getting quotas for project 3f0afc603122424da744092d8ac29cee. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:54:22.818174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Getting quotas for user f5f7743570b2465ea4d4397840485758 and project 3f0afc603122424da744092d8ac29cee. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:54:22.893986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:54:22.898602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:54:22.983017 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a9b6cb4e-d902-4084-9b8c-467415344812 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028019 Aug 06 20:54:22.984364 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 92/215] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:54:22.991259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ad16673-08ce-4a2d-9b6c-4d02bb6213b4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-15834842"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:22.994254 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:22.994254 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:22.995365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.aggregate [None req-5ad16673-08ce-4a2d-9b6c-4d02bb6213b4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Generated uuid 9b8e7446-2e45-4eb7-8256-39d2667250e2 for aggregate {{(pid=142462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:23.026246 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ad16673-08ce-4a2d-9b6c-4d02bb6213b4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.040481 Aug 06 20:54:23.028589 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 93/216] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:22 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:23.035967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-148dbe99-0f39-4c6f-93c4-e33ebd735a41 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:23.036749 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:23.036749 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:23.047124 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-148dbe99-0f39-4c6f-93c4-e33ebd735a41 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.015954 Aug 06 20:54:23.047760 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 94/217] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 20:54:23 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:23.052954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f7d6f07-c3c3-4e18-8352-b85d4916fdeb tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-866935264"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:23.055805 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:23.055805 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:23.056787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.aggregate [None req-6f7d6f07-c3c3-4e18-8352-b85d4916fdeb tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Generated uuid adbf6f18-39e4-43f3-97c0-a5788dada447 for aggregate {{(pid=142462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:23.083236 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f7d6f07-c3c3-4e18-8352-b85d4916fdeb tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.034264 Aug 06 20:54:23.084217 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 95/218] 10.222.0.33 () {62 vars in 1205 bytes} [Sat Aug 6 20:54:23 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:54:23.096445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f024d785-cf18-4ba7-8657-84949e998e88 req-f91afdc9-2354-4e05-b5d7-312ea4e583a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55339407-24b2-4a9c-97db-4ece55de26b2", "name": "network-vif-deleted", "tag": "5e176929-6529-4a00-a589-1fd274ae481c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:23.114048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f024d785-cf18-4ba7-8657-84949e998e88 req-f91afdc9-2354-4e05-b5d7-312ea4e583a6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:23.114844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f024d785-cf18-4ba7-8657-84949e998e88 req-f91afdc9-2354-4e05-b5d7-312ea4e583a6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:23.116327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f024d785-cf18-4ba7-8657-84949e998e88 req-f91afdc9-2354-4e05-b5d7-312ea4e583a6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:23.133943 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f024d785-cf18-4ba7-8657-84949e998e88 req-f91afdc9-2354-4e05-b5d7-312ea4e583a6 service nova] Creating event network-vif-deleted:5e176929-6529-4a00-a589-1fd274ae481c for instance 55339407-24b2-4a9c-97db-4ece55de26b2 on nch2-master-1 Aug 06 20:54:23.145336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f024d785-cf18-4ba7-8657-84949e998e88 req-f91afdc9-2354-4e05-b5d7-312ea4e583a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059602 Aug 06 20:54:23.145960 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 96/219] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:23.151191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8468b308-978c-486a-adb5-86840caa0617 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:23.152355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8468b308-978c-486a-adb5-86840caa0617 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:23.242400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8468b308-978c-486a-adb5-86840caa0617 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:23.254430 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8468b308-978c-486a-adb5-86840caa0617 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1219 microversion: 2.1 time: 0.107235 Aug 06 20:54:23.258796 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 97/220] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:23 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:23.475143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:23.518671 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-efde7e93-7863-4b8f-9fcb-bc8222503c7b tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e/action" status: 202 len: 0 microversion: 2.1 time: 1.324176 Aug 06 20:54:23.521982 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 124/221] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:54:22 2022] POST /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e/action => generated 0 bytes in 1329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:23.532538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aca85ff5-88f3-4962-a7ca-8a0c37e07898 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:23.557365 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:23.557365 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:23.619160 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aca85ff5-88f3-4962-a7ca-8a0c37e07898 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.091579 Aug 06 20:54:23.620419 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 125/222] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:23 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:23.628339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e9c4388e-3d81-4480-a3ac-6769424d0673 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1798743308"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:23.841821 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:23.841821 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:23.908871 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e9c4388e-3d81-4480-a3ac-6769424d0673 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.287195 Aug 06 20:54:23.910992 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 126/223] 10.222.0.33 () {62 vars in 1213 bytes} [Sat Aug 6 20:54:23 2022] PUT /compute/v2.1/os-aggregates/10 => generated 300 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:54:23.942082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:23.948291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:23.967055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:23.969408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:23.969863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:23.974804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:23.976656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:23.979174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:24.047475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95a9bc4c-8464-4520-bd03-9db201406d04 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:24.051328 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.051328 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:24.057579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95a9bc4c-8464-4520-bd03-9db201406d04 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c2fe3cd1577a42d3907c4d62ddb79833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9378dadc4e7a44d38180c953f18f80bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95a9bc4c-8464-4520-bd03-9db201406d04 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Request method failure captured: Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 39 Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTTi1aC7d19zJBaRjs2HJEjkW0aqxAgSXKg4s-TASLdUmeonAStHCQELP4stURh6bjCIknE1Y3qksFA40ZacjTQkecsmw04qkFA8FwPMhxQKqUcmfLDa2lfNhro4DKgea992oFWWKzoTrUwkjPXIxPs6q0htI4KfDCPA8rKN6LGZrw Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:24.070270 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9378dadc4e7a44d38180c953f18f80bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: c2fe3cd1577a42d3907c4d62ddb79833 Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: {"add_host": {"host": "nch1-master-1"}} Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:24.071519 ncdv-master-1 devstack@n-api.service[142462]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '9', 'body': {'add_host': {'host': 'nch1-master-1'}}} Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:24.072366 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 06 20:54:24.073448 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:24.074482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95a9bc4c-8464-4520-bd03-9db201406d04 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:24.077436 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-95a9bc4c-8464-4520-bd03-9db201406d04 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.816860 Aug 06 20:54:24.093435 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 98/224] 10.222.0.33 () {60 vars in 1191 bytes} [Sat Aug 6 20:54:23 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 835 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:24.098707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3d7676d4-4e76-429b-9205-7d16f9c68ccf tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:24.102947 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.102947 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:24.126617 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3d7676d4-4e76-429b-9205-7d16f9c68ccf tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.031430 Aug 06 20:54:24.129433 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 99/225] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 20:54:24 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:24.140151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bc0e630e-10ff-4fd1-80c6-aaeda81a3420 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:24.144300 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.144300 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:24.159746 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bc0e630e-10ff-4fd1-80c6-aaeda81a3420 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.028923 Aug 06 20:54:24.164274 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 100/226] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Aug 6 20:54:24 2022] GET /compute/v2.1/os-aggregates/10 => generated 300 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:54:24.169218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-345c4e12-8f5d-45f8-bbae-e3b1d9020859 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:24.175610 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.175610 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:24.224524 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-345c4e12-8f5d-45f8-bbae-e3b1d9020859 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.058951 Aug 06 20:54:24.228435 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 101/227] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:24 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:24.241694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-97d513dc-fa5b-4802-973d-0ca28fa5d462 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:24.242894 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.242894 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:24.297082 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-97d513dc-fa5b-4802-973d-0ca28fa5d462 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.067233 Aug 06 20:54:24.302752 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 102/228] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:24 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:24.307968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8919b336-d65a-475e-af6c-7db317c85374 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:24.311831 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.311831 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:24.320620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8919b336-d65a-475e-af6c-7db317c85374 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:24.321432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8919b336-d65a-475e-af6c-7db317c85374 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:24.322111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8919b336-d65a-475e-af6c-7db317c85374 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:24.505180 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8919b336-d65a-475e-af6c-7db317c85374 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 315 microversion: 2.41 time: 0.200740 Aug 06 20:54:24.506271 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 103/229] 10.222.0.33 () {62 vars in 1235 bytes} [Sat Aug 6 20:54:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:54:24.510974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-02806ec3-4ee4-402a-b669-ac861b1a4dc0 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1828445297"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:24.522261 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.522261 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:24.523323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.aggregate [None req-02806ec3-4ee4-402a-b669-ac861b1a4dc0 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Generated uuid 74eef5a6-4594-4060-ac1e-bdfae85bbb37 for aggregate {{(pid=142462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:24.604274 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-02806ec3-4ee4-402a-b669-ac861b1a4dc0 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.085716 Aug 06 20:54:24.607154 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 104/230] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:24 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:24.618788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:24.619364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:24.647988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:24.648494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:24.648900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:24.649615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:24.650067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:24.650698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:24.715693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:24.725754 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-233d2323-0875-438b-b853-f91b604507cd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1472 microversion: 2.1 time: 0.813176 Aug 06 20:54:24.727496 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 127/231] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:23 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1472 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:24.733599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-610c5d9f-4e55-4707-a3cb-dcd065328bec tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1793357208", "availability_zone": "tempest-test_az-221569364"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:24.736859 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.736859 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:24.740645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-610c5d9f-4e55-4707-a3cb-dcd065328bec tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Generated uuid a35b93c9-d4f3-44b5-a73b-e88ede74578c for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:24.762888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=6,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:24.803558 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-610c5d9f-4e55-4707-a3cb-dcd065328bec tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.072759 Aug 06 20:54:24.806227 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 128/232] 10.222.0.33 () {60 vars in 1165 bytes} [Sat Aug 6 20:54:24 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:24.820598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d33dba0-f183-4d77-8fc9-91aaf89f9ab6 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:24.833342 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.833342 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:24.854307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d33dba0-f183-4d77-8fc9-91aaf89f9ab6 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:24.860402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d33dba0-f183-4d77-8fc9-91aaf89f9ab6 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:24.863052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d33dba0-f183-4d77-8fc9-91aaf89f9ab6 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:24.890140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:24.918117 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-148f2a1b-ffbc-4666-b63d-798e531c779c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1271 microversion: 2.1 time: 0.295445 Aug 06 20:54:24.921302 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 105/233] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:24 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:24.948690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-277598928"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:24.952802 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:24.952802 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:24.976416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:24.978842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:24.979873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:25.002932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:25.004697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:25.005811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:25.027502 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-277598928 could not be found. Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Request method failure captured: Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 57 Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTWMINfHIwY1TkmQZwoBc0oD5KkRXzYLTvy8tqEKBlitTzTH5-0GZRvAPCDvUI77BmlLn_dnpNTmn_Kf8QEDqD1PzrKJWtMADQHdedjV75SiU4Q6pax_T34r3XsOKZ3lV0dqMHrAI9LlcqqrH8_mhR-x-D0G0LgEY-QXgg0xFhOQCU Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:54:25.035417 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc8895257b064c5dafd5a756473fd31c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7cf7bbbf0c0e4bafb47caa177a0ff6fc Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: {"add_host": {"host": "tempest-nonexist_host-277598928"}} Aug 06 20:54:25.036876 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: exception: Compute host tempest-nonexist_host-277598928 could not be found. Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-277598928'}}} Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-277598928' is not mapped to any cell Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.037521 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 06 20:54:25.038678 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-277598928 could not be found. Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-277598928 could not be found. Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.039716 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.040874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.040874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.040874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.040874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:25.040874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:25.040874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-277598928 could not be found. Aug 06 20:54:25.040874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.040874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-277598928 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:25.040874 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28a1f343-b9fc-4c1b-9a47-307e6ab73aa4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.104573 Aug 06 20:54:25.047366 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 106/234] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Aug 6 20:54:24 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:25.084650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a3fdb939-01de-494c-8789-074e6ed643c9 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1793357208_new", "availability_zone": "tempest-test_az-221569364_new"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:25.097120 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d33dba0-f183-4d77-8fc9-91aaf89f9ab6 tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 300 microversion: 2.41 time: 0.289511 Aug 06 20:54:25.102166 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 129/235] 10.222.0.33 () {62 vars in 1235 bytes} [Sat Aug 6 20:54:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:54:25.115706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bb45cd49-f500-4892-8fdb-9dfb2ec7d375 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.116503 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.116503 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:25.175954 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bb45cd49-f500-4892-8fdb-9dfb2ec7d375 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.070883 Aug 06 20:54:25.195614 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 130/236] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:25 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:25.216568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-61dbce05-e65e-4465-b504-18ff7040f67d tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.218360 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.218360 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:25.292954 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-61dbce05-e65e-4465-b504-18ff7040f67d tempest-AggregatesAdminTestV241-208980143 tempest-AggregatesAdminTestV241-208980143-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.41 time: 0.085350 Aug 06 20:54:25.305950 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 131/237] 10.222.0.33 () {60 vars in 1196 bytes} [Sat Aug 6 20:54:25 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:25.317965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-56896802-1c03-43b7-b1fd-69dc5b630a1f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-56896802-1c03-43b7-b1fd-69dc5b630a1f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Request method failure captured: Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 283 Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTWMINfHIwY1TkmQZwoBc0oD5KkRXzYLTvy8tqEKBlitTzTH5-0GZRvAPCDvUI77BmlLn_dnpNTmn_Kf8QEDqD1PzrKJWtMADQHdedjV75SiU4Q6pax_T34r3XsOKZ3lV0dqMHrAI9LlcqqrH8_mhR-x-D0G0LgEY-QXgg0xFhOQCU Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:25.332353 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc8895257b064c5dafd5a756473fd31c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7cf7bbbf0c0e4bafb47caa177a0ff6fc Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:25.333897 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:54:25.334580 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:25.335258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.336442 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.337665 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:54:25.337665 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:54:25.337665 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 20:54:25.337665 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.338082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-56896802-1c03-43b7-b1fd-69dc5b630a1f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:25.341062 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-56896802-1c03-43b7-b1fd-69dc5b630a1f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.032643 Aug 06 20:54:25.347670 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 132/238] 10.222.0.33 () {60 vars in 1165 bytes} [Sat Aug 6 20:54:25 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:54:25.356058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b8869c0a-c5ed-4b6d-b1f4-e2fe853643d1 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b8869c0a-c5ed-4b6d-b1f4-e2fe853643d1 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Request method failure captured: Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 27 Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTWMINfHIwY1TkmQZwoBc0oD5KkRXzYLTvy8tqEKBlitTzTH5-0GZRvAPCDvUI77BmlLn_dnpNTmn_Kf8QEDqD1PzrKJWtMADQHdedjV75SiU4Q6pax_T34r3XsOKZ3lV0dqMHrAI9LlcqqrH8_mhR-x-D0G0LgEY-QXgg0xFhOQCU Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:25.368777 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc8895257b064c5dafd5a756473fd31c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7cf7bbbf0c0e4bafb47caa177a0ff6fc Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: {"aggregate": {"name": ""}} Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:25.370153 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi '' Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:25.371050 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 06 20:54:25.372643 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.376013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b8869c0a-c5ed-4b6d-b1f4-e2fe853643d1 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:25.376990 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b8869c0a-c5ed-4b6d-b1f4-e2fe853643d1 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.028068 Aug 06 20:54:25.383315 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 133/239] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:25 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:54:25.388363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-369f7c2d-a274-45ab-9235-4c20a417176c tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1498396723"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:25.391291 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.391291 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:25.398604 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.398604 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:25.399796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-369f7c2d-a274-45ab-9235-4c20a417176c tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c2fe3cd1577a42d3907c4d62ddb79833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9378dadc4e7a44d38180c953f18f80bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-369f7c2d-a274-45ab-9235-4c20a417176c tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Request method failure captured: Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 60 Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTTi1aC7d19zJBaRjs2HJEjkW0aqxAgSXKg4s-TASLdUmeonAStHCQELP4stURh6bjCIknE1Y3qksFA40ZacjTQkecsmw04qkFA8FwPMhxQKqUcmfLDa2lfNhro4DKgea992oFWWKzoTrUwkjPXIxPs6q0htI4KfDCPA8rKN6LGZrw Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:25.401855 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9378dadc4e7a44d38180c953f18f80bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: c2fe3cd1577a42d3907c4d62ddb79833 Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: {"aggregate": {"name": "tempest-test_aggregate-1498396723"}} Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:25.403167 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1498396723'}}} Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:25.404047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:25.406187 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 06 20:54:25.407404 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.409105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-369f7c2d-a274-45ab-9235-4c20a417176c tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:25.410135 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-369f7c2d-a274-45ab-9235-4c20a417176c tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.025643 Aug 06 20:54:25.410897 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 134/240] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:25 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:25.421408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c96e1827-1c41-40a8-9a61-519c350690ea tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1939655060"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:25.425975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-c96e1827-1c41-40a8-9a61-519c350690ea tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Generated uuid 0155d7dc-3eca-4b26-8e81-c8ccd898ec8c for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:25.484443 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c96e1827-1c41-40a8-9a61-519c350690ea tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066231 Aug 06 20:54:25.485909 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 135/241] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:25.506048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3fdb939-01de-494c-8789-074e6ed643c9 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:25.506839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3fdb939-01de-494c-8789-074e6ed643c9 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:25.507434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3fdb939-01de-494c-8789-074e6ed643c9 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:25.510935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68b1956a-775b-4a65-83ca-5b5d4ccc8133 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1939655060"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:25.517862 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.517862 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:25.530760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-68b1956a-775b-4a65-83ca-5b5d4ccc8133 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Generated uuid defeed58-4f6a-4fb6-b479-e2300ee9b57c for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:25.551797 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-68b1956a-775b-4a65-83ca-5b5d4ccc8133 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1939655060 already exists. Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68b1956a-775b-4a65-83ca-5b5d4ccc8133 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Request method failure captured: Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 60 Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTWMINfHIwY1TkmQZwoBc0oD5KkRXzYLTvy8tqEKBlitTzTH5-0GZRvAPCDvUI77BmlLn_dnpNTmn_Kf8QEDqD1PzrKJWtMADQHdedjV75SiU4Q6pax_T34r3XsOKZ3lV0dqMHrAI9LlcqqrH8_mhR-x-D0G0LgEY-QXgg0xFhOQCU Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:25.557908 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc8895257b064c5dafd5a756473fd31c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7cf7bbbf0c0e4bafb47caa177a0ff6fc Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: {"aggregate": {"name": "tempest-test_aggregate-1939655060"}} Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:25.559167 ncdv-master-1 devstack@n-api.service[142461]: exception: Aggregate tempest-test_aggregate-1939655060 already exists. Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1939655060'}}} Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 06 20:54:25.559883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1939655060 already exists. Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:25.560976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1939655060 already exists. Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1939655060 already exists. Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68b1956a-775b-4a65-83ca-5b5d4ccc8133 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1939655060 already exists. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:25.568216 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-68b1956a-775b-4a65-83ca-5b5d4ccc8133 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.067670 Aug 06 20:54:25.570701 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 136/242] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:25 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:54:25.574667 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a3fdb939-01de-494c-8789-074e6ed643c9 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 335 microversion: 2.1 time: 0.526070 Aug 06 20:54:25.575315 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 107/243] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Aug 6 20:54:25 2022] PUT /compute/v2.1/os-aggregates/12 => generated 335 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:25.591585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34fdd60f-9cdc-4b0a-a6fc-da087fa1160b tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.593592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b38512cb-f1fe-4ab0-a4de-87a6f1988161 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.594588 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.594588 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:25.595597 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.595597 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:25.611524 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b38512cb-f1fe-4ab0-a4de-87a6f1988161 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 553 microversion: 2.1 time: 0.027955 Aug 06 20:54:25.615194 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 108/244] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 20:54:25 2022] GET /compute/v2.1/os-aggregates => generated 553 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:25.630066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e85f5f18-6f0f-4c50-b939-684e7058bdea tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.635504 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.635504 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:25.653766 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-34fdd60f-9cdc-4b0a-a6fc-da087fa1160b tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.081866 Aug 06 20:54:25.663448 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 137/245] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:25 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:25.697801 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e85f5f18-6f0f-4c50-b939-684e7058bdea tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.077798 Aug 06 20:54:25.699135 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 109/246] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:25 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:25.704032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc5c6e05-2465-488a-a645-6374c32b35e4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2079922214"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:25.708915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8d5332ff-0062-4c31-b6ed-61bae6398010 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1936626444"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:25.711757 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.711757 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:25.713002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.aggregate [None req-8d5332ff-0062-4c31-b6ed-61bae6398010 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Generated uuid 064fe3f5-fa1f-4a3b-ac52-ddaf9fe30897 for aggregate {{(pid=142462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:25.715561 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.715561 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:25.716614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-bc5c6e05-2465-488a-a645-6374c32b35e4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Generated uuid 0e98f3f7-382f-450f-8ce7-690dbf3d99c7 for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:25.755464 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8d5332ff-0062-4c31-b6ed-61bae6398010 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050141 Aug 06 20:54:25.756587 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 110/247] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:25.761363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.773375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:25.775527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=7,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:25.783015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:25.783523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:25.783965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:25.784862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:25.788835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:25.789489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:25.820370 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc5c6e05-2465-488a-a645-6374c32b35e4 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.135247 Aug 06 20:54:25.820765 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 138/248] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:25.833523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc0d6536-8c8a-4908-93b0-e6983b7b6daf tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.834376 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.834376 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:25.865043 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc0d6536-8c8a-4908-93b0-e6983b7b6daf tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.036222 Aug 06 20:54:25.865647 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 139/249] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 20:54:25 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:25.872136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e4ded1a-0b57-494b-af1b-4523a5a50b2b tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.873059 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.873059 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:25.874107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8e4ded1a-0b57-494b-af1b-4523a5a50b2b tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c2fe3cd1577a42d3907c4d62ddb79833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9378dadc4e7a44d38180c953f18f80bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e4ded1a-0b57-494b-af1b-4523a5a50b2b tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Request method failure captured: Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTTi1aC7d19zJBaRjs2HJEjkW0aqxAgSXKg4s-TASLdUmeonAStHCQELP4stURh6bjCIknE1Y3qksFA40ZacjTQkecsmw04qkFA8FwPMhxQKqUcmfLDa2lfNhro4DKgea992oFWWKzoTrUwkjPXIxPs6q0htI4KfDCPA8rKN6LGZrw Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:25.876340 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9378dadc4e7a44d38180c953f18f80bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: c2fe3cd1577a42d3907c4d62ddb79833 Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 06 20:54:25.877485 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '15'} Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:25.878294 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:25.879317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e4ded1a-0b57-494b-af1b-4523a5a50b2b tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:25.880213 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e4ded1a-0b57-494b-af1b-4523a5a50b2b tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.011349 Aug 06 20:54:25.886367 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 140/250] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:25 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:25.891899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5585c5c8-47d9-48d5-9d52-fd0ade580a43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.926107 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5585c5c8-47d9-48d5-9d52-fd0ade580a43 tempest-AggregatesAdminTestJSON-784884245 tempest-AggregatesAdminTestJSON-784884245-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.036268 Aug 06 20:54:25.928187 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 141/251] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:25 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:25.945912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3bb7d7d-b898-46f1-96b9-f61b49182b5f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:25.950865 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:25.950865 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:25.995767 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3bb7d7d-b898-46f1-96b9-f61b49182b5f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.066091 Aug 06 20:54:26.000409 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 142/252] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:25 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:26.010968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:26.013882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:26.033998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:26.035292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:26.037145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:26.039193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:26.040362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:26.041600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:26.097233 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] HTTP exception thrown: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Request method failure captured: Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 HTTP/1.1 Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTTg2P1BpF8MeBvoM7s38OCBbMVUWq4wL5gAbx2ymMc-FHwRxR0L1O9tfePFcZrh1bQznd6f8yuevtmLx-J4Jqpc_HghDaELYheL03q9drY9TwBKV4a2o0dzo7q-kcHnB2IhGz-F5Mr1sPScLGqOER854h140UF6fHZ-EPUSvEAE-k Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: e95c49afa6f7467fb74adef67a9b4910 Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminTestJSON-440792274 Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:26.105583 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e95c49afa6f7467fb74adef67a9b4910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e95c49afa6f7467fb74adef67a9b4910", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e95c49afa6f7467fb74adef67a9b4910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e95c49afa6f7467fb74adef67a9b4910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminTestJSON-440792274 Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: e95c49afa6f7467fb74adef67a9b4910 Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-440792274 Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminTestJSON-440792274-project Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 07d2a43d97f242e5a725eb5e12ba1cc2 Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminTestJSON-440792274-project Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.107149 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '342b8e9c-dd9d-4311-a62e-1eae78811008'} Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:26.107934 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.109160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.110437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Returning 404 to user: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:26.110437 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53b25b91-600b-4c44-a78e-3b5ffd2793f8 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "DELETE /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 404 len: 111 microversion: 2.1 time: 0.106888 Aug 06 20:54:26.117401 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 143/253] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:54:26 2022] DELETE /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:26.145704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:26.153104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:26.179413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:26.180752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:26.181853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:26.184942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:26.186017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:26.189218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:26.260967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:26.273421 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2425795f-0365-4335-a780-3de67c0df660 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1472 microversion: 2.1 time: 0.515679 Aug 06 20:54:26.291526 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 111/254] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:25 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1472 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:26.305491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4e58ffc-0265-4fe0-9514-b3beb698ee1f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:26.308795 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:26.308795 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:26.335684 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-f4e58ffc-0265-4fe0-9514-b3beb698ee1f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4e58ffc-0265-4fe0-9514-b3beb698ee1f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Request method failure captured: Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTWMINfHIwY1TkmQZwoBc0oD5KkRXzYLTvy8tqEKBlitTzTH5-0GZRvAPCDvUI77BmlLn_dnpNTmn_Kf8QEDqD1PzrKJWtMADQHdedjV75SiU4Q6pax_T34r3XsOKZ3lV0dqMHrAI9LlcqqrH8_mhR-x-D0G0LgEY-QXgg0xFhOQCU Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:54:26.337961 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc8895257b064c5dafd5a756473fd31c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7cf7bbbf0c0e4bafb47caa177a0ff6fc Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: exception: Aggregate -1 could not be found. Aug 06 20:54:26.339142 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '-1'} Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 06 20:54:26.339925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.340910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.342814 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.342814 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.342814 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:26.342814 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:26.342814 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 06 20:54:26.342814 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.344213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4e58ffc-0265-4fe0-9514-b3beb698ee1f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:26.345204 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f4e58ffc-0265-4fe0-9514-b3beb698ee1f tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.050459 Aug 06 20:54:26.347615 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 112/255] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:26 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:54:26.352255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:26.357105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:26.357784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] [instance: 342b8e9c-dd9d-4311-a62e-1eae78811008] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:26.363940 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d4fa2a36-28a7-4a9f-9f7b-2392bf5e4b9b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1277 microversion: 2.1 time: 0.245368 Aug 06 20:54:26.364541 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 144/256] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:26 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:26.379356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e5a49a15-9569-43f6-8540-d5c046587162 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2032018104"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:26.379610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:26.380281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:26.380890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:26.381753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:26.382086 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:26.382086 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:26.382639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:26.383097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-e5a49a15-9569-43f6-8540-d5c046587162 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Generated uuid 4c2b7543-620b-45ed-8624-ffd2760817ef for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:26.383427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:26.434954 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] HTTP exception thrown: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.439676 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e5a49a15-9569-43f6-8540-d5c046587162 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074094 Aug 06 20:54:26.440783 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 145/257] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Request method failure captured: Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 HTTP/1.1 Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTTg2P1BpF8MeBvoM7s38OCBbMVUWq4wL5gAbx2ymMc-FHwRxR0L1O9tfePFcZrh1bQznd6f8yuevtmLx-J4Jqpc_HghDaELYheL03q9drY9TwBKV4a2o0dzo7q-kcHnB2IhGz-F5Mr1sPScLGqOER854h140UF6fHZ-EPUSvEAE-k Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: e95c49afa6f7467fb74adef67a9b4910 Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AggregatesAdminTestJSON-440792274 Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:26.446971 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e95c49afa6f7467fb74adef67a9b4910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e95c49afa6f7467fb74adef67a9b4910", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e95c49afa6f7467fb74adef67a9b4910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e95c49afa6f7467fb74adef67a9b4910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AggregatesAdminTestJSON-440792274 Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: e95c49afa6f7467fb74adef67a9b4910 Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-440792274 Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AggregatesAdminTestJSON-440792274-project Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 07d2a43d97f242e5a725eb5e12ba1cc2 Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AggregatesAdminTestJSON-440792274-project Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.448273 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '342b8e9c-dd9d-4311-a62e-1eae78811008'} Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:26.449091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. Aug 06 20:54:26.450402 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.454293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] Returning 404 to user: Instance 342b8e9c-dd9d-4311-a62e-1eae78811008 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:26.455628 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a643891c-4a7d-44ec-ad23-db58e5320912 tempest-AggregatesAdminTestJSON-440792274 tempest-AggregatesAdminTestJSON-440792274-project] 10.222.0.33 "GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008" status: 404 len: 111 microversion: 2.1 time: 0.106901 Aug 06 20:54:26.457730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-57773810-fd5b-4f6f-8f30-463702bbc979 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:26.458683 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:26.458683 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:26.459767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-57773810-fd5b-4f6f-8f30-463702bbc979 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c2fe3cd1577a42d3907c4d62ddb79833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9378dadc4e7a44d38180c953f18f80bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:26.460303 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 113/258] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:26 2022] GET /compute/v2.1/servers/342b8e9c-dd9d-4311-a62e-1eae78811008 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-57773810-fd5b-4f6f-8f30-463702bbc979 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Request method failure captured: Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTTi1aC7d19zJBaRjs2HJEjkW0aqxAgSXKg4s-TASLdUmeonAStHCQELP4stURh6bjCIknE1Y3qksFA40ZacjTQkecsmw04qkFA8FwPMhxQKqUcmfLDa2lfNhro4DKgea992oFWWKzoTrUwkjPXIxPs6q0htI4KfDCPA8rKN6LGZrw Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:26.461472 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9378dadc4e7a44d38180c953f18f80bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: c2fe3cd1577a42d3907c4d62ddb79833 Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 06 20:54:26.462856 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '16'} Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:26.463533 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.464746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-57773810-fd5b-4f6f-8f30-463702bbc979 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:26.467498 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-57773810-fd5b-4f6f-8f30-463702bbc979 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.009511 Aug 06 20:54:26.467498 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 146/259] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:26 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:26.476600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28a00917-1821-4cb8-8728-9d8446dc66a0 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:26.480349 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:26.480349 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:26.520706 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28a00917-1821-4cb8-8728-9d8446dc66a0 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.046671 Aug 06 20:54:26.525486 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 114/260] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:26 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:26.530639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-62b80e57-3b6c-433b-959f-d020b0ab9b98 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:26.544448 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-62b80e57-3b6c-433b-959f-d020b0ab9b98 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-62b80e57-3b6c-433b-959f-d020b0ab9b98 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Request method failure captured: Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTWMINfHIwY1TkmQZwoBc0oD5KkRXzYLTvy8tqEKBlitTzTH5-0GZRvAPCDvUI77BmlLn_dnpNTmn_Kf8QEDqD1PzrKJWtMADQHdedjV75SiU4Q6pax_T34r3XsOKZ3lV0dqMHrAI9LlcqqrH8_mhR-x-D0G0LgEY-QXgg0xFhOQCU Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:26.546062 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc8895257b064c5dafd5a756473fd31c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7cf7bbbf0c0e4bafb47caa177a0ff6fc Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: exception: Aggregate -1 could not be found. Aug 06 20:54:26.547428 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '-1'} Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.548074 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 06 20:54:26.549359 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.550269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-62b80e57-3b6c-433b-959f-d020b0ab9b98 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:26.550269 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-62b80e57-3b6c-433b-959f-d020b0ab9b98 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021096 Aug 06 20:54:26.552673 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 147/261] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:54:26 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:54:26.564021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b50f3db5-71d6-40b9-bc87-41369a6bb175 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:26.567376 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:26.567376 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:26.570065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b50f3db5-71d6-40b9-bc87-41369a6bb175 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c2fe3cd1577a42d3907c4d62ddb79833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9378dadc4e7a44d38180c953f18f80bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b50f3db5-71d6-40b9-bc87-41369a6bb175 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Request method failure captured: Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTTi1aC7d19zJBaRjs2HJEjkW0aqxAgSXKg4s-TASLdUmeonAStHCQELP4stURh6bjCIknE1Y3qksFA40ZacjTQkecsmw04qkFA8FwPMhxQKqUcmfLDa2lfNhro4DKgea992oFWWKzoTrUwkjPXIxPs6q0htI4KfDCPA8rKN6LGZrw Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:26.574453 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9378dadc4e7a44d38180c953f18f80bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: c2fe3cd1577a42d3907c4d62ddb79833 Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 06 20:54:26.577662 ncdv-master-1 devstack@n-api.service[142462]: action_args: {} Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:26.578385 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 06 20:54:26.579420 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.581706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b50f3db5-71d6-40b9-bc87-41369a6bb175 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:26.583320 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b50f3db5-71d6-40b9-bc87-41369a6bb175 tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.025303 Aug 06 20:54:26.584734 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 115/262] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 20:54:26 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:26.597586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-95dce81a-ecca-47b9-9846-9b4ebaaa8032 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-703555872"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:26.600282 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:26.600282 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:26.601199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-95dce81a-ecca-47b9-9846-9b4ebaaa8032 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Generated uuid 6c1b2bad-dcf1-44a8-89de-5a2283d3baba for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:26.624397 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-95dce81a-ecca-47b9-9846-9b4ebaaa8032 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.032448 Aug 06 20:54:26.625349 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 148/263] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:26.637888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1b79e7a5-4306-4f13-98d1-0eeff407c862 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:26.641071 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:26.641071 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:26.656456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b79e7a5-4306-4f13-98d1-0eeff407c862 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:26.657541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b79e7a5-4306-4f13-98d1-0eeff407c862 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:26.658525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b79e7a5-4306-4f13-98d1-0eeff407c862 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:26.898846 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1b79e7a5-4306-4f13-98d1-0eeff407c862 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.266064 Aug 06 20:54:26.899443 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 116/264] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Aug 6 20:54:26 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:26.912298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1de71ebd-5d1a-4a0c-b946-b848a14660fe tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:26.916302 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:26.916302 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:26.917519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1de71ebd-5d1a-4a0c-b946-b848a14660fe tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c2fe3cd1577a42d3907c4d62ddb79833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9378dadc4e7a44d38180c953f18f80bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1de71ebd-5d1a-4a0c-b946-b848a14660fe tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Request method failure captured: Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 42 Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTTi1aC7d19zJBaRjs2HJEjkW0aqxAgSXKg4s-TASLdUmeonAStHCQELP4stURh6bjCIknE1Y3qksFA40ZacjTQkecsmw04qkFA8FwPMhxQKqUcmfLDa2lfNhro4DKgea992oFWWKzoTrUwkjPXIxPs6q0htI4KfDCPA8rKN6LGZrw Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:26.923024 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9378dadc4e7a44d38180c953f18f80bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9378dadc4e7a44d38180c953f18f80bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 9378dadc4e7a44d38180c953f18f80bd Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562070523 Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: c2fe3cd1577a42d3907c4d62ddb79833 Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562070523-project Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: {"remove_host": {"host": "nch1-master-1"}} Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:26.924739 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch1-master-1'}}} Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:26.925507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 06 20:54:26.927108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:26.929281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1de71ebd-5d1a-4a0c-b946-b848a14660fe tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:26.931451 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1de71ebd-5d1a-4a0c-b946-b848a14660fe tempest-AggregatesAdminNegativeTestJSON-562070523 tempest-AggregatesAdminNegativeTestJSON-562070523-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.023210 Aug 06 20:54:26.934100 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 149/265] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Aug 6 20:54:26 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:26.943254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1dac79e2-f7e4-4827-b1a1-a6162cb6e895 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:26.945974 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:26.945974 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:26.964375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1dac79e2-f7e4-4827-b1a1-a6162cb6e895 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:26.964870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1dac79e2-f7e4-4827-b1a1-a6162cb6e895 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:26.965307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1dac79e2-f7e4-4827-b1a1-a6162cb6e895 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:27.150134 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1dac79e2-f7e4-4827-b1a1-a6162cb6e895 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.211758 Aug 06 20:54:27.151120 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 117/266] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Aug 6 20:54:26 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:27.163831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02136b2f-1b4c-4f93-9a04-a80aeaab7c2a tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:27.164597 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:27.164597 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:27.203591 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02136b2f-1b4c-4f93-9a04-a80aeaab7c2a tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.043876 Aug 06 20:54:27.204179 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 150/267] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:27 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:27.214955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-77a2accc-76c1-492b-985f-4fa9e7dc0a99 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1087565169"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:27.218442 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:27.218442 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:27.221373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.aggregate [None req-77a2accc-76c1-492b-985f-4fa9e7dc0a99 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Generated uuid d874634b-7386-42eb-a386-ce9fd555a311 for aggregate {{(pid=142462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 20:54:27.258901 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-77a2accc-76c1-492b-985f-4fa9e7dc0a99 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048873 Aug 06 20:54:27.259521 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 118/268] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 20:54:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:27.271812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:27.274418 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:27.274418 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:27.299315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:27.299926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:27.305598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:27.306918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:27.308066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:27.312499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:27.316749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:27.317517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:27.322609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:27.328456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:27.329177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:27.337722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:27.345661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:27.346189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:27.385402 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.compute.aggregates [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 06 20:54:27.385936 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Request method failure captured: Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 42 Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTWMINfHIwY1TkmQZwoBc0oD5KkRXzYLTvy8tqEKBlitTzTH5-0GZRvAPCDvUI77BmlLn_dnpNTmn_Kf8QEDqD1PzrKJWtMADQHdedjV75SiU4Q6pax_T34r3XsOKZ3lV0dqMHrAI9LlcqqrH8_mhR-x-D0G0LgEY-QXgg0xFhOQCU Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:27.387913 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc8895257b064c5dafd5a756473fd31c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc8895257b064c5dafd5a756473fd31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cc8895257b064c5dafd5a756473fd31c Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836 Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7cf7bbbf0c0e4bafb47caa177a0ff6fc Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: {"remove_host": {"host": "nonexist_host"}} Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:27.389684 ncdv-master-1 devstack@n-api.service[142461]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 06 20:54:27.390377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 06 20:54:27.392210 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:27.393278 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:27.394378 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:27.394378 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:27.394378 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:27.394378 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:27.394378 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 06 20:54:27.394378 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:27.394378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:27.394378 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-344596ca-3e7a-4a72-83c2-01f8a93444e2 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.122706 Aug 06 20:54:27.394378 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 151/269] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Aug 6 20:54:27 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:54:27.411113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:27.413477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:27.433612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:27.434540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:27.435310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:27.438041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:27.440409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:27.441161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:28.022024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:28.041328 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd6b3d9b-441e-46cf-bdc4-921bffd9f89d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1319 microversion: 2.1 time: 0.646156 Aug 06 20:54:28.042471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 152/270] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:27 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1319 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:28.059908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fd318e07-5fde-4cd4-9fe4-4ecf37a97e22 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:28.060328 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:28.060328 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:28.115084 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fd318e07-5fde-4cd4-9fe4-4ecf37a97e22 tempest-AggregatesAdminNegativeTestJSON-1194595836 tempest-AggregatesAdminNegativeTestJSON-1194595836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.070971 Aug 06 20:54:28.118646 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 153/271] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:28 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 20:54:28.215297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:28.224596 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d179a166-b7e6-47b4-9f2c-885e88f979d9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1472 microversion: 2.1 time: 0.929765 Aug 06 20:54:28.227802 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 119/272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:27 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1472 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:29.070351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:29.072709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:29.083000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:29.083852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:29.085108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:29.087694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:29.089843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:29.091110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:29.256028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:29.257314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:29.268354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:29.271217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:29.271911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:29.272973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:29.274236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:29.276243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:30.156385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:30.169621 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-969087be-ac0d-4187-8938-e3aa109dda46 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1472 microversion: 2.1 time: 0.918427 Aug 06 20:54:30.175471 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 120/273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:29 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1472 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:30.401547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:30.415161 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3be82ab2-eb9e-40ef-9075-8c58e927c31d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1319 microversion: 2.1 time: 1.351640 Aug 06 20:54:30.415775 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 154/274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:29 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1319 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:30.663627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-75580c10-8a5b-4356-a966-af3948ded550 req-7ed449cc-5a94-44ac-b270-4faac61b764e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11e35e0-6750-4625-89cf-e1fdc6a83a4d", "tag": "d1f45c2f-20d0-4589-94e6-20bc56e64b9d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:30.691370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-75580c10-8a5b-4356-a966-af3948ded550 req-7ed449cc-5a94-44ac-b270-4faac61b764e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:30.691900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-75580c10-8a5b-4356-a966-af3948ded550 req-7ed449cc-5a94-44ac-b270-4faac61b764e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:30.692328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-75580c10-8a5b-4356-a966-af3948ded550 req-7ed449cc-5a94-44ac-b270-4faac61b764e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:30.713723 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-75580c10-8a5b-4356-a966-af3948ded550 req-7ed449cc-5a94-44ac-b270-4faac61b764e service nova] Creating event network-changed:d1f45c2f-20d0-4589-94e6-20bc56e64b9d for instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d on nch2-master-1 Aug 06 20:54:30.740435 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-75580c10-8a5b-4356-a966-af3948ded550 req-7ed449cc-5a94-44ac-b270-4faac61b764e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088910 Aug 06 20:54:30.741367 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 155/275] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:30.935864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-556272978", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:31.016919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:54:31.197937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:31.198735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:31.224358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:31.225055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:31.226081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:31.227301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:31.227965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:31.228601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:31.850432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:31.859234 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd7d78cc-179d-44f0-adaa-fe1bd853439e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1472 microversion: 2.1 time: 0.665253 Aug 06 20:54:31.859822 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 156/276] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:31 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1472 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:31.865581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:31.866534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:31.873730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:31.874451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:31.875070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:31.875936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:31.876790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:31.877377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:32.233601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:32.242904 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b74abf63-9d0b-42b1-a194-e45ec035f750 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1319 microversion: 2.1 time: 0.380878 Aug 06 20:54:32.255042 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 157/277] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:31 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:32.317973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:54:32.318986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:54:32.319638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:54:32.320205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:54:32.321096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:54:32.334223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:32.334953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:32.336019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:32.336947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:32.338482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:32.339141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:32.392803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:54:32.405554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:54:32.444458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:54:32.457763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:54:32.653262 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1625a931-42c2-4ee6-be32-f3d393c644bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.026493 Aug 06 20:54:32.662804 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 121/278] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:54:32.669968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01d3a26e-659a-41fe-a36c-cdc98c8c47b4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:32.670908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01d3a26e-659a-41fe-a36c-cdc98c8c47b4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:32.863916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01d3a26e-659a-41fe-a36c-cdc98c8c47b4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:32.873299 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01d3a26e-659a-41fe-a36c-cdc98c8c47b4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1216 microversion: 2.1 time: 0.209007 Aug 06 20:54:32.873891 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 158/279] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:32 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:32.892986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:32.893695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:32.906354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:32.907476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:32.909439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:32.910271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:32.912638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:32.913401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:33.272064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:33.273286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:33.289245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:33.291023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:33.293466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:33.297861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:33.299981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:33.303112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:33.978990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:33.993622 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-57f05905-f333-40ed-8f4f-76a3caf9b3c5 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1319 microversion: 2.1 time: 0.726992 Aug 06 20:54:33.994782 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 159/280] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:33 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1319 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:34.015363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:34.017309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:34.021788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:34.032414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:34.033249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:34.033894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:34.034858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:34.035523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:34.036227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:34.037177 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f840f6a7-1959-44e3-ae28-cb78986c3ed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1472 microversion: 2.1 time: 1.149115 Aug 06 20:54:34.037998 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 122/281] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:32 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1472 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:34.133221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:34.155675 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bca76c6c-0546-4a69-a783-f28036a56bd2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1268 microversion: 2.1 time: 0.159497 Aug 06 20:54:34.160078 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 160/282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:33 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:35.019807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:35.020647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:35.041924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:35.043095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:35.045317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:35.046890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:35.052669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:35.056224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:35.074347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:35.078084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:35.099631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:35.103166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:35.105154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:35.111872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:35.112882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:35.114108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:35.494010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:35.507409 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-685316f4-4150-4659-a3cb-bc695e588b3f tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1319 microversion: 2.1 time: 0.494672 Aug 06 20:54:35.507979 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 123/283] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:35 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:35.522322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:35.526015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:35.543257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:35.546099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:35.546752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:35.552825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:35.554184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:35.556291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:35.745312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:35.757757 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-35605b02-8d2d-4d2b-a165-50a64c46f47b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1477 microversion: 2.1 time: 0.696081 Aug 06 20:54:35.759240 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 161/284] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:35 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1477 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:35.808680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:35.821857 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-20cc69f8-d24a-4240-bfde-6da0ebe9f016 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1274 microversion: 2.1 time: 0.308355 Aug 06 20:54:35.823095 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 124/285] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:35 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1274 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:36.533819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:36.534827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:36.562655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:36.563185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:36.563646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:36.564524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:36.564827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:36.565249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:36.923280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4360f88d-9166-4bd7-94fb-2e55d369615e tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2038909656", "id": 410878388, "os-flavor-access:is_public": "True"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:36.930400 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:36.930400 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:36.974289 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4360f88d-9166-4bd7-94fb-2e55d369615e tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.322500 Aug 06 20:54:36.978643 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 125/286] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:36 2022] POST /compute/v2.1/flavors => generated 427 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:37.000898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a6a0215c-6446-4d64-b5b4-9f47878d1404 req-d69113e6-9eeb-42d7-bef9-61aec8826b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11e35e0-6750-4625-89cf-e1fdc6a83a4d", "name": "network-vif-plugged", "status": "completed", "tag": "d1f45c2f-20d0-4589-94e6-20bc56e64b9d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:37.027947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a6a0215c-6446-4d64-b5b4-9f47878d1404 req-d69113e6-9eeb-42d7-bef9-61aec8826b5b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:37.029447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a6a0215c-6446-4d64-b5b4-9f47878d1404 req-d69113e6-9eeb-42d7-bef9-61aec8826b5b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:37.035013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a6a0215c-6446-4d64-b5b4-9f47878d1404 req-d69113e6-9eeb-42d7-bef9-61aec8826b5b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:37.057599 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a6a0215c-6446-4d64-b5b4-9f47878d1404 req-d69113e6-9eeb-42d7-bef9-61aec8826b5b service nova] Creating event network-vif-plugged:d1f45c2f-20d0-4589-94e6-20bc56e64b9d for instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d on nch2-master-1 Aug 06 20:54:37.074441 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a6a0215c-6446-4d64-b5b4-9f47878d1404 req-d69113e6-9eeb-42d7-bef9-61aec8826b5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094203 Aug 06 20:54:37.075372 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 126/287] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:37.090374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:37.091694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:37.111669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:37.112174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:37.112610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:37.113343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:37.118921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:37.119456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:37.338021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:37.438329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:37.450948 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bfa67f4a-eae3-4163-a8dd-f9c4a596d8a4 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1319 microversion: 2.1 time: 0.922688 Aug 06 20:54:37.451556 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 162/288] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:36 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1319 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:37.478428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:37.479116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:37.482509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=80,nova_api:DELETE=15 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:37.490301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:37.490827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:37.491270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:37.491988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:37.492452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:37.492885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:37.599234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:37.613512 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f5575e2-0ff3-4bb6-b648-ca7c181842ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1477 microversion: 2.1 time: 0.535805 Aug 06 20:54:37.614106 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 127/289] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:37 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1477 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:37.740672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:37.752720 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7f347c23-873f-4f58-ba8e-5c9251113582 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1316 microversion: 2.1 time: 0.287553 Aug 06 20:54:37.753319 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 163/290] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:37 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:37.770092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f8876f89-0e79-4df3-bdc9-c0ae79d4ea06 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:37.771064 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:37.771064 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:37.803598 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f8876f89-0e79-4df3-bdc9-c0ae79d4ea06 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/410878388" status: 202 len: 0 microversion: 2.1 time: 0.047745 Aug 06 20:54:37.807592 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 164/291] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:54:37 2022] DELETE /compute/v2.1/flavors/410878388 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:38.091646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4738ea28-a3b4-45f3-86ad-cf3bab9e7b63 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-311468414", "ram": 512, "vcpus": 1, "disk": 10, "id": 1113958904, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:38.099642 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:38.099642 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:38.127399 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4738ea28-a3b4-45f3-86ad-cf3bab9e7b63 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.511687 Aug 06 20:54:38.129701 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 128/292] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:37 2022] POST /compute/v2.1/flavors => generated 415 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:38.142001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d8b98d2-e892-41f9-8b6d-03a234570655 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:38.196929 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4d8b98d2-e892-41f9-8b6d-03a234570655 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.065554 Aug 06 20:54:38.198854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 129/293] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:38 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:38.260709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf3d2501-7083-4787-9402-3f11c0e383eb tempest-AZAdminNegativeTestJSON-481022447 tempest-AZAdminNegativeTestJSON-481022447-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:38.262090 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:38.262090 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:38.263975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cf3d2501-7083-4787-9402-3f11c0e383eb tempest-AZAdminNegativeTestJSON-481022447 tempest-AZAdminNegativeTestJSON-481022447-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'b5bf47f4cae74970b2919507cf7ccaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce715ea78b24df486930bff86ded06e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf3d2501-7083-4787-9402-3f11c0e383eb tempest-AZAdminNegativeTestJSON-481022447 tempest-AZAdminNegativeTestJSON-481022447-project] Request method failure captured: Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tULbHRDDd0esw5WYZiMylAlZGNwkK04y6HAxg8mX4Z6IhZyskjbYw5xRDFqysZ24WjC0-gk2ZS3kbcL_PWprO54qO9NePl9yH_DzM-phLxCD8xNn7_SVEdedcN_DxCTtWJJYokpsggNnS53M3pRDURDWV0ipDF9lvun82OoS24iL20 Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: bce715ea78b24df486930bff86ded06e Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AZAdminNegativeTestJSON-481022447 Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:38.267573 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bce715ea78b24df486930bff86ded06e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bce715ea78b24df486930bff86ded06e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bce715ea78b24df486930bff86ded06e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bce715ea78b24df486930bff86ded06e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AZAdminNegativeTestJSON-481022447 Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: bce715ea78b24df486930bff86ded06e Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-481022447 Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AZAdminNegativeTestJSON-481022447-project Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: b5bf47f4cae74970b2919507cf7ccaf0 Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AZAdminNegativeTestJSON-481022447-project Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 06 20:54:38.269116 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:38.269959 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.271328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf3d2501-7083-4787-9402-3f11c0e383eb tempest-AZAdminNegativeTestJSON-481022447 tempest-AZAdminNegativeTestJSON-481022447-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:38.272512 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf3d2501-7083-4787-9402-3f11c0e383eb tempest-AZAdminNegativeTestJSON-481022447 tempest-AZAdminNegativeTestJSON-481022447-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.460331 Aug 06 20:54:38.272512 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 165/294] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Aug 6 20:54:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 464 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:38.283684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b52f745-7f78-4f3f-9eb4-afddc4307d4e tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-761885425", "id": 1984601585, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:38.294887 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:38.294887 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:38.339655 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b52f745-7f78-4f3f-9eb4-afddc4307d4e tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.060368 Aug 06 20:54:38.340713 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 166/295] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:38 2022] POST /compute/v2.1/flavors => generated 416 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:38.352880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1cdddea0-53f3-419b-b894-d93549c222e1 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:38.433878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e3c3889c-fc49-447f-873a-b1041b5c94be tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:38.451868 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1cdddea0-53f3-419b-b894-d93549c222e1 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5802 microversion: 2.1 time: 0.099664 Aug 06 20:54:38.453206 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 167/296] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:38 2022] GET /compute/v2.1/flavors/detail => generated 5802 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:38.466808 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-e3c3889c-fc49-447f-873a-b1041b5c94be tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] HTTP exception thrown: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e3c3889c-fc49-447f-873a-b1041b5c94be tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Request method failure captured: Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/flavors/1113958904/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUK3ikaY61AxCeFGPCjJGpbNhENxoF83J-M9aZAjWs9LXt-wcuVLALrfWe7ZlRCOtbqQuBbd48-6F1ZK3yC9yBtxoEEYwsxIkVH5jBu2s1FOOv1ta5qS5GmzN-_07HU2kClmBWJ0hnmee56eXai0sgc2D4VmWwgoGbFWIuC3CVKy0U Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 01e4e5b3804648cbbc3c48b5626a6208 Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:38.477067 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01e4e5b3804648cbbc3c48b5626a6208", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 01e4e5b3804648cbbc3c48b5626a6208 Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 5683a6991a8641bdb4323810e36a639a Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:38.478989 ncdv-master-1 devstack@n-api.service[142462]: exception: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'flavor_id': '1113958904', 'id': 'hw:cpu_thread_policy'} Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:38.479736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.481132 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:38.481132 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:38.481132 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:38.481132 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:38.481132 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:38.481132 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. Aug 06 20:54:38.481132 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.482387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:38.483242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e3c3889c-fc49-447f-873a-b1041b5c94be tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Returning 404 to user: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:38.484267 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e3c3889c-fc49-447f-873a-b1041b5c94be tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] 10.222.0.33 "GET /compute/v2.1/flavors/1113958904/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.282318 Aug 06 20:54:38.484971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:38.493805 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 130/297] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 20:54:38 2022] GET /compute/v2.1/flavors/1113958904/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:38.503724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6729c16e-de06-40e4-982a-3990c76e1ee9 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:38.505089 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:38.505089 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:38.505287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:38.507572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:38.509553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:38.512684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:38.515025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:38.517631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:38.556030 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6729c16e-de06-40e4-982a-3990c76e1ee9 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1984601585" status: 202 len: 0 microversion: 2.1 time: 0.059018 Aug 06 20:54:38.560513 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 131/298] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:54:38 2022] DELETE /compute/v2.1/flavors/1984601585 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:38.581924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0328c1a-a8a3-4cde-8690-0ec42a2aba2a tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:38.588010 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:38.588010 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:38.592359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b0328c1a-a8a3-4cde-8690-0ec42a2aba2a tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '5683a6991a8641bdb4323810e36a639a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e4e5b3804648cbbc3c48b5626a6208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0328c1a-a8a3-4cde-8690-0ec42a2aba2a tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Request method failure captured: Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/flavors/1113958904/os-extra_specs HTTP/1.1 Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 66 Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUK3ikaY61AxCeFGPCjJGpbNhENxoF83J-M9aZAjWs9LXt-wcuVLALrfWe7ZlRCOtbqQuBbd48-6F1ZK3yC9yBtxoEEYwsxIkVH5jBu2s1FOOv1ta5qS5GmzN-_07HU2kClmBWJ0hnmee56eXai0sgc2D4VmWwgoGbFWIuC3CVKy0U Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 01e4e5b3804648cbbc3c48b5626a6208 Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:38.601670 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01e4e5b3804648cbbc3c48b5626a6208", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 01e4e5b3804648cbbc3c48b5626a6208 Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 5683a6991a8641bdb4323810e36a639a Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 06 20:54:38.603577 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'flavor_id': '1113958904', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:38.604257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 06 20:54:38.605532 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:38.613508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0328c1a-a8a3-4cde-8690-0ec42a2aba2a tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:38.620535 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0328c1a-a8a3-4cde-8690-0ec42a2aba2a tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] 10.222.0.33 "POST /compute/v2.1/flavors/1113958904/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.057189 Aug 06 20:54:38.628480 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 132/299] 10.222.0.33 () {60 vars in 1224 bytes} [Sat Aug 6 20:54:38 2022] POST /compute/v2.1/flavors/1113958904/os-extra_specs => generated 124 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:38.644674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3edcecd3-37b0-41c8-8f09-77d597183d4c tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:38.726582 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3edcecd3-37b0-41c8-8f09-77d597183d4c tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.096501 Aug 06 20:54:38.727393 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 133/300] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:38 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:38.737457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-69da0cbd-dc70-4942-b603-5d2c6473978b tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:38.792676 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-69da0cbd-dc70-4942-b603-5d2c6473978b tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1113958904/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063668 Aug 06 20:54:38.794000 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 134/301] 10.222.0.33 () {60 vars in 1224 bytes} [Sat Aug 6 20:54:38 2022] POST /compute/v2.1/flavors/1113958904/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:54:38.813164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:38.814051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:38.838837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:38.839777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:38.840332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:38.843177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:38.843780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:38.844423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:39.129783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:39.143234 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2a907e37-6bd5-4874-aa49-299519b0d7c1 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1319 microversion: 2.1 time: 0.674531 Aug 06 20:54:39.144812 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 168/302] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:38 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1319 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:39.158496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f4bd9c9a-dd96-4513-a320-6eeb27b8e4bd tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-676171214", "id": 1243783829, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:39.166692 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:39.166692 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:39.226203 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f4bd9c9a-dd96-4513-a320-6eeb27b8e4bd tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.079264 Aug 06 20:54:39.234352 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 169/303] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:39 2022] POST /compute/v2.1/flavors => generated 428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:39.241011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.241881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:39.251775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:39.252547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:39.253255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:39.254145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:39.254954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:39.255606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:39.317573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:39.330300 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-469886e8-eeeb-4d35-ab58-61a1328639ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1477 microversion: 2.1 time: 0.534797 Aug 06 20:54:39.331605 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 135/304] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:38 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1477 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:39.342591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6d54775c-e1c4-4efa-a828-2905005058dd tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.344517 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:39.344517 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:39.350450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6d54775c-e1c4-4efa-a828-2905005058dd tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '5683a6991a8641bdb4323810e36a639a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e4e5b3804648cbbc3c48b5626a6208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6d54775c-e1c4-4efa-a828-2905005058dd tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Request method failure captured: Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUK3ikaY61AxCeFGPCjJGpbNhENxoF83J-M9aZAjWs9LXt-wcuVLALrfWe7ZlRCOtbqQuBbd48-6F1ZK3yC9yBtxoEEYwsxIkVH5jBu2s1FOOv1ta5qS5GmzN-_07HU2kClmBWJ0hnmee56eXai0sgc2D4VmWwgoGbFWIuC3CVKy0U Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 01e4e5b3804648cbbc3c48b5626a6208 Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:39.352975 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01e4e5b3804648cbbc3c48b5626a6208", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 01e4e5b3804648cbbc3c48b5626a6208 Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 5683a6991a8641bdb4323810e36a639a Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:39.354216 ncdv-master-1 devstack@n-api.service[142462]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'flavor_id': '1113958904', 'id': 'hw:numa_nodes'} Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:39.354874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 06 20:54:39.355960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.359230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6d54775c-e1c4-4efa-a828-2905005058dd tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:39.360503 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6d54775c-e1c4-4efa-a828-2905005058dd tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] 10.222.0.33 "DELETE /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024899 Aug 06 20:54:39.363409 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 136/305] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 20:54:39 2022] DELETE /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:39.381602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-01c409b2-b3b4-4207-a6c5-c38425f05036 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.385473 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:39.385473 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:39.395873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=6,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:39.463844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:39.482652 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5dd287b-2443-4749-b19c-2c178ae31d15 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1316 microversion: 2.1 time: 0.245708 Aug 06 20:54:39.485554 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-01c409b2-b3b4-4207-a6c5-c38425f05036 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1243783829" status: 202 len: 0 microversion: 2.1 time: 0.115938 Aug 06 20:54:39.486677 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 170/306] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:39 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:39.504376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d442c94d-160d-496f-8d8e-1f46469ba901 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:39.511926 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 137/307] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:54:39 2022] DELETE /compute/v2.1/flavors/1243783829 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:39.518193 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:39.518193 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:39.522511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f9308146-7cee-44ae-9428-536bab9f1df7 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.590432 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d442c94d-160d-496f-8d8e-1f46469ba901 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1113958904/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.101921 Aug 06 20:54:39.597896 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 171/308] 10.222.0.33 () {60 vars in 1224 bytes} [Sat Aug 6 20:54:39 2022] POST /compute/v2.1/flavors/1113958904/os-extra_specs => generated 66 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:54:39.600589 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f9308146-7cee-44ae-9428-536bab9f1df7 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.081524 Aug 06 20:54:39.601993 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 138/309] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:39 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:39.604788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9f43677-16e6-4af7-b8a9-ff882d1f1467 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:39.609008 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:39.609008 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:39.611174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a9f43677-16e6-4af7-b8a9-ff882d1f1467 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '5683a6991a8641bdb4323810e36a639a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e4e5b3804648cbbc3c48b5626a6208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9f43677-16e6-4af7-b8a9-ff882d1f1467 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Request method failure captured: Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 22 Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUK3ikaY61AxCeFGPCjJGpbNhENxoF83J-M9aZAjWs9LXt-wcuVLALrfWe7ZlRCOtbqQuBbd48-6F1ZK3yC9yBtxoEEYwsxIkVH5jBu2s1FOOv1ta5qS5GmzN-_07HU2kClmBWJ0hnmee56eXai0sgc2D4VmWwgoGbFWIuC3CVKy0U Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 01e4e5b3804648cbbc3c48b5626a6208 Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:39.613562 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01e4e5b3804648cbbc3c48b5626a6208", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01e4e5b3804648cbbc3c48b5626a6208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 01e4e5b3804648cbbc3c48b5626a6208 Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 5683a6991a8641bdb4323810e36a639a Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: {"hw:numa_nodes": "1"} Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:39.614976 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'flavor_id': '1113958904', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:54:39.615715 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 06 20:54:39.616749 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.625509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7df976ff-002b-4ca9-9808-0db77d2bed8a tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-941543488", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:39.631157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9f43677-16e6-4af7-b8a9-ff882d1f1467 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:39.632531 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:39.632531 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:39.633236 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9f43677-16e6-4af7-b8a9-ff882d1f1467 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390 tempest-FlavorsExtraSpecsNegativeTestJSON-497919390-project] 10.222.0.33 "PUT /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.033379 Aug 06 20:54:39.642592 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 172/310] 10.222.0.33 () {60 vars in 1265 bytes} [Sat Aug 6 20:54:39 2022] PUT /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:39.659024 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7df976ff-002b-4ca9-9808-0db77d2bed8a tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.038864 Aug 06 20:54:39.659550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e4c5e61-8400-461b-b74c-bf3264c1b602 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.660396 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:39.660396 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:39.660812 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 139/311] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:39 2022] POST /compute/v2.1/flavors => generated 506 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:39.671345 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5e4c5e61-8400-461b-b74c-bf3264c1b602 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] HTTP exception thrown: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e4c5e61-8400-461b-b74c-bf3264c1b602 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Request method failure captured: Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/flavors/1113958904/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUMIhZ1J2jco6d_5ypfQKTeqSXwcik215BfdmCY58PZnct4jTB2CUYcj84TiWgFYmxq22QxulFikchLSV3PW9ogZh2CEtQQnjFTvrqkT7q0l74Q5gQD4YZa9wOXSUKOMpDMa_9AYMS-JIL79nigHmkJ4tfMmDronAqQ0JXGOehSoVo Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7c93a6f252254280940f10102ac1b6e3 Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:39.672765 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c93a6f252254280940f10102ac1b6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c93a6f252254280940f10102ac1b6e3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c93a6f252254280940f10102ac1b6e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c93a6f252254280940f10102ac1b6e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7c93a6f252254280940f10102ac1b6e3 Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a0c67ba464e44b22a289a7946ab3ca05 Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:39.674480 ncdv-master-1 devstack@n-api.service[142461]: exception: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'flavor_id': '1113958904', 'id': 'hw:cpu_thread_policy'} Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:39.675284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e4c5e61-8400-461b-b74c-bf3264c1b602 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Returning 404 to user: Flavor 1113958904 has no extra specs with key hw:cpu_thread_policy. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5e4c5e61-8400-461b-b74c-bf3264c1b602 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1113958904/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.030595 Aug 06 20:54:39.676701 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 173/312] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 20:54:39 2022] DELETE /compute/v2.1/flavors/1113958904/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:39.686446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8aa6b59f-8dc1-4d95-a395-60e19ff3b375 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:39.687437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-264c6cda-72bc-44c0-a20f-b9b8f619897c tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.689932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-8aa6b59f-8dc1-4d95-a395-60e19ff3b375 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8aa6b59f-8dc1-4d95-a395-60e19ff3b375 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Request method failure captured: Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 27 Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUMIhZ1J2jco6d_5ypfQKTeqSXwcik215BfdmCY58PZnct4jTB2CUYcj84TiWgFYmxq22QxulFikchLSV3PW9ogZh2CEtQQnjFTvrqkT7q0l74Q5gQD4YZa9wOXSUKOMpDMa_9AYMS-JIL79nigHmkJ4tfMmDronAqQ0JXGOehSoVo Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7c93a6f252254280940f10102ac1b6e3 Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:39.691290 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c93a6f252254280940f10102ac1b6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c93a6f252254280940f10102ac1b6e3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c93a6f252254280940f10102ac1b6e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c93a6f252254280940f10102ac1b6e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7c93a6f252254280940f10102ac1b6e3 Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a0c67ba464e44b22a289a7946ab3ca05 Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: {"hw:cpu_policy": "shared"} Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:39.692674 ncdv-master-1 devstack@n-api.service[142461]: exception: Request body and URI mismatch Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'flavor_id': '1113958904', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.698943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.700197 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:39.700197 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:39.700197 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 06 20:54:39.700197 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.700197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8aa6b59f-8dc1-4d95-a395-60e19ff3b375 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:39.700197 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8aa6b59f-8dc1-4d95-a395-60e19ff3b375 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010206 Aug 06 20:54:39.700197 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 174/313] 10.222.0.33 () {60 vars in 1265 bytes} [Sat Aug 6 20:54:39 2022] PUT /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes => generated 73 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:39.712317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-295e7fdc-8ae6-4dd7-9955-053b09461d50 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:39.728116 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-264c6cda-72bc-44c0-a20f-b9b8f619897c tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/73664f83-80e6-4d5d-9901-0770a4662d87" status: 202 len: 0 microversion: 2.1 time: 0.056639 Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-295e7fdc-8ae6-4dd7-9955-053b09461d50 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Request method failure captured: Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 49 Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUMIhZ1J2jco6d_5ypfQKTeqSXwcik215BfdmCY58PZnct4jTB2CUYcj84TiWgFYmxq22QxulFikchLSV3PW9ogZh2CEtQQnjFTvrqkT7q0l74Q5gQD4YZa9wOXSUKOMpDMa_9AYMS-JIL79nigHmkJ4tfMmDronAqQ0JXGOehSoVo Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7c93a6f252254280940f10102ac1b6e3 Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:54:39.728451 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c93a6f252254280940f10102ac1b6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c93a6f252254280940f10102ac1b6e3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c93a6f252254280940f10102ac1b6e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c93a6f252254280940f10102ac1b6e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7c93a6f252254280940f10102ac1b6e3 Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a0c67ba464e44b22a289a7946ab3ca05 Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 06 20:54:39.729971 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'flavor_id': '1113958904', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance: Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 06 20:54:39.731260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.733636 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:39.735134 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:39.735134 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:39.735134 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:54:39.735134 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:54:39.735134 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 06 20:54:39.735134 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:39.735134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-295e7fdc-8ae6-4dd7-9955-053b09461d50 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:39.735134 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-295e7fdc-8ae6-4dd7-9955-053b09461d50 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.023597 Aug 06 20:54:39.735679 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 175/314] 10.222.0.33 () {60 vars in 1265 bytes} [Sat Aug 6 20:54:39 2022] PUT /compute/v2.1/flavors/1113958904/os-extra_specs/hw:numa_nodes => generated 117 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:54:39.742879 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 140/315] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:54:39 2022] DELETE /compute/v2.1/flavors/73664f83-80e6-4d5d-9901-0770a4662d87 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:39.744690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6a3cfcd1-f1ad-4c46-b883-f0c44c22a044 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.745225 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:39.745225 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:39.759544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-777df874-ed1e-4097-a8ce-906c77dabd40 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.787699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6a3cfcd1-f1ad-4c46-b883-f0c44c22a044 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1113958904" status: 202 len: 0 microversion: 2.1 time: 0.047027 Aug 06 20:54:39.791240 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 176/316] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:54:39 2022] DELETE /compute/v2.1/flavors/1113958904 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:54:39.815597 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-777df874-ed1e-4097-a8ce-906c77dabd40 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.068675 Aug 06 20:54:39.817548 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 141/317] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:39 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:39.824088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4039cc17-f0ce-46b3-8368-65dda75cbd8a tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.870408 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4039cc17-f0ce-46b3-8368-65dda75cbd8a tempest-FlavorsExtraSpecsNegativeTestJSON-810836747 tempest-FlavorsExtraSpecsNegativeTestJSON-810836747-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050895 Aug 06 20:54:39.882614 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 142/318] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:39.882614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-69366791-d1eb-438c-a66e-63d664be8421 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1662915834", "id": "b576787f-02a9-4b4d-90c6-b3f7b915eb86", "os-flavor-access:is_public": "True"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:39.924430 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-69366791-d1eb-438c-a66e-63d664be8421 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.050479 Aug 06 20:54:39.932029 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 143/319] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:39 2022] POST /compute/v2.1/flavors => generated 507 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:39.940370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-49faebf3-1824-464f-86d7-90970fbc9906 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:39.979781 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-49faebf3-1824-464f-86d7-90970fbc9906 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/b576787f-02a9-4b4d-90c6-b3f7b915eb86" status: 202 len: 0 microversion: 2.1 time: 0.046276 Aug 06 20:54:39.990638 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 144/320] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:54:39 2022] DELETE /compute/v2.1/flavors/b576787f-02a9-4b4d-90c6-b3f7b915eb86 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:40.001005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8dba84ba-a356-4466-92f4-f48139e1887d tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:40.049028 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8dba84ba-a356-4466-92f4-f48139e1887d tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052408 Aug 06 20:54:40.050409 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 145/321] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:40.071912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68d054e3-10a6-44c6-803c-4a17c2faf02f tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-478513152", "id": 1037479669, "os-flavor-access:is_public": "True"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:40.100710 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-68d054e3-10a6-44c6-803c-4a17c2faf02f tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.033218 Aug 06 20:54:40.108875 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 146/322] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:40 2022] POST /compute/v2.1/flavors => generated 413 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:40.113606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1534572303", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0b16c9c9-35af-4398-8cf2-00695211de1f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:40.114738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-47a1c0b4-3370-4cb9-87e5-f23ae25115ce tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:40.125210 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-47a1c0b4-3370-4cb9-87e5-f23ae25115ce tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1037479669" status: 200 len: 413 microversion: 2.1 time: 0.014947 Aug 06 20:54:40.133592 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 147/323] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:54:40 2022] GET /compute/v2.1/flavors/1037479669 => generated 413 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:40.246976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] validate_networks() for [('0b16c9c9-35af-4398-8cf2-00695211de1f', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:54:40.605845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-439294f2-777b-4562-b475-f339387dc967 tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:40.652537 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-439294f2-777b-4562-b475-f339387dc967 tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.517191 Aug 06 20:54:40.679941 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 148/324] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:40 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:40.700760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:40.702243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:40.717548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:40.718437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:40.719059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:40.726236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:40.727775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:40.732538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:41.468878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:54:41.469872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:54:41.470532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:54:41.471130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:54:41.471694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:54:41.501009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:41.503914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:41.504532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:41.507590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:41.508256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:41.508913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:41.636221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:54:41.655442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for user 343f309c07e343b4b15268472d19f10c and project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:54:41.709295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:54:41.723047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:54:41.879798 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0eee9a7c-4487-490f-92aa-b382fa5ef5ad tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.084440 Aug 06 20:54:41.889745 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 177/325] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 20:54:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 20:54:41.918193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:41.940023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:41.970355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:41.970913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:41.971705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:41.982803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:41.983710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:41.985551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:42.049212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:42.061739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7525551-dced-4ad7-8d7e-d008635ad7df tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1469 microversion: 2.1 time: 1.376728 Aug 06 20:54:42.076351 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 149/326] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:40 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1469 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:42.088934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:42.089639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:42.113051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:42.113051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:42.113453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:42.121283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:42.122561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:42.124393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:42.362317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:42.427894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=14 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:42.758796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:42.775408 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-322acd90-9fda-4980-893f-25687bb57bf0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1476 microversion: 2.1 time: 0.872714 Aug 06 20:54:42.798937 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 178/327] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:41 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1476 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:42.808419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7cfdd395-7112-400e-81f6-6fffdb4f01f9 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:42.813910 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:42.813910 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:42.878934 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7cfdd395-7112-400e-81f6-6fffdb4f01f9 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1037479669" status: 202 len: 0 microversion: 2.1 time: 0.077600 Aug 06 20:54:42.885000 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 179/328] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:54:42 2022] DELETE /compute/v2.1/flavors/1037479669 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:42.912416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-9cd16d80-185a-469d-84d5-2519284f8611 req-a1d177b2-871f-4f77-a458-4aa7efdde76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ea4f47-8ba4-49b1-afa0-5b8d50656763", "tag": "71613f4b-7fc6-4bb5-9e51-23c21414dd51"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:42.954437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9cd16d80-185a-469d-84d5-2519284f8611 req-a1d177b2-871f-4f77-a458-4aa7efdde76e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:42.958369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9cd16d80-185a-469d-84d5-2519284f8611 req-a1d177b2-871f-4f77-a458-4aa7efdde76e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:42.959199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9cd16d80-185a-469d-84d5-2519284f8611 req-a1d177b2-871f-4f77-a458-4aa7efdde76e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:42.995102 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-9cd16d80-185a-469d-84d5-2519284f8611 req-a1d177b2-871f-4f77-a458-4aa7efdde76e service nova] Creating event network-changed:71613f4b-7fc6-4bb5-9e51-23c21414dd51 for instance 29ea4f47-8ba4-49b1-afa0-5b8d50656763 on nch1-master-1 Aug 06 20:54:43.018356 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-9cd16d80-185a-469d-84d5-2519284f8611 req-a1d177b2-871f-4f77-a458-4aa7efdde76e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123903 Aug 06 20:54:43.020727 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 180/329] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:43.039195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d529995-3ca3-4a93-9bac-ec81494a9a2a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:43.044947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4d529995-3ca3-4a93-9bac-ec81494a9a2a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:43.169324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d529995-3ca3-4a93-9bac-ec81494a9a2a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:43.183597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d529995-3ca3-4a93-9bac-ec81494a9a2a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:43.192443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d529995-3ca3-4a93-9bac-ec81494a9a2a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:43.193776 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d529995-3ca3-4a93-9bac-ec81494a9a2a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1262 microversion: 2.25 time: 0.171012 Aug 06 20:54:43.214000 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 181/330] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:43 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1262 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:54:43.229034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e068c4ab-b7e1-435f-b94b-b12979de9336 tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:43.234265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e068c4ab-b7e1-435f-b94b-b12979de9336 tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:43.242565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e068c4ab-b7e1-435f-b94b-b12979de9336 tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:43.243399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e068c4ab-b7e1-435f-b94b-b12979de9336 tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:43.244047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e068c4ab-b7e1-435f-b94b-b12979de9336 tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:43.245007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e068c4ab-b7e1-435f-b94b-b12979de9336 tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:43.245664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e068c4ab-b7e1-435f-b94b-b12979de9336 tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:43.246294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e068c4ab-b7e1-435f-b94b-b12979de9336 tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:43.251568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:43.390539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:43.402505 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8e4aa7c-837f-40d2-a569-72d1e5eeaacc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1316 microversion: 2.1 time: 1.324295 Aug 06 20:54:43.408749 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 150/331] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:42 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1316 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:43.422447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f8dac09-6368-46fd-8139-30a92b42aa5e tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:43.439897 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e068c4ab-b7e1-435f-b94b-b12979de9336 tempest-DeleteServersAdminTestJSON-1590628909 tempest-DeleteServersAdminTestJSON-1590628909-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d/action" status: 202 len: 0 microversion: 2.1 time: 0.224485 Aug 06 20:54:43.444166 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 182/332] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:54:43 2022] POST /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:43.456991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0e66bd6d-137a-4e0d-b1d9-d67f61c1b91d req-fee0dfb2-89a9-4dd8-af9a-578c45bb4868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe66499-78a6-4cfe-bb3b-dd0daced441e", "name": "network-vif-unplugged", "status": "completed", "tag": "002e51bc-8957-435b-bb91-05c80cbea7e1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:43.485698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0e66bd6d-137a-4e0d-b1d9-d67f61c1b91d req-fee0dfb2-89a9-4dd8-af9a-578c45bb4868 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:43.489205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0e66bd6d-137a-4e0d-b1d9-d67f61c1b91d req-fee0dfb2-89a9-4dd8-af9a-578c45bb4868 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:43.489813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0e66bd6d-137a-4e0d-b1d9-d67f61c1b91d req-fee0dfb2-89a9-4dd8-af9a-578c45bb4868 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:43.497640 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f8dac09-6368-46fd-8139-30a92b42aa5e tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074453 Aug 06 20:54:43.499114 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 151/333] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:43.506454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:43.508305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:43.515541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:43.516312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:43.516823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:43.517618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:43.518148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:43.518824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:43.524004 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0e66bd6d-137a-4e0d-b1d9-d67f61c1b91d req-fee0dfb2-89a9-4dd8-af9a-578c45bb4868 service nova] Creating event network-vif-unplugged:002e51bc-8957-435b-bb91-05c80cbea7e1 for instance ebe66499-78a6-4cfe-bb3b-dd0daced441e on nch2-master-1 Aug 06 20:54:43.577067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-0e66bd6d-137a-4e0d-b1d9-d67f61c1b91d req-fee0dfb2-89a9-4dd8-af9a-578c45bb4868 service nova] Instance ebe66499-78a6-4cfe-bb3b-dd0daced441e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:54:43.591721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:43.592292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:43.592742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:43.594660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lazy-loading 'fault' on Instance uuid c11e35e0-6750-4625-89cf-e1fdc6a83a4d {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:54:43.611898 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0e66bd6d-137a-4e0d-b1d9-d67f61c1b91d req-fee0dfb2-89a9-4dd8-af9a-578c45bb4868 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160254 Aug 06 20:54:43.612883 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 183/334] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:43.619621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf9a9525-efca-4956-a222-430ec3870f9e tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2059038684", "id": 519402350, "os-flavor-access:is_public": "False"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:43.623172 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:43.623172 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:43.651364 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf9a9525-efca-4956-a222-430ec3870f9e tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.036446 Aug 06 20:54:43.652598 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 184/335] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:43 2022] POST /compute/v2.1/flavors => generated 427 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:43.680751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a5ff588-293d-4306-868d-0595f43ab7ef tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "519402350"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:43.715992 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-4a5ff588-293d-4306-868d-0595f43ab7ef tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] HTTP exception thrown: Flavor 519402350 could not be found. Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a5ff588-293d-4306-868d-0595f43ab7ef tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] Request method failure captured: Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 106 Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUKdFOPpVJT8EX3P0PCQ-Qlmn1nIYDBrACAupFDlg9NPgpNFgzQiI3ELPKZ_JwRvuAotuZd3rtFG91qcw-wx-uHczI2PmbyAKlaL-TXxVU__mkZYGVNw67jk_U0Gy6OX5dAIJj5SH9K4DHT51LDZw_HoJaJMBiNCIRfYB0leBsCRsA Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: c0a3acd485194fe3b0a09906d9b70a8f Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FlavorsAdminTestJSON-548577443 Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:43.723957 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0a3acd485194fe3b0a09906d9b70a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0a3acd485194fe3b0a09906d9b70a8f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0a3acd485194fe3b0a09906d9b70a8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0a3acd485194fe3b0a09906d9b70a8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FlavorsAdminTestJSON-548577443 Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: c0a3acd485194fe3b0a09906d9b70a8f Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-548577443 Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FlavorsAdminTestJSON-548577443-project Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 37fc74ce20894de3a3af50802f384ff0 Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FlavorsAdminTestJSON-548577443-project Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "test", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "519402350"}} Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:43.725497 ncdv-master-1 devstack@n-api.service[142461]: exception: Flavor 519402350 could not be found. Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '519402350'}}} Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 519402350 could not be found. Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:43.726358 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 519402350 could not be found. Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:43.727911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:43.729397 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:43.729397 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:43.729397 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:43.729397 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 519402350 could not be found. Aug 06 20:54:43.729397 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:43.742267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a5ff588-293d-4306-868d-0595f43ab7ef tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] Returning 400 to user: Flavor 519402350 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:43.744495 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a5ff588-293d-4306-868d-0595f43ab7ef tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.075505 Aug 06 20:54:43.752122 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 185/336] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:43 2022] POST /compute/v2.1/servers => generated 80 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:54:43.771688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ecf5fcab-2219-4530-ae98-abe19c58d64b tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:43.773490 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:43.773490 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:43.814459 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ecf5fcab-2219-4530-ae98-abe19c58d64b tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/519402350" status: 202 len: 0 microversion: 2.1 time: 0.057352 Aug 06 20:54:43.815479 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 186/337] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:54:43 2022] DELETE /compute/v2.1/flavors/519402350 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:43.840011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:43.840951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:43.862003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:43.862499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:43.863921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:43.865388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:43.866129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:43.867226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:44.351034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:44.359903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:44.366858 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7fed7037-aa96-45f9-aeca-615d7040a686 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1452 microversion: 2.1 time: 0.866094 Aug 06 20:54:44.393537 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 152/338] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:43 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1452 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:44.405023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-985bc451-55c6-4b89-a290-06f484a30ee3 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:44.471396 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-985bc451-55c6-4b89-a290-06f484a30ee3 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075591 Aug 06 20:54:44.478193 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 153/339] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:44.493191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:44.494050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:44.514735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:44.517819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:44.518277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:44.519038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:44.523932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:44.524722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:44.683455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:44.696211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:44.700403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:44.704343 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3bd580db-6a39-44f8-aa69-b8104af74959 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1320 microversion: 2.25 time: 0.223499 Aug 06 20:54:44.704757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:44.716812 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 154/340] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:44 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:54:44.719403 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12250a86-a2f5-4081-9f7c-287386852b2f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1476 microversion: 2.1 time: 0.902521 Aug 06 20:54:44.723663 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 187/341] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:43 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1476 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:44.737984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:44.740024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:44.741726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:44.742631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:44.750821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:44.751523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:44.752108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:44.753054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:44.753656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:44.754230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:44.757283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:44.758126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:44.760836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:44.769161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:44.769672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:44.772732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:44.786405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:54:44.977587 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-546526ec-6f25-4ac8-b60c-facd6807f0c3 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 204 len: 0 microversion: 2.1 time: 0.249217 Aug 06 20:54:44.979308 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 155/342] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:54:44 2022] DELETE /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:54:44.987777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1896766d-154e-4f7d-baf2-1759044436f3 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-450315879", "id": 1206135793, "os-flavor-access:is_public": "False"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:44.991826 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:44.991826 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:45.021512 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1896766d-154e-4f7d-baf2-1759044436f3 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.039781 Aug 06 20:54:45.024163 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 156/343] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:44 2022] POST /compute/v2.1/flavors => generated 414 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:45.038057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:45.039294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:45.050466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:45.052201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:45.054479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:45.060141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:45.061031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:45.061657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:45.139282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:45.141622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:45.142146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:45.143825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lazy-loading 'fault' on Instance uuid c11e35e0-6750-4625-89cf-e1fdc6a83a4d {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:54:45.221015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:45.230965 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-11a13ae9-3c0d-4513-9d7c-44117cd17ff5 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1316 microversion: 2.1 time: 0.505544 Aug 06 20:54:45.232145 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 188/344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:44 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:45.247725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d0d6275-58a7-4166-9851-eda66bf4ffe5 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1793466753", "id": 323038536, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:45.250425 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:45.250425 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:45.291870 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d0d6275-58a7-4166-9851-eda66bf4ffe5 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.058458 Aug 06 20:54:45.297872 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 189/345] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:45 2022] POST /compute/v2.1/flavors => generated 411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:45.311664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81e5d4e2-3cd4-44a5-9906-eccb39bde536 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:45.345872 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-81e5d4e2-3cd4-44a5-9906-eccb39bde536 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.045843 Aug 06 20:54:45.347761 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 190/346] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Aug 6 20:54:45 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:45.366162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9e065184-b57b-4a2f-a9a6-9fbd0fbe0b2b tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:45.376690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=12,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:45.384447 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9e065184-b57b-4a2f-a9a6-9fbd0fbe0b2b tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.023510 Aug 06 20:54:45.386077 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 191/347] 10.222.0.33 () {58 vars in 1177 bytes} [Sat Aug 6 20:54:45 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:45.405739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-658aa3a5-6425-46d7-a004-7ee16d442d9d tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:45.444279 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-658aa3a5-6425-46d7-a004-7ee16d442d9d tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.049248 Aug 06 20:54:45.445077 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 192/348] 10.222.0.33 () {58 vars in 1171 bytes} [Sat Aug 6 20:54:45 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:54:45.480989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5fabb925-5709-4bda-b8a5-ed159e64e9d4 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:45.515259 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5fabb925-5709-4bda-b8a5-ed159e64e9d4 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.046863 Aug 06 20:54:45.516045 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 193/349] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Aug 6 20:54:45 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:45.529048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f090c74d-6cf1-43c3-949a-5f927d272f8c tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:45.580613 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f090c74d-6cf1-43c3-949a-5f927d272f8c tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.055903 Aug 06 20:54:45.581597 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 194/350] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Aug 6 20:54:45 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:45.601021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-df86e6ec-1ac6-40fb-9281-7a1015acde6f tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:45.654375 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-df86e6ec-1ac6-40fb-9281-7a1015acde6f tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.056978 Aug 06 20:54:45.659856 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 195/351] 10.222.0.33 () {58 vars in 1175 bytes} [Sat Aug 6 20:54:45 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:45.679419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0c827951-215b-4b79-80ed-b2acdc481f97 req-93fe1344-a16b-460e-a670-82d18460c4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebe66499-78a6-4cfe-bb3b-dd0daced441e", "tag": "002e51bc-8957-435b-bb91-05c80cbea7e1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:45.698604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0c827951-215b-4b79-80ed-b2acdc481f97 req-93fe1344-a16b-460e-a670-82d18460c4e5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:45.699311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0c827951-215b-4b79-80ed-b2acdc481f97 req-93fe1344-a16b-460e-a670-82d18460c4e5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:45.700838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0c827951-215b-4b79-80ed-b2acdc481f97 req-93fe1344-a16b-460e-a670-82d18460c4e5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:45.722956 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0c827951-215b-4b79-80ed-b2acdc481f97 req-93fe1344-a16b-460e-a670-82d18460c4e5 service nova] Creating event network-changed:002e51bc-8957-435b-bb91-05c80cbea7e1 for instance ebe66499-78a6-4cfe-bb3b-dd0daced441e on nch2-master-1 Aug 06 20:54:45.732663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-0c827951-215b-4b79-80ed-b2acdc481f97 req-93fe1344-a16b-460e-a670-82d18460c4e5 service nova] Instance ebe66499-78a6-4cfe-bb3b-dd0daced441e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:54:45.751722 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0c827951-215b-4b79-80ed-b2acdc481f97 req-93fe1344-a16b-460e-a670-82d18460c4e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090428 Aug 06 20:54:45.752987 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 196/352] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:45.760644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e1ceaaf-7e1c-4c99-9841-b39a1305fb24 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:45.800257 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e1ceaaf-7e1c-4c99-9841-b39a1305fb24 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.042653 Aug 06 20:54:45.811020 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 197/353] 10.222.0.33 () {58 vars in 1173 bytes} [Sat Aug 6 20:54:45 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:45.823066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:45.824040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:45.832344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:45.833283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:45.833947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:45.834998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:45.835696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:45.836754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:46.087962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:46.102836 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c6361c1a-7f92-4400-b41a-4c6b05e3124b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1458 microversion: 2.1 time: 1.076329 Aug 06 20:54:46.127909 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 157/354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:45 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1458 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:46.141770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:46.144612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:46.153599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:46.154430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:46.155591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:46.157270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:46.158276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:46.159109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:46.563184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:46.576643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:46.578473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:46.579422 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd3b4233-a18c-4300-8ced-05c88ee93664 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1362 microversion: 2.25 time: 0.774949 Aug 06 20:54:46.584000 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 198/355] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:45 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1362 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:54:46.606861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f82bb74-0261-46b5-a7a3-6245cddb0ea5 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:46.639632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f82bb74-0261-46b5-a7a3-6245cddb0ea5 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.040122 Aug 06 20:54:46.653067 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 199/356] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Aug 6 20:54:46 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:46.666941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:46.667858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:46.677406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:46.678168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:46.678862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:46.679825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:46.681114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:46.682241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:46.891100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:46.908083 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c80c4ec3-31fa-4285-90c5-810db6754c0e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1476 microversion: 2.1 time: 0.778905 Aug 06 20:54:46.910105 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 158/357] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:46 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1476 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:46.915816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b164840-be8c-4b23-a18d-e3370b96cabe tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:46.917201 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:46.917201 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:46.959142 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b164840-be8c-4b23-a18d-e3370b96cabe tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/323038536" status: 202 len: 0 microversion: 2.1 time: 0.046467 Aug 06 20:54:46.960568 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 159/358] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:54:46 2022] DELETE /compute/v2.1/flavors/323038536 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:46.973775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fe92d46c-c0a0-48c1-8e49-56f3e619622a tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.005290 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fe92d46c-c0a0-48c1-8e49-56f3e619622a tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038636 Aug 06 20:54:47.007797 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 160/359] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:47.032397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c19288ca-54ae-4bae-ad33-027039f27a0f tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.056719 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c19288ca-54ae-4bae-ad33-027039f27a0f tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1206135793" status: 202 len: 0 microversion: 2.1 time: 0.031055 Aug 06 20:54:47.058625 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 161/360] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:54:47 2022] DELETE /compute/v2.1/flavors/1206135793 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:47.082000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f6c265bd-a3c0-4b35-8c42-a5592a5d854b tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.118714 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f6c265bd-a3c0-4b35-8c42-a5592a5d854b tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053482 Aug 06 20:54:47.129386 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 162/361] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:47.135978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.137094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:47.173531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:47.175364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:47.185366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:47.190107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:47.191762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:47.193052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:47.249002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:47.250005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:47.250005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:47.250587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lazy-loading 'fault' on Instance uuid c11e35e0-6750-4625-89cf-e1fdc6a83a4d {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:54:47.445605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:47.461209 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-82e90ae6-20de-4e36-a8e5-104cc52ef53c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1316 microversion: 2.1 time: 0.798609 Aug 06 20:54:47.469904 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 200/362] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:46 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1316 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:47.506644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-663246e0-1de2-4116-9bf5-08920dd48344 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-607253041", "id": 58691917, "os-flavor-access:is_public": "False"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:47.518703 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:47.518703 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:47.562286 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-663246e0-1de2-4116-9bf5-08920dd48344 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.075630 Aug 06 20:54:47.569277 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 201/363] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:47.587108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:47.588392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-21b081e6-59ca-47fc-bbb6-4224967c0686 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.597397 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bbccc32c-ce7f-44a0-9370-8eb77f2076be tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1458 microversion: 2.1 time: 0.466473 Aug 06 20:54:47.601301 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 163/364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:47 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1458 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:47.618693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.620238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:47.638724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:47.641948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:47.643181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:47.647146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:47.650637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:47.652340 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-21b081e6-59ca-47fc-bbb6-4224967c0686 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079287 Aug 06 20:54:47.652665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:47.654516 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 202/365] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:47.683578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d05343ba-60de-4399-a8a0-527f5d78a473 tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.733738 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d05343ba-60de-4399-a8a0-527f5d78a473 tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054337 Aug 06 20:54:47.738014 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 203/366] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:47.756609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6a3a53e9-0064-4771-bd45-1059f9d061b3 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.757867 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:47.757867 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:47.830355 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6a3a53e9-0064-4771-bd45-1059f9d061b3 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/58691917" status: 202 len: 0 microversion: 2.1 time: 0.075348 Aug 06 20:54:47.840868 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 204/367] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 20:54:47 2022] DELETE /compute/v2.1/flavors/58691917 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:47.869801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0274b7c6-8fe5-4c6e-b8d3-42b3efa8f9cf tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.947819 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0274b7c6-8fe5-4c6e-b8d3-42b3efa8f9cf tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097229 Aug 06 20:54:47.951866 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 205/368] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:47.967021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:47.968464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:47.984550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:47.985306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:47.986159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:47.987195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:47.987804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:47.989207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:48.633777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:48.638068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:48.656353 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0234b8fc-a3bf-45f7-97f4-8bf939b67fc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1474 microversion: 2.1 time: 0.702900 Aug 06 20:54:48.658952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:48.660608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:48.661750 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f8a11c9c-ad9e-4e97-b843-288014c2cdfd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1362 microversion: 2.25 time: 1.053824 Aug 06 20:54:48.668120 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 206/369] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:47 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1474 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:48.674670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-399faf2f-b134-4995-97ca-dd57eae15081 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-332569830", "id": 609812985, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:48.692887 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 164/370] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:47 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1362 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:54:48.702771 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:48.702771 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:48.708160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:48.711506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:48.716186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:DELETE=15,nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:48.733845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:48.734599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:48.739803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:48.742085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:48.743177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:48.743799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:48.744449 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-399faf2f-b134-4995-97ca-dd57eae15081 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.073575 Aug 06 20:54:48.746168 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 207/371] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:48 2022] POST /compute/v2.1/flavors => generated 410 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:48.772809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:48.775121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:48.798665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:48.799667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:48.801408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:48.802828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:48.807635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:48.808425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:48.901798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:48.906601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:48.907432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:48.909763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lazy-loading 'fault' on Instance uuid c11e35e0-6750-4625-89cf-e1fdc6a83a4d {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:54:49.132980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:49.149595 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5a10cd09-ef37-409c-b70e-6a1904a18acb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1316 microversion: 2.1 time: 0.449038 Aug 06 20:54:49.151494 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 165/372] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:48 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:49.166937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f7743570b2465ea4d4397840485758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0afc603122424da744092d8ac29cee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:49.167179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c64bb85-458b-42b4-a112-3c3067661e57 tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:49.185816 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0f24d82b-3d52-44eb-b275-d1b7cabe2952 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 200 len: 1416 microversion: 2.1 time: 0.427227 Aug 06 20:54:49.194519 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 208/373] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:48 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 1416 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:49.219592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-94586a4f-3a65-41fb-b9c9-0f4c40bbc1df req-1b75296b-4f4f-4809-a50e-8984f42c4b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11e35e0-6750-4625-89cf-e1fdc6a83a4d", "name": "network-vif-deleted", "tag": "d1f45c2f-20d0-4589-94e6-20bc56e64b9d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:49.232063 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c64bb85-458b-42b4-a112-3c3067661e57 tempest-FlavorsAdminTestJSON-548577443 tempest-FlavorsAdminTestJSON-548577443-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.069712 Aug 06 20:54:49.232906 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 166/374] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:49 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:49.255856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5abf0cce-cca6-41ea-9b31-de9adf865ca8 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:49.257628 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:49.257628 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:49.265772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-94586a4f-3a65-41fb-b9c9-0f4c40bbc1df req-1b75296b-4f4f-4809-a50e-8984f42c4b0b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:49.266309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-94586a4f-3a65-41fb-b9c9-0f4c40bbc1df req-1b75296b-4f4f-4809-a50e-8984f42c4b0b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:49.267362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-94586a4f-3a65-41fb-b9c9-0f4c40bbc1df req-1b75296b-4f4f-4809-a50e-8984f42c4b0b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:49.300052 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5abf0cce-cca6-41ea-9b31-de9adf865ca8 tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/609812985" status: 202 len: 0 microversion: 2.1 time: 0.047688 Aug 06 20:54:49.301221 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 167/375] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:54:49 2022] DELETE /compute/v2.1/flavors/609812985 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:54:49.311216 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-94586a4f-3a65-41fb-b9c9-0f4c40bbc1df req-1b75296b-4f4f-4809-a50e-8984f42c4b0b service nova] Creating event network-vif-deleted:d1f45c2f-20d0-4589-94e6-20bc56e64b9d for instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d on nch2-master-1 Aug 06 20:54:49.318455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3633bdb7-ebc0-4cb3-a184-569729394c0b tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:49.340896 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-94586a4f-3a65-41fb-b9c9-0f4c40bbc1df req-1b75296b-4f4f-4809-a50e-8984f42c4b0b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139382 Aug 06 20:54:49.343772 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 209/376] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:49.356055 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3633bdb7-ebc0-4cb3-a184-569729394c0b tempest-FlavorsAdminTestJSON-372477278 tempest-FlavorsAdminTestJSON-372477278-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049684 Aug 06 20:54:49.358889 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 168/377] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:54:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:49.688319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:49.689994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:49.691358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:49.694113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:49.713721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:49.714223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:49.714695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:49.715458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:49.721993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:49.722885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:49.723710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:49.725028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:49.725677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:49.726650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:49.729260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:49.729889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:50.315519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:50.334955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:50.341341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:50.346778 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cc571296-8ccd-4edd-89e0-fa1a04a640dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1362 microversion: 2.25 time: 0.664839 Aug 06 20:54:50.361601 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 169/378] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:49 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1362 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:54:50.377381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:50.380674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:50.404813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:50.405370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:50.405820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:50.410519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:50.411287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:50.412566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:50.658310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:50.688837 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-280b9cb7-317d-4880-bba6-aaf940b00739 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1474 microversion: 2.1 time: 1.013151 Aug 06 20:54:50.690076 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 210/379] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:49 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1474 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:50.697448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:50.698602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:50.708535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:50.709584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:50.710235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:50.711656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:50.713227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:50.714023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:50.740251 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] HTTP exception thrown: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Request method failure captured: Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d HTTP/1.1 Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTYVi5AGuDYTyGzq2SS1G019QjMMRLI5VFmNwERwNPkgUnOZ46a5d_Ln0UUOrmEqU7AxEFZPCTwHrzqFKdl5RsTZrbURl7fOGRT1jxxCBJ-BCVu3FnTVVOfapiigFdKRH4bX0vlDgpP41WLfDv0GpCviOASXriWd52K8y-R2jjWE8k Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:50.743272 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0afc603122424da744092d8ac29cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0afc603122424da744092d8ac29cee", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f5f7743570b2465ea4d4397840485758 Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.744471 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'c11e35e0-6750-4625-89cf-e1fdc6a83a4d'} Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:50.745176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.746256 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.750473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Returning 404 to user: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:50.751675 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9a1b670-fba5-483b-b8f6-3e7fac61ff1d tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 404 len: 111 microversion: 2.1 time: 0.059788 Aug 06 20:54:50.752254 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 211/380] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:50 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:50.834350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:50.848154 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d1660f82-181b-4c48-b3ae-66c365dfd47f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1316 microversion: 2.1 time: 0.483608 Aug 06 20:54:50.848774 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 170/381] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:50 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:50.875636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:50.878291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:50.901402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:50.903966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:50.904613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:50.905578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:50.906991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:50.909024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:50.915917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-28e5453c-0579-4e0c-b716-deee95bdf5a1 tempest-FlavorsV255TestJSON-168943434 tempest-FlavorsV255TestJSON-168943434-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1497729387", "id": 1430017418, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:50.920863 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:50.920863 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:50.934489 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] HTTP exception thrown: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Request method failure captured: Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d HTTP/1.1 Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTYVi5AGuDYTyGzq2SS1G019QjMMRLI5VFmNwERwNPkgUnOZ46a5d_Ln0UUOrmEqU7AxEFZPCTwHrzqFKdl5RsTZrbURl7fOGRT1jxxCBJ-BCVu3FnTVVOfapiigFdKRH4bX0vlDgpP41WLfDv0GpCviOASXriWd52K8y-R2jjWE8k Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:54:50.939043 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0afc603122424da744092d8ac29cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0afc603122424da744092d8ac29cee", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: f5f7743570b2465ea4d4397840485758 Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.940410 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'c11e35e0-6750-4625-89cf-e1fdc6a83a4d'} Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:50.941086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.942135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.945446 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-28e5453c-0579-4e0c-b716-deee95bdf5a1 tempest-FlavorsV255TestJSON-168943434 tempest-FlavorsV255TestJSON-168943434-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.187818 Aug 06 20:54:50.946421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Returning 404 to user: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:50.947617 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2bc0ae4f-4ccc-4b1a-8dc1-a348df3d9c10 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 404 len: 111 microversion: 2.1 time: 0.082314 Aug 06 20:54:50.950406 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 171/382] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:54:50 2022] DELETE /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:50.951146 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 212/383] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 20:54:50 2022] POST /compute/v2.1/flavors => generated 449 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:54:50.958217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:50.958924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: c11e35e0-6750-4625-89cf-e1fdc6a83a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:50.967216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:50.967772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:50.968288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:50.968999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:50.969443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:50.969937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:50.990178 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] HTTP exception thrown: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Request method failure captured: Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d HTTP/1.1 Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTYVi5AGuDYTyGzq2SS1G019QjMMRLI5VFmNwERwNPkgUnOZ46a5d_Ln0UUOrmEqU7AxEFZPCTwHrzqFKdl5RsTZrbURl7fOGRT1jxxCBJ-BCVu3FnTVVOfapiigFdKRH4bX0vlDgpP41WLfDv0GpCviOASXriWd52K8y-R2jjWE8k Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:50.992549 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0afc603122424da744092d8ac29cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0afc603122424da744092d8ac29cee", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f5f7743570b2465ea4d4397840485758 Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.993736 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'c11e35e0-6750-4625-89cf-e1fdc6a83a4d'} Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:50.994376 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. Aug 06 20:54:50.995445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:50.997035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Returning 404 to user: Instance c11e35e0-6750-4625-89cf-e1fdc6a83a4d could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:50.997035 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8bdb27c-ad94-489f-8a96-923897359a25 tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d" status: 404 len: 111 microversion: 2.1 time: 0.040206 Aug 06 20:54:50.998283 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 213/384] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:50 2022] GET /compute/v2.1/servers/c11e35e0-6750-4625-89cf-e1fdc6a83a4d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:54:51.009753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:51.010200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:51.024588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:51.025369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:51.025584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:51.026276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:51.026769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:51.027200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:51.057161 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] HTTP exception thrown: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Request method failure captured: Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 HTTP/1.1 Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTYVi5AGuDYTyGzq2SS1G019QjMMRLI5VFmNwERwNPkgUnOZ46a5d_Ln0UUOrmEqU7AxEFZPCTwHrzqFKdl5RsTZrbURl7fOGRT1jxxCBJ-BCVu3FnTVVOfapiigFdKRH4bX0vlDgpP41WLfDv0GpCviOASXriWd52K8y-R2jjWE8k Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:51.058602 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0afc603122424da744092d8ac29cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0afc603122424da744092d8ac29cee", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f5f7743570b2465ea4d4397840485758 Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.060286 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '03b3df46-1527-4dfa-bca8-696627205e57'} Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:51.061554 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.063018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.064438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Returning 404 to user: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:51.064438 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc10e8ff-6150-4b46-a327-3405d91c408c tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 404 len: 111 microversion: 2.1 time: 0.056956 Aug 06 20:54:51.064438 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 214/385] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:54:51 2022] DELETE /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:51.075387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:51.076213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] [instance: 03b3df46-1527-4dfa-bca8-696627205e57] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:51.084834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:51.085694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:51.085807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:51.086466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:51.086969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:51.087555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:51.104159 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] HTTP exception thrown: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Request method failure captured: Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 HTTP/1.1 Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTYVi5AGuDYTyGzq2SS1G019QjMMRLI5VFmNwERwNPkgUnOZ46a5d_Ln0UUOrmEqU7AxEFZPCTwHrzqFKdl5RsTZrbURl7fOGRT1jxxCBJ-BCVu3FnTVVOfapiigFdKRH4bX0vlDgpP41WLfDv0GpCviOASXriWd52K8y-R2jjWE8k Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:54:51.106966 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0afc603122424da744092d8ac29cee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0afc603122424da744092d8ac29cee", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0afc603122424da744092d8ac29cee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 3f0afc603122424da744092d8ac29cee Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-786864963 Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f5f7743570b2465ea4d4397840485758 Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersAdminTestJSON-786864963-project Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.108164 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '03b3df46-1527-4dfa-bca8-696627205e57'} Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:54:51.108818 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. Aug 06 20:54:51.109875 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:54:51.110879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] Returning 404 to user: Instance 03b3df46-1527-4dfa-bca8-696627205e57 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:54:51.110879 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f0986c32-7947-4498-9089-4ccde2127b8b tempest-DeleteServersAdminTestJSON-786864963 tempest-DeleteServersAdminTestJSON-786864963-project] 10.222.0.33 "GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57" status: 404 len: 111 microversion: 2.1 time: 0.040276 Aug 06 20:54:51.112715 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 215/386] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:51 2022] GET /compute/v2.1/servers/03b3df46-1527-4dfa-bca8-696627205e57 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:54:51.162683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb4d1c3f-4b4b-466d-a6e0-a8639dae8734 tempest-FlavorsV255TestJSON-1591740344 tempest-FlavorsV255TestJSON-1591740344-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:51.177491 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb4d1c3f-4b4b-466d-a6e0-a8639dae8734 tempest-FlavorsV255TestJSON-1591740344 tempest-FlavorsV255TestJSON-1591740344-project] 10.222.0.33 "GET /compute/v2.1/flavors/1430017418" status: 200 len: 449 microversion: 2.55 time: 0.225351 Aug 06 20:54:51.179598 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 172/387] 10.222.0.33 () {60 vars in 1199 bytes} [Sat Aug 6 20:54:50 2022] GET /compute/v2.1/flavors/1430017418 => generated 449 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:54:51.192525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab5e3c5e-d545-4ce8-aba6-476f651a0f73 tempest-FlavorsV255TestJSON-168943434 tempest-FlavorsV255TestJSON-168943434-project-admin] Action: 'update', calling method: .version_select at 0x7f72a0a27ca0>, body: {"flavor": {"description": "new"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:51.217133 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:51.217133 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:51.300886 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab5e3c5e-d545-4ce8-aba6-476f651a0f73 tempest-FlavorsV255TestJSON-168943434 tempest-FlavorsV255TestJSON-168943434-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1430017418" status: 200 len: 450 microversion: 2.55 time: 0.105278 Aug 06 20:54:51.303228 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 216/388] 10.222.0.33 () {62 vars in 1219 bytes} [Sat Aug 6 20:54:51 2022] PUT /compute/v2.1/flavors/1430017418 => generated 450 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:54:51.316343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b242c6cc-09e3-496b-860b-26217822bb43 tempest-FlavorsV255TestJSON-1591740344 tempest-FlavorsV255TestJSON-1591740344-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:51.379357 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b242c6cc-09e3-496b-860b-26217822bb43 tempest-FlavorsV255TestJSON-1591740344 tempest-FlavorsV255TestJSON-1591740344-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.066798 Aug 06 20:54:51.383412 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 173/389] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Aug 6 20:54:51 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:54:51.399155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:51.399768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:51.409506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:51.409720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4fba5a6e-d958-41f2-a76f-9ae486e01488 tempest-FlavorsV255TestJSON-1591740344 tempest-FlavorsV255TestJSON-1591740344-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:51.409996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:51.410432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:51.419438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:51.419954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:51.420400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:51.456929 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4fba5a6e-d958-41f2-a76f-9ae486e01488 tempest-FlavorsV255TestJSON-1591740344 tempest-FlavorsV255TestJSON-1591740344-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.049102 Aug 06 20:54:51.459472 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 174/390] 10.222.0.33 () {60 vars in 1166 bytes} [Sat Aug 6 20:54:51 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:54:51.474198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f880f3f1-c4bc-4be7-a11b-bc954d5e0f4e tempest-FlavorsV255TestJSON-168943434 tempest-FlavorsV255TestJSON-168943434-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:51.475375 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:51.475375 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:54:51.509808 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f880f3f1-c4bc-4be7-a11b-bc954d5e0f4e tempest-FlavorsV255TestJSON-168943434 tempest-FlavorsV255TestJSON-168943434-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1430017418" status: 202 len: 0 microversion: 2.55 time: 0.039169 Aug 06 20:54:51.511071 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 175/391] 10.222.0.33 () {60 vars in 1202 bytes} [Sat Aug 6 20:54:51 2022] DELETE /compute/v2.1/flavors/1430017418 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 06 20:54:51.524765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a41b8b7-596e-46e3-a689-fc0e1f5156a2 tempest-FlavorsV255TestJSON-168943434 tempest-FlavorsV255TestJSON-168943434-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:51.561622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:51.589249 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6a41b8b7-596e-46e3-a689-fc0e1f5156a2 tempest-FlavorsV255TestJSON-168943434 tempest-FlavorsV255TestJSON-168943434-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.070980 Aug 06 20:54:51.591460 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 176/392] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Aug 6 20:54:51 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:54:51.622776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-12c7e3b7-27cc-4b41-adc8-c2a46b5973fb req-041bf114-5516-4e74-9991-cebbf9a3f2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf528ca4-80d5-47b1-8e89-0241a0132074", "tag": "060516c4-8983-4018-8d4a-a96568a9617f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:51.647185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-12c7e3b7-27cc-4b41-adc8-c2a46b5973fb req-041bf114-5516-4e74-9991-cebbf9a3f2e7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:51.648398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-12c7e3b7-27cc-4b41-adc8-c2a46b5973fb req-041bf114-5516-4e74-9991-cebbf9a3f2e7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:51.649805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-12c7e3b7-27cc-4b41-adc8-c2a46b5973fb req-041bf114-5516-4e74-9991-cebbf9a3f2e7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:51.694725 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-12c7e3b7-27cc-4b41-adc8-c2a46b5973fb req-041bf114-5516-4e74-9991-cebbf9a3f2e7 service nova] Creating event network-changed:060516c4-8983-4018-8d4a-a96568a9617f for instance cf528ca4-80d5-47b1-8e89-0241a0132074 on nch2-master-1 Aug 06 20:54:51.733777 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-12c7e3b7-27cc-4b41-adc8-c2a46b5973fb req-041bf114-5516-4e74-9991-cebbf9a3f2e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123732 Aug 06 20:54:51.734817 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 177/393] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:51.762735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:51.765463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:51.790510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:51.794289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:51.794963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:51.797746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:51.798820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:51.801151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:52.129674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:52.142665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:52.150771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:52.152034 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee2b0e7a-3f4b-431f-b35f-3be521cb5388 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1362 microversion: 2.25 time: 0.768188 Aug 06 20:54:52.157525 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 217/394] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:51 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1362 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:54:52.162904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:52.169658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:52.191927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:52.192783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:52.193435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:52.194352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:52.195033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:52.195685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:52.352478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:52.363871 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c7c0eb6c-16b0-48c5-a686-0086f70c1654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1471 microversion: 2.1 time: 0.626083 Aug 06 20:54:52.364509 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 178/395] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:51 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1471 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:52.381591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f716cd07-fb96-493a-a4a8-351c085f1f7f req-97f61691-dc26-4ce7-9996-3b73c722d2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ea4f47-8ba4-49b1-afa0-5b8d50656763", "name": "network-vif-plugged", "status": "completed", "tag": "71613f4b-7fc6-4bb5-9e51-23c21414dd51"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:52.403327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f716cd07-fb96-493a-a4a8-351c085f1f7f req-97f61691-dc26-4ce7-9996-3b73c722d2b4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:52.404452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f716cd07-fb96-493a-a4a8-351c085f1f7f req-97f61691-dc26-4ce7-9996-3b73c722d2b4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:52.405154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f716cd07-fb96-493a-a4a8-351c085f1f7f req-97f61691-dc26-4ce7-9996-3b73c722d2b4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:52.457295 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f716cd07-fb96-493a-a4a8-351c085f1f7f req-97f61691-dc26-4ce7-9996-3b73c722d2b4 service nova] Creating event network-vif-plugged:71613f4b-7fc6-4bb5-9e51-23c21414dd51 for instance 29ea4f47-8ba4-49b1-afa0-5b8d50656763 on nch1-master-1 Aug 06 20:54:52.477248 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f716cd07-fb96-493a-a4a8-351c085f1f7f req-97f61691-dc26-4ce7-9996-3b73c722d2b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109896 Aug 06 20:54:52.480543 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 179/396] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:52.491804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-270aae74-e1b0-4237-9063-19db01ba0588 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:52.494483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-270aae74-e1b0-4237-9063-19db01ba0588 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:52.511692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-270aae74-e1b0-4237-9063-19db01ba0588 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:52.513538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-270aae74-e1b0-4237-9063-19db01ba0588 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:52.515709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-270aae74-e1b0-4237-9063-19db01ba0588 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:52.518417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-270aae74-e1b0-4237-9063-19db01ba0588 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:52.520627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-270aae74-e1b0-4237-9063-19db01ba0588 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:52.522792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-270aae74-e1b0-4237-9063-19db01ba0588 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:52.675238 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-270aae74-e1b0-4237-9063-19db01ba0588 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e/action" status: 204 len: 0 microversion: 2.1 time: 0.192778 Aug 06 20:54:52.678824 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 180/397] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:54:52 2022] POST /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e/action => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:54:52.704877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:52.706047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:52.714842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:52.716252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:52.716919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:52.717918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:52.718693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:52.720742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:52.851808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:52.863142 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3c9a71bd-3474-418a-8d89-626d3a4627d3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1316 microversion: 2.1 time: 0.703973 Aug 06 20:54:52.864728 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 218/398] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:52 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1316 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:53.182007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:53.182730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:53.184756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:53.193040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:53.193841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:53.194495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:53.195444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:53.196330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:53.196994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:53.525154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:53.539819 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b6c3f46-f0e1-4390-841b-e41fc8cd0ad8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1471 microversion: 2.1 time: 0.843720 Aug 06 20:54:53.541701 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 181/399] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:52 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1471 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:53.676949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:53.710114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:53.721924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:53.723401 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d88261de-9c5d-45fe-a00c-4391a8f2c2cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1362 microversion: 2.25 time: 0.547391 Aug 06 20:54:53.727833 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 219/400] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:53 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1362 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:54:53.885362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:53.885979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:53.895887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:53.896379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:53.904083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:53.905353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:53.906015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:53.906693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:53.919832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:54.286912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:54.302273 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-10b930af-20d6-4cd2-a6a3-28882360bea2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1316 microversion: 2.1 time: 0.418517 Aug 06 20:54:54.306520 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 182/401] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:53 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:54.566371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:54.567083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:54.580871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:54.583651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:54.584498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:54.587621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:54.588355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:54.588949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:54.750017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:54.750651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:54.757674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:54.760882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:54.761334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:54.766038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:54.766853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:54.767575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:55.162957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:55.179235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:55.224063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:55.229270 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03042ba6-ef21-429b-9cbf-9a0d37325984 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1362 microversion: 2.25 time: 0.480652 Aug 06 20:54:55.252080 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 183/402] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:54 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:54:55.255976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-6deeae0d-5d59-4f9f-b7fe-dc8d1ca47476 req-17386dfe-4750-4fe0-94c2-64188925860a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe66499-78a6-4cfe-bb3b-dd0daced441e", "name": "network-vif-plugged", "status": "completed", "tag": "002e51bc-8957-435b-bb91-05c80cbea7e1"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:55.271855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6deeae0d-5d59-4f9f-b7fe-dc8d1ca47476 req-17386dfe-4750-4fe0-94c2-64188925860a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:55.274601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6deeae0d-5d59-4f9f-b7fe-dc8d1ca47476 req-17386dfe-4750-4fe0-94c2-64188925860a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:55.276959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6deeae0d-5d59-4f9f-b7fe-dc8d1ca47476 req-17386dfe-4750-4fe0-94c2-64188925860a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:55.288167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:55.299336 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9abebf0-e7b3-479c-8bb9-24fc72f802fa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1471 microversion: 2.1 time: 0.737735 Aug 06 20:54:55.306770 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 220/403] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:54 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1471 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:55.332347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:55.333198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:55.337921 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-6deeae0d-5d59-4f9f-b7fe-dc8d1ca47476 req-17386dfe-4750-4fe0-94c2-64188925860a service nova] Creating event network-vif-plugged:002e51bc-8957-435b-bb91-05c80cbea7e1 for instance ebe66499-78a6-4cfe-bb3b-dd0daced441e on nch2-master-1 Aug 06 20:54:55.345944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:55.349825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:55.350572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:55.351884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:55.352559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:55.353642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-6deeae0d-5d59-4f9f-b7fe-dc8d1ca47476 req-17386dfe-4750-4fe0-94c2-64188925860a service nova] Instance ebe66499-78a6-4cfe-bb3b-dd0daced441e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:54:55.354281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:55.365482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:55.381881 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-6deeae0d-5d59-4f9f-b7fe-dc8d1ca47476 req-17386dfe-4750-4fe0-94c2-64188925860a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138747 Aug 06 20:54:55.383900 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 184/404] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:55.934953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:55.955519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a74353ef-d208-4cd2-b4b8-08e30259209c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1466 microversion: 2.1 time: 0.627161 Aug 06 20:54:55.958664 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 221/405] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:55 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1466 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:54:56.260640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:56.261257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:56.303263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:56.303787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:56.304241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:56.305076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:56.305428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:56.305854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:56.689988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-abe9224d-20a0-4170-949d-7e2ea377d80a tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:56.691256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-abe9224d-20a0-4170-949d-7e2ea377d80a tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:56.706712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe9224d-20a0-4170-949d-7e2ea377d80a tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:56.707206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe9224d-20a0-4170-949d-7e2ea377d80a tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:56.712471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe9224d-20a0-4170-949d-7e2ea377d80a tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:56.713249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe9224d-20a0-4170-949d-7e2ea377d80a tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:56.715234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe9224d-20a0-4170-949d-7e2ea377d80a tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:56.717448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe9224d-20a0-4170-949d-7e2ea377d80a tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:56.861892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:56.882872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:56.884767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:56.893113 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fc2ccaa2-edaf-4e6b-b7fb-b60c5586dfa0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1362 microversion: 2.25 time: 0.638181 Aug 06 20:54:56.897584 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 222/406] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:56 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1362 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:54:56.919416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:56.920054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:56.946829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:56.947490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:56.947769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:56.948508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:56.948974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:56.949968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:57.815377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:57.823791 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5844ceeb-402b-4cae-b385-dd72fe9eea14 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1463 microversion: 2.1 time: 0.925073 Aug 06 20:54:57.825108 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 223/407] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:56 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1463 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:57.884101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-db9cd8bd-2e4e-47ae-af10-2fda29bf2f9d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:57.885046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db9cd8bd-2e4e-47ae-af10-2fda29bf2f9d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:57.916856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9cd8bd-2e4e-47ae-af10-2fda29bf2f9d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:57.920320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9cd8bd-2e4e-47ae-af10-2fda29bf2f9d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:57.923379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9cd8bd-2e4e-47ae-af10-2fda29bf2f9d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:57.925690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9cd8bd-2e4e-47ae-af10-2fda29bf2f9d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:57.926432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9cd8bd-2e4e-47ae-af10-2fda29bf2f9d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:57.928703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9cd8bd-2e4e-47ae-af10-2fda29bf2f9d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:58.246015 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-abe9224d-20a0-4170-949d-7e2ea377d80a tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1617 microversion: 2.1 time: 2.272422 Aug 06 20:54:58.265948 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 185/408] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:55 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1617 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:58.285293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:58.287686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:54:58.303038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:58.306073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:58.307142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:58.311983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:58.312847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:58.314834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:58.337509 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-db9cd8bd-2e4e-47ae-af10-2fda29bf2f9d tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1614 microversion: 2.1 time: 0.485210 Aug 06 20:54:58.342933 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 224/409] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:54:57 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1614 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:54:58.357366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7cd9f969-7090-40c4-b959-3cd3153a7216 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Action: 'create', calling method: .version_select at 0x7f729e3973a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1178902815", "policies": ["affinity"]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:58.452675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-7cd9f969-7090-40c4-b959-3cd3153a7216 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:54:58.474889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-7cd9f969-7090-40c4-b959-3cd3153a7216 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:54:58.601467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:54:58.678332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-7cd9f969-7090-40c4-b959-3cd3153a7216 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:54:58.689021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-7cd9f969-7090-40c4-b959-3cd3153a7216 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:54:58.744903 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7cd9f969-7090-40c4-b959-3cd3153a7216 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.402732 Aug 06 20:54:58.751886 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 225/410] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Aug 6 20:54:58 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:58.765366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:58.783419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:58.793288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:54:58.794823 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-77fbb50d-cff9-44b0-89e6-de823e135cd5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1362 microversion: 2.25 time: 0.527369 Aug 06 20:54:58.795440 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 186/411] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:54:58 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:54:58.818172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8738ec97-08fe-4cfd-843f-6d5e9adfa6df tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '.version_select at 0x7f729e3c2dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:54:58.831273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8738ec97-08fe-4cfd-843f-6d5e9adfa6df tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:58.834394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8738ec97-08fe-4cfd-843f-6d5e9adfa6df tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:58.835065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8738ec97-08fe-4cfd-843f-6d5e9adfa6df tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:58.876739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8738ec97-08fe-4cfd-843f-6d5e9adfa6df tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.074396 Aug 06 20:54:58.880991 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 187/412] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 20:54:58 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:58.942753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1971974257", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "82fbbd24-b4e1-4d95-9266-83c4990a1892"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:59.044824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:54:59.307487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a7915973-353a-4194-9bfe-007add1d2ffd tempest-FlavorMetadataValidation-1808851410 tempest-FlavorMetadataValidation-1808851410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1246190084", "id": 459375609, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:59.311046 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:59.311046 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:54:59.358295 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a7915973-353a-4194-9bfe-007add1d2ffd tempest-FlavorMetadataValidation-1808851410 tempest-FlavorMetadataValidation-1808851410-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.604042 Aug 06 20:54:59.362009 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 226/413] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 20:54:58 2022] POST /compute/v2.1/flavors => generated 468 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:54:59.369048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e20f08a7-bd91-4f8a-b03b-999d4a0e4f38 req-07ea8e01-78d1-4d8c-a585-8325ee7f0a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf528ca4-80d5-47b1-8e89-0241a0132074", "name": "network-vif-plugged", "status": "completed", "tag": "060516c4-8983-4018-8d4a-a96568a9617f"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:59.403630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e20f08a7-bd91-4f8a-b03b-999d4a0e4f38 req-07ea8e01-78d1-4d8c-a585-8325ee7f0a4e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:54:59.407104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e20f08a7-bd91-4f8a-b03b-999d4a0e4f38 req-07ea8e01-78d1-4d8c-a585-8325ee7f0a4e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:54:59.407952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e20f08a7-bd91-4f8a-b03b-999d4a0e4f38 req-07ea8e01-78d1-4d8c-a585-8325ee7f0a4e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:54:59.444226 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e20f08a7-bd91-4f8a-b03b-999d4a0e4f38 req-07ea8e01-78d1-4d8c-a585-8325ee7f0a4e service nova] Creating event network-vif-plugged:060516c4-8983-4018-8d4a-a96568a9617f for instance cf528ca4-80d5-47b1-8e89-0241a0132074 on nch2-master-1 Aug 06 20:54:59.460708 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e20f08a7-bd91-4f8a-b03b-999d4a0e4f38 req-07ea8e01-78d1-4d8c-a585-8325ee7f0a4e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097149 Aug 06 20:54:59.465542 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 227/414] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:54:59.487903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb963538-f534-4c9e-82b0-b4a54de6c2a8 tempest-FlavorMetadataValidation-1808851410 tempest-FlavorMetadataValidation-1808851410-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:54:59.499100 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:54:59.499100 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:00.037172 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb963538-f534-4c9e-82b0-b4a54de6c2a8 tempest-FlavorMetadataValidation-1808851410 tempest-FlavorMetadataValidation-1808851410-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/459375609/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.558429 Aug 06 20:55:00.037858 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 228/415] 10.222.0.33 () {62 vars in 1262 bytes} [Sat Aug 6 20:54:59 2022] POST /compute/v2.1/flavors/459375609/os-extra_specs => generated 62 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:00.061578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-294355130", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:00.078367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:00.078872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:00.079289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:00.079692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:00.080100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:00.155426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:00.155920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:00.156363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:00.157099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:00.157561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:00.157988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:00.198572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:55:00.210678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:00.227360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:00.276838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Going to run 2 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:00.305926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:00.454005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=142462) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 06 20:55:00.537902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:00.563959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:00.776290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:00.805353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:00.829376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:00.835747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:00.838772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:00.840724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:00.842068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:00.845226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=c16c7d7a-6a48-4260-b7d1-451b01c03425,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:00.894621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:00.908277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:00.910780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:00.912916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:00.916386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:00.916902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:00.919803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:00.986073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:01.001451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:01.032252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:01.056996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for user 0701f31766dd4eeab9a63f6411c26d6e and project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:01.110721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:01.127407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:01.154642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:01.212526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:01.273023 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fc6d7f1f-c353-4ccb-bdd2-b7a2eed88ed6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224335 Aug 06 20:55:01.283541 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 229/416] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:55:01.326902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:01.332098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:01.362817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:01.368197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:01.369930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:01.377015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:01.377940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:01.381396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:01.432275 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a63b147e-6801-4652-9c18-92f0aa0c49e9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.488623 Aug 06 20:55:01.435669 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 188/417] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:54:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 2498 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 06 20:55:01.460449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-47ab6722-91ac-490f-84d1-13c0dd866f90 tempest-FlavorMetadataValidation-1808851410 tempest-FlavorMetadataValidation-1808851410-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:01.461689 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:01.461689 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:01.580110 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-47ab6722-91ac-490f-84d1-13c0dd866f90 tempest-FlavorMetadataValidation-1808851410 tempest-FlavorMetadataValidation-1808851410-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/459375609" status: 202 len: 0 microversion: 2.86 time: 0.143243 Aug 06 20:55:01.580700 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 189/418] 10.222.0.33 () {60 vars in 1199 bytes} [Sat Aug 6 20:55:01 2022] DELETE /compute/v2.1/flavors/459375609 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:55:01.912730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:01.927782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:01.936598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:01.943523 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74d9afa6-0e99-4d3e-bd84-e2817997c8b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1558 microversion: 2.25 time: 0.657024 Aug 06 20:55:01.946420 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 230/419] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:01 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1558 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:01.968797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-013b5061-2041-41d7-ae8e-0bfe66d6cd2e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:01.970004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-013b5061-2041-41d7-ae8e-0bfe66d6cd2e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:02.285502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99cafd3b-4137-47aa-9354-c0237d920ec6 tempest-NetworksTest-1646683068 tempest-NetworksTest-1646683068-project-admin] Calling method '.version_select at 0x7f729e4b6940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:02.409469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-013b5061-2041-41d7-ae8e-0bfe66d6cd2e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:02.418138 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-013b5061-2041-41d7-ae8e-0bfe66d6cd2e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1212 microversion: 2.1 time: 0.469790 Aug 06 20:55:02.421677 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 231/420] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:01 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1212 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:02.440891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:02.460692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:02.461513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Searching by: {'deleted': False, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:55:02.531975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:02.532468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:02.532920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:02.533719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:02.546279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:02.546781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:02.805739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99cafd3b-4137-47aa-9354-c0237d920ec6 tempest-NetworksTest-1646683068 tempest-NetworksTest-1646683068-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 5402 microversion: 2.1 time: 1.222982 Aug 06 20:55:02.806344 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 190/421] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:01 2022] GET /compute/v2.1/os-networks => generated 5402 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:02.812717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0257c2af-508c-4823-8430-4e921a30d2c2 tempest-FlavorMetadataValidation-1808851410 tempest-FlavorMetadataValidation-1808851410-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:02.895287 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0257c2af-508c-4823-8430-4e921a30d2c2 tempest-FlavorMetadataValidation-1808851410 tempest-FlavorMetadataValidation-1808851410-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.077938 Aug 06 20:55:02.896507 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 191/422] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Aug 6 20:55:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:02.961880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 20:55:03.330908 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-50567f66-ad36-40b2-b180-f902deae8117 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.906867 Aug 06 20:55:03.340696 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 232/423] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 20:55:02 2022] GET /compute/v2.1/servers => generated 1003 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:03.353900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bf12bb95-29b9-4c4c-9af3-b2eecd3e78c5 tempest-NetworksTest-1646683068 tempest-NetworksTest-1646683068-project-admin] Calling method '.version_select at 0x7f729e29ee50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:03.463439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:03.466042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:03.473548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:03.485656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:03.486525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:03.488185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:03.488667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:03.489105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:03.671939 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bf12bb95-29b9-4c4c-9af3-b2eecd3e78c5 tempest-NetworksTest-1646683068 tempest-NetworksTest-1646683068-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks/da449dbb-c538-4888-8526-fbd7999668ff" status: 200 len: 652 microversion: 2.1 time: 0.329294 Aug 06 20:55:03.673353 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 233/424] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 20:55:03 2022] GET /compute/v2.1/os-networks/da449dbb-c538-4888-8526-fbd7999668ff => generated 652 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:04.087495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-af1d1ed2-945a-4802-b79f-a3fb92e5d03a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Calling method '.version_select at 0x7f729e288820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:04.091640 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:04.091640 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:04.093363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1d1ed2-945a-4802-b79f-a3fb92e5d03a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:04.094105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1d1ed2-945a-4802-b79f-a3fb92e5d03a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:04.094819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1d1ed2-945a-4802-b79f-a3fb92e5d03a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:04.095973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1d1ed2-945a-4802-b79f-a3fb92e5d03a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:04.096693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1d1ed2-945a-4802-b79f-a3fb92e5d03a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:04.097338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1d1ed2-945a-4802-b79f-a3fb92e5d03a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:04.172139 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-af1d1ed2-945a-4802-b79f-a3fb92e5d03a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.497285 Aug 06 20:55:04.184199 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 234/425] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 20:55:03 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:04.189821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:04.190756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:04.203120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:04.203783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:04.204379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:04.205250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:04.205962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:04.206536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid cf528ca4-80d5-47b1-8e89-0241a0132074 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:04.206758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:04.381243 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72aed972-f426-45ba-82a7-e5e65bfcb4e6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 2051 microversion: 2.25 time: 1.483387 Aug 06 20:55:04.386866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:04.398000 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-439cb884-14b5-4fd2-9c2b-98181d4516eb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1215 microversion: 2.1 time: 0.212151 Aug 06 20:55:04.398621 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 235/426] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:04 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:04.407591 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 192/427] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:02 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 2051 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:04.414832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-801b0a66-037b-496f-92fc-27a47857c6ba tempest-NetworksTest-1646683068 tempest-NetworksTest-1646683068-project-admin] Calling method '.version_select at 0x7f729e3a6c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:04.417245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:04.418665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:04.426078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:04.426840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:04.427429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:04.428295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:04.428922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:04.429513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:04.707963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:04.717552 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0248867e-9a87-4575-afc3-2be78c782977 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1270 microversion: 2.1 time: 0.305325 Aug 06 20:55:04.743309 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 236/428] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:04 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1270 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:04.917837 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-801b0a66-037b-496f-92fc-27a47857c6ba tempest-NetworksTest-1646683068 tempest-NetworksTest-1646683068-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 6097 microversion: 2.1 time: 0.508024 Aug 06 20:55:04.924341 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 193/429] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:04 2022] GET /compute/v2.1/os-networks => generated 6097 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:04.931662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:04.932593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:04.950133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:04.950878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:04.953499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:04.956130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:04.956932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:04.959026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:05.061688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8b32ac83-a3e5-4ad4-b03d-2a748e1d0a22 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Calling method '.version_select at 0x7f729e34d940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.064631 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:05.064631 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:05.065812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8b32ac83-a3e5-4ad4-b03d-2a748e1d0a22 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f413813531e94602959dbf30f21bdd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489f9cb65a0f40a383398c05d84b45f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8b32ac83-a3e5-4ad4-b03d-2a748e1d0a22 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Request method failure captured: Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUkoJyxcOxAe6frI4-14JX_GBm9Ama1RhhYAJOyQdNok0NlXIyI4vDwXzgOvSw-sHRsLrE2r9sZhlOgJQtPAdfa5aVL6WzK7OF7egWS9-c3Y05-hqJ7Dh4oEwB757yUATVB9aoJvXKCywd-U3jiywzXa-PgzT1CtCDJt-6rAhLdnEA Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:05.074883 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_489f9cb65a0f40a383398c05d84b45f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f413813531e94602959dbf30f21bdd45 Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 20:55:05.076241 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:05.077044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 06 20:55:05.078118 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.079224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8b32ac83-a3e5-4ad4-b03d-2a748e1d0a22 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:05.079224 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8b32ac83-a3e5-4ad4-b03d-2a748e1d0a22 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.332022 Aug 06 20:55:05.084686 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 237/430] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 20:55:04 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 341 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:55:05.090025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e42666cf-f9df-4624-b4b1-ef79d59c9b2e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Calling method '.version_select at 0x7f729e3073a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.090847 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:05.090847 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:05.115483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e42666cf-f9df-4624-b4b1-ef79d59c9b2e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f413813531e94602959dbf30f21bdd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489f9cb65a0f40a383398c05d84b45f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e42666cf-f9df-4624-b4b1-ef79d59c9b2e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Request method failure captured: Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUkoJyxcOxAe6frI4-14JX_GBm9Ama1RhhYAJOyQdNok0NlXIyI4vDwXzgOvSw-sHRsLrE2r9sZhlOgJQtPAdfa5aVL6WzK7OF7egWS9-c3Y05-hqJ7Dh4oEwB757yUATVB9aoJvXKCywd-U3jiywzXa-PgzT1CtCDJt-6rAhLdnEA Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:05.120846 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_489f9cb65a0f40a383398c05d84b45f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f413813531e94602959dbf30f21bdd45 Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ncdv-master-1'} Aug 06 20:55:05.122366 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:05.123119 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 06 20:55:05.124224 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.126752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e42666cf-f9df-4624-b4b1-ef79d59c9b2e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:05.126752 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e42666cf-f9df-4624-b4b1-ef79d59c9b2e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.038594 Aug 06 20:55:05.126752 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 238/431] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Aug 6 20:55:05 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:55:05.138160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6b0f536-6f69-49c4-8c64-9d5ba142f141 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Calling method '.version_select at 0x7f729e307700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.163755 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-c6b0f536-6f69-49c4-8c64-9d5ba142f141 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6b0f536-6f69-49c4-8c64-9d5ba142f141 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Request method failure captured: Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUm3wFYQAD-3lk0EQFdPjhQc4LjjaWL9RjxAmjmXNDzhG3HIP-MgvvyL0L9NpjQdIruXu1WszBUn8UKct0UjEQcnH7yIb-aljRcnV66ACwpGn_6Ayw3FeyURY9bMJvNpMUp7kM7Kog06Z8EDyF2UGzpkwi4Y4nuqfoOilWQMqj5udw Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:55:05.165719 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56223cc3fb6f4dda99ae403aa8f1b2d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 58ecd3be3f3b429da58912f0a742608e Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'nonexistent_hostname'} Aug 06 20:55:05.167089 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:55:05.168463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 06 20:55:05.169521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6b0f536-6f69-49c4-8c64-9d5ba142f141 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:05.170513 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c6b0f536-6f69-49c4-8c64-9d5ba142f141 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.036183 Aug 06 20:55:05.180287 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 239/432] 10.222.0.33 () {58 vars in 1212 bytes} [Sat Aug 6 20:55:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:05.190302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f77986db-7c04-4b8b-8d2c-9469aa6ad3d8 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Calling method '.version_select at 0x7f729e3d1ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.191312 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:05.191312 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:05.192484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f77986db-7c04-4b8b-8d2c-9469aa6ad3d8 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f413813531e94602959dbf30f21bdd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489f9cb65a0f40a383398c05d84b45f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f77986db-7c04-4b8b-8d2c-9469aa6ad3d8 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Request method failure captured: Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUkoJyxcOxAe6frI4-14JX_GBm9Ama1RhhYAJOyQdNok0NlXIyI4vDwXzgOvSw-sHRsLrE2r9sZhlOgJQtPAdfa5aVL6WzK7OF7egWS9-c3Y05-hqJ7Dh4oEwB757yUATVB9aoJvXKCywd-U3jiywzXa-PgzT1CtCDJt-6rAhLdnEA Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:05.194063 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_489f9cb65a0f40a383398c05d84b45f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f413813531e94602959dbf30f21bdd45 Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ncdv-master-1'} Aug 06 20:55:05.195683 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:05.196491 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 06 20:55:05.197545 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.199082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f77986db-7c04-4b8b-8d2c-9469aa6ad3d8 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:05.199082 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f77986db-7c04-4b8b-8d2c-9469aa6ad3d8 tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.014220 Aug 06 20:55:05.199082 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 240/433] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Aug 6 20:55:05 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:55:05.218357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e4d4a2e-0e04-4a33-a852-1955c9d6f24d tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Calling method '.version_select at 0x7f729e3158b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.237690 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7e4d4a2e-0e04-4a33-a852-1955c9d6f24d tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e4d4a2e-0e04-4a33-a852-1955c9d6f24d tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Request method failure captured: Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUm3wFYQAD-3lk0EQFdPjhQc4LjjaWL9RjxAmjmXNDzhG3HIP-MgvvyL0L9NpjQdIruXu1WszBUn8UKct0UjEQcnH7yIb-aljRcnV66ACwpGn_6Ayw3FeyURY9bMJvNpMUp7kM7Kog06Z8EDyF2UGzpkwi4Y4nuqfoOilWQMqj5udw Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:55:05.239291 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56223cc3fb6f4dda99ae403aa8f1b2d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 58ecd3be3f3b429da58912f0a742608e Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'nonexistent_hostname'} Aug 06 20:55:05.240510 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.241234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.242271 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.243643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e4d4a2e-0e04-4a33-a852-1955c9d6f24d tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:05.243643 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e4d4a2e-0e04-4a33-a852-1955c9d6f24d tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.026616 Aug 06 20:55:05.258679 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 241/434] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Aug 6 20:55:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:05.264220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a9a7dfb-cc53-421a-8d6f-9ec493fb14dc tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Calling method '.version_select at 0x7f729e44e1f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.267912 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:05.267912 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:05.269830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5a9a7dfb-cc53-421a-8d6f-9ec493fb14dc tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f413813531e94602959dbf30f21bdd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489f9cb65a0f40a383398c05d84b45f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a9a7dfb-cc53-421a-8d6f-9ec493fb14dc tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Request method failure captured: Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUkoJyxcOxAe6frI4-14JX_GBm9Ama1RhhYAJOyQdNok0NlXIyI4vDwXzgOvSw-sHRsLrE2r9sZhlOgJQtPAdfa5aVL6WzK7OF7egWS9-c3Y05-hqJ7Dh4oEwB757yUATVB9aoJvXKCywd-U3jiywzXa-PgzT1CtCDJt-6rAhLdnEA Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:05.275263 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_489f9cb65a0f40a383398c05d84b45f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f413813531e94602959dbf30f21bdd45 Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ncdv-master-1'} Aug 06 20:55:05.277294 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:05.278112 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 06 20:55:05.279252 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.282045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a9a7dfb-cc53-421a-8d6f-9ec493fb14dc tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:05.286910 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5a9a7dfb-cc53-421a-8d6f-9ec493fb14dc tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.027065 Aug 06 20:55:05.294275 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 242/435] 10.222.0.33 () {58 vars in 1197 bytes} [Sat Aug 6 20:55:05 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:55:05.299722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-11811efd-9297-4500-be96-3751429f2d28 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Calling method '.version_select at 0x7f729e3078b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.317101 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-11811efd-9297-4500-be96-3751429f2d28 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-11811efd-9297-4500-be96-3751429f2d28 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Request method failure captured: Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUm3wFYQAD-3lk0EQFdPjhQc4LjjaWL9RjxAmjmXNDzhG3HIP-MgvvyL0L9NpjQdIruXu1WszBUn8UKct0UjEQcnH7yIb-aljRcnV66ACwpGn_6Ayw3FeyURY9bMJvNpMUp7kM7Kog06Z8EDyF2UGzpkwi4Y4nuqfoOilWQMqj5udw Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:55:05.319634 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56223cc3fb6f4dda99ae403aa8f1b2d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 58ecd3be3f3b429da58912f0a742608e Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'nonexistent_hostname'} Aug 06 20:55:05.320845 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:55:05.321563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 06 20:55:05.322621 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.324318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.330639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-11811efd-9297-4500-be96-3751429f2d28 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:05.333281 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-11811efd-9297-4500-be96-3751429f2d28 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.037655 Aug 06 20:55:05.334061 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 243/436] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 20:55:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:05.354082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5981da08-3227-4709-a713-8f2236f460ed tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Calling method '.version_select at 0x7f729e29e940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.355279 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:05.355279 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:05.356697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5981da08-3227-4709-a713-8f2236f460ed tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f413813531e94602959dbf30f21bdd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489f9cb65a0f40a383398c05d84b45f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5981da08-3227-4709-a713-8f2236f460ed tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Request method failure captured: Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUkoJyxcOxAe6frI4-14JX_GBm9Ama1RhhYAJOyQdNok0NlXIyI4vDwXzgOvSw-sHRsLrE2r9sZhlOgJQtPAdfa5aVL6WzK7OF7egWS9-c3Y05-hqJ7Dh4oEwB757yUATVB9aoJvXKCywd-U3jiywzXa-PgzT1CtCDJt-6rAhLdnEA Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:05.360145 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_489f9cb65a0f40a383398c05d84b45f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f413813531e94602959dbf30f21bdd45 Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ncdv-master-1'} Aug 06 20:55:05.361377 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:05.362082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 06 20:55:05.363143 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.371359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5981da08-3227-4709-a713-8f2236f460ed tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:05.372519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5981da08-3227-4709-a713-8f2236f460ed tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.032296 Aug 06 20:55:05.376301 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 244/437] 10.222.0.33 () {58 vars in 1194 bytes} [Sat Aug 6 20:55:05 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:55:05.384776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-58efcc3e-42ed-45ef-b1d2-fdedf8760267 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Calling method '.version_select at 0x7f729e394d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.419154 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-58efcc3e-42ed-45ef-b1d2-fdedf8760267 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-58efcc3e-42ed-45ef-b1d2-fdedf8760267 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Request method failure captured: Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUm3wFYQAD-3lk0EQFdPjhQc4LjjaWL9RjxAmjmXNDzhG3HIP-MgvvyL0L9NpjQdIruXu1WszBUn8UKct0UjEQcnH7yIb-aljRcnV66ACwpGn_6Ayw3FeyURY9bMJvNpMUp7kM7Kog06Z8EDyF2UGzpkwi4Y4nuqfoOilWQMqj5udw Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:55:05.421007 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56223cc3fb6f4dda99ae403aa8f1b2d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 58ecd3be3f3b429da58912f0a742608e Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'nonexistent_hostname'} Aug 06 20:55:05.422285 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:55:05.423330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 06 20:55:05.424450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:05.425462 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:05.427711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-58efcc3e-42ed-45ef-b1d2-fdedf8760267 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:05.428651 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-58efcc3e-42ed-45ef-b1d2-fdedf8760267 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.048036 Aug 06 20:55:05.429453 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 245/438] 10.222.0.33 () {58 vars in 1215 bytes} [Sat Aug 6 20:55:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 06 20:55:05.442517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:05.445139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:05.458324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:05.462738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:05.463384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:05.464883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:05.471282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:05.471960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:05.980239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid cf528ca4-80d5-47b1-8e89-0241a0132074 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:06.007105 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a13a612d-aea1-4d8f-9350-5504f63df4c6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 2051 microversion: 2.25 time: 1.080547 Aug 06 20:55:06.022995 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 194/439] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:04 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 2051 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:06.029274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e16adb57-61e3-4c31-a4b3-14df764d1a97 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Action: 'update', calling method: .version_select at 0x7f729e3eb820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e16adb57-61e3-4c31-a4b3-14df764d1a97 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Request method failure captured: Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 51 Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUm3wFYQAD-3lk0EQFdPjhQc4LjjaWL9RjxAmjmXNDzhG3HIP-MgvvyL0L9NpjQdIruXu1WszBUn8UKct0UjEQcnH7yIb-aljRcnV66ACwpGn_6Ayw3FeyURY9bMJvNpMUp7kM7Kog06Z8EDyF2UGzpkwi4Y4nuqfoOilWQMqj5udw Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:55:06.050578 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56223cc3fb6f4dda99ae403aa8f1b2d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 58ecd3be3f3b429da58912f0a742608e Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: {"status": "enable", "maintenance_mode": "invalid"} Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:55:06.051957 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'disable', Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'Enable', Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'Disable', Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance: Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'invalid' Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.052687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.054084 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.056602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.056602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:55:06.056602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:55:06.056602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 06 20:55:06.056602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.056602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e16adb57-61e3-4c31-a4b3-14df764d1a97 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:06.056602 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e16adb57-61e3-4c31-a4b3-14df764d1a97 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.031699 Aug 06 20:55:06.056602 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 195/440] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Aug 6 20:55:06 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:55:06.085679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:06.086603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:06.108122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:06.108635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:06.109081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:06.109822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:06.125194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:06.125664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:06.347829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:06.401357 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fcad4699-eddf-46ce-b7ec-1e70733f07d6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1270 microversion: 2.1 time: 0.348091 Aug 06 20:55:06.407050 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 196/441] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:06 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1270 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:06.416136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8ed56874-f0af-4e80-9d5b-13c13045ca04 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:06.419004 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:06.419004 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:06.421503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ed56874-f0af-4e80-9d5b-13c13045ca04 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:06.422259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ed56874-f0af-4e80-9d5b-13c13045ca04 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:06.423132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ed56874-f0af-4e80-9d5b-13c13045ca04 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:06.423918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ed56874-f0af-4e80-9d5b-13c13045ca04 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:06.424358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ed56874-f0af-4e80-9d5b-13c13045ca04 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:06.424780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ed56874-f0af-4e80-9d5b-13c13045ca04 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:06.451625 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8ed56874-f0af-4e80-9d5b-13c13045ca04 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043246 Aug 06 20:55:06.452901 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 197/442] 10.222.0.33 () {60 vars in 1217 bytes} [Sat Aug 6 20:55:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:55:06.458041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c56d3426-ff0e-4f72-a6b0-1c0bd430c8bc tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Action: 'update', calling method: .version_select at 0x7f729e3eb160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c56d3426-ff0e-4f72-a6b0-1c0bd430c8bc tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Request method failure captured: Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 51 Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUm3wFYQAD-3lk0EQFdPjhQc4LjjaWL9RjxAmjmXNDzhG3HIP-MgvvyL0L9NpjQdIruXu1WszBUn8UKct0UjEQcnH7yIb-aljRcnV66ACwpGn_6Ayw3FeyURY9bMJvNpMUp7kM7Kog06Z8EDyF2UGzpkwi4Y4nuqfoOilWQMqj5udw Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:55:06.462655 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56223cc3fb6f4dda99ae403aa8f1b2d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 58ecd3be3f3b429da58912f0a742608e Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: {"status": "invalid", "maintenance_mode": "enable"} Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:55:06.464533 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'disable', Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'Enable', Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'Disable', Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance: Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'invalid' Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.465324 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.466668 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.467676 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.467676 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:55:06.467676 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:55:06.467676 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 06 20:55:06.467676 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.469684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c56d3426-ff0e-4f72-a6b0-1c0bd430c8bc tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:06.470777 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c56d3426-ff0e-4f72-a6b0-1c0bd430c8bc tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.016639 Aug 06 20:55:06.471575 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 198/443] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Aug 6 20:55:06 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:55:06.481765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:06.484513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:06.491820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:06.492810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:06.493514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:06.494514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:06.495266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:06.495977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:06.540082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:06.560889 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d4fd392-f343-475d-a583-89ae6f97aa2e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1289 microversion: 2.1 time: 1.129617 Aug 06 20:55:06.565039 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 246/444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:05 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1289 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:06.576824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7df9ddd9-a704-49a7-b00e-421f70499d8e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Action: 'update', calling method: .version_select at 0x7f729e3070d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:06.587441 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:06.587441 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:06.591236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7df9ddd9-a704-49a7-b00e-421f70499d8e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f413813531e94602959dbf30f21bdd45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489f9cb65a0f40a383398c05d84b45f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7df9ddd9-a704-49a7-b00e-421f70499d8e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Request method failure captured: Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 50 Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUkoJyxcOxAe6frI4-14JX_GBm9Ama1RhhYAJOyQdNok0NlXIyI4vDwXzgOvSw-sHRsLrE2r9sZhlOgJQtPAdfa5aVL6WzK7OF7egWS9-c3Y05-hqJ7Dh4oEwB757yUATVB9aoJvXKCywd-U3jiywzXa-PgzT1CtCDJt-6rAhLdnEA Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:06.593826 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_489f9cb65a0f40a383398c05d84b45f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/489f9cb65a0f40a383398c05d84b45f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 489f9cb65a0f40a383398c05d84b45f3 Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-852909425 Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f413813531e94602959dbf30f21bdd45 Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-852909425-project Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: {"status": "enable", "maintenance_mode": "enable"} Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 06 20:55:06.595281 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:06.596063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 06 20:55:06.597117 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.600319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7df9ddd9-a704-49a7-b00e-421f70499d8e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:06.602022 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7df9ddd9-a704-49a7-b00e-421f70499d8e tempest-HostsAdminNegativeTestJSON-852909425 tempest-HostsAdminNegativeTestJSON-852909425-project] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.034403 Aug 06 20:55:06.605736 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 247/445] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Aug 6 20:55:06 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:55:06.627321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12de32c8-8bb9-44d7-ac69-a49a05649d64 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Action: 'update', calling method: .version_select at 0x7f729e28e940>, body: {"status": null, "maintenance_mode": null} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12de32c8-8bb9-44d7-ac69-a49a05649d64 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Request method failure captured: Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 42 Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUm3wFYQAD-3lk0EQFdPjhQc4LjjaWL9RjxAmjmXNDzhG3HIP-MgvvyL0L9NpjQdIruXu1WszBUn8UKct0UjEQcnH7yIb-aljRcnV66ACwpGn_6Ayw3FeyURY9bMJvNpMUp7kM7Kog06Z8EDyF2UGzpkwi4Y4nuqfoOilWQMqj5udw Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:55:06.652200 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56223cc3fb6f4dda99ae403aa8f1b2d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 58ecd3be3f3b429da58912f0a742608e Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: {"status": null, "maintenance_mode": null} Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 06 20:55:06.653741 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'disable', Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'Enable', Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'Disable', Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance: Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi None Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.654520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.656815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.658815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:55:06.658815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:55:06.658815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 06 20:55:06.658815 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.661972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12de32c8-8bb9-44d7-ac69-a49a05649d64 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:06.665350 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12de32c8-8bb9-44d7-ac69-a49a05649d64 tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.044272 Aug 06 20:55:06.668384 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 248/446] 10.222.0.33 () {60 vars in 1190 bytes} [Sat Aug 6 20:55:06 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:55:06.701559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f8457bd8-548e-43dd-b7cc-addf31d6a80a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Action: 'update', calling method: .version_select at 0x7f729e28eee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:06.709552 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.hosts [None req-f8457bd8-548e-43dd-b7cc-addf31d6a80a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Enabling host nonexistent_hostname. Aug 06 20:55:06.725812 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-f8457bd8-548e-43dd-b7cc-addf31d6a80a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f8457bd8-548e-43dd-b7cc-addf31d6a80a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Request method failure captured: Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 50 Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUm3wFYQAD-3lk0EQFdPjhQc4LjjaWL9RjxAmjmXNDzhG3HIP-MgvvyL0L9NpjQdIruXu1WszBUn8UKct0UjEQcnH7yIb-aljRcnV66ACwpGn_6Ayw3FeyURY9bMJvNpMUp7kM7Kog06Z8EDyF2UGzpkwi4Y4nuqfoOilWQMqj5udw Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:55:06.730684 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56223cc3fb6f4dda99ae403aa8f1b2d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56223cc3fb6f4dda99ae403aa8f1b2d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 56223cc3fb6f4dda99ae403aa8f1b2d7 Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2078920054 Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 58ecd3be3f3b429da58912f0a742608e Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2078920054-project-admin Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: {"status": "enable", "maintenance_mode": "enable"} Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:06.732285 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 06 20:55:06.733194 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:06.734272 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 06 20:55:06.735722 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:06.737243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f8457bd8-548e-43dd-b7cc-addf31d6a80a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:06.743777 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f8457bd8-548e-43dd-b7cc-addf31d6a80a tempest-HostsAdminNegativeTestJSON-2078920054 tempest-HostsAdminNegativeTestJSON-2078920054-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.062603 Aug 06 20:55:06.747185 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 249/447] 10.222.0.33 () {60 vars in 1211 bytes} [Sat Aug 6 20:55:06 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:07.347437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'flavor' on Instance uuid cf528ca4-80d5-47b1-8e89-0241a0132074 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:07.424217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:07.424875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:07.440975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:07.442332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:07.444607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:07.450053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:07.451108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:07.453598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:07.469326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Going to try to live migrate instance to nch1-master-1 {{(pid=142462) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 20:55:08.961265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:08.976010 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-48db6338-dd10-44f5-b857-f5f9bea8c2c6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1312 microversion: 2.1 time: 1.555948 Aug 06 20:55:08.977311 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 250/448] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:07 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1312 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:08.993369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:08.995909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:09.011671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:09.015313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:09.019338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:09.022004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:09.022871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:09.024006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:11.016793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:11.036797 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16b7a96b-4958-4d90-92d8-2093e8ce2340 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1319 microversion: 2.1 time: 2.057826 Aug 06 20:55:11.048258 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 251/449] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:08 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1319 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:11.063089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:11.071436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:11.099321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:11.117425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:11.121201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:11.122140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:11.122628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:11.123091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:11.266850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=22 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:12.177473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:12.192713 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d7ebd3c7-a6d2-48c3-b374-764b441a802e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1312 microversion: 2.1 time: 1.138446 Aug 06 20:55:12.194094 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 252/450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:11 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1312 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:12.415188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=16 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:12.577482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Calling method '.version_select at 0x7f729e29e8b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:12.578523 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:12.578523 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:12.580001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:12.580825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:12.581579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:12.637692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:12.641296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:12.641977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:12.668353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:12.671232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:12.671841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:12.681823 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c23377cb-049c-4a74-b8f5-04a2e2a09f4f tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.484536 Aug 06 20:55:12.692806 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 253/451] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Aug 6 20:55:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:55:12.708470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:12.711954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:12.735785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:12.736278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:12.736714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:12.743025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:12.743545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:12.743989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:13.695236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:13.707504 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6af10fcd-0531-4f0c-8a29-fa8c556630aa tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1319 microversion: 2.1 time: 1.011680 Aug 06 20:55:13.712555 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 254/452] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:12 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1319 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:13.743744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-6cbd3a54-a8ad-4950-bdc8-0407619b8fab req-6e7218ba-4a1b-4914-bb12-f20e5e0f947b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d053068c-becf-4353-b775-0bf47d7283ff", "tag": "77bb4236-0e88-4203-bc54-27a09c725653"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:13.759570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6cbd3a54-a8ad-4950-bdc8-0407619b8fab req-6e7218ba-4a1b-4914-bb12-f20e5e0f947b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:13.760569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6cbd3a54-a8ad-4950-bdc8-0407619b8fab req-6e7218ba-4a1b-4914-bb12-f20e5e0f947b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:13.761188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6cbd3a54-a8ad-4950-bdc8-0407619b8fab req-6e7218ba-4a1b-4914-bb12-f20e5e0f947b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:13.787019 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-6cbd3a54-a8ad-4950-bdc8-0407619b8fab req-6e7218ba-4a1b-4914-bb12-f20e5e0f947b service nova] Creating event network-changed:77bb4236-0e88-4203-bc54-27a09c725653 for instance d053068c-becf-4353-b775-0bf47d7283ff on nch2-master-1 Aug 06 20:55:13.796912 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-6cbd3a54-a8ad-4950-bdc8-0407619b8fab req-6e7218ba-4a1b-4914-bb12-f20e5e0f947b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065192 Aug 06 20:55:13.800353 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 255/453] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:13.811087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6ba18e3c-1dd3-49f6-813f-638890fa6609 tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Calling method '.version_select at 0x7f729e2e7160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:13.812501 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:13.812501 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:13.814645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba18e3c-1dd3-49f6-813f-638890fa6609 tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:13.816232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba18e3c-1dd3-49f6-813f-638890fa6609 tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:13.817160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba18e3c-1dd3-49f6-813f-638890fa6609 tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:13.841576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba18e3c-1dd3-49f6-813f-638890fa6609 tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:13.842423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba18e3c-1dd3-49f6-813f-638890fa6609 tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:13.843057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba18e3c-1dd3-49f6-813f-638890fa6609 tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:13.853132 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6ba18e3c-1dd3-49f6-813f-638890fa6609 tempest-HypervisorAdminV228Test-419390459 tempest-HypervisorAdminV228Test-419390459-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.050838 Aug 06 20:55:13.854863 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 256/454] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Aug 6 20:55:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:55:13.860063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:13.861008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:13.889842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:13.903185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:13.906017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:13.907790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:13.910054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:13.912298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:13.970120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:14.113413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:14.577324 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d0aff05e-a069-4966-9bdb-6e14c4292e35 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074/action" status: 202 len: 0 microversion: 2.25 time: 8.103998 Aug 06 20:55:14.580520 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 199/455] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 20:55:06 2022] POST /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074/action => generated 0 bytes in 8108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:55:14.771300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:14.786297 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1b63fd3b-81b7-4650-82ad-e47e1b66ec85 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1312 microversion: 2.1 time: 0.929328 Aug 06 20:55:14.806230 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 257/456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:13 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1312 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:14.847030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:14.848902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:14.867843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:14.868350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:14.868795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:14.873096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:14.873586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:14.874027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:15.065518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-297458888", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": "none"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:15.167134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:15.168016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:15.168732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:15.169396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:15.170787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:15.186017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:15.187323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:15.188567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:15.191632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:15.192345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:15.195095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:15.254139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Getting quotas for project f60674e881dc407296dd58e190b26164. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:15.261393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Getting quotas for user e9067baeaf4a422b85297540fa940079 and project f60674e881dc407296dd58e190b26164. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:15.279308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:15.282286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:15.349982 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1dd6652d-a05f-47b1-9865-5a718c67dbde tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.766854 Aug 06 20:55:15.351003 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 200/457] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 20:55:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 20:55:15.373017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:15.382723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:15.391969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:15.392709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:15.393333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:15.394202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:15.394864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:15.398289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:15.911353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:15.942195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:15.950461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:15.956433 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc4be175-e88a-4e30-9653-4be383703bc0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1568 microversion: 2.25 time: 1.125622 Aug 06 20:55:15.977624 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 258/458] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:14 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1568 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:15.998188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-41a6a552-0df5-4c85-8331-64b2c9bfb685 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:16.010278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-41a6a552-0df5-4c85-8331-64b2c9bfb685 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:16.098018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:16.248185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-41a6a552-0df5-4c85-8331-64b2c9bfb685 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:16.263264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-41a6a552-0df5-4c85-8331-64b2c9bfb685 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:16.269593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-41a6a552-0df5-4c85-8331-64b2c9bfb685 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:16.278949 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-41a6a552-0df5-4c85-8331-64b2c9bfb685 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "PUT /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1358 microversion: 2.75 time: 0.300050 Aug 06 20:55:16.280157 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 259/459] 10.222.0.33 () {62 vars in 1297 bytes} [Sat Aug 6 20:55:15 2022] PUT /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:16.285155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:16.286012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:16.293192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:16.293977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:16.294672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:16.296325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:16.297338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:16.298439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:16.397687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:16.410044 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e592b170-21c2-4fba-a790-0768c10f4eb9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1319 microversion: 2.1 time: 1.057927 Aug 06 20:55:16.411859 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 201/460] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:15 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1319 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:16.421074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9a11bb41-3b61-4d63-b793-13846c0199fb req-2c6ceca8-4e59-4a35-a05b-94e9ae4a28a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc61a7b0-d433-449a-a4a0-c541f208337d", "tag": "80477638-d273-44c3-a82b-c2d5865cd0fd"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:16.441216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9a11bb41-3b61-4d63-b793-13846c0199fb req-2c6ceca8-4e59-4a35-a05b-94e9ae4a28a0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:16.442312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9a11bb41-3b61-4d63-b793-13846c0199fb req-2c6ceca8-4e59-4a35-a05b-94e9ae4a28a0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:16.443334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9a11bb41-3b61-4d63-b793-13846c0199fb req-2c6ceca8-4e59-4a35-a05b-94e9ae4a28a0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:16.470945 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9a11bb41-3b61-4d63-b793-13846c0199fb req-2c6ceca8-4e59-4a35-a05b-94e9ae4a28a0 service nova] Creating event network-changed:80477638-d273-44c3-a82b-c2d5865cd0fd for instance dc61a7b0-d433-449a-a4a0-c541f208337d on nch2-master-1 Aug 06 20:55:16.483621 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9a11bb41-3b61-4d63-b793-13846c0199fb req-2c6ceca8-4e59-4a35-a05b-94e9ae4a28a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069831 Aug 06 20:55:16.487114 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 202/461] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:16.533811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:16.544637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:16.551961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:16.552728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:16.553406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:16.554361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:16.555053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:16.555955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:16.883081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:16.896137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:16.900168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:16.913897 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c83cfd1c-bb4b-4166-841e-bc0611025db5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1354 microversion: 2.75 time: 0.422682 Aug 06 20:55:16.919940 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 203/462] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:16 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1354 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:17.010181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:17.018151 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4bd84424-d416-4d25-8072-de03f4b4ad59 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1312 microversion: 2.1 time: 0.736635 Aug 06 20:55:17.035096 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 260/463] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:16 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1312 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:17.043588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:17.044210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:17.059755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:17.060642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:17.064186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:17.066930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:17.069015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:17.070092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:17.539998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-feb03000-d567-46e0-92f3-ee94754a21d0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:17.557672 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-feb03000-d567-46e0-92f3-ee94754a21d0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.632418 Aug 06 20:55:17.576020 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 204/464] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:17.588582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:17.589558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:17.596342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:17.597298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:17.598127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:17.599255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:17.599935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:17.600701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:17.906398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:17.922297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:17.924442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:17.925812 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc24b856-d5ad-42f5-96d8-d5c7a4e92670 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1568 microversion: 2.25 time: 0.887155 Aug 06 20:55:17.942524 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 261/465] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:17 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1568 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:18.120729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:18.134799 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d3e2b8f6-ce55-4f6f-96c4-6a528d93ea83 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1319 microversion: 2.1 time: 0.556778 Aug 06 20:55:18.135810 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 205/466] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:17 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:18.140491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:18.141087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:18.165883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:18.167495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:18.167923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:18.168707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:18.169172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:18.169600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:18.269029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a3ab8b6-fe05-4768-82e7-974935c47352 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1407773934", "id": 846281360, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:18.272004 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:18.272004 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:18.298200 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5a3ab8b6-fe05-4768-82e7-974935c47352 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.354137 Aug 06 20:55:18.310530 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 262/467] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:17 2022] POST /compute/v2.1/flavors => generated 422 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:18.316208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:18.317183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:18.327558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:18.328360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:18.329626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:18.330679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:18.331473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:18.332103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:18.346637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:18.349051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:18.358930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:18.360289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:18.374494 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0bc368c4-49f0-4a8a-8e0b-423ba767ef8f tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1416 microversion: 2.75 time: 0.237522 Aug 06 20:55:18.381399 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 206/468] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:18 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1416 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:18.387526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-704095db-3f0b-4175-b1de-91ff39e1a9f1 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:18.398007 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-704095db-3f0b-4175-b1de-91ff39e1a9f1 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015429 Aug 06 20:55:18.403681 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 207/469] 10.222.0.33 () {58 vars in 1182 bytes} [Sat Aug 6 20:55:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:55:18.413577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a75a00d6-0b65-4a39-9673-ad49454d01c1 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-957065558", "id": 1007064571, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:18.417860 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:18.417860 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:18.475241 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a75a00d6-0b65-4a39-9673-ad49454d01c1 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.066183 Aug 06 20:55:18.478317 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 208/470] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:18 2022] POST /compute/v2.1/flavors => generated 424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:18.497057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cd7752b0-170a-453c-a35e-1ea9b9d19f74 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:18.526675 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cd7752b0-170a-453c-a35e-1ea9b9d19f74 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036848 Aug 06 20:55:18.532065 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 209/471] 10.222.0.33 () {58 vars in 1182 bytes} [Sat Aug 6 20:55:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:55:18.556538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c5ea340-2381-4fb7-a37f-8f94c621bb15 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Action: 'create', calling method: .version_select at 0x7f729e3a48b0>, body: {"keypair": {"name": "tempest-keypair-601269215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUEsONRKf3Ixx7aB4BO15cwF5ewPyJEechFEQ/N5a7hVMUgMFgsklHSG53xx6CO/Z+GUzUdSgNpq4qlWHYykIw8xvTWhtZuK4nLJI7h5A7WdQoNNHJ6jfSlAeH5FxNpCw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:18.631475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7c5ea340-2381-4fb7-a37f-8f94c621bb15 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Getting quotas for project 2eff0aae88974b5a893b71e0d6b34257. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:18.643090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7c5ea340-2381-4fb7-a37f-8f94c621bb15 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Getting quotas for user 4604780fce5b4ece8cb20354efb53569 and project 2eff0aae88974b5a893b71e0d6b34257. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:18.692020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=89,nova_api:DELETE=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:18.708536 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c5ea340-2381-4fb7-a37f-8f94c621bb15 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166006 Aug 06 20:55:18.711045 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 210/472] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 20:55:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:19.205756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Calling method '.version_select at 0x7f729e15b9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:19.219963 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:19.219963 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:19.222173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.223889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.224578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.243461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.245690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.249080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.274029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.276115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.283958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.301635 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-09472e96-92bd-4e6d-b15e-5a162820e1e3 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.582193 Aug 06 20:55:19.307746 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 211/473] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:55:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:19.317880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:19.327263 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-85caa7fa-61a0-4f67-b66e-b8a4e04ab050 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1312 microversion: 2.1 time: 1.015382 Aug 06 20:55:19.327827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d35c4169-1449-46d3-b430-b4770c6e2258 req-023609e6-1fc7-40e1-aaa4-b9b9a4790cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c16c7d7a-6a48-4260-b7d1-451b01c03425", "tag": "3c8d9295-154e-4003-bad7-77e541a4a2d4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:19.332666 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 263/474] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:18 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1312 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:19.342472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d7beecb0-1093-4520-8c03-5033018f192c req-12fa4cf1-d0de-4c10-abd9-77dfe21971f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf528ca4-80d5-47b1-8e89-0241a0132074", "name": "network-vif-unplugged", "status": "completed", "tag": "060516c4-8983-4018-8d4a-a96568a9617f"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:19.357782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d35c4169-1449-46d3-b430-b4770c6e2258 req-023609e6-1fc7-40e1-aaa4-b9b9a4790cea service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.359378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d35c4169-1449-46d3-b430-b4770c6e2258 req-023609e6-1fc7-40e1-aaa4-b9b9a4790cea service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.360155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d35c4169-1449-46d3-b430-b4770c6e2258 req-023609e6-1fc7-40e1-aaa4-b9b9a4790cea service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.366041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d7beecb0-1093-4520-8c03-5033018f192c req-12fa4cf1-d0de-4c10-abd9-77dfe21971f7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.366568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d7beecb0-1093-4520-8c03-5033018f192c req-12fa4cf1-d0de-4c10-abd9-77dfe21971f7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.367014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d7beecb0-1093-4520-8c03-5033018f192c req-12fa4cf1-d0de-4c10-abd9-77dfe21971f7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.391230 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d35c4169-1449-46d3-b430-b4770c6e2258 req-023609e6-1fc7-40e1-aaa4-b9b9a4790cea service nova] Creating event network-changed:3c8d9295-154e-4003-bad7-77e541a4a2d4 for instance c16c7d7a-6a48-4260-b7d1-451b01c03425 on nch2-master-1 Aug 06 20:55:19.400296 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d35c4169-1449-46d3-b430-b4770c6e2258 req-023609e6-1fc7-40e1-aaa4-b9b9a4790cea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090871 Aug 06 20:55:19.404718 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 212/475] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:19.406743 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d7beecb0-1093-4520-8c03-5033018f192c req-12fa4cf1-d0de-4c10-abd9-77dfe21971f7 service nova] Creating event network-vif-unplugged:060516c4-8983-4018-8d4a-a96568a9617f for instance cf528ca4-80d5-47b1-8e89-0241a0132074 on nch2-master-1 Aug 06 20:55:19.412187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:19.416672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:19.422880 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d7beecb0-1093-4520-8c03-5033018f192c req-12fa4cf1-d0de-4c10-abd9-77dfe21971f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088091 Aug 06 20:55:19.427274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 264/476] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:19.439596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.442005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:19.442358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.442769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:19.443447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.445436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.448453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.449992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.469950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.470386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.475285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.477401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.477915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.478366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.754885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:19.771893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:19.773627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:19.775296 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8eda7e22-be8b-4b1d-b203-ed6589b2af91 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1568 microversion: 2.25 time: 0.367357 Aug 06 20:55:19.776628 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 213/477] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:19 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1568 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:19.783218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Calling method '.version_select at 0x7f729e0efe50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:19.784099 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:19.784099 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:19.787633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.795313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.796016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.843349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.844103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.844708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.892993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.901165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.901794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.918464 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fd7f4f8b-f565-4567-8500-c4790d99f567 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.140746 Aug 06 20:55:19.919086 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 214/478] 10.222.0.33 () {58 vars in 1212 bytes} [Sat Aug 6 20:55:19 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:19.931275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:19.932879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:19.945197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.945976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.954941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:19.955960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:19.956590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:19.957166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.103634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:20.115988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:20.117714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:20.118425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:20.134264 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3484afb4-f114-43a9-8e0a-29170d9cf3ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1319 microversion: 2.1 time: 0.704011 Aug 06 20:55:20.135529 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1bb0be37-ecc7-4ca6-a0ee-4c6ee4780829 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1437 microversion: 2.75 time: 0.215233 Aug 06 20:55:20.136302 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 215/479] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:19 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1437 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:20.152590 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 265/480] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:19 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1319 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:20.153858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Calling method '.version_select at 0x7f729e1caf70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:20.157989 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:20.157989 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:20.159254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.159746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.160188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.161874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:20.165477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:20.173160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.173671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.174108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.175081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.176338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.176931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.191449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.191943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.192388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.217312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.217825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.218273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.232825 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-af868233-e5c6-46cb-81c0-1ed36ea1a4b1 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.095293 Aug 06 20:55:20.237091 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 216/481] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:55:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:20.249615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43138bb4-91e1-4da9-afbf-4f626839d6d9 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Calling method '.version_select at 0x7f729e15b820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:20.251299 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:20.251299 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:20.255821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43138bb4-91e1-4da9-afbf-4f626839d6d9 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.256838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43138bb4-91e1-4da9-afbf-4f626839d6d9 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.257894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43138bb4-91e1-4da9-afbf-4f626839d6d9 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.293155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43138bb4-91e1-4da9-afbf-4f626839d6d9 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.294622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43138bb4-91e1-4da9-afbf-4f626839d6d9 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.295401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43138bb4-91e1-4da9-afbf-4f626839d6d9 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.295871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:20.296312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:20.296796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:20.297661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:20.298088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:20.304631 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-43138bb4-91e1-4da9-afbf-4f626839d6d9 tempest-HypervisorAdminUnderV252Test-292957795 tempest-HypervisorAdminUnderV252Test-292957795-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.062475 Aug 06 20:55:20.315678 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 217/482] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Aug 6 20:55:20 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:20.357204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:20.358769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:20.374212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.375922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.377185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.378310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.378991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.379695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.398434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:20.418980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.419891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.420869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.422429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.423069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.423819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.745295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:20.757709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:20.767782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:20.779467 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf85d364-1101-4c06-9cfd-3ae1d0315811 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "POST /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48/action" status: 202 len: 1494 microversion: 2.75 time: 0.621946 Aug 06 20:55:20.782047 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 266/483] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 20:55:20 2022] POST /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48/action => generated 1494 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 06 20:55:20.801967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:20.802866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:20.816877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.817270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.819384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.820122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.820590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.821025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.838891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:20.861196 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-184841d4-277d-4602-b930-c53fe50e5896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1312 microversion: 2.1 time: 0.512710 Aug 06 20:55:20.865309 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 218/484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:20 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:20.875381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:20.876269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:20.898853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.900119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.912422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:20.913941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:20.914632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:20.915235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:21.144012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:21.160604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:21.184520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:21.192455 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-76cbbd86-1b84-493b-a8f2-8b308bc75921 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.325781 Aug 06 20:55:21.208139 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 219/485] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:20 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:21.217198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d3efe04e-618f-49da-932d-af57ac27ff95 req-0f58d05f-ade3-468e-8e94-1cc39b9d7908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d053068c-becf-4353-b775-0bf47d7283ff", "name": "network-vif-plugged", "status": "completed", "tag": "77bb4236-0e88-4203-bc54-27a09c725653"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:21.250873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d3efe04e-618f-49da-932d-af57ac27ff95 req-0f58d05f-ade3-468e-8e94-1cc39b9d7908 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:21.253008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d3efe04e-618f-49da-932d-af57ac27ff95 req-0f58d05f-ade3-468e-8e94-1cc39b9d7908 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:21.254919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d3efe04e-618f-49da-932d-af57ac27ff95 req-0f58d05f-ade3-468e-8e94-1cc39b9d7908 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:21.285319 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d3efe04e-618f-49da-932d-af57ac27ff95 req-0f58d05f-ade3-468e-8e94-1cc39b9d7908 service nova] Creating event network-vif-plugged:77bb4236-0e88-4203-bc54-27a09c725653 for instance d053068c-becf-4353-b775-0bf47d7283ff on nch2-master-1 Aug 06 20:55:21.300128 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d3efe04e-618f-49da-932d-af57ac27ff95 req-0f58d05f-ade3-468e-8e94-1cc39b9d7908 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090197 Aug 06 20:55:21.303524 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 220/486] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:21.321309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:21.322374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:21.333793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:21.339514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:21.340307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:21.341425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:21.342077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:21.342748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:21.785603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:21.794460 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f53308f-48ea-4c84-9b1a-51e64321312b tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1319 microversion: 2.1 time: 0.489400 Aug 06 20:55:21.795079 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 221/487] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:21 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:21.808674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1575417e-c20a-4097-b368-79cb033c66c5 req-1356b535-5ebd-47ff-8c74-9e1298056d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf528ca4-80d5-47b1-8e89-0241a0132074", "tag": "060516c4-8983-4018-8d4a-a96568a9617f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:21.832312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1575417e-c20a-4097-b368-79cb033c66c5 req-1356b535-5ebd-47ff-8c74-9e1298056d8f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:21.833034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1575417e-c20a-4097-b368-79cb033c66c5 req-1356b535-5ebd-47ff-8c74-9e1298056d8f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:21.833348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1575417e-c20a-4097-b368-79cb033c66c5 req-1356b535-5ebd-47ff-8c74-9e1298056d8f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:21.868747 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1575417e-c20a-4097-b368-79cb033c66c5 req-1356b535-5ebd-47ff-8c74-9e1298056d8f service nova] Creating event network-changed:060516c4-8983-4018-8d4a-a96568a9617f for instance cf528ca4-80d5-47b1-8e89-0241a0132074 on nch2-master-1 Aug 06 20:55:21.877299 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1575417e-c20a-4097-b368-79cb033c66c5 req-1356b535-5ebd-47ff-8c74-9e1298056d8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081017 Aug 06 20:55:21.891237 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 222/488] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:22.256534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Calling method '.version_select at 0x7f729e0d8670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:22.261456 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:22.261456 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:22.263238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.263788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.264337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.283806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.284311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.284913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.340658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.341795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.342606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.356670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.357512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.358154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.402752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.404098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.405450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.406852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:22.417857 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ccbd5f4-05da-46c7-850c-5538a24a8ccc tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2152 microversion: 2.53 time: 0.523159 Aug 06 20:55:22.418874 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 223/489] 10.222.0.33 () {60 vars in 1243 bytes} [Sat Aug 6 20:55:21 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2152 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:22.419993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:22.421601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:22.425642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:22.426674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:22.427815 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dccf2f60-2b78-43c8-99fa-d411d4e27db4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1568 microversion: 2.25 time: 1.629722 Aug 06 20:55:22.428413 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 267/490] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:20 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1568 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:55:22.434186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:22.434839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:22.435159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.436010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.436631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.437537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.438233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.438750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.449670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.453229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.455144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.456449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.457119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.457717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.682687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:22.694438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:22.696277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:22.703352 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a64885af-dc96-4a74-8c60-de8a61bbd873 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.273889 Aug 06 20:55:22.714580 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 268/491] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:22 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:22.714580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Calling method '.version_select at 0x7f729e14ddc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:22.723833 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:22.723833 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:22.723833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.723833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.724256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.756917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:22.762222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.767103 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab403c57-5690-4efe-b64a-4bbb366b65ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1312 microversion: 2.1 time: 0.346744 Aug 06 20:55:22.767934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.768541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.770750 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 224/492] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:22 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1312 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:22.793283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.793852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.794357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.818889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:22.820035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:22.832439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.834483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.835827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.836282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.839632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.840298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.841495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.843784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.845467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.923740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.924469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.925057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.934496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fdf5b0ef-b406-4872-9cca-f9cdeba66141 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 844 microversion: 2.53 time: 0.228906 Aug 06 20:55:22.935649 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 269/493] 10.222.0.33 () {60 vars in 1222 bytes} [Sat Aug 6 20:55:22 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 844 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:55:22.949917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-297afa1a-9bde-4e08-8376-cf69f5618302 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Calling method '.version_select at 0x7f729e28e4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:22.960165 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:22.960165 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:22.961917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297afa1a-9bde-4e08-8376-cf69f5618302 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.962606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297afa1a-9bde-4e08-8376-cf69f5618302 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.963447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297afa1a-9bde-4e08-8376-cf69f5618302 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.984422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297afa1a-9bde-4e08-8376-cf69f5618302 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.985163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297afa1a-9bde-4e08-8376-cf69f5618302 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.985878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297afa1a-9bde-4e08-8376-cf69f5618302 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.997835 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-297afa1a-9bde-4e08-8376-cf69f5618302 tempest-HypervisorAdminV253TestBase-809920229 tempest-HypervisorAdminV253TestBase-809920229-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/9d7cabcd-68e4-4d2f-9d4c-da57700556c3" status: 200 len: 792 microversion: 2.53 time: 0.053515 Aug 06 20:55:22.998583 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 270/494] 10.222.0.33 () {60 vars in 1298 bytes} [Sat Aug 6 20:55:22 2022] GET /compute/v2.1/os-hypervisors/9d7cabcd-68e4-4d2f-9d4c-da57700556c3 => generated 792 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:55:23.226030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:23.246245 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f233acd-f82c-47ea-9ede-9d3fc0178bd9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1319 microversion: 2.1 time: 0.431460 Aug 06 20:55:23.248559 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 225/495] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:22 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:23.455209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:23.456095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:23.471079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:23.472527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:23.475968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:23.479659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:23.480162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:23.480592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:23.732786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:23.733459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:23.747459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:23.747957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:23.748398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:23.749118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:23.749576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:23.749996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:23.993378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:24.004979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:24.007061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:24.015351 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f1e3c9e2-736e-49a8-b4e3-da1c8a43f746 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.287328 Aug 06 20:55:24.016553 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 226/496] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:23 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:24.041773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:24.042472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:24.064973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:24.065603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:24.066070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:24.066874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:24.067348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:24.079072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:24.453628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:24.463708 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bf700fbd-508b-4fad-a842-3ab639f36a0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1461 microversion: 2.1 time: 0.438598 Aug 06 20:55:24.474006 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 227/497] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:24 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1461 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:24.479806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:24.486333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:24.520366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:24.520889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:24.521369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:24.522155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:24.522593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:24.527810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:24.545536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:24.861096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:24.870245 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-db1689de-93d0-46c6-a9a3-878e5d8cab0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1319 microversion: 2.1 time: 0.394771 Aug 06 20:55:24.875553 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 228/498] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:24 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:24.880636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:24.889961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:24.910467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:24.911183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:24.911835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:24.912722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:24.913361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:24.913965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:25.087387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:25.094865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Old instance type m1.heat2, new instance type m1.heat {{(pid=142462) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 20:55:25.107758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:25.110006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:25.110721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:25.112982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:25.113618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:25.291861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:25.417154 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-091709f6-f541-470e-97d6-812d5eab6dbd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff/action" status: 202 len: 0 microversion: 2.1 time: 0.540147 Aug 06 20:55:25.420611 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 229/499] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:55:24 2022] POST /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:55:25.426136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:25.427553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:25.436145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:25.436651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:25.437096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:25.438878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:25.439359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:25.439975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:25.684532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:25.704310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:25.707685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:25.709669 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-960f7379-f4a9-4a01-b20f-a2a8d7900b81 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1568 microversion: 2.25 time: 2.260054 Aug 06 20:55:25.710255 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 271/500] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:23 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1568 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:25.717678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:25.747445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:25.748343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:25.749807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:25.753882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:25.779774 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7951608d-cfa1-4890-b9b5-4c2760214470 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.359114 Aug 06 20:55:25.783098 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 230/501] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:25 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:25.783368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:25.787251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:25.788552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:25.790225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:25.793059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:25.793421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:25.807648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-62fc49be-5965-4cd2-982e-da6772ec0da5 req-91c6d50b-313f-44e0-8a2e-bc0f8a6877ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc61a7b0-d433-449a-a4a0-c541f208337d", "name": "network-vif-plugged", "status": "completed", "tag": "80477638-d273-44c3-a82b-c2d5865cd0fd"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:25.858722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-62fc49be-5965-4cd2-982e-da6772ec0da5 req-91c6d50b-313f-44e0-8a2e-bc0f8a6877ae service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:25.859923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-62fc49be-5965-4cd2-982e-da6772ec0da5 req-91c6d50b-313f-44e0-8a2e-bc0f8a6877ae service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:25.860526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-62fc49be-5965-4cd2-982e-da6772ec0da5 req-91c6d50b-313f-44e0-8a2e-bc0f8a6877ae service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:25.913553 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-62fc49be-5965-4cd2-982e-da6772ec0da5 req-91c6d50b-313f-44e0-8a2e-bc0f8a6877ae service nova] Creating event network-vif-plugged:80477638-d273-44c3-a82b-c2d5865cd0fd for instance dc61a7b0-d433-449a-a4a0-c541f208337d on nch2-master-1 Aug 06 20:55:25.929248 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-62fc49be-5965-4cd2-982e-da6772ec0da5 req-91c6d50b-313f-44e0-8a2e-bc0f8a6877ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143505 Aug 06 20:55:25.930206 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 231/502] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:26.255888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:26.377426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ebd11cd-243b-4105-97db-34f7d3aadb9d tempest-InstanceUsageAuditLogNegativeTestJSON-519233315 tempest-InstanceUsageAuditLogNegativeTestJSON-519233315-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:26.378397 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:26.378397 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:26.380871 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-6ebd11cd-243b-4105-97db-34f7d3aadb9d tempest-InstanceUsageAuditLogNegativeTestJSON-519233315 tempest-InstanceUsageAuditLogNegativeTestJSON-519233315-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ebd11cd-243b-4105-97db-34f7d3aadb9d tempest-InstanceUsageAuditLogNegativeTestJSON-519233315 tempest-InstanceUsageAuditLogNegativeTestJSON-519233315-project-admin] Request method failure captured: Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tU9VDGa4pZo8haxhZ_0U8CsHU7koJ6MtCW9JMtMt7yCg6UMQbmb1Jb7oH3I7lDlqPcPjKtbi5t1QPjNTrYRaQ4HLGHuk96o_o48Ry_fy2hFp-7VFC1DGaelzG1ZwPwiff6y9BhBB-HfrILZ8OjnH6Tf4aSUc8WakYbF91wHGgPZsPQ Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: d61c47fe5b094398b28069eb001777b6 Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-519233315 Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:55:26.396248 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d61c47fe5b094398b28069eb001777b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d61c47fe5b094398b28069eb001777b6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d61c47fe5b094398b28069eb001777b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d61c47fe5b094398b28069eb001777b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-519233315 Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: d61c47fe5b094398b28069eb001777b6 Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-519233315 Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-519233315-project-admin Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 94bf980445424649afb7274e8cc8f953 Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-519233315-project-admin Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:55:26.398419 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid timestamp for date invalid_time Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'invalid_time'} Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:26.399262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 06 20:55:26.401825 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.404618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ebd11cd-243b-4105-97db-34f7d3aadb9d tempest-InstanceUsageAuditLogNegativeTestJSON-519233315 tempest-InstanceUsageAuditLogNegativeTestJSON-519233315-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:26.405738 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6ebd11cd-243b-4105-97db-34f7d3aadb9d tempest-InstanceUsageAuditLogNegativeTestJSON-519233315 tempest-InstanceUsageAuditLogNegativeTestJSON-519233315-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.474255 Aug 06 20:55:26.406511 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 232/503] 10.222.0.33 () {58 vars in 1224 bytes} [Sat Aug 6 20:55:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 476 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:26.415544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:26.416985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:26.433992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:26.440684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:26.441648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:26.443295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:26.444122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:26.444895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:26.475176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:26.487630 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8a4c3a0c-7cbb-4d06-bccf-28a639427575 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1470 microversion: 2.1 time: 0.774767 Aug 06 20:55:26.490909 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 272/504] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:25 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1470 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:26.783660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e257532-ca75-4ce1-842d-be46430d92cd tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:26.785156 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:26.785156 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:26.786633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1e257532-ca75-4ce1-842d-be46430d92cd tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '6eb56171c33045c0ae3de05f854a1e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85daaeab115b4b38a6a28e2730bb36da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e257532-ca75-4ce1-842d-be46430d92cd tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] Request method failure captured: Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tU8gau3CN6nU2dakhhZT1NNBNtCr-PEzYFA2EG6pziRAThjkuZyMy-uki_P5sZf9qm5ufvcmXD1iRR4LpkUjHALlk40zwnb6VJyr7nvuEDsfaiqrpzcVSs-cYWhuBZTg4KuETMZAPTToK4HUHKU4RJVOFtwb-hd42s_sk9ELtbGS6Y Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 85daaeab115b4b38a6a28e2730bb36da Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:26.788779 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85daaeab115b4b38a6a28e2730bb36da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85daaeab115b4b38a6a28e2730bb36da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85daaeab115b4b38a6a28e2730bb36da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85daaeab115b4b38a6a28e2730bb36da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 85daaeab115b4b38a6a28e2730bb36da Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 6eb56171c33045c0ae3de05f854a1e6d Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project Aug 06 20:55:26.790178 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:26.791013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 06 20:55:26.792445 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.795018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e257532-ca75-4ce1-842d-be46430d92cd tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:26.796101 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e257532-ca75-4ce1-842d-be46430d92cd tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.303668 Aug 06 20:55:26.797130 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 273/505] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Aug 6 20:55:26 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 306 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:55:26.804321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:26.805498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:26.814108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:26.823087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:26.823827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:26.824294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:26.825194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:26.825887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:26.826504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:26.837527 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a6a124d3-c46a-4333-b96f-58d209d884a8 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1319 microversion: 2.1 time: 0.429706 Aug 06 20:55:26.846316 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 233/506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:26 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:26.851460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-57a30b5a-65f8-48e7-955c-d2f6a1d1161b tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:26.852221 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:26.852221 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:26.853345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-57a30b5a-65f8-48e7-955c-d2f6a1d1161b tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '6eb56171c33045c0ae3de05f854a1e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85daaeab115b4b38a6a28e2730bb36da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-57a30b5a-65f8-48e7-955c-d2f6a1d1161b tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] Request method failure captured: Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-06%2020:55:26 HTTP/1.1 Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tU8gau3CN6nU2dakhhZT1NNBNtCr-PEzYFA2EG6pziRAThjkuZyMy-uki_P5sZf9qm5ufvcmXD1iRR4LpkUjHALlk40zwnb6VJyr7nvuEDsfaiqrpzcVSs-cYWhuBZTg4KuETMZAPTToK4HUHKU4RJVOFtwb-hd42s_sk9ELtbGS6Y Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 85daaeab115b4b38a6a28e2730bb36da Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:55:26.854987 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85daaeab115b4b38a6a28e2730bb36da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85daaeab115b4b38a6a28e2730bb36da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85daaeab115b4b38a6a28e2730bb36da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85daaeab115b4b38a6a28e2730bb36da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 85daaeab115b4b38a6a28e2730bb36da Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 6eb56171c33045c0ae3de05f854a1e6d Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project Aug 06 20:55:26.856314 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '2022-08-06 20:55:26'} Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:26.856898 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 06 20:55:26.859247 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:26.862318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-57a30b5a-65f8-48e7-955c-d2f6a1d1161b tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:26.862318 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-57a30b5a-65f8-48e7-955c-d2f6a1d1161b tempest-InstanceUsageAuditLogNegativeTestJSON-604350018 tempest-InstanceUsageAuditLogNegativeTestJSON-604350018-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-06 20:55:26" status: 403 len: 128 microversion: 2.1 time: 0.008921 Aug 06 20:55:26.864354 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 234/507] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 20:55:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-06%2020%3A55%3A26 => generated 128 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:55:26.877881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:26.880421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:26.881258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:26.888997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:26.889488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:26.901506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:26.902518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:26.903164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:26.903780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:27.054023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:27.070895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:27.073405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:27.090491 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d89c0f1f-5793-4252-8aaf-b81fdc8d2876 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.225115 Aug 06 20:55:27.091213 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 235/508] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:26 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:27.516324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:27.517193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:27.528109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:27.528855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:27.529439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:27.539643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:27.540370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:27.542824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:27.599457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:27.616212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:27.620712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:27.622110 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d7f826a-4650-4c69-9e00-02b585d478b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1568 microversion: 2.25 time: 0.823713 Aug 06 20:55:27.630469 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 274/509] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:26 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1568 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:27.647801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2014715227", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "1007064571", "adminPass": "***", "networks": [{"uuid": "4fc9d6ac-3573-4277-8082-cfce024b5c45"}], "security_groups": [{"name": "tempest-securitygroup--1562997924"}], "key_name": "tempest-keypair-601269215", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:28.016813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] validate_networks() for [('4fc9d6ac-3573-4277-8082-cfce024b5c45', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:55:28.283939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:28.292605 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-73659603-b69c-4b0a-bb0d-c4c5642e20e6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1470 microversion: 2.1 time: 0.780476 Aug 06 20:55:28.295099 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 236/510] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:27 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1470 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:28.301509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:28.302351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:28.309821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:28.310593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:28.311142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:28.311955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:28.312596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:28.313127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:28.592637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:28.604734 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f45ba28-6d13-42fb-91e2-d03bd1236ee1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1469 microversion: 2.1 time: 0.306898 Aug 06 20:55:28.605860 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 237/511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:28 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:28.613640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-3d4d6a4b-f235-45c4-9d24-d1c6e2f2bc0e req-d9446444-279f-4d2f-963b-eeed8f20b2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16c7d7a-6a48-4260-b7d1-451b01c03425", "name": "network-vif-plugged", "status": "completed", "tag": "3c8d9295-154e-4003-bad7-77e541a4a2d4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:28.630422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3d4d6a4b-f235-45c4-9d24-d1c6e2f2bc0e req-d9446444-279f-4d2f-963b-eeed8f20b2e7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:28.631517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3d4d6a4b-f235-45c4-9d24-d1c6e2f2bc0e req-d9446444-279f-4d2f-963b-eeed8f20b2e7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:28.632305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3d4d6a4b-f235-45c4-9d24-d1c6e2f2bc0e req-d9446444-279f-4d2f-963b-eeed8f20b2e7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:28.654457 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-3d4d6a4b-f235-45c4-9d24-d1c6e2f2bc0e req-d9446444-279f-4d2f-963b-eeed8f20b2e7 service nova] Creating event network-vif-plugged:3c8d9295-154e-4003-bad7-77e541a4a2d4 for instance c16c7d7a-6a48-4260-b7d1-451b01c03425 on nch2-master-1 Aug 06 20:55:28.664063 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-3d4d6a4b-f235-45c4-9d24-d1c6e2f2bc0e req-d9446444-279f-4d2f-963b-eeed8f20b2e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054619 Aug 06 20:55:28.666441 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 238/512] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:28.673999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=10 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:28.687458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:28.688479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:28.713384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:28.714933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:28.715599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:28.717221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:28.718433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:28.720386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:28.916828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:28.931749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:28.934318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:28.961405 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e0bd40bc-387c-45aa-87ca-9f7baa687b3c tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.287100 Aug 06 20:55:28.963024 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 239/513] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:28 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:28.973054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:28.974482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:28.988690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:28.993132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:28.995199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:28.996141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:28.998496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:28.999131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:29.163343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:29.163862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:29.164451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:29.164973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:29.166216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:29.186854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:29.187814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:29.188381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:29.189598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:29.190206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:29.190737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:29.226999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Getting quotas for project 2eff0aae88974b5a893b71e0d6b34257. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:29.234950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Getting quotas for user 4604780fce5b4ece8cb20354efb53569 and project 2eff0aae88974b5a893b71e0d6b34257. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:29.271898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:29.279607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:29.391580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:29.395674 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9625d324-ddd4-47f5-991d-84d214481203 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.763599 Aug 06 20:55:29.396216 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 275/514] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:55:29.405674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:29.406273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:29.419620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:29.420148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:29.420586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:29.428568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:29.433330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:29.436068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:29.439197 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d2fb172-b6d2-4174-ac20-8cb8260b9311 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425" status: 200 len: 1319 microversion: 2.1 time: 0.468917 Aug 06 20:55:29.441616 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 240/515] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:28 2022] GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:29.456204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:29.457300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:29.495631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:29.497363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:29.499045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:29.500119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:29.500807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:29.501880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:29.835372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:29.854828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:29.862160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:29.868174 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-27b3f3f2-fd61-47d8-a7c3-7b109422708d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1568 microversion: 2.25 time: 0.470936 Aug 06 20:55:29.876610 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 276/516] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:29 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1568 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:29.908398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4ba96c43-f05e-4da2-acb1-ad0fdfde7798 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:29.911507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4ba96c43-f05e-4da2-acb1-ad0fdfde7798 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:29.947584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:29.962845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-01074ecc-1f4a-463d-af6b-918becfe8896 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1470 microversion: 2.1 time: 0.519156 Aug 06 20:55:29.963688 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 241/517] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:29 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1470 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:29.997124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:29.998666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:30.017233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:30.017937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:30.019158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:30.020196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:30.021138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:30.021774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:30.201379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:30.234793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:30.242270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:30.264227 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fef6d5b5-f4dd-4846-968e-34cbaf15e440 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.279876 Aug 06 20:55:30.272731 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 242/518] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:29 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:30.467513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:30.468374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:30.484797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:30.487303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:30.493781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:30.496742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:30.497410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:30.497874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:30.597329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4ba96c43-f05e-4da2-acb1-ad0fdfde7798 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:30.612937 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4ba96c43-f05e-4da2-acb1-ad0fdfde7798 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1264 microversion: 2.1 time: 0.715095 Aug 06 20:55:30.628279 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 277/519] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:29 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1264 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:30.900851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:30.902168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:30.908708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:30.909533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:30.910248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:30.911290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:30.912054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:30.912580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:30.978625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:30.990476 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1472025f-fcba-4eb9-9915-ee1864895628 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425" status: 200 len: 1469 microversion: 2.1 time: 0.527862 Aug 06 20:55:30.991719 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 243/520] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:30 2022] GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 => generated 1469 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:30.998598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:31.000184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:31.006526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:31.007253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:31.007842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:31.008713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:31.009720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:31.010150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:31.085045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.094378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.096338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.098047 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0abf1220-1392-4147-95b2-5c9ed7427065 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1558 microversion: 2.25 time: 0.201833 Aug 06 20:55:31.098980 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 278/521] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:30 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:55:31.104386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:31.109841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.111079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Searching by: {'reservation_id': 'r-to2zji5i', 'deleted': False, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:55:31.117083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:31.118186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:31.119336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:31.120548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:31.121124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:31.121663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:31.303975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 20:55:31.426166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.438728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:31.439209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:31.439651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:31.707382 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-29ddb5aa-3f4e-4141-99ce-1d4b3f50e5bd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-to2zji5i" status: 200 len: 2931 microversion: 2.1 time: 0.607177 Aug 06 20:55:31.719145 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 279/522] 10.222.0.33 () {58 vars in 1197 bytes} [Sat Aug 6 20:55:31 2022] GET /compute/v2.1/servers/detail?reservation_id=r-to2zji5i => generated 2931 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:31.724062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6fdc2f55-b8f9-4675-ab5c-c7a058b1cc89 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '.version_select at 0x7f729e3224c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:31.734048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fdc2f55-b8f9-4675-ab5c-c7a058b1cc89 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:31.736569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fdc2f55-b8f9-4675-ab5c-c7a058b1cc89 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:31.737364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fdc2f55-b8f9-4675-ab5c-c7a058b1cc89 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:31.770635 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6fdc2f55-b8f9-4675-ab5c-c7a058b1cc89 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.049129 Aug 06 20:55:31.771990 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 280/523] 10.222.0.33 () {60 vars in 1184 bytes} [Sat Aug 6 20:55:31 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:31.781884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:31.782958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:31.795722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:31.797093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:31.798222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:31.804515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:31.805321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:31.806179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:31.936647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.951230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.953064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.966960 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d44197d-70a4-4304-ac9c-9cd6b35317ab tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.193494 Aug 06 20:55:31.975141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.987651 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3656722c-02af-4439-a884-11c38f227279 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.994611 Aug 06 20:55:31.988411 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 244/525] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:30 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:31.990797 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 281/525] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:31 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:32.002046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:32.002527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:32.010805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.011415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53aa8847-748d-4d26-a026-1397a7aebf4e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:32.012164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.012933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.013963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.014676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.015443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.081063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.compute.server_groups [None req-53aa8847-748d-4d26-a026-1397a7aebf4e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Querying cell 7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) for 2 instances {{(pid=142461) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 06 20:55:32.082173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53aa8847-748d-4d26-a026-1397a7aebf4e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.085028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53aa8847-748d-4d26-a026-1397a7aebf4e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.085671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53aa8847-748d-4d26-a026-1397a7aebf4e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.176308 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53aa8847-748d-4d26-a026-1397a7aebf4e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/82fbbd24-b4e1-4d95-9266-83c4990a1892" status: 200 len: 266 microversion: 2.1 time: 0.183877 Aug 06 20:55:32.177370 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 282/526] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 20:55:31 2022] GET /compute/v2.1/os-server-groups/82fbbd24-b4e1-4d95-9266-83c4990a1892 => generated 266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:32.182589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:32.184421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:32.185228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:32.192897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.193773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.194395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.195362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.195975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.196586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.211190 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-db1c5607-d450-4390-9ae4-32ba8cf1a422 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1322 microversion: 2.1 time: 0.220231 Aug 06 20:55:32.217060 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 245/527] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:31 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:32.226492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aaafbb60-1110-422b-a523-a197d424a6f3 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:32.234085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aaafbb60-1110-422b-a523-a197d424a6f3 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:32.255822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aaafbb60-1110-422b-a523-a197d424a6f3 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.256310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aaafbb60-1110-422b-a523-a197d424a6f3 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.256756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aaafbb60-1110-422b-a523-a197d424a6f3 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.257473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aaafbb60-1110-422b-a523-a197d424a6f3 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.257948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aaafbb60-1110-422b-a523-a197d424a6f3 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.258375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aaafbb60-1110-422b-a523-a197d424a6f3 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.479705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid cf528ca4-80d5-47b1-8e89-0241a0132074 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:32.548982 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-62b03f3d-30f5-4286-8aac-008e9816e7db tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 2051 microversion: 2.25 time: 0.369746 Aug 06 20:55:32.550098 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 283/528] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:32 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 2051 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:32.682492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:32.694453 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aaafbb60-1110-422b-a523-a197d424a6f3 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425" status: 200 len: 1620 microversion: 2.1 time: 0.475684 Aug 06 20:55:32.695649 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 246/529] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:32 2022] GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 => generated 1620 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:32.714728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9278ec5-e189-4c9f-a379-9881e3b782ac tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:32.715914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b9278ec5-e189-4c9f-a379-9881e3b782ac tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:32.722401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9278ec5-e189-4c9f-a379-9881e3b782ac tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.722929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9278ec5-e189-4c9f-a379-9881e3b782ac tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.723539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9278ec5-e189-4c9f-a379-9881e3b782ac tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.724403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9278ec5-e189-4c9f-a379-9881e3b782ac tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.725026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9278ec5-e189-4c9f-a379-9881e3b782ac tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.725452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9278ec5-e189-4c9f-a379-9881e3b782ac tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.871468 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9278ec5-e189-4c9f-a379-9881e3b782ac tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 200 len: 1620 microversion: 2.1 time: 0.160933 Aug 06 20:55:32.876288 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 284/530] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:32 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 1620 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:32.895065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f2b18318-9729-441d-8064-297249bda793 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Action: 'create', calling method: .version_select at 0x7f729e44e9d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1215149189", "policies": ["anti-affinity"]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:32.897379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1361528012", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0b16c9c9-35af-4398-8cf2-00695211de1f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:32.909849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:32.913939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f2b18318-9729-441d-8064-297249bda793 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:32.920216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f2b18318-9729-441d-8064-297249bda793 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:32.939680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:32.982142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] validate_networks() for [('0b16c9c9-35af-4398-8cf2-00695211de1f', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:55:32.992865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f2b18318-9729-441d-8064-297249bda793 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:33.002133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f2b18318-9729-441d-8064-297249bda793 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:33.017320 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f2b18318-9729-441d-8064-297249bda793 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.126730 Aug 06 20:55:33.018124 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 285/531] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Aug 6 20:55:32 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:55:33.029903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:33.031793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:33.042833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:33.043332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:33.043772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:33.044483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:33.047598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:33.048040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:33.170772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:33.183153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:33.184930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:33.195521 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f55efc06-2bc4-4143-a3ea-4550b1ba4c84 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.176001 Aug 06 20:55:33.204099 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 286/532] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:33 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:33.214193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:33.214976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:33.229674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:33.232166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:33.232166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:33.232166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:33.232565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:33.232987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:33.529595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:33.539342 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-31775a35-589b-4a23-8fbb-c9638d8e8763 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.333875 Aug 06 20:55:33.542426 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 287/533] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:33 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:33.547568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:33.548671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:33.557715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:33.558455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:33.559422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:33.560404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:33.561157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:33.562133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:33.798660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:33.811237 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e9ed5bf7-03af-475e-ac8f-bb80f079629d tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1390 microversion: 2.1 time: 0.267503 Aug 06 20:55:33.812491 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 288/534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:33 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1390 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:33.817672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1775553640", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cd84b490-1adc-4a7f-a8e2-6ddf1fcf3316"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:33.895255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:55:33.996935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:33.998141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:33.998825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:33.999438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:34.000084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:34.010851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:34.011339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:34.011873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:34.012799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:34.013407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:34.013992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:34.035973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:34.042953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for user 343f309c07e343b4b15268472d19f10c and project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:34.060649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:34.064627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:34.127286 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4b870ed7-0bfa-40c8-8f3a-c53e1399499e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.240853 Aug 06 20:55:34.128504 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 247/535] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 20:55:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 20:55:34.145232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-13f6366d-590c-4b67-86df-e2d2dd7c3892 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:34.146314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13f6366d-590c-4b67-86df-e2d2dd7c3892 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:34.219974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:34.221863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:34.221863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:34.221863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:34.221863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:34.228012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13f6366d-590c-4b67-86df-e2d2dd7c3892 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:34.241888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13f6366d-590c-4b67-86df-e2d2dd7c3892 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:34.246197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13f6366d-590c-4b67-86df-e2d2dd7c3892 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:34.247446 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-13f6366d-590c-4b67-86df-e2d2dd7c3892 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1262 microversion: 2.25 time: 0.108145 Aug 06 20:55:34.249324 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 248/536] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:34 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1262 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:55:34.250626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:34.251336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:34.251713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:34.252455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:34.253127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:34.253557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:34.274853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:34.280656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:34.300641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Going to run 2 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:34.302884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:34.357656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=142461) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 06 20:55:34.396553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:34.405062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:34.492735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:34.500013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:34.519967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=f4a6fa4c-df67-4379-88ff-45430f0b9a4d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:34.584060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-978982985", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:34.633631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:34.652523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:34.685404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:55:34.749668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:34.756462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'server_group_members'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:34.810636 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd35fd24-5d64-4140-aa78-b639fdc3ef0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.996761 Aug 06 20:55:34.816607 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 289/537] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 1003 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 06 20:55:34.827972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:34.828904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:34.846942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:34.847363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:34.848060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:34.848986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:34.849642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:34.850261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:34.969460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:34.982629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:34.984737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:34.989366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:34.991480 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f18ecef8-f70a-4ae0-b139-5719d2aca371 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.173161 Aug 06 20:55:34.992627 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 290/538] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:34 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:34.998820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:34.999668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:35.015523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.016393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.018701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.019461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.019933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.020372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.150661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:35.151250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:35.151738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:35.152154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:35.152616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:35.174435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.174719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.175163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.175905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.176365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.176799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.229282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:35.232184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Getting quotas for project d5ef27173302447a82d257b1f838e75d. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:35.248636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Getting quotas for user 79ffbe6477ea45f481620fa6293e1958 and project d5ef27173302447a82d257b1f838e75d. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:35.249502 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c89e1085-9409-4bf5-a61f-832084294133 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.255385 Aug 06 20:55:35.250196 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 291/539] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:34 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:35.264190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:35.264190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:35.264190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Searching by: {'deleted': False, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:55:35.274218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:35.278065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.278590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.279235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.280072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.280738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.281267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.285208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:35.336830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 20:55:35.362221 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6567e20f-55f6-42f7-8105-a42eae4426ee tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111802 Aug 06 20:55:35.363176 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 249/540] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:55:35.381770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:35.382639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:35.392607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.393356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.394112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.395031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.395687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.396519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.405251 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bfa22a74-f91c-4782-b05c-bfddff64f2b2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.151025 Aug 06 20:55:35.413103 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 292/541] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 20:55:35 2022] GET /compute/v2.1/servers => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:35.417099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e1ea350e-dac4-44f7-952b-2d3153a02294 req-9619d57c-e641-4c99-bc9d-7479a1d7669c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d48166-5304-479e-998a-4ca89870b1a2", "tag": "6753505e-1a26-48b2-8451-717992f9bed3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:35.437284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e1ea350e-dac4-44f7-952b-2d3153a02294 req-9619d57c-e641-4c99-bc9d-7479a1d7669c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.437980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e1ea350e-dac4-44f7-952b-2d3153a02294 req-9619d57c-e641-4c99-bc9d-7479a1d7669c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.438727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e1ea350e-dac4-44f7-952b-2d3153a02294 req-9619d57c-e641-4c99-bc9d-7479a1d7669c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.457568 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e1ea350e-dac4-44f7-952b-2d3153a02294 req-9619d57c-e641-4c99-bc9d-7479a1d7669c service nova] Creating event network-changed:6753505e-1a26-48b2-8451-717992f9bed3 for instance 70d48166-5304-479e-998a-4ca89870b1a2 on nch1-master-1 Aug 06 20:55:35.465182 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e1ea350e-dac4-44f7-952b-2d3153a02294 req-9619d57c-e641-4c99-bc9d-7479a1d7669c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056347 Aug 06 20:55:35.466460 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 293/542] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:35.746759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:35.755923 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-60d59b2f-15cc-42f3-aca7-0e08862bd07e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1390 microversion: 2.1 time: 0.391512 Aug 06 20:55:35.759891 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 250/543] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:35 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1390 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:35.770648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:35.771496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:35.773762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32f22333-da32-41c6-bc82-049ff53e631f tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Action: 'create', calling method: .version_select at 0x7f729e6053a0>, body: {"keypair": {"name": "tempest-keypair-1349911272", "type": "ssh", "user_id": "1af69965aeae44449fe70f2cd63c0fed", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFghSkHYOh6AlU3zLjqpvA6u1ncWZZjjJ6bnkfNTagrNaxtAwucGExFOA49B3y4/BUUKu9C4/7bqcUcomyW+ERtuKFD4z+m72/qxq6dXo80HxVUyFg0LKX2veL//apIMyw=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:35.792217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.794083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.796008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.798616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.800302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.801943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.817729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-32f22333-da32-41c6-bc82-049ff53e631f tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Getting quotas for project b74c8a0e42c14775aee608cad242c989. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:35.827153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-32f22333-da32-41c6-bc82-049ff53e631f tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Getting quotas for user 2b8a9623b0174c6e95097546c83667c3 and project b74c8a0e42c14775aee608cad242c989. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:35.866199 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32f22333-da32-41c6-bc82-049ff53e631f tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.396918 Aug 06 20:55:35.869088 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 294/544] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Aug 6 20:55:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 402 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 20:55:35.885182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12d9757b-3844-4d35-9a60-c8b9c8257121 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:35.886649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-12d9757b-3844-4d35-9a60-c8b9c8257121 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:35.987212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:35.999042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:36.000963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:36.002501 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b379c59a-eb10-480f-9dbc-040a5f82362c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1322 microversion: 2.25 time: 0.240800 Aug 06 20:55:36.003290 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 251/545] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:35 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:36.008120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-305bb36b-7d7e-4983-99fb-4ab89543a5ef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.010064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-305bb36b-7d7e-4983-99fb-4ab89543a5ef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:36.086047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-305bb36b-7d7e-4983-99fb-4ab89543a5ef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:36.095385 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-305bb36b-7d7e-4983-99fb-4ab89543a5ef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1219 microversion: 2.1 time: 0.090820 Aug 06 20:55:36.096389 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 252/546] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:36 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:36.173818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1021b3c2-d5b3-4bc1-9467-887609fec57f tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Calling method '.version_select at 0x7f729e15b820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.197190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-12d9757b-3844-4d35-9a60-c8b9c8257121 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:36.202224 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-1021b3c2-d5b3-4bc1-9467-887609fec57f tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] HTTP exception thrown: Image not found. Aug 06 20:55:36.204966 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12d9757b-3844-4d35-9a60-c8b9c8257121 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1218 microversion: 2.1 time: 0.332529 Aug 06 20:55:36.205529 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 295/547] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:35 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1218 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1021b3c2-d5b3-4bc1-9467-887609fec57f tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Request method failure captured: Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/images/a24ef2be-16ad-4e58-a61b-087fb8f0aafe/metadata/os_distro HTTP/1.1 Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVH70--4pASjtga6k6fFWi0vOdJC0ReRym8fGfxlfj3nuTTDneMds91HOZUeztenFCgs0_6f4y5Z_zACV2jfLSp4MoOcdNT5YFJvGQQ1xQvwu9luUoVJXuith-Ud8sjHIMPPcXb8f4SqZ-ImHxp5_rsDbbJzbnj1qrpUA2T4nLw6GQ Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:55:36.210488 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d3df491595442f0b3db2c41d8f92e90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 86365ec401234204a907a9f7d955b41c Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'image_id': 'a24ef2be-16ad-4e58-a61b-087fb8f0aafe', 'id': 'os_distro'} Aug 06 20:55:36.212592 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.213479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a24ef2be-16ad-4e58-a61b-087fb8f0aafe Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.214965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a24ef2be-16ad-4e58-a61b-087fb8f0aafe could not be found. Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:36.216558 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:55:36.217909 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.219182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1021b3c2-d5b3-4bc1-9467-887609fec57f tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:36.223489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a13d8e0d-1ade-4911-9bfc-4ef8cc6f0d0c tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Action: 'create', calling method: .version_select at 0x7f729e14ddc0>, body: {"keypair": {"name": "tempest-keypair-1894114232", "type": "ssh", "user_id": "1af69965aeae44449fe70f2cd63c0fed", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+26m7DvF86vZuHy9/wJDmcN9yVK62k7WifU3ufj6BRrBiIrrTrXHu+1YlVN/cVNCfvmalZ679NNkKu/kTRxW8c9nKG/udRCVx4BGJPOA7lKW10iNwI6GiqywvqIWoh2Q=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:36.223722 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1021b3c2-d5b3-4bc1-9467-887609fec57f tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] 10.222.0.33 "DELETE /compute/v2.1/images/a24ef2be-16ad-4e58-a61b-087fb8f0aafe/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.125725 Aug 06 20:55:36.225205 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 253/548] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 20:55:36 2022] DELETE /compute/v2.1/images/a24ef2be-16ad-4e58-a61b-087fb8f0aafe/metadata/os_distro => generated 62 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:36.235121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.235931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:36.243657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:36.243878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a13d8e0d-1ade-4911-9bfc-4ef8cc6f0d0c tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Getting quotas for project b74c8a0e42c14775aee608cad242c989. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:36.244258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:36.244894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:36.245777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:36.246406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:36.246897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:36.249737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a13d8e0d-1ade-4911-9bfc-4ef8cc6f0d0c tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Getting quotas for user 2b8a9623b0174c6e95097546c83667c3 and project b74c8a0e42c14775aee608cad242c989. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:36.284915 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a13d8e0d-1ade-4911-9bfc-4ef8cc6f0d0c tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.078153 Aug 06 20:55:36.285682 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 296/549] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Aug 6 20:55:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 20:55:36.292348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6fd51c47-b7d0-473d-8259-de82cd57ed8d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Calling method '.version_select at 0x7f729e307280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.325717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:36.327127 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-6fd51c47-b7d0-473d-8259-de82cd57ed8d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] HTTP exception thrown: Image not found. Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6fd51c47-b7d0-473d-8259-de82cd57ed8d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Request method failure captured: Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/images/63ba3ebf-47b2-4231-ad05-ccfbce7af95b/metadata/os_version HTTP/1.1 Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVH70--4pASjtga6k6fFWi0vOdJC0ReRym8fGfxlfj3nuTTDneMds91HOZUeztenFCgs0_6f4y5Z_zACV2jfLSp4MoOcdNT5YFJvGQQ1xQvwu9luUoVJXuith-Ud8sjHIMPPcXb8f4SqZ-ImHxp5_rsDbbJzbnj1qrpUA2T4nLw6GQ Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:36.332880 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d3df491595442f0b3db2c41d8f92e90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 86365ec401234204a907a9f7d955b41c Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'image_id': '63ba3ebf-47b2-4231-ad05-ccfbce7af95b', 'id': 'os_version'} Aug 06 20:55:36.334178 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.334986 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 63ba3ebf-47b2-4231-ad05-ccfbce7af95b Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.340626 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63ba3ebf-47b2-4231-ad05-ccfbce7af95b could not be found. Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:36.341895 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.343062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6fd51c47-b7d0-473d-8259-de82cd57ed8d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:36.345333 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6fd51c47-b7d0-473d-8259-de82cd57ed8d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] 10.222.0.33 "GET /compute/v2.1/images/63ba3ebf-47b2-4231-ad05-ccfbce7af95b/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.048176 Aug 06 20:55:36.345472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:36.345623 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 297/550] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 20:55:36 2022] GET /compute/v2.1/images/63ba3ebf-47b2-4231-ad05-ccfbce7af95b/metadata/os_version => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:36.345755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:36.345896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.345896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:36.346161 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e77f17f-7cce-4d3a-818f-19cf951e6e4b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.117432 Aug 06 20:55:36.351299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:36.351799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:36.352243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:36.353961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:36.354687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:36.355185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:36.359055 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 254/551] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:36 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:36.363863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-01d42fb8-18ac-436a-bbdc-3db61eba2e0d tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Calling method '.version_select at 0x7f729ee761f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.375672 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-01d42fb8-18ac-436a-bbdc-3db61eba2e0d tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1349911272?user_id=1af69965aeae44449fe70f2cd63c0fed" status: 200 len: 512 microversion: 2.10 time: 0.015418 Aug 06 20:55:36.376715 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 255/552] 10.222.0.33 () {60 vars in 1340 bytes} [Sat Aug 6 20:55:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1349911272?user_id=1af69965aeae44449fe70f2cd63c0fed => generated 512 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:55:36.381664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7bfaec7-9fc2-4453-8400-7e5ff8affdbd tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Calling method '.version_select at 0x7f729df8c040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.406815 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a7bfaec7-9fc2-4453-8400-7e5ff8affdbd tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] HTTP exception thrown: Image not found. Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7bfaec7-9fc2-4453-8400-7e5ff8affdbd tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Request method failure captured: Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/images/515fd568-a912-4c47-9381-d3896976937d/metadata HTTP/1.1 Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVH70--4pASjtga6k6fFWi0vOdJC0ReRym8fGfxlfj3nuTTDneMds91HOZUeztenFCgs0_6f4y5Z_zACV2jfLSp4MoOcdNT5YFJvGQQ1xQvwu9luUoVJXuith-Ud8sjHIMPPcXb8f4SqZ-ImHxp5_rsDbbJzbnj1qrpUA2T4nLw6GQ Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:55:36.409008 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d3df491595442f0b3db2c41d8f92e90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 86365ec401234204a907a9f7d955b41c Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'image_id': '515fd568-a912-4c47-9381-d3896976937d'} Aug 06 20:55:36.410429 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.411219 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 515fd568-a912-4c47-9381-d3896976937d Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.412271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 515fd568-a912-4c47-9381-d3896976937d could not be found. Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:36.414111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.416581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7bfaec7-9fc2-4453-8400-7e5ff8affdbd tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:36.418704 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7bfaec7-9fc2-4453-8400-7e5ff8affdbd tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] 10.222.0.33 "GET /compute/v2.1/images/515fd568-a912-4c47-9381-d3896976937d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.033381 Aug 06 20:55:36.418704 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 256/553] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 20:55:36 2022] GET /compute/v2.1/images/515fd568-a912-4c47-9381-d3896976937d/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:36.420835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-511ad8af-2271-4450-8562-931b23b16bfb tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Action: 'create', calling method: .version_select at 0x7f729df99b80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-326980849", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSdDxvtBCmKs9839ym0TG21rsaiHG2dNQtgf81Iqk9V1iMF+7jfnOYQYCQZAFfloPR+MhF+jUQ6bMnoRG7tCFVGOtd4AUVL8ZaFwJzsJm/G77JHGVXiTC70bPLwwvjcFw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:36.437182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-511ad8af-2271-4450-8562-931b23b16bfb tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Getting quotas for project b74c8a0e42c14775aee608cad242c989. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:36.442472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-511ad8af-2271-4450-8562-931b23b16bfb tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Getting quotas for user 2b8a9623b0174c6e95097546c83667c3 and project b74c8a0e42c14775aee608cad242c989. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:36.469413 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-511ad8af-2271-4450-8562-931b23b16bfb tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.056531 Aug 06 20:55:36.470276 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 257/554] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Aug 6 20:55:36 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 20:55:36.475380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5cd07221-a0c5-43d5-babb-5f127e06797d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Action: 'update_all', calling method: .version_select at 0x7f729e0d8a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:36.504371 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5cd07221-a0c5-43d5-babb-5f127e06797d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] HTTP exception thrown: Image not found. Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5cd07221-a0c5-43d5-babb-5f127e06797d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Request method failure captured: Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/images/643a7368-7a6c-4ae1-95fd-552b8d861be2/metadata HTTP/1.1 Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 57 Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVH70--4pASjtga6k6fFWi0vOdJC0ReRym8fGfxlfj3nuTTDneMds91HOZUeztenFCgs0_6f4y5Z_zACV2jfLSp4MoOcdNT5YFJvGQQ1xQvwu9luUoVJXuith-Ud8sjHIMPPcXb8f4SqZ-ImHxp5_rsDbbJzbnj1qrpUA2T4nLw6GQ Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:55:36.506480 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d3df491595442f0b3db2c41d8f92e90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 86365ec401234204a907a9f7d955b41c Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 20:55:36.508060 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'image_id': '643a7368-7a6c-4ae1-95fd-552b8d861be2', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.509646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 643a7368-7a6c-4ae1-95fd-552b8d861be2 Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.510930 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 643a7368-7a6c-4ae1-95fd-552b8d861be2 could not be found. Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:36.512729 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:55:36.514973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.518216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5cd07221-a0c5-43d5-babb-5f127e06797d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:36.518216 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5cd07221-a0c5-43d5-babb-5f127e06797d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] 10.222.0.33 "PUT /compute/v2.1/images/643a7368-7a6c-4ae1-95fd-552b8d861be2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036759 Aug 06 20:55:36.518216 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 258/555] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 20:55:36 2022] PUT /compute/v2.1/images/643a7368-7a6c-4ae1-95fd-552b8d861be2/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:36.518564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fcbca232-128e-4e92-b887-09420a10d2ec tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Calling method '.version_select at 0x7f729df8cee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.522905 ncdv-master-1 devstack@n-api.service[142462]: WARNING oslo_db.sqlalchemy.utils [None req-fcbca232-128e-4e92-b887-09420a10d2ec tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 06 20:55:36.530239 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fcbca232-128e-4e92-b887-09420a10d2ec tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs?user_id=1af69965aeae44449fe70f2cd63c0fed" status: 200 len: 726 microversion: 2.10 time: 0.015301 Aug 06 20:55:36.531000 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 259/556] 10.222.0.33 () {60 vars in 1259 bytes} [Sat Aug 6 20:55:36 2022] GET /compute/v2.1/os-keypairs?user_id=1af69965aeae44449fe70f2cd63c0fed => generated 726 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:55:36.535572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-807d30a4-7b2a-40a5-9db8-4791d47f8794 tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Action: 'update', calling method: .version_select at 0x7f729e0d8c10>, body: {"meta": {"os_distro": "alt"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:36.558685 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-807d30a4-7b2a-40a5-9db8-4791d47f8794 tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] HTTP exception thrown: Image not found. Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-807d30a4-7b2a-40a5-9db8-4791d47f8794 tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Request method failure captured: Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/images/b30e0bc6-cc69-4e27-b9c8-366b8720ceb2/metadata/os_distro HTTP/1.1 Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 30 Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVH70--4pASjtga6k6fFWi0vOdJC0ReRym8fGfxlfj3nuTTDneMds91HOZUeztenFCgs0_6f4y5Z_zACV2jfLSp4MoOcdNT5YFJvGQQ1xQvwu9luUoVJXuith-Ud8sjHIMPPcXb8f4SqZ-ImHxp5_rsDbbJzbnj1qrpUA2T4nLw6GQ Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:55:36.560786 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d3df491595442f0b3db2c41d8f92e90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 86365ec401234204a907a9f7d955b41c Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: {"meta": {"os_distro": "alt"}} Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 20:55:36.563280 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'image_id': 'b30e0bc6-cc69-4e27-b9c8-366b8720ceb2', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.565180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b30e0bc6-cc69-4e27-b9c8-366b8720ceb2 Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.567983 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b30e0bc6-cc69-4e27-b9c8-366b8720ceb2 could not be found. Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:36.569342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:55:36.570672 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.573262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-807d30a4-7b2a-40a5-9db8-4791d47f8794 tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:36.573262 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-807d30a4-7b2a-40a5-9db8-4791d47f8794 tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] 10.222.0.33 "PUT /compute/v2.1/images/b30e0bc6-cc69-4e27-b9c8-366b8720ceb2/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.030521 Aug 06 20:55:36.573262 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 260/557] 10.222.0.33 () {60 vars in 1310 bytes} [Sat Aug 6 20:55:36 2022] PUT /compute/v2.1/images/b30e0bc6-cc69-4e27-b9c8-366b8720ceb2/metadata/os_distro => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:36.573504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:36.577244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e920846-318f-4ea7-8d64-3315a6865009 tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Calling method '.version_select at 0x7f729e066790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.577367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:36.582233 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c35a5f9-027f-4411-8b57-62689400cd0b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.245645 Aug 06 20:55:36.596444 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 298/558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:36 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:36.597840 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0e920846-318f-4ea7-8d64-3315a6865009 tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-326980849" status: 204 len: 0 microversion: 2.10 time: 0.029132 Aug 06 20:55:36.598590 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 261/559] 10.222.0.33 () {60 vars in 1322 bytes} [Sat Aug 6 20:55:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-326980849 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 20:55:36.601320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bdc91c7-8270-4f20-af5c-70796e5c466d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Action: 'create', calling method: .version_select at 0x7f729e288f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:36.607607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46aac886-ac75-465f-8fa9-f33168d2901f tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Calling method '.version_select at 0x7f729e0d8c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.628027 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-8bdc91c7-8270-4f20-af5c-70796e5c466d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] HTTP exception thrown: Image not found. Aug 06 20:55:36.629243 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46aac886-ac75-465f-8fa9-f33168d2901f tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894114232?user_id=1af69965aeae44449fe70f2cd63c0fed" status: 204 len: 0 microversion: 2.10 time: 0.025091 Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bdc91c7-8270-4f20-af5c-70796e5c466d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Request method failure captured: Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/images/6463c46d-2117-46b1-88a2-0a13630da83f/metadata HTTP/1.1 Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 57 Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVH70--4pASjtga6k6fFWi0vOdJC0ReRym8fGfxlfj3nuTTDneMds91HOZUeztenFCgs0_6f4y5Z_zACV2jfLSp4MoOcdNT5YFJvGQQ1xQvwu9luUoVJXuith-Ud8sjHIMPPcXb8f4SqZ-ImHxp5_rsDbbJzbnj1qrpUA2T4nLw6GQ Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:36.630292 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7d3df491595442f0b3db2c41d8f92e90", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7d3df491595442f0b3db2c41d8f92e90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7d3df491595442f0b3db2c41d8f92e90 Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-396818083 Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 86365ec401234204a907a9f7d955b41c Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-396818083-project Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 20:55:36.631633 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'image_id': '6463c46d-2117-46b1-88a2-0a13630da83f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.632489 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6463c46d-2117-46b1-88a2-0a13630da83f Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:55:36.633527 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6463c46d-2117-46b1-88a2-0a13630da83f could not be found. Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:36.636729 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:55:36.640537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:36.644492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bdc91c7-8270-4f20-af5c-70796e5c466d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:36.644492 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8bdc91c7-8270-4f20-af5c-70796e5c466d tempest-ImagesMetadataNegativeTestJSON-396818083 tempest-ImagesMetadataNegativeTestJSON-396818083-project] 10.222.0.33 "POST /compute/v2.1/images/6463c46d-2117-46b1-88a2-0a13630da83f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034321 Aug 06 20:55:36.644811 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 262/560] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 20:55:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894114232?user_id=1af69965aeae44449fe70f2cd63c0fed => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 20:55:36.644965 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 299/561] 10.222.0.33 () {60 vars in 1281 bytes} [Sat Aug 6 20:55:36 2022] POST /compute/v2.1/images/6463c46d-2117-46b1-88a2-0a13630da83f/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:55:36.647783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a04b71ef-4434-4f89-b966-6a69beeecf4d tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] Calling method '.version_select at 0x7f729df349d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.680470 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a04b71ef-4434-4f89-b966-6a69beeecf4d tempest-KeyPairsV210TestJSON-1411702979 tempest-KeyPairsV210TestJSON-1411702979-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349911272?user_id=1af69965aeae44449fe70f2cd63c0fed" status: 204 len: 0 microversion: 2.10 time: 0.045449 Aug 06 20:55:36.686807 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 263/562] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 20:55:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349911272?user_id=1af69965aeae44449fe70f2cd63c0fed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 20:55:36.782830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:36.783596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:36.798646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:36.799467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:36.799912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:36.801857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:36.802350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:36.802816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.028701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:37.029434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:37.043089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.045568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.046902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.050272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.051347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.052088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.350593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.379804 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2adfdbe9-ce3a-4d48-8e79-a35943219869 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1390 microversion: 2.1 time: 0.601315 Aug 06 20:55:37.380789 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 300/563] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:36 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1390 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:37.407586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:37.419497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:37.444237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.445413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.446966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.448467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.451201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.455434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.551000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.562100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.567424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.568607 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dd4e582c-b318-4e03-ba35-faefa1126488 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1362 microversion: 2.25 time: 0.546241 Aug 06 20:55:37.583071 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 264/564] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:37 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:37.590913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:37.591550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:37.599258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.600001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.600779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.602223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.603037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.603709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.675018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.689837 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a6037d0f-09e8-49ef-986d-9c7264459074 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1271 microversion: 2.1 time: 0.300161 Aug 06 20:55:37.700390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.703135 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 301/565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:37 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1271 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:37.710355 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5bf80939-b490-4a40-8af3-0cd7eca4addb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1270 microversion: 2.1 time: 0.126134 Aug 06 20:55:37.710560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:37.711276 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 265/566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:37 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1270 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:37.724441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:37.724441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.724441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.724941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.725497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.732536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.732924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.736349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:37.736997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:37.745761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.746706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.747485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.748545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.749082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.749587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.907318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.935355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.937103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.944465 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e7b6d88d-404f-47d2-bbfb-af27f97e6695 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.240170 Aug 06 20:55:37.945388 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 302/567] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:37 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:37.984710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.998455 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9cd0b946-0dbc-4bd8-93f7-ed6f42978f7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.268214 Aug 06 20:55:37.999767 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 266/568] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:37 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:38.403057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:38.404975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:38.412717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:38.413677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:38.415366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:38.416538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:38.417273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:38.417891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:38.596797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:38.597420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:38.605075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:38.605808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:38.606464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:38.607446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:38.608121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:38.608761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:38.838091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:38.852018 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-be250830-0491-4f5b-8514-a77bb4b4719f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1390 microversion: 2.1 time: 0.453717 Aug 06 20:55:38.854834 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 303/569] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:38 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1390 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:38.871876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:38.873199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:38.884108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:38.885257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:38.886953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:38.887946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:38.888748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:38.889661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.020382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.029370 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-945bfba1-0371-487b-be25-f2bf27c471ed tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1277 microversion: 2.1 time: 0.172115 Aug 06 20:55:39.029952 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 304/570] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:38 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:39.035401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:39.036189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:39.043597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.044474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.045134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.045871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.046639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.047237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.093761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.114124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.120020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.121205 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46f1d8b4-dbcf-47a9-bfde-17673387a0d7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1362 microversion: 2.25 time: 0.528365 Aug 06 20:55:39.144259 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 267/571] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:38 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1362 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:39.154734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-24d275a0-66f2-411b-b85b-380d31ac10b0 req-cb15c23e-511a-41c4-a774-84f6546db2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7468a9b2-902c-4b29-bdc2-230d3f558c4b", "tag": "0f582021-42a5-4a6d-ab3f-f6de4b82347d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:39.168250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-24d275a0-66f2-411b-b85b-380d31ac10b0 req-cb15c23e-511a-41c4-a774-84f6546db2e4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.168757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-24d275a0-66f2-411b-b85b-380d31ac10b0 req-cb15c23e-511a-41c4-a774-84f6546db2e4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.169742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-24d275a0-66f2-411b-b85b-380d31ac10b0 req-cb15c23e-511a-41c4-a774-84f6546db2e4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.183367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.213436 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6d1d0333-f310-4399-82ca-9fb8d58fdabb tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1276 microversion: 2.1 time: 0.165740 Aug 06 20:55:39.215976 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 305/572] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:39 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:39.247136 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-24d275a0-66f2-411b-b85b-380d31ac10b0 req-cb15c23e-511a-41c4-a774-84f6546db2e4 service nova] Creating event network-changed:0f582021-42a5-4a6d-ab3f-f6de4b82347d for instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b on nch2-master-1 Aug 06 20:55:39.250464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:39.251122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:39.260086 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-24d275a0-66f2-411b-b85b-380d31ac10b0 req-cb15c23e-511a-41c4-a774-84f6546db2e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114066 Aug 06 20:55:39.263135 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 268/573] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:39.271829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.272341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.272791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.273515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.273982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.277221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:39.278218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.280666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:39.303425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.303934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.304385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.314337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.315150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.319526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.704928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.724200 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8aa5af76-4bd5-4633-8bd9-55cfb33f63d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.459728 Aug 06 20:55:39.728597 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 269/574] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:39 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:39.820623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.832313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.834377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.841503 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c56d0e93-0185-4f81-8b57-2945fabdc730 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.618560 Aug 06 20:55:39.860549 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 306/575] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:39 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:39.875473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:39.876102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:39.887219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.887720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.888233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.888880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.895000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.896702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.053178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:40.054097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:40.065721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.066597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.069057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.070012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.077142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.078157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.257880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:40.266153 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d602a6e8-81af-4b4a-b20e-c7bbd36a72d0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1277 microversion: 2.1 time: 0.217309 Aug 06 20:55:40.267031 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 307/576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:40 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:40.307304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:40.326186 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8afa46cc-431e-4e51-b344-64bf407822e4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1390 microversion: 2.1 time: 0.454416 Aug 06 20:55:40.336272 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 270/577] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:39 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1390 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:40.336272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:40.336272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:40.342708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.342708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.342708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.342708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.343136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.343580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.451878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1136815117", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:40.521238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:55:40.558802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:40.570160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:40.572422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:40.573797 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2b34e3e1-3dab-4ae1-81ce-0bf13a5fd09c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1362 microversion: 2.25 time: 0.245565 Aug 06 20:55:40.576029 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 271/578] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:40 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:40.589120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:40.589751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:40.596635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.597152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.597602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.598465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.599662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.600158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.751338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:40.767095 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f872b529-ada2-4699-8721-2a03ec012331 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1276 microversion: 2.1 time: 0.189920 Aug 06 20:55:40.767696 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 272/579] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:40 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:40.772527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:40.773148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:40.789879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.790438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.790925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.791676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.792142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.792773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.833740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:40.839507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:40.840307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:40.841714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:40.843256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:40.871813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.872467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.873910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.877870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.879171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.879907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.940627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Getting quotas for project 7397d6b602604e2caa60f16aee28c950. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:40.951764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Getting quotas for user 096b2f40a81a4627af9ae5c7b83fc619 and project 7397d6b602604e2caa60f16aee28c950. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:40.968841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:40.972493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:41.026996 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a1d15675-2c10-4f6b-a161-943023a5b0eb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758604 Aug 06 20:55:41.028186 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 308/580] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:55:41.033410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:41.034341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:41.042910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.043793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.044459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.045660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.046641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.047467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.140787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:41.156695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:41.158646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:41.167319 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c411a8b4-ac5b-46d6-86d0-aeb1258d679e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.136887 Aug 06 20:55:41.180095 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 309/581] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:41 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:41.193326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-233b2c52-dc09-4df2-9f86-cd4b60f66ac3 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:41.194088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-233b2c52-dc09-4df2-9f86-cd4b60f66ac3 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:41.283801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-233b2c52-dc09-4df2-9f86-cd4b60f66ac3 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:41.295176 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-233b2c52-dc09-4df2-9f86-cd4b60f66ac3 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1217 microversion: 2.1 time: 0.113680 Aug 06 20:55:41.296426 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 310/582] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:41 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:41.301179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:41.302034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:41.309259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.310737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.311452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.312380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.313749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.314275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.437120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:41.456378 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b6dea389-3d5e-4373-a8aa-71044f4c8bd4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.686217 Aug 06 20:55:41.458098 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 273/583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:40 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:41.466451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:41.467420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:41.493403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.495147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.495606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.500177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.501785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.503095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.526947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:41.535777 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6dcfec21-434c-441c-8297-ea474d15e188 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1319 microversion: 2.1 time: 0.237159 Aug 06 20:55:41.536711 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 311/584] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:41 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:41.602568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:41.603212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:41.624067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.625911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.626743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.627651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.628140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.635268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.828506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:41.837291 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dbe6e650-66e1-46bd-b11a-0c61e25c5a8c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1390 microversion: 2.1 time: 0.376852 Aug 06 20:55:41.842053 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 274/585] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:41 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1390 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:41.847073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:41.850682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:41.869132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.873872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.874763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.876022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.877870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.879418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.203309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:42.211837 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0bbf26c0-8587-4a0b-9491-0e7f72d812df tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1318 microversion: 2.1 time: 0.368359 Aug 06 20:55:42.212595 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 275/586] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:41 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:42.229663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-3ed0e6fd-3616-4557-a421-b1698b5b832f req-d7e434fa-24e3-4fe5-b1c4-9fc8b74a4600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d48166-5304-479e-998a-4ca89870b1a2", "name": "network-vif-plugged", "status": "completed", "tag": "6753505e-1a26-48b2-8451-717992f9bed3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:42.241147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:42.246860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3ed0e6fd-3616-4557-a421-b1698b5b832f req-d7e434fa-24e3-4fe5-b1c4-9fc8b74a4600 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.247600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3ed0e6fd-3616-4557-a421-b1698b5b832f req-d7e434fa-24e3-4fe5-b1c4-9fc8b74a4600 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.248332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3ed0e6fd-3616-4557-a421-b1698b5b832f req-d7e434fa-24e3-4fe5-b1c4-9fc8b74a4600 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.263084 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-3ed0e6fd-3616-4557-a421-b1698b5b832f req-d7e434fa-24e3-4fe5-b1c4-9fc8b74a4600 service nova] Creating event network-vif-plugged:6753505e-1a26-48b2-8451-717992f9bed3 for instance 70d48166-5304-479e-998a-4ca89870b1a2 on nch1-master-1 Aug 06 20:55:42.269046 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-3ed0e6fd-3616-4557-a421-b1698b5b832f req-d7e434fa-24e3-4fe5-b1c4-9fc8b74a4600 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055271 Aug 06 20:55:42.270165 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 276/587] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:42.279943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:42.280878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:42.288613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.290208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.290970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.292712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.293472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.294102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.341236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:42.350896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:42.357209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:42.358744 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f3da727-8bbd-469a-b163-8f0f2642d771 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1362 microversion: 2.25 time: 0.760447 Aug 06 20:55:42.362533 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 312/588] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:41 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1362 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:42.367453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:42.368627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:42.384840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.385335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.386827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.388242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.390472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.391098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.430368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:42.443032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:42.444773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:42.462687 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-914fe3ea-3c76-4f4a-b48c-7e42d8757848 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.190773 Aug 06 20:55:42.463773 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 277/589] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:42 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:42.498346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:42.515481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:42.527717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.529483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.530105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.531368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.532105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.532692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.537514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:42.558805 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b051cb0-f653-47a7-9dc5-bfa1bce2c77c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1269 microversion: 2.1 time: 0.194874 Aug 06 20:55:42.560914 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 313/590] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:42 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1269 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:42.561426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:42.574313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:42.575311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:42.613917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.616176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.617348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.619906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.621479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.625228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.895045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:42.910838 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7b43c05-36c5-4455-82f1-ba6abd95013f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.418725 Aug 06 20:55:42.912086 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 278/591] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:42 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:42.922838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:42.924184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:42.933637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.935815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.936706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:42.938231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:42.938949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:42.940247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.255830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:43.264702 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-debea6b4-0081-4251-826f-332d0f2eaffd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1319 microversion: 2.1 time: 0.700231 Aug 06 20:55:43.285301 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 314/592] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:42 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:43.293302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:43.294293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:43.303005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.304451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.305374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.307128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.308259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.311010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.561581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:43.571797 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a79d91f9-ba36-4c82-a900-2733ac0d96f3 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1390 microversion: 2.1 time: 0.656579 Aug 06 20:55:43.573189 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 279/593] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:42 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1390 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:43.582222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-3b25c692-6d00-4527-a1b1-90ef8b3e06e3 req-e62510f6-3d8a-4d4f-bf5f-750ced7a035b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a6fa4c-df67-4379-88ff-45430f0b9a4d", "tag": "b9c19136-ed57-49e3-8d70-56bec4ee1ca7"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:43.595861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3b25c692-6d00-4527-a1b1-90ef8b3e06e3 req-e62510f6-3d8a-4d4f-bf5f-750ced7a035b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.596490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3b25c692-6d00-4527-a1b1-90ef8b3e06e3 req-e62510f6-3d8a-4d4f-bf5f-750ced7a035b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.597355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3b25c692-6d00-4527-a1b1-90ef8b3e06e3 req-e62510f6-3d8a-4d4f-bf5f-750ced7a035b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.614397 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-3b25c692-6d00-4527-a1b1-90ef8b3e06e3 req-e62510f6-3d8a-4d4f-bf5f-750ced7a035b service nova] Creating event network-changed:b9c19136-ed57-49e3-8d70-56bec4ee1ca7 for instance f4a6fa4c-df67-4379-88ff-45430f0b9a4d on nch2-master-1 Aug 06 20:55:43.623162 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-3b25c692-6d00-4527-a1b1-90ef8b3e06e3 req-e62510f6-3d8a-4d4f-bf5f-750ced7a035b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047139 Aug 06 20:55:43.624179 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 280/594] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:43.775266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Action: 'update', calling method: .version_select at 0x7f729e3eb9d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:43.782999 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:43.782999 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:43.787232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.788300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.789106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.794771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:43.802476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.803305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.804357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.810213 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d538fcf5-d546-4ebf-802e-7253a86bd6a7 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1318 microversion: 2.1 time: 0.519592 Aug 06 20:55:43.812495 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 315/595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:43 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:43.827777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:43.829309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:43.833868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] HTTP exception thrown: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Request method failure captured: Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/os-services/2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc HTTP/1.1 Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 56 Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVPpItuFNSdnf8Jq9wy6Wrtp7M9g3AVQ-5M1-iJjwAIEtnC4K8nrFdAZnkeD9IWJ5KlPZx7RWeB4aGR9-q-SBgWXlsFIbvISd789uUBDtjQT21a8rB-3-dSVfK0QBe3mHNFAh2Oe3lB_fb-3Mi5uGqZdGvsJ30zs4rKlLIEoj0c_mI Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.53 Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 06c34e95151a4212986b05ed7a84656e Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-152217668 Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:55:43.841107 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/06c34e95151a4212986b05ed7a84656e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_06c34e95151a4212986b05ed7a84656e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06c34e95151a4212986b05ed7a84656e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06c34e95151a4212986b05ed7a84656e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-152217668 Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 06c34e95151a4212986b05ed7a84656e Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-152217668 Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 535b817c316343de84b6e7c4876c24e2 Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:55:43.842901 ncdv-master-1 devstack@n-api.service[142462]: exception: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:43.843777 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:43.846874 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:43.851313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:43.851313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:43.851313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:43.853586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.854324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Returning 404 to user: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:43.855267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.859207 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33a2d4f9-c1cb-4977-87ea-a5a42bd6c913 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc" status: 404 len: 110 microversion: 2.53 time: 0.231948 Aug 06 20:55:43.861724 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 281/596] 10.222.0.33 () {62 vars in 1309 bytes} [Sat Aug 6 20:55:43 2022] PUT /compute/v2.1/os-services/2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc => generated 110 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:55:43.870718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:43.872392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:43.872699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.875026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.877593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.878323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.887121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.887911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.888502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.889370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.890124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.890759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.042905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.054291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.056545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.063055 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-595a6780-0135-4a2a-9527-cf31ac1d0703 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.198680 Aug 06 20:55:44.063728 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 282/597] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:43 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:44.074290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:44.075360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:44.082967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.083464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.083899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.084615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.085101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.085536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.207804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.217215 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-caad2054-d9cc-4fbc-80fd-ff0dee08a589 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1275 microversion: 2.1 time: 0.152231 Aug 06 20:55:44.217818 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 283/598] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:44 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:44.235124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-3cd554fb-657f-4504-b334-f3af347cc63e req-797cc095-1ab6-48b3-9902-e4b18a498285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5f4cef-88c9-4234-b823-bb15b4d351a8", "tag": "99e7008f-8aa5-4595-804c-937e754dabbe"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:44.265243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3cd554fb-657f-4504-b334-f3af347cc63e req-797cc095-1ab6-48b3-9902-e4b18a498285 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.265743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3cd554fb-657f-4504-b334-f3af347cc63e req-797cc095-1ab6-48b3-9902-e4b18a498285 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.266190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3cd554fb-657f-4504-b334-f3af347cc63e req-797cc095-1ab6-48b3-9902-e4b18a498285 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.279310 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-3cd554fb-657f-4504-b334-f3af347cc63e req-797cc095-1ab6-48b3-9902-e4b18a498285 service nova] Creating event network-changed:99e7008f-8aa5-4595-804c-937e754dabbe for instance 0b5f4cef-88c9-4234-b823-bb15b4d351a8 on nch1-master-1 Aug 06 20:55:44.284834 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-3cd554fb-657f-4504-b334-f3af347cc63e req-797cc095-1ab6-48b3-9902-e4b18a498285 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065660 Aug 06 20:55:44.285889 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 284/599] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:44.291344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Action: 'update', calling method: .version_select at 0x7f729e066ca0>, body: {"status": "disabled"} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:44.294285 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:44.294285 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:44.295496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.296466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.297274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.304348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.304348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.304978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.311092 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] HTTP exception thrown: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Request method failure captured: Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/os-services/2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc HTTP/1.1 Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 22 Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVPpItuFNSdnf8Jq9wy6Wrtp7M9g3AVQ-5M1-iJjwAIEtnC4K8nrFdAZnkeD9IWJ5KlPZx7RWeB4aGR9-q-SBgWXlsFIbvISd789uUBDtjQT21a8rB-3-dSVfK0QBe3mHNFAh2Oe3lB_fb-3Mi5uGqZdGvsJ30zs4rKlLIEoj0c_mI Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.53 Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 06c34e95151a4212986b05ed7a84656e Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-152217668 Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:55:44.313014 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/06c34e95151a4212986b05ed7a84656e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_06c34e95151a4212986b05ed7a84656e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06c34e95151a4212986b05ed7a84656e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06c34e95151a4212986b05ed7a84656e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-152217668 Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 06c34e95151a4212986b05ed7a84656e Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-152217668 Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 535b817c316343de84b6e7c4876c24e2 Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: {"status": "disabled"} Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: exception: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.314765 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc', 'body': {'status': 'disabled'}} Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:44.315749 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:44.318589 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:44.322087 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.322087 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.322087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Returning 404 to user: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:44.322087 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4d9e87a9-5235-4bbc-9ddb-c11b51dba28c tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc" status: 404 len: 110 microversion: 2.53 time: 0.027871 Aug 06 20:55:44.324218 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 285/600] 10.222.0.33 () {62 vars in 1309 bytes} [Sat Aug 6 20:55:44 2022] PUT /compute/v2.1/os-services/2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:55:44.329722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:44.330919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:44.340925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.341434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.341884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.342646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.343299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.343740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.490790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.503271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.504974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.506232 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a32fa131-404f-4273-a142-660f49af8c7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1362 microversion: 2.25 time: 0.692515 Aug 06 20:55:44.507853 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 316/601] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:43 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1362 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:44.513219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:44.513908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:44.520313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.521061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.522013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.524310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.524868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.525476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.683118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.691622 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3d7d9611-6d8c-4e20-9ef5-1103fc772619 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.366577 Aug 06 20:55:44.692458 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 286/602] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:44 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:44.697978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Action: 'update', calling method: .version_select at 0x7f729e141160>, body: {"status": "enabled"} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:44.700790 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:44.700790 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:44.702172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.702918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.703582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.709463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.710295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.710984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.717391 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] HTTP exception thrown: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Request method failure captured: Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/os-services/2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc HTTP/1.1 Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 21 Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVPpItuFNSdnf8Jq9wy6Wrtp7M9g3AVQ-5M1-iJjwAIEtnC4K8nrFdAZnkeD9IWJ5KlPZx7RWeB4aGR9-q-SBgWXlsFIbvISd789uUBDtjQT21a8rB-3-dSVfK0QBe3mHNFAh2Oe3lB_fb-3Mi5uGqZdGvsJ30zs4rKlLIEoj0c_mI Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.53 Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 06c34e95151a4212986b05ed7a84656e Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-152217668 Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:55:44.719361 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/06c34e95151a4212986b05ed7a84656e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_06c34e95151a4212986b05ed7a84656e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06c34e95151a4212986b05ed7a84656e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/06c34e95151a4212986b05ed7a84656e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-152217668 Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 06c34e95151a4212986b05ed7a84656e Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-152217668 Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 535b817c316343de84b6e7c4876c24e2 Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: {"status": "enabled"} Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: exception: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.720832 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc', 'body': {'status': 'enabled'}} Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:44.721736 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:44.723129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:44.724280 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. Aug 06 20:55:44.724280 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:55:44.725945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Returning 404 to user: Service 2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:44.727682 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99f51253-a8e4-4281-b3e6-f60c1459a5d5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc" status: 404 len: 110 microversion: 2.53 time: 0.033484 Aug 06 20:55:44.729152 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 287/603] 10.222.0.33 () {62 vars in 1309 bytes} [Sat Aug 6 20:55:44 2022] PUT /compute/v2.1/os-services/2ce1ef8b-cfc0-4609-aadc-29c4e658fdfc => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:55:44.734074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:44.735095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:44.743708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.744525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.745223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.746181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.746968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.747654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.750916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.763849 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-be3520c2-84e1-4de5-9497-83790db7b9a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1319 microversion: 2.1 time: 0.254487 Aug 06 20:55:44.764449 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 317/604] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:44 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:44.770679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6a888bbd-9897-49ae-828e-27c7f92ed1fd tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:44.783202 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:44.783202 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:44.784601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a888bbd-9897-49ae-828e-27c7f92ed1fd tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.785110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a888bbd-9897-49ae-828e-27c7f92ed1fd tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.785560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a888bbd-9897-49ae-828e-27c7f92ed1fd tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.786315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a888bbd-9897-49ae-828e-27c7f92ed1fd tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.786811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a888bbd-9897-49ae-828e-27c7f92ed1fd tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.787244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a888bbd-9897-49ae-828e-27c7f92ed1fd tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.808411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:44.839452 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6a888bbd-9897-49ae-828e-27c7f92ed1fd tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.073676 Aug 06 20:55:44.840337 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 318/605] 10.222.0.33 () {60 vars in 1178 bytes} [Sat Aug 6 20:55:44 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:44.846563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:44.847829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:44.851538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:44.856111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.856792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.857468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.859331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.859952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.862296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.053696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:45.061803 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23daf8c2-5fef-4572-a014-4bdab6855699 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1589 microversion: 2.1 time: 0.331415 Aug 06 20:55:45.061952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:45.062920 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 288/606] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:44 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1589 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:45.067870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-25b7f439-9ff1-4345-8cd2-52a363b0d013 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.071553 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:45.071553 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:45.072036 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ed8709a8-8ab2-4314-80f4-a6fc4edeaa2a tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1318 microversion: 2.1 time: 0.230018 Aug 06 20:55:45.082400 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 319/607] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:44 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:45.083150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25b7f439-9ff1-4345-8cd2-52a363b0d013 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.084398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25b7f439-9ff1-4345-8cd2-52a363b0d013 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.084398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25b7f439-9ff1-4345-8cd2-52a363b0d013 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.084791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-047ac221-b055-4813-8878-7c7e6d8815f0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.085344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-047ac221-b055-4813-8878-7c7e6d8815f0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:45.089613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25b7f439-9ff1-4345-8cd2-52a363b0d013 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.090759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25b7f439-9ff1-4345-8cd2-52a363b0d013 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.092414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25b7f439-9ff1-4345-8cd2-52a363b0d013 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.093528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047ac221-b055-4813-8878-7c7e6d8815f0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.094122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047ac221-b055-4813-8878-7c7e6d8815f0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.094816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047ac221-b055-4813-8878-7c7e6d8815f0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.095725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047ac221-b055-4813-8878-7c7e6d8815f0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.096251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047ac221-b055-4813-8878-7c7e6d8815f0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.096860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047ac221-b055-4813-8878-7c7e6d8815f0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.126094 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-25b7f439-9ff1-4345-8cd2-52a363b0d013 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.061535 Aug 06 20:55:45.134158 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 289/608] 10.222.0.33 () {60 vars in 1211 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:45.143215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.144454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:45.153248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.154343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.154819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.155544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.156003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.156800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.202211 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-047ac221-b055-4813-8878-7c7e6d8815f0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122079 Aug 06 20:55:45.209641 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 320/609] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:55:45.217531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7a8e7676-3c4d-40db-8709-dc80e3076fe2 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.220087 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:45.220087 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:45.221473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a8e7676-3c4d-40db-8709-dc80e3076fe2 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.222019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a8e7676-3c4d-40db-8709-dc80e3076fe2 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.222411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a8e7676-3c4d-40db-8709-dc80e3076fe2 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.223190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a8e7676-3c4d-40db-8709-dc80e3076fe2 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.223659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a8e7676-3c4d-40db-8709-dc80e3076fe2 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.224392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a8e7676-3c4d-40db-8709-dc80e3076fe2 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.254354 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7a8e7676-3c4d-40db-8709-dc80e3076fe2 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.050129 Aug 06 20:55:45.255274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 321/610] 10.222.0.33 () {60 vars in 1178 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:45.260029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.260850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:45.267664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.268402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.269032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.269910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.270539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.271166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.363982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:45.375784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:45.377989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:45.383562 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e03e0a4b-9900-4b99-9019-c03d0fb3b737 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.247710 Aug 06 20:55:45.384446 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 290/611] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:45.389535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d36f1556-0c3a-4498-9c68-b5a65ea397e5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.392479 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:45.392479 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:45.393587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d36f1556-0c3a-4498-9c68-b5a65ea397e5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.394156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d36f1556-0c3a-4498-9c68-b5a65ea397e5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.394778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d36f1556-0c3a-4498-9c68-b5a65ea397e5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.395620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d36f1556-0c3a-4498-9c68-b5a65ea397e5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.396151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d36f1556-0c3a-4498-9c68-b5a65ea397e5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.396855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d36f1556-0c3a-4498-9c68-b5a65ea397e5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.421904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:45.428821 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d36f1556-0c3a-4498-9c68-b5a65ea397e5 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.042504 Aug 06 20:55:45.431205 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 291/612] 10.222.0.33 () {60 vars in 1237 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:45.439295 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d3aa1211-36c4-42a4-bf7b-a2ae942226bc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.182728 Aug 06 20:55:45.440146 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 322/613] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:45.449687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-813f9c71-5711-4434-b07a-3276a09a2ec7 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.452217 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:45.452217 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:55:45.453384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-813f9c71-5711-4434-b07a-3276a09a2ec7 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.453871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-813f9c71-5711-4434-b07a-3276a09a2ec7 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.454321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-813f9c71-5711-4434-b07a-3276a09a2ec7 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.455161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-813f9c71-5711-4434-b07a-3276a09a2ec7 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.455691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-813f9c71-5711-4434-b07a-3276a09a2ec7 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.456003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-813f9c71-5711-4434-b07a-3276a09a2ec7 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.481642 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-813f9c71-5711-4434-b07a-3276a09a2ec7 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.037210 Aug 06 20:55:45.482594 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 292/614] 10.222.0.33 () {60 vars in 1178 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:55:45.494649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-695f1ca5-0a94-4edd-a178-7471fa3ed593 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.497555 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:45.497555 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:45.498717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-695f1ca5-0a94-4edd-a178-7471fa3ed593 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.499211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-695f1ca5-0a94-4edd-a178-7471fa3ed593 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.499657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-695f1ca5-0a94-4edd-a178-7471fa3ed593 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.500409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-695f1ca5-0a94-4edd-a178-7471fa3ed593 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.500869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-695f1ca5-0a94-4edd-a178-7471fa3ed593 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.501302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-695f1ca5-0a94-4edd-a178-7471fa3ed593 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.527338 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-695f1ca5-0a94-4edd-a178-7471fa3ed593 tempest-ServicesAdminNegativeV253TestJSON-152217668 tempest-ServicesAdminNegativeV253TestJSON-152217668-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036990 Aug 06 20:55:45.528080 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 323/615] 10.222.0.33 () {60 vars in 1239 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:45.529886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.531038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:45.537916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.538586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.539030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.540006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.540508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.541152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.658036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8fd6b999-f419-4f13-a6a8-e157dbf79c4d tempest-ServicesAdminNegativeV253TestJSON-56775494 tempest-ServicesAdminNegativeV253TestJSON-56775494-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.660552 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:45.660552 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:45.661653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8fd6b999-f419-4f13-a6a8-e157dbf79c4d tempest-ServicesAdminNegativeV253TestJSON-56775494 tempest-ServicesAdminNegativeV253TestJSON-56775494-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '58458184a2c0439091c78decf58b0177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223cac9f81b340e1bb38e07ac0cf33df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8fd6b999-f419-4f13-a6a8-e157dbf79c4d tempest-ServicesAdminNegativeV253TestJSON-56775494 tempest-ServicesAdminNegativeV253TestJSON-56775494-project] Request method failure captured: Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVO4Kv_vfgd43vDrFTVqppm5ro_x8muZswtA11wWR_1MPxeDG5E0wr159CpYzUwGyfLPx4nxcP526owQkc8ZyQ9MmaJJmKsGf9VARLv5aJcbrzmwrXUYI3lqPoWoMnGhUbVH0kUp0qIQ4jV-6H1-LqhnYH7iKRWkMID_2iM8HQj-Eo Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.53 Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 223cac9f81b340e1bb38e07ac0cf33df Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-56775494 Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:55:45.664971 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/223cac9f81b340e1bb38e07ac0cf33df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_223cac9f81b340e1bb38e07ac0cf33df", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/223cac9f81b340e1bb38e07ac0cf33df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/223cac9f81b340e1bb38e07ac0cf33df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-56775494 Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 223cac9f81b340e1bb38e07ac0cf33df Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-56775494 Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServicesAdminNegativeV253TestJSON-56775494-project Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 58458184a2c0439091c78decf58b0177 Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-56775494-project Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 06 20:55:45.666451 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:55:45.667395 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 06 20:55:45.668876 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:45.676716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8fd6b999-f419-4f13-a6a8-e157dbf79c4d tempest-ServicesAdminNegativeV253TestJSON-56775494 tempest-ServicesAdminNegativeV253TestJSON-56775494-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:45.677960 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8fd6b999-f419-4f13-a6a8-e157dbf79c4d tempest-ServicesAdminNegativeV253TestJSON-56775494 tempest-ServicesAdminNegativeV253TestJSON-56775494-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.141896 Aug 06 20:55:45.679052 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 324/616] 10.222.0.33 () {60 vars in 1178 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 143 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Aug 06 20:55:45.714574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.716456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:45.739743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.740446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.741360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.742447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.744971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.745745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.168108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.172953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.188916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.191442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.196104 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e0db17ed-ceee-440e-a5ef-f95ab9de5c83 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.486129 Aug 06 20:55:46.197119 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb3a3aad-5af3-4e37-b4a6-db460e69c9fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1362 microversion: 2.25 time: 0.671379 Aug 06 20:55:46.198352 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 293/617] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1362 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:55:46.213433 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 325/618] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:46.214708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:46.215335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:46.219604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:46.220935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:46.222530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.223382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.224015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.225366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.226009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.227406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.229429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.229925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.230539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.231446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.232084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.232699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.451305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=20 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:46.648090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.655746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.662891 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e8c60b45-2d36-42c0-8b9d-a02fba70428b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1318 microversion: 2.1 time: 0.447571 Aug 06 20:55:46.666987 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b9ca3f02-85a5-44f6-a824-b0dca65c8c52 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1319 microversion: 2.1 time: 0.467149 Aug 06 20:55:46.675701 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 326/619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:46 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:46.680693 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 294/620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:46 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:46.685838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:46.686289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:46.690105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-29ed4682-6528-4721-9ad2-8fadd934c708 req-eaeef7b5-bf25-4121-b6da-d66c7c995610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5f43e6-eb38-4c09-8284-99bba87f1564", "tag": "5fc2e6b6-1ef8-49a2-a162-668afad75272"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:46.705498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-29ed4682-6528-4721-9ad2-8fadd934c708 req-eaeef7b5-bf25-4121-b6da-d66c7c995610 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.706901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-29ed4682-6528-4721-9ad2-8fadd934c708 req-eaeef7b5-bf25-4121-b6da-d66c7c995610 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.707624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-29ed4682-6528-4721-9ad2-8fadd934c708 req-eaeef7b5-bf25-4121-b6da-d66c7c995610 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.707791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.708491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.709102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.710000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.710660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.711820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.725969 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-29ed4682-6528-4721-9ad2-8fadd934c708 req-eaeef7b5-bf25-4121-b6da-d66c7c995610 service nova] Creating event network-changed:5fc2e6b6-1ef8-49a2-a162-668afad75272 for instance cc5f43e6-eb38-4c09-8284-99bba87f1564 on nch1-master-1 Aug 06 20:55:46.733334 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-29ed4682-6528-4721-9ad2-8fadd934c708 req-eaeef7b5-bf25-4121-b6da-d66c7c995610 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056081 Aug 06 20:55:46.734513 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 327/621] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:46.739874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:46.740751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:46.749433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.750160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.750808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.751736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.752972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.753611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.855830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.875171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.877808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.886454 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d505c2e-8a69-4f59-9239-007d6fd8e38e tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.204619 Aug 06 20:55:46.887926 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 295/622] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:46 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:46.894954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-4193291d-c4f9-4da2-8eb8-cd2265c7e7e8 req-0f3224b0-d9a1-4461-a7f4-41911b655053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7468a9b2-902c-4b29-bdc2-230d3f558c4b", "name": "network-vif-plugged", "status": "completed", "tag": "0f582021-42a5-4a6d-ab3f-f6de4b82347d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:46.912862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4193291d-c4f9-4da2-8eb8-cd2265c7e7e8 req-0f3224b0-d9a1-4461-a7f4-41911b655053 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.913441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4193291d-c4f9-4da2-8eb8-cd2265c7e7e8 req-0f3224b0-d9a1-4461-a7f4-41911b655053 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.915211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4193291d-c4f9-4da2-8eb8-cd2265c7e7e8 req-0f3224b0-d9a1-4461-a7f4-41911b655053 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.932934 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-4193291d-c4f9-4da2-8eb8-cd2265c7e7e8 req-0f3224b0-d9a1-4461-a7f4-41911b655053 service nova] Creating event network-vif-plugged:0f582021-42a5-4a6d-ab3f-f6de4b82347d for instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b on nch2-master-1 Aug 06 20:55:46.938432 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-4193291d-c4f9-4da2-8eb8-cd2265c7e7e8 req-0f3224b0-d9a1-4461-a7f4-41911b655053 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048890 Aug 06 20:55:46.939314 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 296/623] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:47.147781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:47.157238 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7cb350e8-07d3-43c5-9e14-9e5b56a1bce6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.421212 Aug 06 20:55:47.167721 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 328/624] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:46 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:47.202662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:47.203516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:47.218540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:47.219303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:47.224156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.224962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.225421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.226179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.228306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.228830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.229272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.229600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.230052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.235298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.236150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.236594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.440769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:47.452861 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1301a471-1f14-4907-af8e-a503edf0f228 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1475 microversion: 2.1 time: 0.237936 Aug 06 20:55:47.453546 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 329/625] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:47 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1475 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:47.459695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:47.460044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:47.460643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:47.467002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.467489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.467919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.468109 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15444125-0e15-45fd-aad2-ced5c809898b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 200 len: 1589 microversion: 2.1 time: 0.269975 Aug 06 20:55:47.469021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.469756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.470415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.470910 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 297/626] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:47 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 1589 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:47.481152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a172f030-069c-4ca1-b432-219d977de87d req-466d5088-933e-49a4-b0d6-6f7761ec96de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0af8fc-0b76-4863-bb2d-699fc8f3cde9", "tag": "1ae474c0-bff8-4514-9ff0-4e4609198c44"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:47.501476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a172f030-069c-4ca1-b432-219d977de87d req-466d5088-933e-49a4-b0d6-6f7761ec96de service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.502356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a172f030-069c-4ca1-b432-219d977de87d req-466d5088-933e-49a4-b0d6-6f7761ec96de service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.503063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a172f030-069c-4ca1-b432-219d977de87d req-466d5088-933e-49a4-b0d6-6f7761ec96de service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.516200 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a172f030-069c-4ca1-b432-219d977de87d req-466d5088-933e-49a4-b0d6-6f7761ec96de service nova] Creating event network-changed:1ae474c0-bff8-4514-9ff0-4e4609198c44 for instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 on nch2-master-1 Aug 06 20:55:47.521343 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a172f030-069c-4ca1-b432-219d977de87d req-466d5088-933e-49a4-b0d6-6f7761ec96de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049208 Aug 06 20:55:47.522466 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 298/627] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:47.637376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:47.651876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:47.654985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:47.656387 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cfc2f5ae-64c2-4d1d-aea1-e7434f657ea2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1362 microversion: 2.25 time: 0.200701 Aug 06 20:55:47.683002 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 330/628] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:47 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:47.690407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:47.691646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:47.693759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:47.694644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:47.701992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.703152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.703874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.706077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.707643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.709801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.715430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.717680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.718903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.720701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.721584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.722913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.927296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:47.936386 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-353e4992-470d-4651-abc0-e4f68404adf9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1319 microversion: 2.1 time: 0.252222 Aug 06 20:55:47.937463 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 331/629] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:47 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:47.947144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:47.948268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:47.955261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.956014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.956639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.957658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.958444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.959098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:48.041657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:48.052236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:48.054320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:48.060395 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c663d00d-320f-4626-acae-ddd7c7740b25 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.121256 Aug 06 20:55:48.071431 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 332/630] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:47 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:48.192820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:48.193651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:48.220617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:48.225107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:48.226870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:48.228925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:48.229661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:48.230758 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ed2a4346-ec53-4363-91f1-8e86dcfcb5a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1318 microversion: 2.1 time: 0.546434 Aug 06 20:55:48.233157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:48.233712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:48.233982 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 299/631] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:47 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:48.486120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:48.491125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:48.499560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:48.500192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:48.501260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:48.502199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:48.505017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:48.505729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:48.730899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:48.740742 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5d8d36eb-4db6-4064-951b-3416d2d3191c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.555679 Aug 06 20:55:48.751995 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 333/632] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:48 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:48.756980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:48.757601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:48.764383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:48.764881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:48.765323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:48.766037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:48.766500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:48.767015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:48.992980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.006992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.009837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.011549 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d0613c6c-c634-4d45-855e-c029f35500cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1362 microversion: 2.25 time: 0.258707 Aug 06 20:55:49.012289 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 334/633] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:48 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:49.017669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d4d2a765-7aa0-43e3-91a9-3717cf5e4872 req-ea71b16f-88aa-4f8e-80d4-a4e5536bfb4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d48166-5304-479e-998a-4ca89870b1a2", "tag": "6753505e-1a26-48b2-8451-717992f9bed3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:49.030966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d4d2a765-7aa0-43e3-91a9-3717cf5e4872 req-ea71b16f-88aa-4f8e-80d4-a4e5536bfb4a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.032110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d4d2a765-7aa0-43e3-91a9-3717cf5e4872 req-ea71b16f-88aa-4f8e-80d4-a4e5536bfb4a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.032749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d4d2a765-7aa0-43e3-91a9-3717cf5e4872 req-ea71b16f-88aa-4f8e-80d4-a4e5536bfb4a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.046370 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d4d2a765-7aa0-43e3-91a9-3717cf5e4872 req-ea71b16f-88aa-4f8e-80d4-a4e5536bfb4a service nova] Creating event network-changed:6753505e-1a26-48b2-8451-717992f9bed3 for instance 70d48166-5304-479e-998a-4ca89870b1a2 on nch1-master-1 Aug 06 20:55:49.052712 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d4d2a765-7aa0-43e3-91a9-3717cf5e4872 req-ea71b16f-88aa-4f8e-80d4-a4e5536bfb4a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038892 Aug 06 20:55:49.053983 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 335/634] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:49.061067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:49.062702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:49.083388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.083891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.084488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.085227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.085694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.086994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.228366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.240013 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5c89ca70-d230-46a0-953b-ddc7f7d4f571 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1474 microversion: 2.1 time: 0.767079 Aug 06 20:55:49.249298 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 300/635] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:48 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1474 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:49.265492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:49.266234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:49.278155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.278848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.279291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.280007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.280465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.280891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.297389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.300404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:49.310094 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-323e90f3-44cd-4fd9-b3eb-8472ccedb6bb tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1319 microversion: 2.1 time: 0.254101 Aug 06 20:55:49.317866 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 336/636] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:49 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:49.317866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:49.317866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:49.323705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.324450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.325036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.326172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.326665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.327094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.381159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.410308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.422150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.433550 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9ebfccd8-ea48-41d7-8330-e26eaddaab37 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.180260 Aug 06 20:55:49.434995 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 301/637] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:49 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:49.764809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:49.765661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:49.776503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.777114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.781906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.782447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.783889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.784519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.785308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.788284 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd6f6800-1801-41ff-b650-6348975ad268 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1318 microversion: 2.1 time: 0.476340 Aug 06 20:55:49.789421 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 337/638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:49 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:50.035674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:50.036839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:50.044792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.045497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.046480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.047482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.048206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.049227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.150211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:50.172285 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6dba33f2-4308-4ffc-9835-326c87616056 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.411813 Aug 06 20:55:50.204621 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 302/639] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:49 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:50.237373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-fffce129-1d4b-42a4-9321-d3a084d259b4 req-948c588d-5a62-4555-b748-b1cadbcc618a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5f4cef-88c9-4234-b823-bb15b4d351a8", "name": "network-vif-plugged", "status": "completed", "tag": "99e7008f-8aa5-4595-804c-937e754dabbe"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:50.261783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fffce129-1d4b-42a4-9321-d3a084d259b4 req-948c588d-5a62-4555-b748-b1cadbcc618a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.266709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fffce129-1d4b-42a4-9321-d3a084d259b4 req-948c588d-5a62-4555-b748-b1cadbcc618a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.267772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fffce129-1d4b-42a4-9321-d3a084d259b4 req-948c588d-5a62-4555-b748-b1cadbcc618a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.290320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:50.291047 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-fffce129-1d4b-42a4-9321-d3a084d259b4 req-948c588d-5a62-4555-b748-b1cadbcc618a service nova] Creating event network-vif-plugged:99e7008f-8aa5-4595-804c-937e754dabbe for instance 0b5f4cef-88c9-4234-b823-bb15b4d351a8 on nch1-master-1 Aug 06 20:55:50.303649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:50.304201 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-fffce129-1d4b-42a4-9321-d3a084d259b4 req-948c588d-5a62-4555-b748-b1cadbcc618a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071110 Aug 06 20:55:50.306046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:50.307413 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 303/640] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:55:50.307559 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-55b60706-cf13-49e1-b052-85be15803268 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1557 microversion: 2.25 time: 0.277327 Aug 06 20:55:50.308315 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 338/641] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:50 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1557 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:50.315465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:50.316170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:50.334887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.337117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.337777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.339171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.339991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.341299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.350409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:50.353582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:50.370766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.371287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.371721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.377169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.377867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.378672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.405342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:50.540815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid 7468a9b2-902c-4b29-bdc2-230d3f558c4b {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:50.561518 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-abeb1e02-69ad-4357-86b6-91dfe728d554 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 2050 microversion: 2.25 time: 0.233747 Aug 06 20:55:50.570948 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 339/642] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:50 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 2050 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:50.582161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:50.583642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:50.596466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.605306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.606427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.608249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.609144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.609826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.733970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:50.741759 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7d2137ec-3ee5-4fc3-9489-6f01a84989c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1474 microversion: 2.1 time: 0.433112 Aug 06 20:55:50.759609 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 304/643] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:50 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1474 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:50.759609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:50.759609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:50.767558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.768062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.768507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.769219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.769685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.770307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.804248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:50.814659 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ff9e09f4-1cd6-4016-8bb2-0170fabf3221 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1319 microversion: 2.1 time: 0.242141 Aug 06 20:55:50.826583 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 340/644] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:50 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:50.831349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:50.831861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:50.842728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.843230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.843676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.844550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.845235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.845859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.891037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:50.900468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:50.902166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:50.907651 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9b67463c-4ad1-4e8f-b196-47b5f6d5f73b tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.159647 Aug 06 20:55:50.908961 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 305/645] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:50 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:50.914593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:50.915835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:50.923444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.924174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.924829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.925731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.926368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.927017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.999858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid 7468a9b2-902c-4b29-bdc2-230d3f558c4b {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:51.017417 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2d7a1edc-f9e3-429f-bf59-ab2344df340a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 2050 microversion: 2.25 time: 0.195783 Aug 06 20:55:51.018122 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 341/646] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:50 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 2050 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:51.155558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6de6abc-3d7d-46c0-8992-a4028cfdd2c6 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.164864 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c6de6abc-3d7d-46c0-8992-a4028cfdd2c6 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.145264 Aug 06 20:55:51.165570 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 342/647] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:51.171394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ea72d078-49f3-4706-b536-0c195718faf6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.174362 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:55:51.174362 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:55:51.176461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea72d078-49f3-4706-b536-0c195718faf6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.177013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea72d078-49f3-4706-b536-0c195718faf6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.177457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea72d078-49f3-4706-b536-0c195718faf6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.178188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea72d078-49f3-4706-b536-0c195718faf6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.178675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea72d078-49f3-4706-b536-0c195718faf6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.179097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea72d078-49f3-4706-b536-0c195718faf6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.191031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:51.199629 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e5547d4-bb03-4b18-bffc-86b7ad40a0e0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1318 microversion: 2.1 time: 0.289291 Aug 06 20:55:51.200213 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 306/648] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:50 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:51.204799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-b174883c-ad19-485f-ba3d-17a3aa7ebcfd req-fc1a0910-3fa7-4af4-8f44-5b01a2152579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d053068c-becf-4353-b775-0bf47d7283ff", "name": "network-vif-unplugged", "status": "completed", "tag": "77bb4236-0e88-4203-bc54-27a09c725653"}, {"name": "network-changed", "server_uuid": "d053068c-becf-4353-b775-0bf47d7283ff", "tag": "77bb4236-0e88-4203-bc54-27a09c725653"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:51.207775 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ea72d078-49f3-4706-b536-0c195718faf6 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.040949 Aug 06 20:55:51.208544 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 343/649] 10.222.0.33 () {60 vars in 1217 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:55:51.213127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8695034a-840a-4106-9b05-5bc7a474210f tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.218599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b174883c-ad19-485f-ba3d-17a3aa7ebcfd req-fc1a0910-3fa7-4af4-8f44-5b01a2152579 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.219300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b174883c-ad19-485f-ba3d-17a3aa7ebcfd req-fc1a0910-3fa7-4af4-8f44-5b01a2152579 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.219915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b174883c-ad19-485f-ba3d-17a3aa7ebcfd req-fc1a0910-3fa7-4af4-8f44-5b01a2152579 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.232696 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-b174883c-ad19-485f-ba3d-17a3aa7ebcfd req-fc1a0910-3fa7-4af4-8f44-5b01a2152579 service nova] Creating event network-vif-unplugged:77bb4236-0e88-4203-bc54-27a09c725653 for instance d053068c-becf-4353-b775-0bf47d7283ff on nch1-master-1 Aug 06 20:55:51.233207 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-b174883c-ad19-485f-ba3d-17a3aa7ebcfd req-fc1a0910-3fa7-4af4-8f44-5b01a2152579 service nova] Creating event network-changed:77bb4236-0e88-4203-bc54-27a09c725653 for instance d053068c-becf-4353-b775-0bf47d7283ff on nch1-master-1 Aug 06 20:55:51.234809 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8695034a-840a-4106-9b05-5bc7a474210f tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.025342 Aug 06 20:55:51.235651 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 344/650] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:51.239098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-b174883c-ad19-485f-ba3d-17a3aa7ebcfd req-fc1a0910-3fa7-4af4-8f44-5b01a2152579 service nova] Instance d053068c-becf-4353-b775-0bf47d7283ff is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:55:51.240202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.240811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:51.247658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.248148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.248588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.249294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.249741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.250685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.251891 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-b174883c-ad19-485f-ba3d-17a3aa7ebcfd req-fc1a0910-3fa7-4af4-8f44-5b01a2152579 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.050525 Aug 06 20:55:51.252707 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 307/651] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:51.262064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-83fede3e-0cf3-4b49-b365-64932840422b tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:51.262713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-83fede3e-0cf3-4b49-b365-64932840422b tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:51.268861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83fede3e-0cf3-4b49-b365-64932840422b tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.269340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83fede3e-0cf3-4b49-b365-64932840422b tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.269777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83fede3e-0cf3-4b49-b365-64932840422b tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.270476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83fede3e-0cf3-4b49-b365-64932840422b tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.270969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83fede3e-0cf3-4b49-b365-64932840422b tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.271391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83fede3e-0cf3-4b49-b365-64932840422b tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.288565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=58 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:51.341718 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-83fede3e-0cf3-4b49-b365-64932840422b tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b/action" status: 202 len: 0 microversion: 2.25 time: 0.083999 Aug 06 20:55:51.342403 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 308/652] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 20:55:51 2022] POST /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:55:51.348464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd7ae68f-2e90-4f89-8f43-b9eaf6be2849 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.359266 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dd7ae68f-2e90-4f89-8f43-b9eaf6be2849 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014678 Aug 06 20:55:51.360201 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 309/653] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:51.365227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.365995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:51.375740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.377132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.377778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.378937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.379559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.380166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.501836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:51.513707 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0c2bdab2-6dc7-4a6d-8c3b-33a9263536b7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.276646 Aug 06 20:55:51.514366 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 345/654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:51.526566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid 7468a9b2-902c-4b29-bdc2-230d3f558c4b {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:51.530645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2cdc0342-81b7-4cbc-a73d-5a0be42a5635 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.545077 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6bd433ae-e4e0-47c9-8ce6-76c6cf6920f1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 2055 microversion: 2.25 time: 0.183858 Aug 06 20:55:51.558610 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2cdc0342-81b7-4cbc-a73d-5a0be42a5635 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040235 Aug 06 20:55:51.558610 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 346/655] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:51.559971 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 310/656] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 2055 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:51.573002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6b5b1e6-2930-4b11-aa6d-e1f62f998f1d tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.602264 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6b5b1e6-2930-4b11-aa6d-e1f62f998f1d tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.036775 Aug 06 20:55:51.602855 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 347/657] 10.222.0.33 () {58 vars in 1165 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:51.620444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7abed89a-06f9-4263-9c54-3f21dfb42623 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.630046 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7abed89a-06f9-4263-9c54-3f21dfb42623 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014662 Aug 06 20:55:51.631728 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 311/658] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:51.643559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9bbc0818-71ef-41f4-8294-f7d9f8bf4c57 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.678289 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9bbc0818-71ef-41f4-8294-f7d9f8bf4c57 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.038507 Aug 06 20:55:51.679851 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 348/659] 10.222.0.33 () {58 vars in 1169 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:51.695766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8bcf24a8-d910-4289-b5a0-6e019d083f02 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.709007 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8bcf24a8-d910-4289-b5a0-6e019d083f02 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018056 Aug 06 20:55:51.713293 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 312/660] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:51.723363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b0dc761-d535-4b12-bacc-4d7c8405593b tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.733139 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b0dc761-d535-4b12-bacc-4d7c8405593b tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013563 Aug 06 20:55:51.734291 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 349/661] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:51.746916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-81622d0a-f00e-45ce-936f-6b928e5dc7c3 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.767151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.767847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:51.775049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.775757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.776368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.777268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.777907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.778514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.800414 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-81622d0a-f00e-45ce-936f-6b928e5dc7c3 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2912 microversion: 2.1 time: 0.058326 Aug 06 20:55:51.812809 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 313/662] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2912 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:51.818923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34a4e67a-84b6-42d4-b230-96ae9e8d5905 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.832347 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-34a4e67a-84b6-42d4-b230-96ae9e8d5905 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017926 Aug 06 20:55:51.834664 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 314/663] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:51.839291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:51.840136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:51.846468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.847054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.847498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:51.848210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:51.848699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:51.849126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.011611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:52.019521 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f1b4905b-8b84-49a1-8e98-76e877b3f51a tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1319 microversion: 2.1 time: 0.185396 Aug 06 20:55:52.020253 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 315/664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:52.022342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:52.025631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e4af1f41-54b7-49c2-9c36-ef945a888659 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.032374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6f43ce5b-e5bd-4c51-ba64-7eae3a40fa7e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1474 microversion: 2.1 time: 0.269020 Aug 06 20:55:52.033751 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 350/665] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:51 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1474 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:52.039209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.039926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:52.046338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.047011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.047459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.048167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.048629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.049059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.066582 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e4af1f41-54b7-49c2-9c36-ef945a888659 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.044881 Aug 06 20:55:52.067578 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 316/666] 10.222.0.33 () {58 vars in 1144 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:52.081056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a9530b5-944e-4e47-97ea-6175b3b8cb6c tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.089437 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6a9530b5-944e-4e47-97ea-6175b3b8cb6c tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012204 Aug 06 20:55:52.089940 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 317/667] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:55:52.101314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-950a464c-54dd-4b2e-8fca-b6043ebffc80 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.118433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:52.126401 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-950a464c-54dd-4b2e-8fca-b6043ebffc80 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.028878 Aug 06 20:55:52.127055 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 318/668] 10.222.0.33 () {58 vars in 1148 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:52.127210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:52.128797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:52.134814 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9109ce18-8724-440c-aa9e-e9e89b9291d7 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1446 microversion: 2.75 time: 0.099407 Aug 06 20:55:52.135270 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 351/669] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:52.142035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8ce52c00-1766-4509-acf8-c0a31fef1248 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.154569 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8ce52c00-1766-4509-acf8-c0a31fef1248 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.016488 Aug 06 20:55:52.155136 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 319/670] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:52.167497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-72dc3d34-5702-4827-b579-87aead271792 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.175894 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-72dc3d34-5702-4827-b579-87aead271792 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012694 Aug 06 20:55:52.176421 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 352/671] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:52.188191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-924252d7-09e9-45be-be10-9da11e234b43 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.194134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:52.210196 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-924252d7-09e9-45be-be10-9da11e234b43 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1541 microversion: 2.1 time: 0.025697 Aug 06 20:55:52.210784 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 320/672] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/flavors?marker=452 => generated 1541 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:52.218821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.219818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:52.224210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21f56c15-54b8-400c-91f5-9f838a4f9782 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.225862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.226342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.226798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.227491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.227949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.228366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.246140 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21f56c15-54b8-400c-91f5-9f838a4f9782 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.025624 Aug 06 20:55:52.247033 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 321/673] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:52.264546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-adac3a4f-1bc0-4253-b798-69a437954c67 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.273756 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-adac3a4f-1bc0-4253-b798-69a437954c67 tempest-FlavorsV2TestJSON-1026554845 tempest-FlavorsV2TestJSON-1026554845-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012308 Aug 06 20:55:52.274334 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 322/674] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:55:52.325788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-724efdaa-ff66-4a44-a947-44fd9e80125e req-f3acd7b2-7e44-46af-a862-f8df6e88943f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a6fa4c-df67-4379-88ff-45430f0b9a4d", "name": "network-vif-plugged", "status": "completed", "tag": "b9c19136-ed57-49e3-8d70-56bec4ee1ca7"}, {"server_uuid": "cc5f43e6-eb38-4c09-8284-99bba87f1564", "name": "network-vif-plugged", "status": "completed", "tag": "5fc2e6b6-1ef8-49a2-a162-668afad75272"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:52.338123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-724efdaa-ff66-4a44-a947-44fd9e80125e req-f3acd7b2-7e44-46af-a862-f8df6e88943f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.338750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-724efdaa-ff66-4a44-a947-44fd9e80125e req-f3acd7b2-7e44-46af-a862-f8df6e88943f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.339180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-724efdaa-ff66-4a44-a947-44fd9e80125e req-f3acd7b2-7e44-46af-a862-f8df6e88943f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.352071 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-724efdaa-ff66-4a44-a947-44fd9e80125e req-f3acd7b2-7e44-46af-a862-f8df6e88943f service nova] Creating event network-vif-plugged:b9c19136-ed57-49e3-8d70-56bec4ee1ca7 for instance f4a6fa4c-df67-4379-88ff-45430f0b9a4d on nch2-master-1 Aug 06 20:55:52.352562 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-724efdaa-ff66-4a44-a947-44fd9e80125e req-f3acd7b2-7e44-46af-a862-f8df6e88943f service nova] Creating event network-vif-plugged:5fc2e6b6-1ef8-49a2-a162-668afad75272 for instance cc5f43e6-eb38-4c09-8284-99bba87f1564 on nch1-master-1 Aug 06 20:55:52.363153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:52.363651 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-724efdaa-ff66-4a44-a947-44fd9e80125e req-f3acd7b2-7e44-46af-a862-f8df6e88943f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041723 Aug 06 20:55:52.364589 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 323/675] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:55:52.372410 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6aadf5c0-e53e-4a54-8d89-12727d15360b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1318 microversion: 2.1 time: 0.157251 Aug 06 20:55:52.385976 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 353/676] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:52.534836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.535547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:52.542492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.543008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.543456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.544167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.544697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.545051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.571309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:52.571935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:52.578623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.579117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.579556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.580262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.580723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.581155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.750931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid 7468a9b2-902c-4b29-bdc2-230d3f558c4b {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:52.765487 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e110cd80-2026-4ca1-b4a6-be73d3fcabd8 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 2035 microversion: 2.25 time: 0.198132 Aug 06 20:55:52.766080 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 354/677] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 2035 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:55:52.793989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:52.799129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:52.808035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.808545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.809887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.810532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:52.811015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:52.811686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:52.815134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:52.831054 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b9f62f74-e4e7-4e9b-8bb8-f4b9c90b371f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.300531 Aug 06 20:55:52.844652 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 324/678] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:52 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:52.889706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'flavor' on Instance uuid 7468a9b2-902c-4b29-bdc2-230d3f558c4b {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:52.940262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Going to try to live migrate instance to nch1-master-1 {{(pid=142461) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 20:55:53.041295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:53.041945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:53.048856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.049415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.049858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.050592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.051085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.052165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.222672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:53.231684 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5eb39ab7-14c2-4416-81fa-6ad1a0ce80a3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1469 microversion: 2.1 time: 0.194264 Aug 06 20:55:53.243256 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 325/679] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:53 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:53.252965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:53.253644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:53.282033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.282640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.283095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.283854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.284469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.285069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.433113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:53.441216 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-85f02a2b-1289-47c1-854c-61444ee4ac75 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1474 microversion: 2.1 time: 0.196855 Aug 06 20:55:53.442190 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 326/680] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:53 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1474 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:53.447433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:53.448230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:53.457323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.458098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.458977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.459799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.460278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.461492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.540825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:53.549326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:53.550855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:53.556624 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-25f8aec0-eb65-4b84-b88c-81b844ac13f5 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1452 microversion: 2.75 time: 0.113360 Aug 06 20:55:53.557194 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 327/681] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:53 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:53.564521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:53.565210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:53.578394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.579105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.579608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.580516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.581393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.581894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.750825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:53.759827 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-554790d5-967b-457c-b306-8e2ee623e10e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d" status: 200 len: 1319 microversion: 2.1 time: 0.201463 Aug 06 20:55:53.760407 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 328/682] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:53 2022] GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:53.764809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:53.765407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:53.771179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.771657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.772095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.772781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.774307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.774458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.932488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:53.940499 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f511c504-1843-4c1a-9505-259fe51c8cef tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1318 microversion: 2.1 time: 0.179109 Aug 06 20:55:53.941168 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 329/683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:53 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:53.946330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:53.947129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:53.953222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.953717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.954155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.954874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:53.955329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:53.955755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:53.971833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:54.168573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:54.177713 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-07de5f35-183f-4cbe-88fb-446c9dbe2737 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.235333 Aug 06 20:55:54.191615 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 330/684] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:53 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:54.463984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:54.464650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:54.471367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:54.472077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:54.472524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:54.473237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:54.473702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:54.474130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:54.707518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:54.721452 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e7a4fdb1-d271-4b31-abfa-f11ad6c35392 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1474 microversion: 2.1 time: 0.260736 Aug 06 20:55:54.722357 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 331/685] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:54 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1474 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:54.735021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:54.736274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:54.750002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:54.750523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:54.754255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:54.755032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:54.755511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:54.755950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:54.849338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:54.860802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:54.862569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:54.868716 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e4b0fc3a-428d-414b-8865-0bccac4f47e2 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1452 microversion: 2.75 time: 0.143181 Aug 06 20:55:54.869623 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 332/686] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:54 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:54.887587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:54.888334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:54.900478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:54.900962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:54.901767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:54.902681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:54.903681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:54.904267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:55.234773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:55.247586 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-29b958af-a545-4970-8ea8-86b205922ad1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d" status: 200 len: 1469 microversion: 2.1 time: 0.376482 Aug 06 20:55:55.248405 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 333/687] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:54 2022] GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d => generated 1469 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:55.253095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:55.253893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:55.260075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:55.260779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:55.261429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:55.262359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:55.263014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:55.263611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:55.387540 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d3906574-20eb-4fee-aa4a-adac83950003 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b/action" status: 202 len: 0 microversion: 2.25 time: 2.598773 Aug 06 20:55:55.388937 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 355/688] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 20:55:52 2022] POST /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b/action => generated 0 bytes in 2601 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:55:55.396478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:55.397490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:55.405592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:55.406436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:55.407166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:55.408005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:55.408492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:55.409001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:55.465438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=16 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:55.580456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:55.601851 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd0e42b5-6f33-4e27-9be9-55e64730da9a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.210269 Aug 06 20:55:55.605062 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 356/689] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:55 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:55.611184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:55.617482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:55.618645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Searching by: {'reservation_id': 'r-n9983mcj', 'deleted': False, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:55:55.624515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:55.625079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:55.625574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:55.626572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:55.627234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:55.627874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:55.657913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=19 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:55.734284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 20:55:55.807727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:55.814207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:55.814731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:55.815364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:55.876243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:55.887339 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6efb4435-2e13-49d4-a63b-aa8588e51016 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1468 microversion: 2.1 time: 0.637646 Aug 06 20:55:55.888216 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 334/690] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:55 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1468 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:55.910631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:55.914535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:55.926200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:55.927068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:55.927684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:55.928771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:55.929944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:55.930665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.006012 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aa2aba7e-ade2-466d-8ced-d83d2ae4e57e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-n9983mcj" status: 200 len: 2931 microversion: 2.1 time: 0.399612 Aug 06 20:55:56.007024 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 357/691] 10.222.0.33 () {58 vars in 1197 bytes} [Sat Aug 6 20:55:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-n9983mcj => generated 2931 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:56.024897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:56.026240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:56.035383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.035882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.037299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.040504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.043732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.044868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.192314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:56.202035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:56.203893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:56.205091 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7d298345-cf3f-4016-baab-7a05f6276eff tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.300571 Aug 06 20:55:56.205854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 335/692] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:55 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:56.217246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:56.218106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:56.218757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:56.226494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.227301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.228003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.228384 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7a99b3cf-cd63-49a4-8c0c-208f58c0bbf7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1472 microversion: 2.1 time: 0.218967 Aug 06 20:55:56.229076 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 358/693] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:56 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1472 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:56.229242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.229849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.230578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.316258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:56.327025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:56.328812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:56.335943 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5c12dd2a-15cf-4327-93e7-b0ee785daa77 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1452 microversion: 2.75 time: 0.128898 Aug 06 20:55:56.336624 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 336/694] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:56 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:56.341624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3cec1841-5451-4958-a033-65b33c68930e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:56.357333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.compute.server_groups [None req-3cec1841-5451-4958-a033-65b33c68930e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Querying cell 7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) for 2 instances {{(pid=142462) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 06 20:55:56.358064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3cec1841-5451-4958-a033-65b33c68930e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.358575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3cec1841-5451-4958-a033-65b33c68930e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.359021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3cec1841-5451-4958-a033-65b33c68930e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.380540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-755349556", "block_migration": true, "disk_over_commit": false}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:56.384221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:56.390388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.391046 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3cec1841-5451-4958-a033-65b33c68930e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/cd84b490-1adc-4a7f-a8e2-6ddf1fcf3316" status: 200 len: 271 microversion: 2.1 time: 0.052695 Aug 06 20:55:56.391455 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 337/695] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 20:55:56 2022] GET /compute/v2.1/os-server-groups/cd84b490-1adc-4a7f-a8e2-6ddf1fcf3316 => generated 271 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:56.391609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.391921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.392632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.393091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.393525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.402223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4a80340f-f8aa-4486-91d8-3dece47cb709 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:56.402960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4a80340f-f8aa-4486-91d8-3dece47cb709 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:56.409271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a80340f-f8aa-4486-91d8-3dece47cb709 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.409898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a80340f-f8aa-4486-91d8-3dece47cb709 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.410455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a80340f-f8aa-4486-91d8-3dece47cb709 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.411299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a80340f-f8aa-4486-91d8-3dece47cb709 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.411867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a80340f-f8aa-4486-91d8-3dece47cb709 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.412456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a80340f-f8aa-4486-91d8-3dece47cb709 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.420269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lazy-loading 'flavor' on Instance uuid cc5f43e6-eb38-4c09-8284-99bba87f1564 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:56.436389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Going to try to live migrate instance to tempest-host-755349556 {{(pid=142461) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 20:55:56.441347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:56.447243 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] HTTP exception thrown: Compute host tempest-host-755349556 could not be found. Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Request method failure captured: Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564/action HTTP/1.1 Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 106 Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVFh7Y9H-lF1izqPJDTHas8J6l3Alx2LpszJDPtPCyf2GSeLVwZIVt-WkXI8mOhRNsU6M7w2WaOBkMFLDeoXiTH2f89VqSnFoaLdPGng_oc0kUIQrp5jNcaylfZ6SXrWrXzAentosFzwfgZNr4DZncnE80KACRXMtPYmjxFz3ElNAM Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 6df791ea0dc14b459fd00aeeae02d584 Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-LiveMigrationNegativeTest-1777190573 Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:55:56.451407 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6df791ea0dc14b459fd00aeeae02d584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6df791ea0dc14b459fd00aeeae02d584", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6df791ea0dc14b459fd00aeeae02d584"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6df791ea0dc14b459fd00aeeae02d584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-LiveMigrationNegativeTest-1777190573 Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 6df791ea0dc14b459fd00aeeae02d584 Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1777190573 Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-LiveMigrationNegativeTest-1777190573-project-admin Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: edbe49bf4b1a46fcbe274cb75a16c5e2 Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-LiveMigrationNegativeTest-1777190573-project-admin Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: {"os-migrateLive": {"host": "tempest-host-755349556", "block_migration": true, "disk_over_commit": false}} Aug 06 20:55:56.452868 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: exception: Compute host tempest-host-755349556 could not be found. Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'cc5f43e6-eb38-4c09-8284-99bba87f1564', 'body': {'os-migrateLive': {'host': 'tempest-host-755349556', 'block_migration': True, 'disk_over_commit': False}}} Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:55:56.453638 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-755349556 could not be found. Aug 06 20:55:56.455822 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-755349556 could not be found. Aug 06 20:55:56.458316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-755349556 could not be found. Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Returning 400 to user: Compute host tempest-host-755349556 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-587d07fa-e27a-4d41-a340-ae837af73c3e tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564/action" status: 400 len: 99 microversion: 2.1 time: 0.222894 Aug 06 20:55:56.461383 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 359/696] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Aug 6 20:55:56 2022] POST /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564/action => generated 99 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:56.462262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:56.463258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:56.471434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.471935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.472380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.473110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.473575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.474010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.622575 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4a80340f-f8aa-4486-91d8-3dece47cb709 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 200 len: 1620 microversion: 2.1 time: 0.224457 Aug 06 20:55:56.642399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:56.642609 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 338/697] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:56 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 1620 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:56.647961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:56.648730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:56.654322 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0247658d-7404-47a9-8b56-23e8752cd4e1 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1468 microversion: 2.1 time: 0.196385 Aug 06 20:55:56.654918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.655732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.656372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.657343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.657984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.658616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.669608 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 360/698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:56 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1468 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:56.700208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9ab858b-778f-4f14-8f7b-a38829908a32 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:56.701745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9ab858b-778f-4f14-8f7b-a38829908a32 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:56.708559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ab858b-778f-4f14-8f7b-a38829908a32 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.709791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ab858b-778f-4f14-8f7b-a38829908a32 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.711039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ab858b-778f-4f14-8f7b-a38829908a32 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.712576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ab858b-778f-4f14-8f7b-a38829908a32 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:56.713253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ab858b-778f-4f14-8f7b-a38829908a32 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:56.713664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ab858b-778f-4f14-8f7b-a38829908a32 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:56.922015 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9ab858b-778f-4f14-8f7b-a38829908a32 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d" status: 200 len: 1620 microversion: 2.1 time: 0.251072 Aug 06 20:55:56.941036 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 361/699] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:56 2022] GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d => generated 1620 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:56.959193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1196795520", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:57.030379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:55:57.091520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:57.099967 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0e430590-4a78-4528-a997-6f888f7f0541 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.456185 Aug 06 20:55:57.100558 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 339/700] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:56 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:57.111852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d6771eca-6055-4066-afd2-382eff0d0904 req-1169241a-d041-4949-9025-2b420ea9ad9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0af8fc-0b76-4863-bb2d-699fc8f3cde9", "name": "network-vif-plugged", "status": "completed", "tag": "1ae474c0-bff8-4514-9ff0-4e4609198c44"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:57.127420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d6771eca-6055-4066-afd2-382eff0d0904 req-1169241a-d041-4949-9025-2b420ea9ad9b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:57.128187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d6771eca-6055-4066-afd2-382eff0d0904 req-1169241a-d041-4949-9025-2b420ea9ad9b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:57.128805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d6771eca-6055-4066-afd2-382eff0d0904 req-1169241a-d041-4949-9025-2b420ea9ad9b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:57.141541 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d6771eca-6055-4066-afd2-382eff0d0904 req-1169241a-d041-4949-9025-2b420ea9ad9b service nova] Creating event network-vif-plugged:1ae474c0-bff8-4514-9ff0-4e4609198c44 for instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 on nch2-master-1 Aug 06 20:55:57.148087 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d6771eca-6055-4066-afd2-382eff0d0904 req-1169241a-d041-4949-9025-2b420ea9ad9b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043700 Aug 06 20:55:57.149322 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 340/701] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:57.157475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1919784548", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "29ea4f47-8ba4-49b1-afa0-5b8d50656763"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:57.240144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:55:57.337215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:57.337649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:57.338136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:57.339165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:57.339594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:57.342682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:57.362808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:57.363317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:57.363767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:57.364511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:57.364983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:57.365410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:57.391708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Getting quotas for project d5ef27173302447a82d257b1f838e75d. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:57.401341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Getting quotas for user 79ffbe6477ea45f481620fa6293e1958 and project d5ef27173302447a82d257b1f838e75d. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:57.428400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:57.435839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:57.543640 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02705636-ce9d-4527-82df-5c0e6e029436 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601132 Aug 06 20:55:57.551313 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 362/702] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:55:57.556653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:57.557291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:57.573316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:57.573831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:57.581563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:57.581984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:57.582488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:57.583043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:57.792363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:57.818926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:57.821949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:57.823483 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eebf16d7-e39a-42ef-a760-44107edd360b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.275723 Aug 06 20:55:57.838577 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 363/703] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:57 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:57.838577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:57.838577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:57.842907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:57.843716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:57.844602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:57.858242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:57.859061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:57.861046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.084980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:58.095345 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-25c0d403-bf6c-43d5-a44d-0b65bff1330a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1469 microversion: 2.1 time: 0.269602 Aug 06 20:55:58.104184 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 364/704] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:57 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1469 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:58.108164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:58.108757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:58.115188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.115771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.116274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.117285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.117755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.118190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.191430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:58.201286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:58.202849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:58.208121 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7cb70522-6120-4e33-86b1-79f07739faf0 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1437 microversion: 2.75 time: 0.110761 Aug 06 20:55:58.209028 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 365/705] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:58 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:58.209737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:58.211932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:58.212979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:58.213758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:58.214091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:58.214687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:58.214819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:58.220747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.221242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.221683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.222518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.223010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.223445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.227769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.228727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.229420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.230351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.231506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.232447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.254813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:58.264035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:58.279910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:58.282504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:58.299218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:58.314602 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da47c220-9909-4fde-87ed-f39334ebe921 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1223 microversion: 2.1 time: 0.103860 Aug 06 20:55:58.316265 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 366/706] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:58 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:58.323718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-465a4c89-b7cb-4236-ba5a-3f608f96c725 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:58.324864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-465a4c89-b7cb-4236-ba5a-3f608f96c725 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:58.335252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465a4c89-b7cb-4236-ba5a-3f608f96c725 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.336377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465a4c89-b7cb-4236-ba5a-3f608f96c725 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.336998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465a4c89-b7cb-4236-ba5a-3f608f96c725 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.337920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465a4c89-b7cb-4236-ba5a-3f608f96c725 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.338444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465a4c89-b7cb-4236-ba5a-3f608f96c725 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.339053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465a4c89-b7cb-4236-ba5a-3f608f96c725 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.365552 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dabc7056-1dcb-4373-a15e-26da994e04e3 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214681 Aug 06 20:55:58.367510 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 341/707] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:55:58.372913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:58.373840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:58.381883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.382842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.384207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.385112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.385875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.386463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.438325 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-465a4c89-b7cb-4236-ba5a-3f608f96c725 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff/action" status: 204 len: 0 microversion: 2.1 time: 0.119570 Aug 06 20:55:58.439526 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 367/708] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:55:58 2022] POST /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff/action => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:55:58.589971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:58.599802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:58.613972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.614802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.615016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.615953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.616302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.616835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.724327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:58.724762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:58.725400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:58.726587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:58.727042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:58.800460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:58.809243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.810229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.810961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.812074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:58.812851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:58.813571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:58.818083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:58.827895 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b5584fe-defa-4f10-832b-be580910b62c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1317 microversion: 2.1 time: 0.458961 Aug 06 20:55:58.828951 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 342/709] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:58 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:58.834013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1720eab3-0226-4790-9b59-5df8f4484b0c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:58.834910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1720eab3-0226-4790-9b59-5df8f4484b0c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:58.955300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1720eab3-0226-4790-9b59-5df8f4484b0c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:58.963284 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1720eab3-0226-4790-9b59-5df8f4484b0c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1217 microversion: 2.1 time: 0.132955 Aug 06 20:55:58.975404 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 343/710] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:58 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:58.981673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:58.982519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:59.004430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.005159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.006717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:59.016535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.019875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.020340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:59.035471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:59.079231 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-af1925db-44d2-4bfb-879a-f422e6128216 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48/action" status: 202 len: 1940 microversion: 2.75 time: 0.634868 Aug 06 20:55:59.084748 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 368/711] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 20:55:58 2022] POST /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48/action => generated 1940 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 06 20:55:59.091706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:59.092544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:59.099122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.099867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.102074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:59.102863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.103335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.103772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:59.491526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:59.508548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:59.526119 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-84aa3430-0b94-4e82-acb3-89db48e78068 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1469 microversion: 2.1 time: 0.548649 Aug 06 20:55:59.527852 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 344/712] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:58 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1469 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:59.534830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:59.540733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:59.548160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:59.556630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.558943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.559681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:59.560381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:59.561119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.561577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.566700 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-611e847b-e246-49fd-a361-45d6f0050be0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.474166 Aug 06 20:55:59.567706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:59.568571 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 369/713] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:59 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:55:59.585295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:59.597291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:59.615796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.617700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.618351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:59.620070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.620705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.621295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:59.785698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:59.801663 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-49ebb727-7ab8-4b01-a400-fe7e7aa6927e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1277 microversion: 2.1 time: 0.228580 Aug 06 20:55:59.807653 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 370/714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:59 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:59.850455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:59.851815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:59.859771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.860742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.861185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:59.862032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:59.862681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:59.863207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:00.035588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:00.077427 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2c7556d3-522e-46f5-83f8-f75f1955e297 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.547667 Aug 06 20:56:00.078703 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 345/715] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:55:59 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:00.088103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:00.094226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:00.109235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:00.112186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:00.112743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:00.113488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:00.113952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:00.114388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:00.303585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:00.317669 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-015d6ab8-5d71-4d75-a72b-4a26269192a1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1287 microversion: 2.1 time: 0.237574 Aug 06 20:56:00.336414 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 346/716] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:00 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1287 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:00.555768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:00.558450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:00.571317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:00.572205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:00.572896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:00.574069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:00.574732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:00.575380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:00.825512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:00.850303 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4bb47b78-fe18-437b-bb49-7fa2331fc717 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1466 microversion: 2.1 time: 1.002988 Aug 06 20:56:00.852697 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 371/717] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:59 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1466 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:00.871113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:00.872055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:00.882843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:00.883774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:00.885036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:00.886140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:00.886843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:00.887453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:01.022198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:01.031559 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4ffbd1a6-13b3-481b-9126-a443f3edae97 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1469 microversion: 2.1 time: 0.483880 Aug 06 20:56:01.048294 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 347/718] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:00 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1469 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:01.054501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:01.054501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:01.066965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:01.068233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:01.068666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:01.069719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:01.070110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:01.070647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:01.464033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:01.470000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:01.479444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:01.487328 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-960edd06-c322-425d-955d-034d44d017a0 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1319 microversion: 2.1 time: 0.437316 Aug 06 20:56:01.488328 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 348/719] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:01 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:01.489096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:01.491512 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8bcf681-2a9c-49ba-b17e-3696188d70c9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.637540 Aug 06 20:56:01.496017 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 372/720] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:00 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:01.502847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-901813505", "metadata": {"image_type": "test"}}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:01.503537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-2f2ee1c7-0b80-46fe-bc67-8f0230524c5a req-d8b9822a-ea72-4ea1-819f-b091c21a73db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7468a9b2-902c-4b29-bdc2-230d3f558c4b", "name": "network-vif-unplugged", "status": "completed", "tag": "0f582021-42a5-4a6d-ab3f-f6de4b82347d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:01.509855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:01.522237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2f2ee1c7-0b80-46fe-bc67-8f0230524c5a req-d8b9822a-ea72-4ea1-819f-b091c21a73db service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:01.523377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2f2ee1c7-0b80-46fe-bc67-8f0230524c5a req-d8b9822a-ea72-4ea1-819f-b091c21a73db service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:01.523825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2f2ee1c7-0b80-46fe-bc67-8f0230524c5a req-d8b9822a-ea72-4ea1-819f-b091c21a73db service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:01.528090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:01.528796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:01.531299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:01.532249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:01.535943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:01.539233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:01.546432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:01.578950 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-2f2ee1c7-0b80-46fe-bc67-8f0230524c5a req-d8b9822a-ea72-4ea1-819f-b091c21a73db service nova] Creating event network-vif-unplugged:0f582021-42a5-4a6d-ab3f-f6de4b82347d for instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b on nch2-master-1 Aug 06 20:56:01.585580 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-2f2ee1c7-0b80-46fe-bc67-8f0230524c5a req-d8b9822a-ea72-4ea1-819f-b091c21a73db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095697 Aug 06 20:56:01.593262 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 349/721] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:01.605512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:01.607536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:01.626424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:01.626963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:01.627409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:01.637400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:01.639061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Getting quotas for project 7397d6b602604e2caa60f16aee28c950. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:01.646911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:01.649038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Getting quotas for user 096b2f40a81a4627af9ae5c7b83fc619 and project 7397d6b602604e2caa60f16aee28c950. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:01.649284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:01.652672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:01.836611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:01.877966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac80d7b7-4a3b-4205-8471-4cb52cd4b3b8 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.283032 Aug 06 20:56:01.883853 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 350/722] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:01 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:01.899354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:01.900354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:01.924772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:01.928767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:01.929637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:01.930593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:01.931220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:01.931823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:02.055237 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3bbb9d70-9ed8-4fbe-ac9e-17e2d11104ea tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "POST /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9/action" status: 202 len: 0 microversion: 2.1 time: 0.557724 Aug 06 20:56:02.065044 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 373/723] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:56:01 2022] POST /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 20:56:02.072942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:02.074009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:02.081236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:02.082134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:02.082826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:02.084266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:02.085508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:02.088782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:02.178370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:02.191563 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-db57bea0-58d4-4069-872d-95f44a716ed2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1275 microversion: 2.1 time: 0.304673 Aug 06 20:56:02.199576 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 351/724] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:01 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1275 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:02.208702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ec3a870-35f4-49d4-a506-3651b7e78efa tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729df46dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:02.307256 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6ec3a870-35f4-49d4-a506-3651b7e78efa tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.106222 Aug 06 20:56:02.319371 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 352/725] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:02 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:02.512639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:02.513387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:02.524038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:02.524689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:02.527145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:02.528037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:02.529974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:02.539235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:02.565572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:02.580403 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f23afb66-a232-4ed1-9fb8-34b9664bb12c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1469 microversion: 2.1 time: 0.511898 Aug 06 20:56:02.581343 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 374/726] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:02 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1469 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:02.590315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:02.590965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:02.625706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:02.626226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:02.626728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:02.627663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:02.628327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:02.638562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:02.925875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:02.954339 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b15d3cf3-7614-447e-8829-f8296027f08d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1319 microversion: 2.1 time: 0.444317 Aug 06 20:56:02.968293 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 353/727] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:02 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:02.975748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a9d64aa3-9038-4de2-8358-e153fa373274 req-d56d2087-8824-4ea9-b61a-53348f8e4911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d053068c-becf-4353-b775-0bf47d7283ff", "name": "network-vif-plugged", "status": "completed", "tag": "77bb4236-0e88-4203-bc54-27a09c725653"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:02.989858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a9d64aa3-9038-4de2-8358-e153fa373274 req-d56d2087-8824-4ea9-b61a-53348f8e4911 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:02.990878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a9d64aa3-9038-4de2-8358-e153fa373274 req-d56d2087-8824-4ea9-b61a-53348f8e4911 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:02.992627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a9d64aa3-9038-4de2-8358-e153fa373274 req-d56d2087-8824-4ea9-b61a-53348f8e4911 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:03.009649 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a9d64aa3-9038-4de2-8358-e153fa373274 req-d56d2087-8824-4ea9-b61a-53348f8e4911 service nova] Creating event network-vif-plugged:77bb4236-0e88-4203-bc54-27a09c725653 for instance d053068c-becf-4353-b775-0bf47d7283ff on nch1-master-1 Aug 06 20:56:03.016028 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a9d64aa3-9038-4de2-8358-e153fa373274 req-d56d2087-8824-4ea9-b61a-53348f8e4911 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046330 Aug 06 20:56:03.017570 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 354/728] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:03.026908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:03.027684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:03.039155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:03.039929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:03.041086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:03.043247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:03.043948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:03.045138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:03.165865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:03.192951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:03.197436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:03.198965 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-50eb1920-3124-4318-9ad6-43b6c147d328 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.616610 Aug 06 20:56:03.201558 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 375/729] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:02 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:03.229809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:03.230725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:03.247299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:03.249995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:03.254147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:03.255304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:03.255930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:03.256514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:03.281021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:03.325706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:03.332101 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9855f492-f458-4c0b-8fe3-26e082d4860f tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.307952 Aug 06 20:56:03.333718 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 355/730] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:03 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:03.343240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7abf2d75-8949-4e0b-b797-e8e27b82b064 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729df468b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:03.422736 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7abf2d75-8949-4e0b-b797-e8e27b82b064 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.086132 Aug 06 20:56:03.424427 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 356/731] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:03 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:03.609991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:03.611516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:03.624127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:03.625058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:03.625855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:03.627105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:03.627755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:03.628373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:03.838904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:03.857372 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-49dd00bd-0ec0-4d0e-875b-52dba2cd8302 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1317 microversion: 2.1 time: 0.634436 Aug 06 20:56:03.858070 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 376/732] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:03 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:03.863140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-4c1073c5-078d-4df7-934c-a37b1979a830 req-161edefb-ced0-485c-82d0-21b70ebca1be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7468a9b2-902c-4b29-bdc2-230d3f558c4b", "tag": "0f582021-42a5-4a6d-ab3f-f6de4b82347d"}, {"name": "network-changed", "server_uuid": "a24a700b-1705-475c-a864-68d72e6ef501", "tag": "9b40f1fe-1540-41d4-af7e-cd55329a30db"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:03.886831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4c1073c5-078d-4df7-934c-a37b1979a830 req-161edefb-ced0-485c-82d0-21b70ebca1be service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:03.888162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4c1073c5-078d-4df7-934c-a37b1979a830 req-161edefb-ced0-485c-82d0-21b70ebca1be service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:03.888939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4c1073c5-078d-4df7-934c-a37b1979a830 req-161edefb-ced0-485c-82d0-21b70ebca1be service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:03.903947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-4c1073c5-078d-4df7-934c-a37b1979a830 req-161edefb-ced0-485c-82d0-21b70ebca1be service nova] Creating event network-changed:0f582021-42a5-4a6d-ab3f-f6de4b82347d for instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b on nch2-master-1 Aug 06 20:56:03.904851 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-4c1073c5-078d-4df7-934c-a37b1979a830 req-161edefb-ced0-485c-82d0-21b70ebca1be service nova] Creating event network-changed:9b40f1fe-1540-41d4-af7e-cd55329a30db for instance a24a700b-1705-475c-a864-68d72e6ef501 on nch1-master-1 Aug 06 20:56:03.921147 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-4c1073c5-078d-4df7-934c-a37b1979a830 req-161edefb-ced0-485c-82d0-21b70ebca1be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060629 Aug 06 20:56:03.927971 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 377/733] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:03.951963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:03.964298 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-48d88517-b446-41fb-8cb8-4ad84ee5d3b7 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1461 microversion: 2.1 time: 0.360168 Aug 06 20:56:03.967926 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 357/734] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:03 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1461 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:03.979545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:03.980252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:03.989843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:03.992110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:03.992848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:03.993502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:03.994515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:03.995496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:03.997864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:03.998577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:04.008483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:04.012064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:04.012756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:04.013559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:04.023465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:04.024132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:04.180073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:04.188711 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ab12f8a-246b-461a-bfd1-5c9c004eaed4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1461 microversion: 2.1 time: 0.202519 Aug 06 20:56:04.189631 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 358/735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:03 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1461 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:04.214984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a69fefa8-7bc9-42e8-96ba-e8bc09255c92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'create', calling method: .version_select at 0x7f729df46dc0>, body: {"keypair": {"name": "tempest-keypair-1417093008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVtqfiyoccStoE/zfpcBruS7xx7BQoC9GoQVmCeBRRXZ1AWCk3CT9reJlTFckvFcb/IoEoiGDhXPCR1Q0OQ4u9v2Lh3h4z7SRym4LP+WITnSktOfzuAUzrfGmHdw4HK1A=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:04.233082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a69fefa8-7bc9-42e8-96ba-e8bc09255c92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:04.239775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a69fefa8-7bc9-42e8-96ba-e8bc09255c92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for user 0701f31766dd4eeab9a63f6411c26d6e and project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:04.279459 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a69fefa8-7bc9-42e8-96ba-e8bc09255c92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069622 Aug 06 20:56:04.280064 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 359/736] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 20:56:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:56:04.284910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:04.291340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:04.300593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:04.301096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:04.301724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:04.302706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:04.304382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:04.305140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:04.526783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:04.537531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:04.539950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:04.544221 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-100cc564-2b68-4efe-b939-5e8d97d7df30 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.260447 Aug 06 20:56:04.555150 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 360/737] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:04 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:04.576088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:04.577142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:04.583724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:04.584423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:04.585001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:04.585741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:04.586210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:04.586857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:04.690445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:04.718681 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-720e3a77-409c-4079-83f9-605cdda0fe7e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.162082 Aug 06 20:56:04.719459 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 361/738] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:04 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:04.724390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f38ef416-6f19-478d-985a-625d16623ae7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729de34820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:04.739503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:04.750030 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22cb8391-41d7-42f7-9617-84ff91425ffc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1319 microversion: 2.1 time: 0.774502 Aug 06 20:56:04.751286 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 378/739] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:03 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1319 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:04.780336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f38ef416-6f19-478d-985a-625d16623ae7 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.059969 Aug 06 20:56:04.781609 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 362/740] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:04 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:04.877849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:04.878464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:04.885200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:04.885736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:04.886121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:04.887018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:04.887511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:04.887979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:05.098025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-71029002-e4ba-4719-a386-3a6526fc27e4 req-29657b55-4234-4ff7-9790-baa158138e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3246844f-93dc-4826-a925-2438888ba4b2", "tag": "8ee6ca35-6eb6-4bd9-add8-773df07bbbb4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:05.124696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-71029002-e4ba-4719-a386-3a6526fc27e4 req-29657b55-4234-4ff7-9790-baa158138e37 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:05.125687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-71029002-e4ba-4719-a386-3a6526fc27e4 req-29657b55-4234-4ff7-9790-baa158138e37 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:05.126348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-71029002-e4ba-4719-a386-3a6526fc27e4 req-29657b55-4234-4ff7-9790-baa158138e37 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:05.147501 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-71029002-e4ba-4719-a386-3a6526fc27e4 req-29657b55-4234-4ff7-9790-baa158138e37 service nova] Creating event network-changed:8ee6ca35-6eb6-4bd9-add8-773df07bbbb4 for instance 3246844f-93dc-4826-a925-2438888ba4b2 on nch2-master-1 Aug 06 20:56:05.159758 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-71029002-e4ba-4719-a386-3a6526fc27e4 req-29657b55-4234-4ff7-9790-baa158138e37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072391 Aug 06 20:56:05.161314 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 363/741] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:05.298074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:05.326928 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-238df075-fbc4-4fe1-b80f-463e4eef5cb7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1317 microversion: 2.1 time: 0.449581 Aug 06 20:56:05.329191 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 379/742] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:04 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:05.396196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1335797012", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5d497235-5173-4b4c-802d-29c9feaf9b47"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:05.480830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] validate_networks() for [('5d497235-5173-4b4c-802d-29c9feaf9b47', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:56:05.566931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:05.567837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:05.575144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:05.575641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:05.576273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:05.577166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:05.577908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:05.578510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:05.866781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:05.875269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:05.880031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:05.882255 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-52f053f8-5c3f-4858-9e7b-d429f10fea1c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.318451 Aug 06 20:56:05.883129 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 380/743] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:05 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:56:05.888010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:05.888924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:05.895547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:05.896385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:05.897596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:05.898592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:05.899295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:05.899944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.064302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:06.097190 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-afcca964-9e24-498e-98cb-63b463d80d02 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.212241 Aug 06 20:56:06.098025 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 381/744] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:05 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:06.104420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:06.105354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:06.112725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:06.113430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:06.114100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.115066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:06.115727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:06.117232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.295065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:06.304608 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08fe318b-ef7f-48b6-8ed5-fd24244f138f tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1319 microversion: 2.1 time: 0.205053 Aug 06 20:56:06.315869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 382/745] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:06 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:06.330380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-073ead5a-dcd8-4b55-9e69-10254d3bc488 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dc06a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:06.387758 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-073ead5a-dcd8-4b55-9e69-10254d3bc488 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.061846 Aug 06 20:56:06.388977 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 383/746] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:06 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:06.394341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:06.395159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:06.403516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:06.404391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:06.405171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.406347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:06.406992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:06.407817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.587890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:06.598639 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ae733c13-e3fd-43b4-a2ed-b271128d8cae tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1317 microversion: 2.1 time: 0.208376 Aug 06 20:56:06.600078 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 384/747] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:06 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:06.865073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ac9af19-f98b-4cf5-af32-211560986494 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '.version_select at 0x7f729dc06670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:06.869348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ac9af19-f98b-4cf5-af32-211560986494 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:06.869995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ac9af19-f98b-4cf5-af32-211560986494 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:06.870275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ac9af19-f98b-4cf5-af32-211560986494 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.877276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:06.877825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:06.878177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:06.878616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:06.879033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:06.895184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:06.895696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:06.896133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.897914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:06.898185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:06.898534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.910017 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8ac9af19-f98b-4cf5-af32-211560986494 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.048619 Aug 06 20:56:06.919189 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 385/748] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 20:56:06 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:06.919189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:06.919189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:06.947066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:06.947836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:06.948498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.949459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:06.950135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:06.952252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:06.966397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Getting quotas for project 8fd242c56a3f436c9cf158e68253218c. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:06.977613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Getting quotas for user dff69a9a061a454685cfc57c1675f4b9 and project 8fd242c56a3f436c9cf158e68253218c. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:07.008331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:56:07.014116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:56:07.097934 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1ac12237-4ccc-4a36-be6a-f49e92eea7d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789676 Aug 06 20:56:07.113752 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 364/749] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:56:07.119452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-195cf4a7-170f-4f25-91c9-57026f7b4b3c tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:07.139724 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-195cf4a7-170f-4f25-91c9-57026f7b4b3c tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024448 Aug 06 20:56:07.140618 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 365/750] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:56:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:07.161120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b92c165-dc64-48ac-8207-fbaa2c8bd507 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:07.166694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b92c165-dc64-48ac-8207-fbaa2c8bd507 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:07.304247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b92c165-dc64-48ac-8207-fbaa2c8bd507 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:07.313257 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b92c165-dc64-48ac-8207-fbaa2c8bd507 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1225 microversion: 2.1 time: 0.163869 Aug 06 20:56:07.314378 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 366/751] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:07 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1225 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:07.320748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:07.321861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:07.339317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:07.340010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:07.340531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:07.342379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:07.343269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:07.346238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:07.347518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:07.359163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:07.364057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:07.366223 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9663a1d-19ef-43ba-83f4-02b35a2582ce tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.454043 Aug 06 20:56:07.371736 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 386/752] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:06 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:07.376607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74820c72-60b0-4929-aead-cd159aac08db tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1984546811", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:07.382191 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:56:07.382191 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:56:07.399605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:07.409851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:07.433962 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74820c72-60b0-4929-aead-cd159aac08db tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.060921 Aug 06 20:56:07.441114 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 387/753] 10.222.0.33 () {60 vars in 1146 bytes} [Sat Aug 6 20:56:07 2022] POST /compute/v2.1/flavors => generated 499 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:07.447075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:07.448259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:07.478144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:07.478684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:07.482471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:07.492832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:07.493753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:07.494353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:07.603655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:07.644672 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0690726e-1833-4859-884c-8ff0c70b8cdd tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.328982 Aug 06 20:56:07.645843 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 367/754] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:07 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:07.651506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f5d282bc-3c8e-4a69-b8e6-88dfdad23700 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729de34af0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:07.760219 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f5d282bc-3c8e-4a69-b8e6-88dfdad23700 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.112950 Aug 06 20:56:07.761144 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 368/755] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:07 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:07.778301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b07ab526-3e09-49d2-8fff-5111d61385fe tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:07.797059 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b07ab526-3e09-49d2-8fff-5111d61385fe tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031574 Aug 06 20:56:07.800716 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 369/756] 10.222.0.33 () {58 vars in 1182 bytes} [Sat Aug 6 20:56:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:56:07.823630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:07.824431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:07.836517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:07.839889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:07.840425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:07.842872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:07.843486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:07.844006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:07.970135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:07.979815 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb447dc3-2cbc-4e39-8954-5e8755cfe9b3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1319 microversion: 2.1 time: 0.537570 Aug 06 20:56:07.985166 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 388/757] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:07 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1319 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:08.072190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-788877584", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "f5e9013f-d318-4d9f-aebe-f26d76d7c28f"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:08.193427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:56:08.261459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:08.272688 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8a70c9a7-7b67-4f9f-bf3c-8071c0569cea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1317 microversion: 2.1 time: 0.460343 Aug 06 20:56:08.274015 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 370/758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:07 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:08.337802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:08.339372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:08.360552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:08.366405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:08.367130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:08.368483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:08.369458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:08.370306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:08.462889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:08.480815 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b4a90d9c-6deb-4c3c-bb82-da21ad9d2c38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1221 microversion: 2.1 time: 0.148724 Aug 06 20:56:08.482706 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 371/759] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:08 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:08.496813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:08.499944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:08.513544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:08.516656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:08.517530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:08.535812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:08.536788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:08.539509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:08.820879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:08.834170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:08.836181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:08.837529 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f3fe4ca7-cd01-405c-8b3b-13ee7c1f29b0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.353075 Aug 06 20:56:08.839432 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 372/760] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:08 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:08.845295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:08.846301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:08.846510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:08.846970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:08.847452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:08.847872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:08.848296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:08.864606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:08.865101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:08.866887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:08.867325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:08.867777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:08.869254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:08.870586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:08.871350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:08.872378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:08.874191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:08.875151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:08.883867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:08.953622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:08.971765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for user 0701f31766dd4eeab9a63f6411c26d6e and project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:09.003604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:56:09.004573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:09.006711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:56:09.033986 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-282a4cc1-d50e-4c3e-a083-b2167667a7f0 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.192992 Aug 06 20:56:09.035348 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 373/761] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:08 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:09.063555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e5504078-8e54-4af9-b9be-00525e676f90 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729df46700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:09.115375 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-240911bd-7736-49f1-a084-4123c5f2b32f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047554 Aug 06 20:56:09.116141 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 389/762] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:56:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 20:56:09.137587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:09.138219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:09.154325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:09.154855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:09.155296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:09.156210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:09.156830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:09.157427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:09.208191 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e5504078-8e54-4af9-b9be-00525e676f90 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.156512 Aug 06 20:56:09.209080 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 374/763] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:09 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:09.222734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d480c110-f998-42a4-b8d3-40faf9f02643 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:09.234063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d480c110-f998-42a4-b8d3-40faf9f02643 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:09.375865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d480c110-f998-42a4-b8d3-40faf9f02643 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:09.387874 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d480c110-f998-42a4-b8d3-40faf9f02643 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1278 microversion: 2.1 time: 0.177119 Aug 06 20:56:09.390047 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 375/764] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:09 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:09.396706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:09.418117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:09.440779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:09.451805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:09.452217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:09.452891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:09.453394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:09.453892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:09.823104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:09.834987 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce834461-ed3a-4b12-bfb2-d33d303be832 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1317 microversion: 2.1 time: 0.442689 Aug 06 20:56:09.853709 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 376/765] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:09 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:09.858846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:09.859483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:09.881672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:09.882198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:09.882835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:09.883888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:09.884372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:09.884795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:09.889396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:09.992254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:10.004115 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3de27a33-685f-4440-ba4f-4c51db89debf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1283 microversion: 2.1 time: 0.149092 Aug 06 20:56:10.005856 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 377/766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:09 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1283 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:10.012636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:10.013569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:10.022762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:10.023874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:10.024837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:10.025795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:10.026477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:10.027975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:10.237709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:10.252663 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9d0bf7b2-51fa-4040-b11b-eed95f56b50b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1319 microversion: 2.1 time: 1.125913 Aug 06 20:56:10.268626 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 390/767] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:09 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1319 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:10.283525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:10.285798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:10.294778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:10.301571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:10.304070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:10.304573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:10.309997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:10.310998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:10.314350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:10.315024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:10.319145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:10.320719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:10.321914 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e10dfe01-fad9-48e0-a5a1-d28ac7a2dba5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.313720 Aug 06 20:56:10.322491 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 378/768] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:10 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:10.349765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-77a5fab9-606a-4a5b-b9cc-45b11bb29dd8 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729e0d89d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:10.401636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:10.453137 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-77a5fab9-606a-4a5b-b9cc-45b11bb29dd8 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.107046 Aug 06 20:56:10.454318 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 379/769] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:10 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:10.459028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-76111ef6-a390-4d65-a9ed-f5c63f28ec17 req-c20f4e94-6810-4075-abcc-e7eee2a2bbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0af8fc-0b76-4863-bb2d-699fc8f3cde9", "name": "network-vif-plugged", "status": "completed", "tag": "1ae474c0-bff8-4514-9ff0-4e4609198c44"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:10.483527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-76111ef6-a390-4d65-a9ed-f5c63f28ec17 req-c20f4e94-6810-4075-abcc-e7eee2a2bbee service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:10.484037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-76111ef6-a390-4d65-a9ed-f5c63f28ec17 req-c20f4e94-6810-4075-abcc-e7eee2a2bbee service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:10.484647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-76111ef6-a390-4d65-a9ed-f5c63f28ec17 req-c20f4e94-6810-4075-abcc-e7eee2a2bbee service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:10.502103 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-76111ef6-a390-4d65-a9ed-f5c63f28ec17 req-c20f4e94-6810-4075-abcc-e7eee2a2bbee service nova] Creating event network-vif-plugged:1ae474c0-bff8-4514-9ff0-4e4609198c44 for instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 on nch2-master-1 Aug 06 20:56:10.519449 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-76111ef6-a390-4d65-a9ed-f5c63f28ec17 req-c20f4e94-6810-4075-abcc-e7eee2a2bbee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063658 Aug 06 20:56:10.520071 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 380/770] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:10.537869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:10.538589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:10.554845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:10.555621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:10.556546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:10.557423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:10.558088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:10.558475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:10.642522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:10.685578 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-63bd93aa-fb5d-4194-823a-df90fcbc3127 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.415360 Aug 06 20:56:10.686180 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 391/771] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:10 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:10.707412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:10.718040 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9aba2616-831d-4996-abeb-0bbcd6232b39 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1274 microversion: 2.1 time: 0.195726 Aug 06 20:56:10.718854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 381/772] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:10 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:10.861871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:10.862962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:10.869910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:10.871761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:10.872446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:10.873397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:10.874086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:10.874797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:11.025629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:11.026244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:11.033022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:11.033962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:11.034409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:11.035185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:11.035817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:11.036445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:11.090055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:11.104271 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fd07074b-4a1c-4f52-ac91-f598267a9236 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1317 microversion: 2.1 time: 0.248507 Aug 06 20:56:11.107880 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 392/773] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:10 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:11.122059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:11.134597 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b41e066f-7250-43df-a2f5-673c49ee0ebf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1283 microversion: 2.1 time: 0.110022 Aug 06 20:56:11.138057 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 382/774] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:11 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1283 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:11.286802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:11.290621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:11.302637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:11.314523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:11.315100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:11.315885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:11.318596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:11.319084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:11.346856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:11.347799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:11.361309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:11.363632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:11.364251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:11.367150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:11.368349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:11.369211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:11.785206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:11.793772 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-923b12f4-2a48-4d64-b507-cd6a461511d6 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1319 microversion: 2.1 time: 0.517887 Aug 06 20:56:11.798182 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 393/775] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:11 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:11.816055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e836dd29-1cae-4006-b65a-05ee42ab6ac0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dc15a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:11.903571 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e836dd29-1cae-4006-b65a-05ee42ab6ac0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.103320 Aug 06 20:56:11.905436 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 394/776] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:11 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:11.916557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:11.918837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:11.937193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:11.938329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:11.939287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:11.940032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:11.940496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:11.940926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.026976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:12.043440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:12.045519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:12.049153 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8223453-c281-4ff1-a3b1-3fe23aca4d96 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1567 microversion: 2.25 time: 0.707656 Aug 06 20:56:12.049950 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 383/777] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:11 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1567 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:12.059441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:12.064355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:12.077760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:12.082957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:12.083596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.084743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:12.085368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:12.096208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.225529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:12.237323 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7caa80f2-60a7-48d2-886a-180182d593f5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1336 microversion: 2.1 time: 0.184100 Aug 06 20:56:12.251593 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 384/778] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:12 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1336 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:12.260544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:12.268796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:12.294181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:12.299608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:12.302427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.304503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:12.307132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:12.309807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.391705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:12.439484 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca07aaac-e59b-4139-883c-c4b0a25e520e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.532856 Aug 06 20:56:12.440121 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 395/779] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:11 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:12.451826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:12.452770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:12.464152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:12.471298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:12.471975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.472888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:12.473644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:12.474238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.737369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:12.749922 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-74ff0d2d-4f78-44be-9525-17d39e253c6d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1317 microversion: 2.1 time: 0.493940 Aug 06 20:56:12.754478 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 385/780] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:12 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:12.774879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9ad18cf5-a3d9-4c66-af96-cc12f25d7b33 req-77d53a9a-93fb-413e-8665-eb82d5d7550c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3246844f-93dc-4826-a925-2438888ba4b2", "name": "network-vif-plugged", "status": "completed", "tag": "8ee6ca35-6eb6-4bd9-add8-773df07bbbb4"}, {"server_uuid": "a24a700b-1705-475c-a864-68d72e6ef501", "name": "network-vif-plugged", "status": "completed", "tag": "9b40f1fe-1540-41d4-af7e-cd55329a30db"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:12.792795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9ad18cf5-a3d9-4c66-af96-cc12f25d7b33 req-77d53a9a-93fb-413e-8665-eb82d5d7550c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:12.793554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9ad18cf5-a3d9-4c66-af96-cc12f25d7b33 req-77d53a9a-93fb-413e-8665-eb82d5d7550c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:12.794100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9ad18cf5-a3d9-4c66-af96-cc12f25d7b33 req-77d53a9a-93fb-413e-8665-eb82d5d7550c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.814657 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9ad18cf5-a3d9-4c66-af96-cc12f25d7b33 req-77d53a9a-93fb-413e-8665-eb82d5d7550c service nova] Creating event network-vif-plugged:8ee6ca35-6eb6-4bd9-add8-773df07bbbb4 for instance 3246844f-93dc-4826-a925-2438888ba4b2 on nch2-master-1 Aug 06 20:56:12.815340 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9ad18cf5-a3d9-4c66-af96-cc12f25d7b33 req-77d53a9a-93fb-413e-8665-eb82d5d7550c service nova] Creating event network-vif-plugged:9b40f1fe-1540-41d4-af7e-cd55329a30db for instance a24a700b-1705-475c-a864-68d72e6ef501 on nch1-master-1 Aug 06 20:56:12.826230 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9ad18cf5-a3d9-4c66-af96-cc12f25d7b33 req-77d53a9a-93fb-413e-8665-eb82d5d7550c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056859 Aug 06 20:56:12.826794 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 386/781] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:12.832074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:12.832772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:12.841890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:12.842387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:12.843267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.843796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:12.844253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:12.845533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:12.936807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:12.953561 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c491146a-3774-4d8c-81bc-5269a44965ea tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1325 microversion: 2.1 time: 0.511487 Aug 06 20:56:12.958099 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 396/782] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:12 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1325 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:12.972603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-477cc516-4707-4b5c-abd2-6ea4f59d765c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db8b1f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:13.045859 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-477cc516-4707-4b5c-abd2-6ea4f59d765c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.083085 Aug 06 20:56:13.051080 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 397/783] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:12 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:13.077274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-539f2316-ef6d-4e43-9447-5206d3597bbc req-85bf9237-97f1-4151-bb1a-6d049f9467e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d5617c-e074-40e2-961a-27e0db7198df", "tag": "46f0b675-2387-4217-a1b4-a3c373145493"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:13.136092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-539f2316-ef6d-4e43-9447-5206d3597bbc req-85bf9237-97f1-4151-bb1a-6d049f9467e6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.141189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-539f2316-ef6d-4e43-9447-5206d3597bbc req-85bf9237-97f1-4151-bb1a-6d049f9467e6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.141582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-539f2316-ef6d-4e43-9447-5206d3597bbc req-85bf9237-97f1-4151-bb1a-6d049f9467e6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.183848 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-539f2316-ef6d-4e43-9447-5206d3597bbc req-85bf9237-97f1-4151-bb1a-6d049f9467e6 service nova] Creating event network-changed:46f0b675-2387-4217-a1b4-a3c373145493 for instance 33d5617c-e074-40e2-961a-27e0db7198df on nch2-master-1 Aug 06 20:56:13.194784 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-539f2316-ef6d-4e43-9447-5206d3597bbc req-85bf9237-97f1-4151-bb1a-6d049f9467e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142138 Aug 06 20:56:13.195729 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 398/784] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:13.209975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:13.214340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:13.223174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.223552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.224041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.225525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.226152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.226601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.438030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:13.448151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:13.449925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:13.451133 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-558b3434-2940-4e6b-8cea-1bdcb975ae7c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1542 microversion: 2.25 time: 0.253404 Aug 06 20:56:13.452250 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 399/785] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:13 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1542 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:13.456965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:13.457868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:13.476076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.476810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.477502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.478433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.479076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.479689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.752512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:13.764609 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e7cd49e7-19a5-4671-952c-9b93ca9723f0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.311047 Aug 06 20:56:13.765397 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 400/786] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:13 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:13.775964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:13.776603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:13.785247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.785762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.786385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.787205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.790926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.791434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.795223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:13.811130 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03a84849-a157-4f3c-bee0-776b8bd6390b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1319 microversion: 2.1 time: 0.980783 Aug 06 20:56:13.811755 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 387/787] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:12 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1319 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:13.832907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b33df912-e019-4e01-8abc-f4adb527a686 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '.version_select at 0x7f729df46700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:13.839428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b33df912-e019-4e01-8abc-f4adb527a686 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.840461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b33df912-e019-4e01-8abc-f4adb527a686 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.843232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b33df912-e019-4e01-8abc-f4adb527a686 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.854305 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b33df912-e019-4e01-8abc-f4adb527a686 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.040262 Aug 06 20:56:13.855676 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 388/788] 10.222.0.33 () {60 vars in 1184 bytes} [Sat Aug 6 20:56:13 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:13.860952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:13.861852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:13.870826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.872136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.873007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.873904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:13.874754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:13.875493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:13.942251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:13.966262 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6daac789-cedb-48e9-a5c5-dc40450acd35 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.199832 Aug 06 20:56:13.967117 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 401/789] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:13 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:13.994499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:13.995140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:14.004374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:14.004882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:14.005323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:14.007136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:14.007603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:14.008030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:14.224639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid 7468a9b2-902c-4b29-bdc2-230d3f558c4b {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:14.225998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:14.239422 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-85c3081c-d1c6-4b48-93bf-61018ad01065 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1317 microversion: 2.1 time: 0.382387 Aug 06 20:56:14.254899 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e098c396-e083-4838-84da-d7d80b77e999 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 2035 microversion: 2.25 time: 0.266801 Aug 06 20:56:14.284386 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 402/790] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:13 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 2035 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:14.290115 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 389/791] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:13 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:14.290754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:14.291387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:14.300243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b4f5e881-f27c-4576-b63d-d67fec965bf0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729df46820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:14.312442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:14.312960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:14.313405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:14.314506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:14.314655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:14.315263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:14.372041 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b4f5e881-f27c-4576-b63d-d67fec965bf0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.077762 Aug 06 20:56:14.372634 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 390/792] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:14 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:14.379494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-da974e5d-c25c-4950-b12d-dfb4e3fd9271 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Action: 'create', calling method: .version_select at 0x7f729de21b80>, body: {"keypair": {"name": "tempest-keypair-1062076998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDLniy7DukjYBX4TMQtPzPGD2FTpZQwclMZ0kzbhw6sk5mW+r6fTePomjhI7Yy+YSBcUu16nG9Vwrn3qTFL+wEMPoYlREBuRY9QusH7ERtD43Q200U/JBEe1oV8mfLSzg=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:14.405958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-da974e5d-c25c-4950-b12d-dfb4e3fd9271 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:14.413366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-da974e5d-c25c-4950-b12d-dfb4e3fd9271 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for user 343f309c07e343b4b15268472d19f10c and project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:14.429373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:14.452077 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-da974e5d-c25c-4950-b12d-dfb4e3fd9271 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.076312 Aug 06 20:56:14.453672 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 391/793] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Aug 6 20:56:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 20:56:14.655363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:14.679787 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2ea43cb5-e224-490e-a4e4-a2420188aee2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1325 microversion: 2.1 time: 0.394093 Aug 06 20:56:14.680940 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 403/794] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:14 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1325 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:14.785360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:14.786326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:14.802002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:14.803267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:14.809289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:14.810077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:14.810584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:14.811027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:14.833068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:14.833696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:14.841795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:14.842305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:14.842774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:14.849181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:14.849974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:14.850664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.074944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:15.083568 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-092ff6ba-41ed-48ce-9413-bc63506dfc44 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1319 microversion: 2.1 time: 0.254574 Aug 06 20:56:15.088330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:15.096807 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b1a587dd-2ee0-418f-8d2e-62be730643f8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.315459 Aug 06 20:56:15.097655 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 404/795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:14 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:15.105779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b2dc24e1-bb21-4d17-99d9-bd9cb3667ee1 req-7865d76f-fab3-451b-ad37-defb12bd148d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a7adc6-d32c-4d2b-84be-536c9aebe878", "tag": "397efc42-e695-4b22-a223-76833b924b55"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:15.118403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b2dc24e1-bb21-4d17-99d9-bd9cb3667ee1 req-7865d76f-fab3-451b-ad37-defb12bd148d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:15.118866 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 392/796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:14 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:15.119566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b2dc24e1-bb21-4d17-99d9-bd9cb3667ee1 req-7865d76f-fab3-451b-ad37-defb12bd148d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:15.120265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b2dc24e1-bb21-4d17-99d9-bd9cb3667ee1 req-7865d76f-fab3-451b-ad37-defb12bd148d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.123767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:15.124416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:15.138594 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b2dc24e1-bb21-4d17-99d9-bd9cb3667ee1 req-7865d76f-fab3-451b-ad37-defb12bd148d service nova] Creating event network-changed:397efc42-e695-4b22-a223-76833b924b55 for instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 on nch1-master-1 Aug 06 20:56:15.138987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:15.139498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:15.139936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.140682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:15.141108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:15.145823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.148990 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b2dc24e1-bb21-4d17-99d9-bd9cb3667ee1 req-7865d76f-fab3-451b-ad37-defb12bd148d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045122 Aug 06 20:56:15.149838 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 405/797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:15.262356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:15.263303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:15.272025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:15.272737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:15.273346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.274202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:15.275778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:15.276486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.309644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:15.355004 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3007303c-59d9-485c-a0a5-dd30f056f181 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.234883 Aug 06 20:56:15.355594 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 393/798] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:15 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:15.387653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33626d20-c20c-450c-bc9d-b60d84609387 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729df46820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:15.450786 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33626d20-c20c-450c-bc9d-b60d84609387 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.066880 Aug 06 20:56:15.483295 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 394/799] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:15 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:15.544310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:15.564476 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5d37687a-b06b-4162-90fc-545cfb19cb28 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1467 microversion: 2.1 time: 0.305757 Aug 06 20:56:15.571402 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 406/800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:15 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1467 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:15.590009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdab9d94-1aa8-4880-838f-6be33c05ef33 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:15.591071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fdab9d94-1aa8-4880-838f-6be33c05ef33 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:15.598689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdab9d94-1aa8-4880-838f-6be33c05ef33 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:15.599830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdab9d94-1aa8-4880-838f-6be33c05ef33 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:15.601068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdab9d94-1aa8-4880-838f-6be33c05ef33 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.602068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdab9d94-1aa8-4880-838f-6be33c05ef33 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:15.602875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdab9d94-1aa8-4880-838f-6be33c05ef33 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:15.603629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdab9d94-1aa8-4880-838f-6be33c05ef33 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.701059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:15.701965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:15.712496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:15.713346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:15.715505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.716467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:15.717095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:15.718953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:15.950329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:15.963066 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-febcf590-6725-4060-8ae0-9770405c5cb7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1325 microversion: 2.1 time: 0.265831 Aug 06 20:56:15.966709 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 407/801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:15 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1325 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:16.104302 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fdab9d94-1aa8-4880-838f-6be33c05ef33 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1618 microversion: 2.1 time: 0.518287 Aug 06 20:56:16.108068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:16.108979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:16.120570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.121391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.122037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.123002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.123654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.124276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.126766 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 395/802] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:15 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1618 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:16.140646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:16.150706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:16.158158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.159028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.159666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.160550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.161203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.161789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.360595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:16.375293 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1a099738-b5be-45d5-b982-cdfcccebfe5f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.247025 Aug 06 20:56:16.376425 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 396/803] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:16 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:16.381291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1006160363", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["29ea4f47-8ba4-49b1-afa0-5b8d50656763"]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:16.448203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:56:16.542914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:16.552004 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a96fffab-87bd-4280-8657-4ca77ca9cd56 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1468 microversion: 2.1 time: 0.447727 Aug 06 20:56:16.555403 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 408/804] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:16 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1468 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:16.566285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:16.567318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:16.579004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.586515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.587303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.588165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.588746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.589510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.735075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:16.738817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:16.763728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:16.764730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:16.765171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:16.765880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:16.766464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:16.769443 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9a4ad1ac-590c-468d-879e-07cf48120bfa tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.212703 Aug 06 20:56:16.770360 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 409/805] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:16 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:16.776172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e2cf7df1-1481-42f0-a4bf-fa1c2b707107 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dc15d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:16.817177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.818022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.819231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.820226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.820914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.821584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.853939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:16.855422 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e2cf7df1-1481-42f0-a4bf-fa1c2b707107 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.083772 Aug 06 20:56:16.861490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:16.863832 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 410/806] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:16 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:16.869854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:16.870506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:16.881456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.890612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.890612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.890612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:16.890612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:16.891225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:16.894582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:56:16.898079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:56:16.929123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lazy-loading 'flavor' on Instance uuid a24a700b-1705-475c-a864-68d72e6ef501 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:16.970047 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5e1eb924-1977-46b3-b5d6-aa5edbfa8b9c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591614 Aug 06 20:56:16.970047 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 397/807] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:56:16.999801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e468e042-8e44-4650-acdf-449f257da8e7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:17.000424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e468e042-8e44-4650-acdf-449f257da8e7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:17.108765 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b705de2-7254-4ca2-acaa-de85957be265 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501/action" status: 202 len: 0 microversion: 2.1 time: 0.243663 Aug 06 20:56:17.109410 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 411/808] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:56:16 2022] POST /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:56:17.121734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:17.122453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:17.142194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:17.142755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:17.143373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:17.145082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:17.148980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e468e042-8e44-4650-acdf-449f257da8e7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:17.154433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:17.154995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:17.158574 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e468e042-8e44-4650-acdf-449f257da8e7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1217 microversion: 2.1 time: 0.173323 Aug 06 20:56:17.161625 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 398/809] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:16 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:17.167170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:17.168778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:17.192302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:17.193017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:17.194158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:17.196745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:17.197424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:17.199069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:17.448164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:17.453772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:17.458328 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-21a4e236-3623-482a-a64a-27c6fa0b124d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1325 microversion: 2.1 time: 0.340662 Aug 06 20:56:17.460247 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 412/810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:17 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1325 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:17.465211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1933728470", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0b16c9c9-35af-4398-8cf2-00695211de1f"}], "security_groups": [{"name": "tempest-securitygroup--1086363540"}], "key_name": "tempest-keypair-1062076998", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:17.483365 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1437011d-b2c0-4842-bcd5-8292ed121842 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1476 microversion: 2.1 time: 0.319892 Aug 06 20:56:17.484400 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 399/811] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:17 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:17.499332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:17.500739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:17.511195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:17.512472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:17.513605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:17.514943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:17.515769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:17.516614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:17.651293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] validate_networks() for [('0b16c9c9-35af-4398-8cf2-00695211de1f', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:56:17.773762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:17.788903 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0dfc8127-e59a-492c-9016-630de92efe8e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.303276 Aug 06 20:56:17.794569 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 400/812] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:17 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:17.799304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:17.799916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:17.821313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:17.821850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:17.822285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:17.827046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:17.827726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:17.830874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:17.844465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:18.080356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:18.126607 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-29389aa7-c909-4a9a-8ded-ef746af1d795 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.330702 Aug 06 20:56:18.148719 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 401/813] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:17 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:18.154819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-53c1cd97-1205-4303-9aee-512b19de2820 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729de22310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:18.216361 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-53c1cd97-1205-4303-9aee-512b19de2820 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.065740 Aug 06 20:56:18.221082 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 402/814] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:18 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:18.227122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:18.227978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:18.235043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.235782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.236433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:18.237346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.237996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.238646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:18.310622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:18.311254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:18.311967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:18.312597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:18.313220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:18.324425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.325388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.326261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:18.327407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.327996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.328532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:18.337611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:18.348327 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c8a1e7a-1934-48e4-a8c5-4b391a62273d tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1269 microversion: 2.1 time: 0.124212 Aug 06 20:56:18.352681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:18.358701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for user 343f309c07e343b4b15268472d19f10c and project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:18.362416 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 403/815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:18 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:18.376763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:56:18.380193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:56:18.472042 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e240494-e907-45cb-a018-8be6ff718b95 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.010442 Aug 06 20:56:18.475526 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 413/816] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 20:56:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 20:56:18.485757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:18.486386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:18.488582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-346822b1-c45b-4164-90ab-e0cf326965b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:18.489305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-346822b1-c45b-4164-90ab-e0cf326965b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:18.534615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.549779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.550578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:18.552991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.554897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.558848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:18.654595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-346822b1-c45b-4164-90ab-e0cf326965b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:18.665045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-346822b1-c45b-4164-90ab-e0cf326965b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:18.672913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-346822b1-c45b-4164-90ab-e0cf326965b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:18.674228 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-346822b1-c45b-4164-90ab-e0cf326965b6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1286 microversion: 2.25 time: 0.190468 Aug 06 20:56:18.675710 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 414/817] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:18 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:18.688750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:18.694363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:18.702927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.703628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.704216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:18.707747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.709071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.709547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:18.860519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:18.872909 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0689f7f8-baaf-4b6d-aa20-c5bd42ecd687 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1325 microversion: 2.1 time: 0.393505 Aug 06 20:56:18.891291 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 404/818] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:18 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:18.912334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:18.912967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:18.925529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.926037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.928250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:18.929941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:18.930434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:18.930906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.075116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:19.091409 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1dab8ed9-181e-4f55-ad71-1e654153300d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1459 microversion: 2.1 time: 0.414378 Aug 06 20:56:19.092187 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 415/819] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:18 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1459 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:19.114649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-41de1839-d774-40d5-9305-eb85c34c7398 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:19.118367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-41de1839-d774-40d5-9305-eb85c34c7398 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:19.150850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41de1839-d774-40d5-9305-eb85c34c7398 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.153366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41de1839-d774-40d5-9305-eb85c34c7398 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.154882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41de1839-d774-40d5-9305-eb85c34c7398 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.163752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41de1839-d774-40d5-9305-eb85c34c7398 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.167241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41de1839-d774-40d5-9305-eb85c34c7398 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.167781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41de1839-d774-40d5-9305-eb85c34c7398 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.194798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:19.208084 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9bdae6a3-8207-4e58-8861-20c1715d603e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.319350 Aug 06 20:56:19.218863 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 405/820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:18 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:19.222489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:19.228425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:19.248782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.249226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.251225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.251982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.252454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.252897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.376746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:19.399354 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bafa0160-4d59-48a1-b18c-c01546572eb1 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.185566 Aug 06 20:56:19.399965 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 406/821] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:19 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:19.424289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-377d95df-f2d4-4a40-a787-58ab55514b9b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dee4790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:19.502867 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-377d95df-f2d4-4a40-a787-58ab55514b9b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.089728 Aug 06 20:56:19.504095 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 407/822] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:19 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:19.524169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:19.526326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:19.533590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.534518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.535208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.536202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.537891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.538872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.607487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:19.624705 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4dbb303f-b715-4bb5-8711-1a3f8fe5d67c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1275 microversion: 2.1 time: 0.118008 Aug 06 20:56:19.625910 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 408/823] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:19 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:19.704509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:19.705386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:19.726139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.727099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.727938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.729144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.730842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.731717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.868289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:19.878899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:19.882810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:19.883957 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4ad0413c-8e7e-4da3-870c-1d87104c9770 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1338 microversion: 2.25 time: 0.184327 Aug 06 20:56:19.900142 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 409/824] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:19 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1338 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:19.910217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:19.910900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:19.919007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.919993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.920576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:19.921391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:19.921884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:19.922319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.077843 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-41de1839-d774-40d5-9305-eb85c34c7398 tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1610 microversion: 2.1 time: 0.965884 Aug 06 20:56:20.080335 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 416/825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:19 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1610 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:20.087491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-8b83f9ab-c3d7-413f-989d-9c57a563b216 req-6812f8c6-e281-406c-bd75-eba0d9ab2f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d5617c-e074-40e2-961a-27e0db7198df", "name": "network-vif-plugged", "status": "completed", "tag": "46f0b675-2387-4217-a1b4-a3c373145493"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:20.098274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8b83f9ab-c3d7-413f-989d-9c57a563b216 req-6812f8c6-e281-406c-bd75-eba0d9ab2f2a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.098831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8b83f9ab-c3d7-413f-989d-9c57a563b216 req-6812f8c6-e281-406c-bd75-eba0d9ab2f2a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.100168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8b83f9ab-c3d7-413f-989d-9c57a563b216 req-6812f8c6-e281-406c-bd75-eba0d9ab2f2a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.112547 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-8b83f9ab-c3d7-413f-989d-9c57a563b216 req-6812f8c6-e281-406c-bd75-eba0d9ab2f2a service nova] Creating event network-vif-plugged:46f0b675-2387-4217-a1b4-a3c373145493 for instance 33d5617c-e074-40e2-961a-27e0db7198df on nch2-master-1 Aug 06 20:56:20.118811 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-8b83f9ab-c3d7-413f-989d-9c57a563b216 req-6812f8c6-e281-406c-bd75-eba0d9ab2f2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037140 Aug 06 20:56:20.120646 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 417/826] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:20.126666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:20.127329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a0369bc4-7f4e-4dd4-b730-75240277f52c tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:20.131544 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:56:20.131544 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:56:20.133603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0369bc4-7f4e-4dd4-b730-75240277f52c tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.134305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0369bc4-7f4e-4dd4-b730-75240277f52c tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.134980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0369bc4-7f4e-4dd4-b730-75240277f52c tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.135450 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b4ada492-53e8-4aaf-ae87-3f82c188d42d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1325 microversion: 2.1 time: 0.234258 Aug 06 20:56:20.136261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0369bc4-7f4e-4dd4-b730-75240277f52c tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.136986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0369bc4-7f4e-4dd4-b730-75240277f52c tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.137642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0369bc4-7f4e-4dd4-b730-75240277f52c tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.150248 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 410/827] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:19 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1325 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:20.197357 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a0369bc4-7f4e-4dd4-b730-75240277f52c tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.074351 Aug 06 20:56:20.198506 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 418/828] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Aug 6 20:56:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:20.223951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:20.235245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:20.239961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:20.240722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:20.247767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.249144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.249660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.250783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.251506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.252734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.260478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.261273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.261906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.263360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.270740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.272127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.290453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Lazy-loading 'flavor' on Instance uuid a24a700b-1705-475c-a864-68d72e6ef501 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:20.317932 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance a24a700b-1705-475c-a864-68d72e6ef501 while it is in vm_state suspended Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Request method failure captured: Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501/action HTTP/1.1 Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 97 Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVFh7Y9H-lF1izqPJDTHas8J6l3Alx2LpszJDPtPCyf2GSeLVwZIVt-WkXI8mOhRNsU6M7w2WaOBkMFLDeoXiTH2f89VqSnFoaLdPGng_oc0kUIQrp5jNcaylfZ6SXrWrXzAentosFzwfgZNr4DZncnE80KACRXMtPYmjxFz3ElNAM Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 6df791ea0dc14b459fd00aeeae02d584 Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-LiveMigrationNegativeTest-1777190573 Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:56:20.322143 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6df791ea0dc14b459fd00aeeae02d584"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6df791ea0dc14b459fd00aeeae02d584", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6df791ea0dc14b459fd00aeeae02d584"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6df791ea0dc14b459fd00aeeae02d584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-LiveMigrationNegativeTest-1777190573 Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 6df791ea0dc14b459fd00aeeae02d584 Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1777190573 Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-LiveMigrationNegativeTest-1777190573-project-admin Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: edbe49bf4b1a46fcbe274cb75a16c5e2 Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-LiveMigrationNegativeTest-1777190573-project-admin Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} Aug 06 20:56:20.323863 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: exception: Cannot 'os-migrateLive' instance a24a700b-1705-475c-a864-68d72e6ef501 while it is in vm_state suspended Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'a24a700b-1705-475c-a864-68d72e6ef501', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 06 20:56:20.324767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a24a700b-1705-475c-a864-68d72e6ef501 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:56:20.326073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance a24a700b-1705-475c-a864-68d72e6ef501 while it is in vm_state suspended Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance a24a700b-1705-475c-a864-68d72e6ef501 while it is in vm_state suspended Aug 06 20:56:20.327617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:20.335826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance a24a700b-1705-475c-a864-68d72e6ef501 while it is in vm_state suspended {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:20.336977 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-84798027-6e54-473f-b80a-6abff12269ff tempest-LiveMigrationNegativeTest-1777190573 tempest-LiveMigrationNegativeTest-1777190573-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501/action" status: 409 len: 155 microversion: 2.1 time: 0.130017 Aug 06 20:56:20.338048 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 411/829] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:56:20 2022] POST /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501/action => generated 155 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:56:20.351662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:20.355488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:20.367338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.370029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.370689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.376768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.377504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.378145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.432339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:56:20.588309 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d9d6117b-5687-41b1-b4a3-7862d78849d3 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 204 len: 0 microversion: 2.1 time: 0.242166 Aug 06 20:56:20.589466 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 412/830] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:56:20 2022] DELETE /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:56:20.597254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:20.598373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:20.607027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.607761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.608359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.609241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.611020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.611733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.713551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:20.735647 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4a49b86b-52d1-4a59-a987-f92609b12107 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.144056 Aug 06 20:56:20.736155 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 413/831] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:20 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:20.737500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:20.749493 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-813ec7a2-3999-4ac3-81b5-32b60e24e704 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.519974 Aug 06 20:56:20.755349 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 419/832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:20 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:20.761249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:20.767473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:20.772747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a75e16e-2c87-4ff0-902b-d57a86d44947 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729de21310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:20.782267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.783030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.783679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.784576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.787299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.787962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.845974 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a75e16e-2c87-4ff0-902b-d57a86d44947 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.098096 Aug 06 20:56:20.853739 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 414/833] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:20 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:20.853739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:20.853739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:20.860784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.861248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.861694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:20.862418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:20.862914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:20.863345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:21.098539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:21.109071 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-35403fa1-d63b-4943-9459-e07bc4da0cbd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1317 microversion: 2.1 time: 0.260700 Aug 06 20:56:21.110100 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 415/834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:20 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:21.118897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:21.120803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:21.128861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:21.129454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:21.129966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:21.130823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:21.131409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:21.131863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:21.217670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:21.227165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:21.228991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:21.230380 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-82f7ed46-47b4-4101-9670-a595880c35b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1344 microversion: 2.25 time: 0.119160 Aug 06 20:56:21.242583 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 416/835] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:21 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1344 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:21.242583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:21.242583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:21.244423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:21.244922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:21.245371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:21.246070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:21.246524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:21.249882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:21.373856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:21.385088 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2c8dec65-105c-4cd9-9666-d050bd16a6f8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1465 microversion: 2.1 time: 0.627473 Aug 06 20:56:21.398575 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 420/836] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:20 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1465 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:21.460922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:21.472717 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-319e862a-3aa0-4db4-888f-5076614f42bb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1325 microversion: 2.1 time: 0.240114 Aug 06 20:56:21.474208 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 417/837] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:21 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:21.763332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:21.764202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:21.776733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:21.777808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:21.779019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:21.779848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:21.781814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:21.785383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:21.787479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:21.788593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:21.790972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:21.791585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:21.792155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:21.792963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:21.793649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:21.794314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:21.798523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:21.941982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:21.975652 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-671fb536-ff4f-4fdf-9e22-3f1f20e68c26 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.216550 Aug 06 20:56:21.991732 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 421/838] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:21 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:22.004904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:22.009427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b515328f-e1af-4ad2-bba6-99792fb88d33 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dba9dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:22.016632 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8dcf7007-3a73-4b3f-bb60-2b8041fd9202 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.243173 Aug 06 20:56:22.018013 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 418/839] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:21 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:22.068223 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b515328f-e1af-4ad2-bba6-99792fb88d33 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.074750 Aug 06 20:56:22.069244 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 422/840] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:21 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:22.132176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:22.132816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:22.140171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:22.140640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:22.141087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:22.142119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:22.143330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:22.153370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:22.260029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:22.260872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:22.272744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:22.275006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:22.276387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:22.287286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:22.288668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:22.289330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:22.386684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:22.409021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:22.409875 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6d734feb-821d-47d6-b3dd-1d5582b50a7c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1317 microversion: 2.1 time: 0.281970 Aug 06 20:56:22.410673 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 419/841] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:22 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:22.418329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:22.419171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:22.431482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:22.433267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:22.434021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:22.434469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:22.434665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:22.435260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:22.435888 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-625557c4-9079-4cb2-9ce9-1704203c89ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1344 microversion: 2.25 time: 0.182527 Aug 06 20:56:22.436009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:22.436381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:22.436520 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 423/842] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:22 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1344 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:22.496255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:22.497367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:22.518189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:22.519000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:22.519616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:22.520499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:22.521167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:22.521756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:22.785899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:22.801360 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8d4242d2-4c6e-415d-82ca-ce6ca29f4c6e tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 200 len: 1465 microversion: 2.1 time: 0.388140 Aug 06 20:56:22.820540 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 420/843] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:22 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 1465 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:22.820540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1dd0f3de-c1e5-4851-bdcf-baf7d8934fb8 req-7650e643-a004-474e-b6ab-571c9e656e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814b0a3e-029c-47e3-b686-a3d2473a44e5", "tag": "1b24865d-9fb9-4d82-b0d8-cdc42c0ec4de"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:22.840329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1dd0f3de-c1e5-4851-bdcf-baf7d8934fb8 req-7650e643-a004-474e-b6ab-571c9e656e22 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:22.840550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1dd0f3de-c1e5-4851-bdcf-baf7d8934fb8 req-7650e643-a004-474e-b6ab-571c9e656e22 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:22.841200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1dd0f3de-c1e5-4851-bdcf-baf7d8934fb8 req-7650e643-a004-474e-b6ab-571c9e656e22 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:22.862785 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1dd0f3de-c1e5-4851-bdcf-baf7d8934fb8 req-7650e643-a004-474e-b6ab-571c9e656e22 service nova] Creating event network-changed:1b24865d-9fb9-4d82-b0d8-cdc42c0ec4de for instance 814b0a3e-029c-47e3-b686-a3d2473a44e5 on nch2-master-1 Aug 06 20:56:22.881550 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1dd0f3de-c1e5-4851-bdcf-baf7d8934fb8 req-7650e643-a004-474e-b6ab-571c9e656e22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072949 Aug 06 20:56:22.882218 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 421/844] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:22.992683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:23.005893 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-61339c9f-6511-4ef6-813b-201bc13f7200 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1522 microversion: 2.1 time: 0.514413 Aug 06 20:56:23.006339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:23.007028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:23.007825 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 424/845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:22 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:23.041491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:23.042510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:23.044208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:23.044208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:23.044862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:23.045593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:23.053979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:23.054439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:23.079663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:23.081061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:23.083096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:23.086946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:23.087758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:23.088420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:23.299682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:23.351413 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fcee99a0-750d-440e-a70d-4abb8df2c211 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.349755 Aug 06 20:56:23.366234 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 422/846] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:22 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:56:23.368075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:23.370463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:23.391175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:23.391824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:23.393655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:23.394465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:23.397701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:23.398746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:23.705186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:23.728301 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-63ee09c8-650f-42a2-9ca1-fd3728eb938a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.372941 Aug 06 20:56:23.729141 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 423/847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:23 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:23.733828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3921ec29-a2b8-41a9-93e9-34232f304f1d tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729de04dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:23.799197 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3921ec29-a2b8-41a9-93e9-34232f304f1d tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.068649 Aug 06 20:56:23.799971 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 424/848] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:23 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:23.809926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:23.810848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:23.824077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:23.824804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:23.825141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:23.825743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:23.826315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:23.826795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:23.958006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:23.973314 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e80e547-7d29-482d-9051-396b3ee1190d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1522 microversion: 2.1 time: 0.938502 Aug 06 20:56:23.975173 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 425/849] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:23 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1522 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:23.985092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:23.986246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:23.993819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:23.995010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:23.999977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.001146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.001733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.002404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.066181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:24.074579 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ff73794a-913f-4ed1-827d-d2ec60f1b508 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1317 microversion: 2.1 time: 0.273419 Aug 06 20:56:24.076039 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 425/850] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:23 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:24.095403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c1295b10-a7c7-42e9-9287-4ea542b05b33 req-a34112db-9bfc-4d34-8f46-7d5bdbb5990c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24a700b-1705-475c-a864-68d72e6ef501", "name": "network-vif-deleted", "tag": "9b40f1fe-1540-41d4-af7e-cd55329a30db"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:24.136366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c1295b10-a7c7-42e9-9287-4ea542b05b33 req-a34112db-9bfc-4d34-8f46-7d5bdbb5990c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.136960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c1295b10-a7c7-42e9-9287-4ea542b05b33 req-a34112db-9bfc-4d34-8f46-7d5bdbb5990c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.137430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c1295b10-a7c7-42e9-9287-4ea542b05b33 req-a34112db-9bfc-4d34-8f46-7d5bdbb5990c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.179172 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c1295b10-a7c7-42e9-9287-4ea542b05b33 req-a34112db-9bfc-4d34-8f46-7d5bdbb5990c service nova] Creating event network-vif-deleted:9b40f1fe-1540-41d4-af7e-cd55329a30db for instance a24a700b-1705-475c-a864-68d72e6ef501 on nch1-master-1 Aug 06 20:56:24.203510 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c1295b10-a7c7-42e9-9287-4ea542b05b33 req-a34112db-9bfc-4d34-8f46-7d5bdbb5990c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124016 Aug 06 20:56:24.209789 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 426/851] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:24.229124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-85d8e1d8-0c00-414f-a46c-fb30c24e9412 req-73ad2a5a-62bc-4649-9206-0d2e13b5676c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a7adc6-d32c-4d2b-84be-536c9aebe878", "name": "network-vif-plugged", "status": "completed", "tag": "397efc42-e695-4b22-a223-76833b924b55"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:24.253112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-85d8e1d8-0c00-414f-a46c-fb30c24e9412 req-73ad2a5a-62bc-4649-9206-0d2e13b5676c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.253513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-85d8e1d8-0c00-414f-a46c-fb30c24e9412 req-73ad2a5a-62bc-4649-9206-0d2e13b5676c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.253944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-85d8e1d8-0c00-414f-a46c-fb30c24e9412 req-73ad2a5a-62bc-4649-9206-0d2e13b5676c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.284037 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-85d8e1d8-0c00-414f-a46c-fb30c24e9412 req-73ad2a5a-62bc-4649-9206-0d2e13b5676c service nova] Creating event network-vif-plugged:397efc42-e695-4b22-a223-76833b924b55 for instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 on nch1-master-1 Aug 06 20:56:24.297974 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-85d8e1d8-0c00-414f-a46c-fb30c24e9412 req-73ad2a5a-62bc-4649-9206-0d2e13b5676c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075379 Aug 06 20:56:24.305287 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 427/852] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:24.315577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:24.316794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: a24a700b-1705-475c-a864-68d72e6ef501] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:24.326161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.329374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.331125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.333055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.334075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.335475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.343874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:24.354267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:24.356302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:24.357691 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-95a21011-6c0b-4476-9234-beaac025e698 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1412 microversion: 2.25 time: 0.381255 Aug 06 20:56:24.372931 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] HTTP exception thrown: Instance a24a700b-1705-475c-a864-68d72e6ef501 could not be found. Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Request method failure captured: Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 HTTP/1.1 Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVEx-rZAC4ik78uDLQq2BlK9Cfcmh-UalQ28d4WxZKurGkOC1Ssd71TdCNcZ3UQqXOL_vI0qVs1PEiI_5bP20lGl-iStd1K0-zCxiOjJVxmNTlltOybFUBWHcOtrNVP0h5ZfEB1oVLqhMwwPpJYHgXyA47laXAVDrYpI3qVpMWPyNA Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: d5ef27173302447a82d257b1f838e75d Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-LiveMigrationNegativeTest-295484584 Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:56:24.379080 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d5ef27173302447a82d257b1f838e75d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d5ef27173302447a82d257b1f838e75d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d5ef27173302447a82d257b1f838e75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d5ef27173302447a82d257b1f838e75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-LiveMigrationNegativeTest-295484584 Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: d5ef27173302447a82d257b1f838e75d Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-295484584 Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-LiveMigrationNegativeTest-295484584-project Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 79ffbe6477ea45f481620fa6293e1958 Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-LiveMigrationNegativeTest-295484584-project Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance a24a700b-1705-475c-a864-68d72e6ef501 could not be found. Aug 06 20:56:24.381671 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'a24a700b-1705-475c-a864-68d72e6ef501'} Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a24a700b-1705-475c-a864-68d72e6ef501 could not be found. Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:24.384313 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a24a700b-1705-475c-a864-68d72e6ef501 could not be found. Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a24a700b-1705-475c-a864-68d72e6ef501 could not be found. Aug 06 20:56:24.389908 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.392695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Returning 404 to user: Instance a24a700b-1705-475c-a864-68d72e6ef501 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:24.392695 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8d6dd525-0dd1-4462-b6a5-fee46e1ddf5d tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501" status: 404 len: 111 microversion: 2.1 time: 0.071092 Aug 06 20:56:24.392695 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 428/853] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:24 2022] GET /compute/v2.1/servers/a24a700b-1705-475c-a864-68d72e6ef501 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:56:24.397911 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 426/854] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:23 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1412 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:24.402003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7995d246-8e7a-45f6-b21e-c1eaa2e3916b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-313550469", "metadata": {"": ""}}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:24.403796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:24.404643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:24.416760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.417654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7995d246-8e7a-45f6-b21e-c1eaa2e3916b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action HTTP/1.1 Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 106 Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:56:24.417803 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-313550469", "metadata": {"": ""}}} Aug 06 20:56:24.419353 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '33d5617c-e074-40e2-961a-27e0db7198df', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-313550469', 'metadata': {'': ''}}}} Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'': ''} Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:24.420367 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.421593 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:24.423257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:24.423257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:24.423257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:56:24.423257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:56:24.423257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 20:56:24.423257 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:24.426291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.426291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.426291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.426291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.428263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7995d246-8e7a-45f6-b21e-c1eaa2e3916b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:24.436498 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7995d246-8e7a-45f6-b21e-c1eaa2e3916b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action" status: 400 len: 170 microversion: 2.1 time: 0.047640 Aug 06 20:56:24.437364 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 429/855] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Aug 6 20:56:24 2022] POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action => generated 170 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:56:24.445713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:24.450269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:24.461317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:24.474786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.476002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.476649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.477605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.478259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.478923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.530436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:56:24.626259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:24.680674 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37610a5b-0d21-4847-a3f7-7ec91df00ad9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.280720 Aug 06 20:56:24.707296 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 427/856] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:24 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:24.707296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:24.707296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:24.708316 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-231951a9-2f20-4dcc-940d-6d9bb15de6cc tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 204 len: 0 microversion: 2.1 time: 0.269184 Aug 06 20:56:24.721762 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 430/857] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:56:24 2022] DELETE /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:56:24.721996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.721996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.721996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.721996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.722307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.722307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.724978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:24.725730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:24.739860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.741402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.742599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.744207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.744670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.745384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.925343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:24.936463 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b62548d-83ef-46d5-8d0f-ec1cede36bc4 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1474 microversion: 2.1 time: 0.221503 Aug 06 20:56:24.936977 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 431/858] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:24 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1474 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:24.956209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:24.956866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:24.964137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.964642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.965231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.965956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:24.966417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:24.966936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:24.983886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:24.995683 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-62783c11-269a-4c96-a40b-62884f89004c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1522 microversion: 2.1 time: 0.294747 Aug 06 20:56:24.996457 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 428/859] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:24 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:25.007289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f07add2-d232-4fc0-a9bb-8a369c4d6d75 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db6a5e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:25.090947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f07add2-d232-4fc0-a9bb-8a369c4d6d75 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1423 microversion: 2.1 time: 0.089713 Aug 06 20:56:25.093997 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 429/860] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:24 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:25.099926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:25.111253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:25.114760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:25.120793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.121298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.121750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.122473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.123528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.123971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.136978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:25.192950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:25.210748 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-20fa04b2-aee9-470f-835d-40e8f9c2235f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.272616 Aug 06 20:56:25.211671 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 432/861] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:24 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:25.220495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c46fea74-ad27-4560-be08-cbf7a7fa23fd req-ee7e3e7b-ec4c-46cd-b620-6677735b0698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87d6735-5d42-4f96-aac5-55b50a1a804f", "tag": "270cefb5-0f7a-43e8-8015-bdf5afc1c875"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:25.232709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c46fea74-ad27-4560-be08-cbf7a7fa23fd req-ee7e3e7b-ec4c-46cd-b620-6677735b0698 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.233197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c46fea74-ad27-4560-be08-cbf7a7fa23fd req-ee7e3e7b-ec4c-46cd-b620-6677735b0698 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.233780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c46fea74-ad27-4560-be08-cbf7a7fa23fd req-ee7e3e7b-ec4c-46cd-b620-6677735b0698 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.246575 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c46fea74-ad27-4560-be08-cbf7a7fa23fd req-ee7e3e7b-ec4c-46cd-b620-6677735b0698 service nova] Creating event network-changed:270cefb5-0f7a-43e8-8015-bdf5afc1c875 for instance a87d6735-5d42-4f96-aac5-55b50a1a804f on nch2-master-1 Aug 06 20:56:25.251543 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c46fea74-ad27-4560-be08-cbf7a7fa23fd req-ee7e3e7b-ec4c-46cd-b620-6677735b0698 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038509 Aug 06 20:56:25.252660 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 433/862] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:25.260638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:25.261594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:25.268995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.269783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.270402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.271463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.272107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.272715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.301184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:25.312380 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e1685f4-9040-459d-b7c9-3aec9d3ff093 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1522 microversion: 2.1 time: 0.216934 Aug 06 20:56:25.313662 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 430/863] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:25 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:25.335189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c66e0f0c-e54d-40d9-8a1f-b46ccac4d252 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-398520345", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c66e0f0c-e54d-40d9-8a1f-b46ccac4d252 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action HTTP/1.1 Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 618 Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:56:25.346853 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:25.348392 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:56:25.349238 ncdv-master-1 devstack@n-api.service[142461]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-398520345", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 06 20:56:25.349238 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:56:25.349238 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '33d5617c-e074-40e2-961a-27e0db7198df', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-398520345', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 06 20:56:25.349485 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:25.350171 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:25.351212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:25.351957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:25.351957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:25.351957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:56:25.351957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:56:25.351957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 20:56:25.351957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:25.354291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c66e0f0c-e54d-40d9-8a1f-b46ccac4d252 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:25.355472 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c66e0f0c-e54d-40d9-8a1f-b46ccac4d252 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action" status: 400 len: 938 microversion: 2.1 time: 0.024890 Aug 06 20:56:25.356437 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 431/864] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Aug 6 20:56:25 2022] POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action => generated 938 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:56:25.372850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:25.374108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:25.401121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.401722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.404761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.407699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.408483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.408933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.473315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:25.483845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d443f88-94f1-4758-be29-971d322bb46c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1317 microversion: 2.1 time: 0.229673 Aug 06 20:56:25.486590 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 434/865] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:25 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:25.493098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:25.493855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:25.500889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.501570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.502133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.502976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.503719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.504304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.682985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:25.692372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:25.695076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:25.696416 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-05ee7ac2-eea3-4a8f-b7f5-e3065b81bf78 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1412 microversion: 2.25 time: 0.208611 Aug 06 20:56:25.696999 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 435/866] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:25 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1412 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:25.729798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:25.730608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:25.737442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.738411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.738955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.739751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.740386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.740822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.826910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:25.851377 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-81d8566b-9ce2-44cc-83a5-990550639322 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.125416 Aug 06 20:56:25.852554 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 436/867] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:25 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:56:25.957877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:25.959522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:25.970915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.971511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.972035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:25.972906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:25.973681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:25.973911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.111508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:26.113866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:26.122993 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac270ea0-9313-422d-bc8e-ea894d39adf8 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1474 microversion: 2.1 time: 0.168955 Aug 06 20:56:26.123776 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 437/868] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:25 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1474 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:26.135759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ed3141f-5bc7-489d-802e-ba5ca55239ee tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dd84820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.187595 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2ed3141f-5bc7-489d-802e-ba5ca55239ee tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1432 microversion: 2.1 time: 0.055681 Aug 06 20:56:26.188206 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 438/869] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1432 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:26.201334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e0fd8f9b-afdd-4e68-907a-88c6b3c8b87c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dee4790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.212911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:26.221224 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-94efe1f7-0b8c-4c2f-9751-36f1090cce84 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1522 microversion: 2.1 time: 0.857016 Aug 06 20:56:26.221791 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 432/870] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:25 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1522 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:26.242650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.243407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:26.249474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.250036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.250648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.251333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.251942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.252536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.273003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e0fd8f9b-afdd-4e68-907a-88c6b3c8b87c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 200 len: 1432 microversion: 2.1 time: 0.075290 Aug 06 20:56:26.273763 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 439/871] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 1432 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:26.287602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.288376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:26.295540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.298439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.298439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.298439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.298792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.299281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.445017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:26.455993 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9d2ac4a6-0a9a-43a6-bcc8-0561ce3ab0d4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1522 microversion: 2.1 time: 0.174865 Aug 06 20:56:26.457269 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 440/872] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:26.463857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.464691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:26.472287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.473061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.473612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.474492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.475050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.475635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.605286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:26.613336 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-deaec693-557d-47b6-bd05-053ab04c8b2d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1378 microversion: 2.1 time: 0.376884 Aug 06 20:56:26.617359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:26.625458 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-88970b06-7952-4fd1-ab9e-be0da589bfbc tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1466 microversion: 2.1 time: 0.166222 Aug 06 20:56:26.626201 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 441/873] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1466 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:26.626807 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 433/874] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1378 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:26.631977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03cc8386-1da5-4c9a-a2ce-552ed9b385b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:26.632773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.633402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03cc8386-1da5-4c9a-a2ce-552ed9b385b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action HTTP/1.1 Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 285 Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:56:26.636316 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:56:26.637898 ncdv-master-1 devstack@n-api.service[142462]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '33d5617c-e074-40e2-961a-27e0db7198df', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:56:26.642108 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:56:26.643288 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:56:26.644796 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:56:26.645793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 20:56:26.645793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:26.645793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03cc8386-1da5-4c9a-a2ce-552ed9b385b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:26.645793 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03cc8386-1da5-4c9a-a2ce-552ed9b385b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action" status: 400 len: 619 microversion: 2.1 time: 0.010208 Aug 06 20:56:26.646427 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 442/875] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Aug 6 20:56:26 2022] POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:56:26.650450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.650984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.651610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.652514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.652642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.653109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.653221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:26.653551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.665253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.665253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.665253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.665253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.665705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.665705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.813234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:26.821164 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-13898f48-2b26-4110-8dbe-ed280e46b32e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1522 microversion: 2.1 time: 0.177769 Aug 06 20:56:26.821741 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 443/876] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:26.826192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-631a694a-b562-4b74-b34e-c0f542f9b3f5 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729de225e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.845003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:26.876529 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-631a694a-b562-4b74-b34e-c0f542f9b3f5 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/5135514a-af3f-4057-893c-38dd4d85e4cd" status: 200 len: 784 microversion: 2.1 time: 0.053617 Aug 06 20:56:26.877130 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 444/877] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/images/5135514a-af3f-4057-893c-38dd4d85e4cd => generated 784 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:26.882247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.882904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:26.889258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.889970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.890474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.891297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.891876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.892385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.947526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:26.955798 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dcaee962-c151-4f1b-9eb1-5fbf78f48ade tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1317 microversion: 2.1 time: 0.327836 Aug 06 20:56:26.956643 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 434/878] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:26.977765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:26.978392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:26.986104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.988007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.988468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:26.989222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:26.991000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:26.991450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.147471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:27.151114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:27.154773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=34 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:27.158615 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab73a99b-86e5-4435-be04-fd81da8d8de0 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1522 microversion: 2.1 time: 0.190257 Aug 06 20:56:27.159200 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 435/879] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:27.161922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:27.163908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:27.164946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:27.165075 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b2c40670-6e36-4f4a-b0e4-219243928375 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1412 microversion: 2.25 time: 0.286943 Aug 06 20:56:27.165584 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 445/880] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:26 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1412 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:27.166020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:27.172878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.173595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.174210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.179320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e8cae4f8-6093-48b8-9976-e84da1d0b29d tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:27.187874 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e8cae4f8-6093-48b8-9976-e84da1d0b29d tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021127 Aug 06 20:56:27.188785 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 446/881] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:56:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:27.191371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.191913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.192403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.193188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:27.193809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:27.200017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.200505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.200952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.201657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.202119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.202577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.267774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:27.285398 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-28f050eb-8136-479d-8340-8307c3722f04 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.124777 Aug 06 20:56:27.285818 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 436/882] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:27 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:27.300203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0b484442-b363-4385-bc1a-49b52537c271 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1119284730"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:27.303286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0b484442-b363-4385-bc1a-49b52537c271 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:27.309767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b484442-b363-4385-bc1a-49b52537c271 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.310263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b484442-b363-4385-bc1a-49b52537c271 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.310741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b484442-b363-4385-bc1a-49b52537c271 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.311457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b484442-b363-4385-bc1a-49b52537c271 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.311924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b484442-b363-4385-bc1a-49b52537c271 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.312359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b484442-b363-4385-bc1a-49b52537c271 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.389071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:27.403167 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d8bf7c3b-ddfc-4702-b69c-ac98efd26676 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1474 microversion: 2.1 time: 0.213398 Aug 06 20:56:27.404170 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 447/883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:27 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1474 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:27.410152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9fc6d1d6-7fcf-4adb-820c-fc05adfd2a6a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dee44c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:27.535874 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0b484442-b363-4385-bc1a-49b52537c271 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action" status: 202 len: 0 microversion: 2.1 time: 0.247892 Aug 06 20:56:27.537376 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 437/884] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:56:27 2022] POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 20:56:27.548964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1759940518"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:27.551555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:27.559636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.560644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.561314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.562208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.563005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.563607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.599584 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Cannot 'createImage' instance 33d5617c-e074-40e2-961a-27e0db7198df while it is in task_state image_snapshot_pending Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action HTTP/1.1 Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 85 Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:56:27.601245 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1759940518"}} Aug 06 20:56:27.602765 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: exception: Cannot 'createImage' instance 33d5617c-e074-40e2-961a-27e0db7198df while it is in task_state image_snapshot_pending Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '33d5617c-e074-40e2-961a-27e0db7198df', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1759940518'}}} Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 33d5617c-e074-40e2-961a-27e0db7198df in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:27.606952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 33d5617c-e074-40e2-961a-27e0db7198df while it is in task_state image_snapshot_pending Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 33d5617c-e074-40e2-961a-27e0db7198df while it is in task_state image_snapshot_pending Aug 06 20:56:27.608279 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:27.609448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 409 to user: Cannot 'createImage' instance 33d5617c-e074-40e2-961a-27e0db7198df while it is in task_state image_snapshot_pending {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:27.609448 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-87772d57-d904-4c51-8290-62651b86ffbf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action" status: 409 len: 167 microversion: 2.1 time: 0.058778 Aug 06 20:56:27.609448 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 438/885] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:56:27 2022] POST /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df/action => generated 167 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:56:27.619356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d9f34d46-dc3a-45a0-9ea9-28780c573718 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '.version_select at 0x7f729dba0820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:27.813217 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d9f34d46-dc3a-45a0-9ea9-28780c573718 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/images/f6cf34dc-5f40-49c3-8de0-95e7030c6ee0" status: 204 len: 0 microversion: 2.1 time: 0.201335 Aug 06 20:56:27.814013 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 439/886] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:27 2022] DELETE /compute/v2.1/images/f6cf34dc-5f40-49c3-8de0-95e7030c6ee0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:56:27.827759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:27.829057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:27.839355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.839859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.840517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:27.841276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:27.841741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:27.842161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.077143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:28.090252 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22ac62ec-d122-4b6b-9c35-f7dbcafd60ed tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1528 microversion: 2.1 time: 0.274836 Aug 06 20:56:28.091353 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 440/887] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:27 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1528 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:28.108993 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9fc6d1d6-7fcf-4adb-820c-fc05adfd2a6a tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "DELETE /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 204 len: 0 microversion: 2.1 time: 0.703451 Aug 06 20:56:28.110520 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 448/888] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:27 2022] DELETE /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 0 bytes in 706 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:56:28.116820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-b104d6a3-73fd-43ae-8f11-c4395c16f7aa req-07fb5676-8a9f-4023-bed5-d66f7b085d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5f43e6-eb38-4c09-8284-99bba87f1564", "name": "network-vif-deleted", "tag": "5fc2e6b6-1ef8-49a2-a162-668afad75272"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:28.118083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.118775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:28.131338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b104d6a3-73fd-43ae-8f11-c4395c16f7aa req-07fb5676-8a9f-4023-bed5-d66f7b085d2e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.132401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b104d6a3-73fd-43ae-8f11-c4395c16f7aa req-07fb5676-8a9f-4023-bed5-d66f7b085d2e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.133112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b104d6a3-73fd-43ae-8f11-c4395c16f7aa req-07fb5676-8a9f-4023-bed5-d66f7b085d2e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.140338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.140982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.141394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.142172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.142672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.143160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.160648 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-b104d6a3-73fd-43ae-8f11-c4395c16f7aa req-07fb5676-8a9f-4023-bed5-d66f7b085d2e service nova] Creating event network-vif-deleted:5fc2e6b6-1ef8-49a2-a162-668afad75272 for instance cc5f43e6-eb38-4c09-8284-99bba87f1564 on nch1-master-1 Aug 06 20:56:28.168165 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-b104d6a3-73fd-43ae-8f11-c4395c16f7aa req-07fb5676-8a9f-4023-bed5-d66f7b085d2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055590 Aug 06 20:56:28.172287 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 449/889] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:28.181818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.183597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:28.190774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.191374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.191911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.194212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.195164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.195685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.310212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:28.321148 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47bdbbb2-4636-4e22-a448-74f56376adc4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1542 microversion: 2.1 time: 0.215304 Aug 06 20:56:28.321743 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 441/890] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1542 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:28.331375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7c0256b4-0c47-4e83-91a1-9734d14b0765 req-5faa8f80-b52e-4aff-b041-9a53fc31778f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814b0a3e-029c-47e3-b686-a3d2473a44e5", "name": "network-vif-plugged", "status": "completed", "tag": "1b24865d-9fb9-4d82-b0d8-cdc42c0ec4de"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:28.341989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7c0256b4-0c47-4e83-91a1-9734d14b0765 req-5faa8f80-b52e-4aff-b041-9a53fc31778f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.342478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7c0256b4-0c47-4e83-91a1-9734d14b0765 req-5faa8f80-b52e-4aff-b041-9a53fc31778f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.342962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7c0256b4-0c47-4e83-91a1-9734d14b0765 req-5faa8f80-b52e-4aff-b041-9a53fc31778f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.357377 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7c0256b4-0c47-4e83-91a1-9734d14b0765 req-5faa8f80-b52e-4aff-b041-9a53fc31778f service nova] Creating event network-vif-plugged:1b24865d-9fb9-4d82-b0d8-cdc42c0ec4de for instance 814b0a3e-029c-47e3-b686-a3d2473a44e5 on nch2-master-1 Aug 06 20:56:28.363930 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7c0256b4-0c47-4e83-91a1-9734d14b0765 req-5faa8f80-b52e-4aff-b041-9a53fc31778f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040477 Aug 06 20:56:28.364750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:28.365634 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 442/891] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:28.372789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.372965 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d99637f4-c69e-40d9-930a-8b28554931af tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1317 microversion: 2.1 time: 0.197302 Aug 06 20:56:28.373526 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 450/892] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:28.373621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:28.379473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-104cd7f1-8964-4ef8-a0a0-d5ccd2a56147 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dde3940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.382359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.383174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.383970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.384921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.385583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.386172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.423147 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-104cd7f1-8964-4ef8-a0a0-d5ccd2a56147 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] HTTP exception thrown: Image not found. Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-104cd7f1-8964-4ef8-a0a0-d5ccd2a56147 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Request method failure captured: Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c HTTP/1.1 Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVLEIvWlOKBVbbmLAAR0lMlQTgeB7afqmPz9cAYB2PEGuQLcitddQvt-uuNP2Fsc6rKY2GviZBixPFZmjRmOAkJ_IYSD9pXFRISGmFQrpoXOvwFwuX3sZWlgHRpuQq_4RsigYSP8-tQmpvFq_SYB_YFsIwHtDChe_GTRHUu-Vpdewg Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7397d6b602604e2caa60f16aee28c950 Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerTestJSON-1524795796 Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:56:28.425888 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7397d6b602604e2caa60f16aee28c950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7397d6b602604e2caa60f16aee28c950", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7397d6b602604e2caa60f16aee28c950"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7397d6b602604e2caa60f16aee28c950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerTestJSON-1524795796 Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7397d6b602604e2caa60f16aee28c950 Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1524795796 Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerTestJSON-1524795796-project Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 096b2f40a81a4627af9ae5c7b83fc619 Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerTestJSON-1524795796-project Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'a491739a-09ed-40fc-a71b-db92bc42198c'} Aug 06 20:56:28.428244 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:56:28.429213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a491739a-09ed-40fc-a71b-db92bc42198c Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:56:28.430514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a491739a-09ed-40fc-a71b-db92bc42198c could not be found. Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:56:28.431971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-104cd7f1-8964-4ef8-a0a0-d5ccd2a56147 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:28.433510 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-104cd7f1-8964-4ef8-a0a0-d5ccd2a56147 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 404 len: 62 microversion: 2.1 time: 0.053489 Aug 06 20:56:28.434807 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 451/893] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:56:28.442193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.442906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:28.451107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.451605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.452131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.452942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.453483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.453923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.580387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:28.588345 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ef8358cd-c213-485f-b71f-61f8c711ebdf tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1528 microversion: 2.1 time: 0.221344 Aug 06 20:56:28.589123 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 443/894] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1528 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:28.595062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.595799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:28.599874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:28.602788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.603337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.603781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.604728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.605198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.605652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.608908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:28.610834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:28.612038 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-876d2578-f7a0-464b-9133-37e477116b6d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1412 microversion: 2.25 time: 0.178992 Aug 06 20:56:28.612948 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 452/895] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1412 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:28.618507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.619310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:28.625832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.626390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.626939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.627855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.628396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.628876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.659246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=14 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:28.672913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.673895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.674565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.675242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lazy-loading 'fault' on Instance uuid cc5f43e6-eb38-4c09-8284-99bba87f1564 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:28.711495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:28.731440 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-319e8d95-f029-4092-8b6e-d71855e184b6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.139808 Aug 06 20:56:28.732336 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 444/896] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:28.735943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ffbe6477ea45f481620fa6293e1958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef27173302447a82d257b1f838e75d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:28.737270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b1cf861d-5239-4a82-858a-66dcea8d795b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-914683063"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:28.739837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b1cf861d-5239-4a82-858a-66dcea8d795b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:28.744155 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c3ba8843-0519-455b-8214-8cfa2cdd6e4b tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 200 len: 1308 microversion: 2.1 time: 0.129931 Aug 06 20:56:28.744732 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 453/897] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:28.748157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1cf861d-5239-4a82-858a-66dcea8d795b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.748758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1cf861d-5239-4a82-858a-66dcea8d795b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.749305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1cf861d-5239-4a82-858a-66dcea8d795b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.750288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1cf861d-5239-4a82-858a-66dcea8d795b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.750894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1cf861d-5239-4a82-858a-66dcea8d795b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.751325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1cf861d-5239-4a82-858a-66dcea8d795b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.754155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f0ef962-ec7a-4d14-a74e-6e9320632e46 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.755655 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:56:28.755655 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:56:28.772624 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f0ef962-ec7a-4d14-a74e-6e9320632e46 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/f5e9013f-d318-4d9f-aebe-f26d76d7c28f" status: 202 len: 0 microversion: 2.1 time: 0.026723 Aug 06 20:56:28.774574 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 454/898] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:56:28 2022] DELETE /compute/v2.1/flavors/f5e9013f-d318-4d9f-aebe-f26d76d7c28f => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:56:28.781145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-073db1bb-6a48-489c-b982-5ae75c7479f7 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.803419 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-073db1bb-6a48-489c-b982-5ae75c7479f7 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.025613 Aug 06 20:56:28.804262 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 455/899] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:28.822164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:28.824394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:28.830325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.830844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.831285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.831978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.832437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.832907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.861334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:28.868556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Old instance type tempest-test_resize_flavor_-1984546811, new instance type m1.heat {{(pid=142462) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 20:56:28.875626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:28.876079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:28.876600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:28.876966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:28.877568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:28.942162 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c06e4b9-096f-425f-9128-1e48cbc0da8a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878/action" status: 202 len: 0 microversion: 2.1 time: 0.123506 Aug 06 20:56:28.944166 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 456/900] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:56:28 2022] POST /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:56:28.949277 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b1cf861d-5239-4a82-858a-66dcea8d795b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "POST /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9/action" status: 202 len: 0 microversion: 2.1 time: 0.215696 Aug 06 20:56:28.950168 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 445/901] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:56:28 2022] POST /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 20:56:28.952069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.952691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:28.961232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.961456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.961765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-af88453e-915b-49e0-998e-bce06c4d907c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db6a8b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:28.961923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:28.962647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:28.963111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:28.963549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.016368 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-af88453e-915b-49e0-998e-bce06c4d907c tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.059958 Aug 06 20:56:29.024203 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 446/902] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:29.123672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:29.132209 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dff121d9-39e6-4fbf-a326-d131b9a7b58a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1537 microversion: 2.1 time: 0.183982 Aug 06 20:56:29.133486 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 457/903] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:28 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1537 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:29.342095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:29.342932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:29.355290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.356145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.356997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.358207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.358914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.359382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.366797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:29.401883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:29.402782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:29.415580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.416245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.416753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.417543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.418100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.418620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.530479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:29.539109 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01ee5a38-0071-4585-9268-bfbd4e47bcab tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1534 microversion: 2.1 time: 0.201744 Aug 06 20:56:29.539704 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 447/904] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:29 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1534 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:29.641127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:29.641736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:29.648359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.648848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.649312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.650018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.650471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.650923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.825768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:29.836882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:29.839948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:29.841636 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e4bd6059-23ce-4cf8-8652-f2f4fd6e3054 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1412 microversion: 2.25 time: 0.204485 Aug 06 20:56:29.842632 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 448/905] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:29 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1412 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:56:29.847972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:29.849689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:29.856137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.856919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.857654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.858615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.859294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.859947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.863228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:29.871884 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-62e7f625-ec62-4477-abe7-9dc170eb9e53 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1317 microversion: 2.1 time: 0.478818 Aug 06 20:56:29.872486 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 458/906] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:29 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:29.885684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:29.887532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] [instance: cc5f43e6-eb38-4c09-8284-99bba87f1564] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:29.894140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.895004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.896253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.897474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:29.898158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:29.898940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:29.916464 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] HTTP exception thrown: Instance cc5f43e6-eb38-4c09-8284-99bba87f1564 could not be found. Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Request method failure captured: Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 HTTP/1.1 Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVEx-rZAC4ik78uDLQq2BlK9Cfcmh-UalQ28d4WxZKurGkOC1Ssd71TdCNcZ3UQqXOL_vI0qVs1PEiI_5bP20lGl-iStd1K0-zCxiOjJVxmNTlltOybFUBWHcOtrNVP0h5ZfEB1oVLqhMwwPpJYHgXyA47laXAVDrYpI3qVpMWPyNA Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: d5ef27173302447a82d257b1f838e75d Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-LiveMigrationNegativeTest-295484584 Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:56:29.918488 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d5ef27173302447a82d257b1f838e75d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d5ef27173302447a82d257b1f838e75d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d5ef27173302447a82d257b1f838e75d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d5ef27173302447a82d257b1f838e75d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-LiveMigrationNegativeTest-295484584 Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: d5ef27173302447a82d257b1f838e75d Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-295484584 Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-LiveMigrationNegativeTest-295484584-project Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 79ffbe6477ea45f481620fa6293e1958 Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-LiveMigrationNegativeTest-295484584-project Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance cc5f43e6-eb38-4c09-8284-99bba87f1564 could not be found. Aug 06 20:56:29.920158 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'cc5f43e6-eb38-4c09-8284-99bba87f1564'} Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5f43e6-eb38-4c09-8284-99bba87f1564 could not be found. Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:29.920897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5f43e6-eb38-4c09-8284-99bba87f1564 could not be found. Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5f43e6-eb38-4c09-8284-99bba87f1564 could not be found. Aug 06 20:56:29.922091 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:56:29.925624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] Returning 404 to user: Instance cc5f43e6-eb38-4c09-8284-99bba87f1564 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:29.926966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c87a28ac-2dc6-45ed-90b4-20a2150ec1f2 tempest-LiveMigrationNegativeTest-295484584 tempest-LiveMigrationNegativeTest-295484584-project] 10.222.0.33 "GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564" status: 404 len: 111 microversion: 2.1 time: 0.049587 Aug 06 20:56:29.929125 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 459/907] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:29 2022] GET /compute/v2.1/servers/cc5f43e6-eb38-4c09-8284-99bba87f1564 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:56:29.946674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:29.968768 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-81b88902-6497-4718-8db4-878b9b5fed5d tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.124644 Aug 06 20:56:29.982581 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 449/908] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:29 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:30.031966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df04dccb-5665-406c-bf78-2bbde29d1585 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dd84ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:30.090420 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df04dccb-5665-406c-bf78-2bbde29d1585 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.062289 Aug 06 20:56:30.091391 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 460/909] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:30 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:30.157135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:30.157902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:30.159821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:30.174442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:30.177647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:30.178125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:30.178992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:30.179347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:30.179799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:30.354577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:30.366105 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4ebe4a1c-5e53-4b23-b66c-f787af735b7d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1537 microversion: 2.1 time: 0.214040 Aug 06 20:56:30.367109 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 450/910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:30 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:30.412495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-106fa979-5179-44f6-95ae-e19cc50db58f req-42bc9096-7e06-49bb-829f-0f71d99452fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0af8fc-0b76-4863-bb2d-699fc8f3cde9", "name": "network-vif-unplugged", "status": "completed", "tag": "1ae474c0-bff8-4514-9ff0-4e4609198c44"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:30.426286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-106fa979-5179-44f6-95ae-e19cc50db58f req-42bc9096-7e06-49bb-829f-0f71d99452fe service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:30.427610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-106fa979-5179-44f6-95ae-e19cc50db58f req-42bc9096-7e06-49bb-829f-0f71d99452fe service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:30.428233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-106fa979-5179-44f6-95ae-e19cc50db58f req-42bc9096-7e06-49bb-829f-0f71d99452fe service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:30.439555 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-106fa979-5179-44f6-95ae-e19cc50db58f req-42bc9096-7e06-49bb-829f-0f71d99452fe service nova] Creating event network-vif-unplugged:1ae474c0-bff8-4514-9ff0-4e4609198c44 for instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 on nch2-master-1 Aug 06 20:56:30.445206 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-106fa979-5179-44f6-95ae-e19cc50db58f req-42bc9096-7e06-49bb-829f-0f71d99452fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036607 Aug 06 20:56:30.445849 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 461/911] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:30.561294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:30.562038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:30.568343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:30.568879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:30.569311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:30.570016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:30.570483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:30.570941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:30.715324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:30.722923 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-10101022-6d34-4299-9bb4-088a13c54182 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1540 microversion: 2.1 time: 0.165525 Aug 06 20:56:30.724044 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 451/912] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:30 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1540 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:30.866876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:30.867612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:30.873988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:30.874682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:30.875121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:30.875829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:30.876283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:30.876707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:30.893046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:30.893700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:30.901037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:30.901542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:30.901987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:30.902745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:30.903206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:30.903640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:31.026943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:31.035965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:31.038007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:31.039177 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f0e72ed5-1ad1-4d4d-bdf3-68a025bd52d9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1412 microversion: 2.25 time: 0.177539 Aug 06 20:56:31.040408 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 462/913] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:30 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:31.045452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:31.046225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:31.053459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:31.053955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:31.054579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:31.055448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:31.056305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:31.057045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:31.117885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:31.126458 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-10e63651-d55e-4849-b8dc-e74d3cd2326c tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1317 microversion: 2.1 time: 0.237181 Aug 06 20:56:31.127911 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 452/914] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:30 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:31.133661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-91bbab9c-2d88-4f1c-abbb-3038bad220f1 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db098b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:31.189378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:31.194602 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-91bbab9c-2d88-4f1c-abbb-3038bad220f1 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.065024 Aug 06 20:56:31.195631 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 453/915] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:31 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:31.237824 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2b78f686-c8ec-4ac7-b097-5cc52872fef6 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1927 microversion: 2.75 time: 0.196058 Aug 06 20:56:31.241691 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 463/916] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:31 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1927 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:31.389185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:31.389843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:31.397381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:31.397875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:31.398314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:31.399210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:31.399820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:31.400395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:31.538245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:31.546710 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c7d6556d-ff71-4dcd-a956-fc955dee37aa tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1537 microversion: 2.1 time: 0.162693 Aug 06 20:56:31.547293 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 454/917] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:31 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:31.745359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:31.746067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:31.755496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:31.756502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:31.757076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:31.757735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:31.758203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:31.758688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:31.776488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:31.927550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:31.937611 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03d1d790-7c3d-42f8-8dc4-f6d93ec1c2b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1540 microversion: 2.1 time: 0.195330 Aug 06 20:56:31.955561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:31.956078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:31.962579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:31.963071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:31.963305 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 464/918] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:31 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1540 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:31.963905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:31.964804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:31.965269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:31.965799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:31.993465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:56:32.066578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:32.068356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:32.081223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.081958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.082370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.083817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.084711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.085446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.087818 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1baff15a-ff6a-41ba-a234-8a174a6d3c3e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "DELETE /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 204 len: 0 microversion: 2.1 time: 0.138059 Aug 06 20:56:32.088821 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 455/919] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:56:31 2022] DELETE /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:56:32.155596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:32.156443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:32.167349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.167840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.170003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.170789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.171252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.171681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.283643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:32.294854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:32.296417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:32.297742 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d3e9752-75dc-458c-8f50-9c38aa826ecb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1412 microversion: 2.25 time: 0.236790 Aug 06 20:56:32.298800 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 465/920] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:32 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1412 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:32.304144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-272631ea-6889-4d58-8782-0918a9660280 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dd98310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:32.356643 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-272631ea-6889-4d58-8782-0918a9660280 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.056294 Aug 06 20:56:32.357524 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 466/921] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:32 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:32.363428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1198662270", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "846281360", "adminPass": "***", "networks": [{"uuid": "4fc9d6ac-3573-4277-8082-cfce024b5c45"}], "security_groups": [{"name": "tempest-securitygroup--1562997924"}], "key_name": "tempest-keypair-601269215", "user_data": "}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:32.372922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:32.381536 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc40cf9b-4c1e-4f44-bd55-d35ccb5c6d5e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1467 microversion: 2.1 time: 0.232259 Aug 06 20:56:32.382417 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 456/922] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:32 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1467 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:32.390298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:32.391028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:32.398517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.399138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.399650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.400725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.401505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.402828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.491903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:32.501482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] validate_networks() for [('4fc9d6ac-3573-4277-8082-cfce024b5c45', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:56:32.514897 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32d5046e-978b-44ae-9a13-6c87e985efd9 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1933 microversion: 2.75 time: 0.131214 Aug 06 20:56:32.515996 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 457/923] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:32 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1933 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:32.521505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e39e5611-ed95-4d7e-9789-1b043dffc334 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:32.522124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e39e5611-ed95-4d7e-9789-1b043dffc334 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:32.537979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e39e5611-ed95-4d7e-9789-1b043dffc334 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.538489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e39e5611-ed95-4d7e-9789-1b043dffc334 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.538977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e39e5611-ed95-4d7e-9789-1b043dffc334 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.539922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e39e5611-ed95-4d7e-9789-1b043dffc334 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.540456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e39e5611-ed95-4d7e-9789-1b043dffc334 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.540812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e39e5611-ed95-4d7e-9789-1b043dffc334 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.712902 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e39e5611-ed95-4d7e-9789-1b043dffc334 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1618 microversion: 2.1 time: 0.195564 Aug 06 20:56:32.713487 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 458/924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:32 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1618 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:32.718064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-633d3717-774f-4d0f-b276-62cbd19737d7 req-0674d74c-b1e7-445d-ac10-bb39281511de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87d6735-5d42-4f96-aac5-55b50a1a804f", "name": "network-vif-plugged", "status": "completed", "tag": "270cefb5-0f7a-43e8-8015-bdf5afc1c875"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:32.732337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-633d3717-774f-4d0f-b276-62cbd19737d7 req-0674d74c-b1e7-445d-ac10-bb39281511de service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.733088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-633d3717-774f-4d0f-b276-62cbd19737d7 req-0674d74c-b1e7-445d-ac10-bb39281511de service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.733687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-633d3717-774f-4d0f-b276-62cbd19737d7 req-0674d74c-b1e7-445d-ac10-bb39281511de service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.752772 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-633d3717-774f-4d0f-b276-62cbd19737d7 req-0674d74c-b1e7-445d-ac10-bb39281511de service nova] Creating event network-vif-plugged:270cefb5-0f7a-43e8-8015-bdf5afc1c875 for instance a87d6735-5d42-4f96-aac5-55b50a1a804f on nch2-master-1 Aug 06 20:56:32.758825 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-633d3717-774f-4d0f-b276-62cbd19737d7 req-0674d74c-b1e7-445d-ac10-bb39281511de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043958 Aug 06 20:56:32.759529 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 459/925] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:32.767838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:32.768477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:32.775136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.775871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.776488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.777346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:32.777955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:32.778533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:32.997273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:33.006070 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a04c9428-58cb-48c5-9486-d7ab1da2fc43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1537 microversion: 2.1 time: 0.242345 Aug 06 20:56:33.006661 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 460/926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:32 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:33.024609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1195390138", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "29ea4f47-8ba4-49b1-afa0-5b8d50656763"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:33.045051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:33.045780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:33.047528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:33.047987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:33.049174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:33.062461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.063268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.063933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.064915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.065523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.065968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.086348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:56:33.087400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Getting quotas for project 2eff0aae88974b5a893b71e0d6b34257. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:33.092950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Getting quotas for user 4604780fce5b4ece8cb20354efb53569 and project 2eff0aae88974b5a893b71e0d6b34257. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:33.105766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:56:33.108281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:56:33.159392 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-87bb9bc9-d1b3-43ab-b78c-c459092c9776 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.800546 Aug 06 20:56:33.160227 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 467/927] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:56:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:56:33.165540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:33.166156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:33.173512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.173512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.173864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.174839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.175304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.175740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.324654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:33.325110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:33.325738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:33.326197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:33.326662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:33.329922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:33.336527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.337563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.338507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.339276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.339434 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e0939e2c-1340-4def-b200-5fff1c007772 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1540 microversion: 2.1 time: 0.178322 Aug 06 20:56:33.339689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.340080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.341462 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 468/928] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:33 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1540 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:33.369332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:33.374714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Getting quotas for user 10aebae8bbbd4ea88b9cbf85d3438ed1 and project c0e3164f8b4943eeb85883a0fa08efaa. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:33.388318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:56:33.390699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:56:33.442737 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-db776289-ba4a-4af1-978c-6b3e4c3a8798 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.421929 Aug 06 20:56:33.443822 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 461/929] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:56:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:56:33.449703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8800fff7-332f-41e5-ad83-603fa57d28d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:33.450668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8800fff7-332f-41e5-ad83-603fa57d28d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:33.514389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8800fff7-332f-41e5-ad83-603fa57d28d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:33.515948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-adc6320a-7795-4e72-a4f9-9728486c689c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Action: 'update', calling method: .version_select at 0x7f729df99a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:33.523399 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8800fff7-332f-41e5-ad83-603fa57d28d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1262 microversion: 2.1 time: 0.078183 Aug 06 20:56:33.524619 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 462/930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:33 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:33.529237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:33.529843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:33.553063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.553988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.554843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.555744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.562886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.563776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.607886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc6320a-7795-4e72-a4f9-9728486c689c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.608805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc6320a-7795-4e72-a4f9-9728486c689c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.609508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc6320a-7795-4e72-a4f9-9728486c689c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.610354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc6320a-7795-4e72-a4f9-9728486c689c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.611015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc6320a-7795-4e72-a4f9-9728486c689c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.611732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc6320a-7795-4e72-a4f9-9728486c689c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.636673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:33.704990 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-adc6320a-7795-4e72-a4f9-9728486c689c tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/845885d4ede946babd400ee92b7c4490" status: 200 len: 240 microversion: 2.36 time: 0.362059 Aug 06 20:56:33.705624 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 469/931] 10.222.0.33 () {62 vars in 1303 bytes} [Sat Aug 6 20:56:33 2022] PUT /compute/v2.1/os-quota-sets/845885d4ede946babd400ee92b7c4490 => generated 240 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:56:33.715621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a9dcf36a-307e-418e-8495-bc713cef1479 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dee49d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:33.762271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:33.772294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:33.773739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a9dcf36a-307e-418e-8495-bc713cef1479 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.067067 Aug 06 20:56:33.773975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:33.774495 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 470/932] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:33 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:33.775277 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e2b944f-9e24-4517-a536-40e4c949fe27 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1412 microversion: 2.25 time: 0.249831 Aug 06 20:56:33.776039 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 463/933] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:33 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1412 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:33.784339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca2a77e0-80cb-4cdf-b711-356dc812c699 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:33.787019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ca2a77e0-80cb-4cdf-b711-356dc812c699 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:33.789169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:33.790115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:33.797692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.798175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.798667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.799366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.799823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.800292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.860044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ca2a77e0-80cb-4cdf-b711-356dc812c699 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:33.870773 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ca2a77e0-80cb-4cdf-b711-356dc812c699 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1217 microversion: 2.1 time: 0.094434 Aug 06 20:56:33.871700 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 471/934] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:33 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:33.873356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:33.878811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:33.888473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-81611773-14eb-448c-a469-5cb24c43d185 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Calling method '.version_select at 0x7f729dd98700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:33.900675 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-de7c4e53-da52-4ef7-b286-d7bd6256009e tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1933 microversion: 2.75 time: 0.116455 Aug 06 20:56:33.901253 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 464/935] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:33 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1933 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:33.962767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81611773-14eb-448c-a469-5cb24c43d185 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.963377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81611773-14eb-448c-a469-5cb24c43d185 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.963826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81611773-14eb-448c-a469-5cb24c43d185 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.964658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81611773-14eb-448c-a469-5cb24c43d185 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:33.965203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81611773-14eb-448c-a469-5cb24c43d185 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:33.965654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81611773-14eb-448c-a469-5cb24c43d185 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:33.986144 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-81611773-14eb-448c-a469-5cb24c43d185 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/845885d4ede946babd400ee92b7c4490/detail" status: 200 len: 672 microversion: 2.36 time: 0.113255 Aug 06 20:56:33.986719 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 472/936] 10.222.0.33 () {60 vars in 1304 bytes} [Sat Aug 6 20:56:33 2022] GET /compute/v2.1/os-quota-sets/845885d4ede946babd400ee92b7c4490/detail => generated 672 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:56:34.028449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:34.029973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:34.037705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.039058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.039689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.040695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.041263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.041793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.146838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Action: 'update', calling method: .version_select at 0x7f729de04430>, body: {"quota_set": {"ram": "2048"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:34.193376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:34.201649 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd88b6a6-b060-4c76-8747-e5a9fd56790d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1537 microversion: 2.1 time: 0.177544 Aug 06 20:56:34.202220 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 465/937] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:34 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:34.217736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.218315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.218861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.219664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.220182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.220802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.254380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.255021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.255527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.256287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.256745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.257170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.322785 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3c2aba56-3076-4783-935f-206a660765fd tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/845885d4ede946babd400ee92b7c4490?user_id=2b104f8851c54d48a0489d45884eddb3" status: 200 len: 240 microversion: 2.36 time: 0.180313 Aug 06 20:56:34.323761 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 473/938] 10.222.0.33 () {62 vars in 1384 bytes} [Sat Aug 6 20:56:34 2022] PUT /compute/v2.1/os-quota-sets/845885d4ede946babd400ee92b7c4490?user_id=2b104f8851c54d48a0489d45884eddb3 => generated 240 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:56:34.336383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71a4f3c5-beea-453f-9d40-25883c45e883 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] Calling method '.version_select at 0x7f729dba0550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:34.361894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:34.362518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:34.386808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.387315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.387816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.388603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.389068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.392532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.478310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:34.482034 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71a4f3c5-beea-453f-9d40-25883c45e883 tempest-QuotasAdminTestV236-740850247 tempest-QuotasAdminTestV236-740850247-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/845885d4ede946babd400ee92b7c4490?user_id=2b104f8851c54d48a0489d45884eddb3" status: 200 len: 282 microversion: 2.36 time: 0.151047 Aug 06 20:56:34.497827 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 466/939] 10.222.0.33 () {60 vars in 1364 bytes} [Sat Aug 6 20:56:34 2022] GET /compute/v2.1/os-quota-sets/845885d4ede946babd400ee92b7c4490?user_id=2b104f8851c54d48a0489d45884eddb3 => generated 282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:56:34.546944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:34.547988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:34.560726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.562100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.562756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.564670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.565989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.567123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.647158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:34.654985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:34.656676 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1be77e51-b5c2-4f50-a75e-3ac6f05437de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1522 microversion: 2.1 time: 0.298978 Aug 06 20:56:34.658598 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 474/940] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:34 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:34.680747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:34.680747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:34.687354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.687925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.688689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.689213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.689687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.690127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.691114 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f291f5b2-beb2-452c-9d0e-8639206d155c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1258 microversion: 2.1 time: 0.149667 Aug 06 20:56:34.691702 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 467/941] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:34 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:34.721366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:56:34.790319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-750fde86-219f-48f8-b4db-23edf739df7f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db6a4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:34.891905 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-750fde86-219f-48f8-b4db-23edf739df7f tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.106320 Aug 06 20:56:34.893821 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 468/942] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:34 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:34.902346 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7e24c2fc-bcf4-49c6-bdec-f5c412aee0e2 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 204 len: 0 microversion: 2.1 time: 0.227622 Aug 06 20:56:34.903241 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 475/943] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:56:34 2022] DELETE /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:56:34.908883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:34.920143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:34.921095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:34.922374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:34.933798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.934558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.938599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.939819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.940717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.941327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.947668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.948197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.948622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:34.951878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:34.952356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:34.952794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:35.054611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:35.067532 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a6f76496-2535-4c01-b013-555959460ee7 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1269 microversion: 2.1 time: 0.160922 Aug 06 20:56:35.070319 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 476/944] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:34 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:35.086259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:35.086642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:35.095738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:35.096263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:35.096661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:35.097758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:35.098076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:35.099002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:35.210033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:35.220898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:35.222692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:35.224819 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b51d2725-f807-4127-9764-4a04cf4f4853 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1412 microversion: 2.25 time: 0.329582 Aug 06 20:56:35.225393 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 469/945] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:34 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1412 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:35.230832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:35.231438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:35.242838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:35.243394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:35.243848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:35.244609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:35.245082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:35.245990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:35.335523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:35.355266 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d86d952a-2912-4b88-88c6-d854bc6779ec tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1933 microversion: 2.75 time: 0.128118 Aug 06 20:56:35.356208 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 470/946] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:35 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1933 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:35.361316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:35.362221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:35.371320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:35.372040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:35.372642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:35.375992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:35.381142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:35.381640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:35.382086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:35.387360 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-82bc804c-b7be-47a5-b286-85f84c69dded tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1528 microversion: 2.1 time: 0.315698 Aug 06 20:56:35.388310 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 477/947] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:35 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1528 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:35.535367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:35.546636 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78ad1a0a-4caf-4eca-952e-49c49b2c6ab3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1537 microversion: 2.1 time: 0.189276 Aug 06 20:56:35.547262 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 471/948] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:35 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:35.712889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:35.713504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:35.720317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:35.720803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:35.721429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:35.722132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:35.722612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:35.723233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:35.838877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:35.847690 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5a6e372c-ff27-4ae7-9834-04ce9330d141 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1314 microversion: 2.1 time: 0.138592 Aug 06 20:56:35.848355 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 478/949] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:35 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:35.906282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7a3c355a-3c34-429b-a7d3-3e97e1d1e2a4 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db49f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:35.951889 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7a3c355a-3c34-429b-a7d3-3e97e1d1e2a4 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.049574 Aug 06 20:56:35.952596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 472/950] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:35 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:36.095881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:36.096412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:36.102887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.103516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.104054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:36.105036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.105651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.106218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:36.200410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:36.214166 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55de373b-79a8-4621-9554-d70b3f170525 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1277 microversion: 2.1 time: 0.123152 Aug 06 20:56:36.217076 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 479/951] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:36 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:36.247958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:36.250287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:36.276599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.277102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.286509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:36.287420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.293649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.294462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:36.384422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:36.385672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:36.417218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.430530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.431016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:36.431777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.432241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.432671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:36.595846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:36.628818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:36.636490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:36.644684 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3b6834b6-16c2-4416-a7ff-0e9e11848ecf tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1607 microversion: 2.25 time: 0.399465 Aug 06 20:56:36.647574 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 473/952] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:36 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1607 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:36.664165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:36.666580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:36.688160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.689805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.692664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:36.695251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.697099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.699044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:36.738366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] Lazy-loading 'services' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:36.776554 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4c145620-234d-4a67-ba85-310932f958b4 tempest-ServersAdmin275Test-218495464 tempest-ServersAdmin275Test-218495464-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1918 microversion: 2.75 time: 0.398255 Aug 06 20:56:36.780231 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 480/953] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:36 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1918 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:36.785500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:36.791771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:36.816531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.818075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.818750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:36.819670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:36.820311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:36.820902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:37.198797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:37.211972 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-18ffa785-cde8-4e6b-b7c2-ca9c4859e033 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1528 microversion: 2.1 time: 0.561846 Aug 06 20:56:37.215883 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 474/954] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:36 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:37.230897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8824aca8-9823-46d7-8ca5-ce1742cff6b8 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:37.232411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8824aca8-9823-46d7-8ca5-ce1742cff6b8 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:37.242669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8824aca8-9823-46d7-8ca5-ce1742cff6b8 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:37.246477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8824aca8-9823-46d7-8ca5-ce1742cff6b8 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:37.247875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8824aca8-9823-46d7-8ca5-ce1742cff6b8 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:37.248869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8824aca8-9823-46d7-8ca5-ce1742cff6b8 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:37.249574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8824aca8-9823-46d7-8ca5-ce1742cff6b8 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:37.252753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8824aca8-9823-46d7-8ca5-ce1742cff6b8 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:37.496222 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8824aca8-9823-46d7-8ca5-ce1742cff6b8 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.278977 Aug 06 20:56:37.496929 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 475/955] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Aug 6 20:56:37 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:56:37.503143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:37.503900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:37.521869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:37.526260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:37.527083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:37.530577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:37.531304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:37.531971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:37.590905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:56:37.672614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:37.684336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fa708a28-4766-49ad-b2b3-b1d89e904828 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1537 microversion: 2.1 time: 0.902523 Aug 06 20:56:37.685125 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 481/956] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:36 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1537 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:37.713793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f1b80d7b-cd0d-4e0f-833a-0225d4bd63db req-2013a63f-e3ba-40ba-b252-4e52a6c6c71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d5617c-e074-40e2-961a-27e0db7198df", "name": "network-vif-plugged", "status": "completed", "tag": "46f0b675-2387-4217-a1b4-a3c373145493"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:37.751154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f1b80d7b-cd0d-4e0f-833a-0225d4bd63db req-2013a63f-e3ba-40ba-b252-4e52a6c6c71a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:37.753049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f1b80d7b-cd0d-4e0f-833a-0225d4bd63db req-2013a63f-e3ba-40ba-b252-4e52a6c6c71a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:37.753554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f1b80d7b-cd0d-4e0f-833a-0225d4bd63db req-2013a63f-e3ba-40ba-b252-4e52a6c6c71a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:37.789175 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-367f1dc2-2bf5-496f-a7f0-090f3247dce6 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "DELETE /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 204 len: 0 microversion: 2.75 time: 0.290715 Aug 06 20:56:37.790727 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 476/957] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 20:56:37 2022] DELETE /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 20:56:37.797348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:37.798259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:37.805344 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f1b80d7b-cd0d-4e0f-833a-0225d4bd63db req-2013a63f-e3ba-40ba-b252-4e52a6c6c71a service nova] Creating event network-vif-plugged:46f0b675-2387-4217-a1b4-a3c373145493 for instance 33d5617c-e074-40e2-961a-27e0db7198df on nch2-master-1 Aug 06 20:56:37.811988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:37.817624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:37.819264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:37.820357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:37.821116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:37.821555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:37.836387 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f1b80d7b-cd0d-4e0f-833a-0225d4bd63db req-2013a63f-e3ba-40ba-b252-4e52a6c6c71a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143683 Aug 06 20:56:37.838082 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 482/958] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:37.853403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-efc09191-b5ee-4f66-b4dc-a1fd9135dc83 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dd4f040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:37.962712 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-efc09191-b5ee-4f66-b4dc-a1fd9135dc83 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.120529 Aug 06 20:56:37.964210 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 483/959] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:37 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:37.977482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:37.978517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:37.999091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:38.007488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:38.008335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:38.013941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:38.014789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:38.015408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:38.534848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:38.555728 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bdbd27ce-921f-48ef-b155-4d1dce789abc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1275 microversion: 2.1 time: 0.589111 Aug 06 20:56:38.562062 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 484/960] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:37 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1275 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:38.586926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:38.589363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:38.612042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:38.614663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:38.616541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:38.617487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:38.619839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:38.620512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:38.917200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:38.934496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b1ea090b-27a4-48e0-9a3a-5ad320ea7399 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1320 microversion: 2.1 time: 1.141996 Aug 06 20:56:38.937675 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 477/961] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:37 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1320 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:38.950517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:38.951570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:38.971274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:38.972056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:38.973501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:38.975094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:38.975750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:38.977517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:39.134606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:39.142133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:39.149698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:39.157593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:39.165142 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-367a051f-874f-4ed9-a138-62aa9c91a7ae tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1443 microversion: 2.75 time: 0.601173 Aug 06 20:56:39.178745 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 485/962] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:38 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1443 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:39.183081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-92c1f927-2f2e-46f6-b4f6-632bfbcfae70 req-6dcd2e7d-4f0e-4264-ba24-3ca36609c8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d48166-5304-479e-998a-4ca89870b1a2", "name": "network-vif-deleted", "tag": "6753505e-1a26-48b2-8451-717992f9bed3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:39.205452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-92c1f927-2f2e-46f6-b4f6-632bfbcfae70 req-6dcd2e7d-4f0e-4264-ba24-3ca36609c8ec service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:39.206194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-92c1f927-2f2e-46f6-b4f6-632bfbcfae70 req-6dcd2e7d-4f0e-4264-ba24-3ca36609c8ec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:39.206842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-92c1f927-2f2e-46f6-b4f6-632bfbcfae70 req-6dcd2e7d-4f0e-4264-ba24-3ca36609c8ec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:39.237183 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-92c1f927-2f2e-46f6-b4f6-632bfbcfae70 req-6dcd2e7d-4f0e-4264-ba24-3ca36609c8ec service nova] Creating event network-vif-deleted:6753505e-1a26-48b2-8451-717992f9bed3 for instance 70d48166-5304-479e-998a-4ca89870b1a2 on nch1-master-1 Aug 06 20:56:39.249024 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-92c1f927-2f2e-46f6-b4f6-632bfbcfae70 req-6dcd2e7d-4f0e-4264-ba24-3ca36609c8ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076199 Aug 06 20:56:39.249970 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 486/963] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:39.259080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:39.260361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:39.276466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:39.277041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:39.278040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:39.289556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:39.290063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:39.290682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:39.884329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:39.901783 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c631d44b-c22f-4dac-ab5f-fb932be12461 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.647123 Aug 06 20:56:39.903247 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 487/964] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:39 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:39.922635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fe4a9ce7-31a0-4be8-957b-2e4e885dd010 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dde3940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:40.030748 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fe4a9ce7-31a0-4be8-957b-2e4e885dd010 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.124489 Aug 06 20:56:40.031358 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 488/965] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:39 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:40.050070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:40.054836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:40.079111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:40.079939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:40.080550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:40.081458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:40.082208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:40.084232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:40.600729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:40.609522 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6d7edf87-f1df-4e16-b053-8803acc0f9b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 200 len: 1528 microversion: 2.1 time: 1.670345 Aug 06 20:56:40.631071 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 478/966] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:38 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 1528 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:40.636084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:40.636708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:40.670977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:40.671484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:40.671935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:40.672660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:40.673125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:40.673557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:40.758915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:40.779612 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-75f87746-7b26-4082-843f-155b24fbc4c9 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1317 microversion: 2.1 time: 0.743085 Aug 06 20:56:40.781583 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 489/967] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:40 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:40.789379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d7800b89-b9a3-4f91-9c8b-f5b1480ed2ea req-751443e4-fa7d-4c3b-b0cc-fd1e08d64f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0af8fc-0b76-4863-bb2d-699fc8f3cde9", "name": "network-vif-plugged", "status": "completed", "tag": "1ae474c0-bff8-4514-9ff0-4e4609198c44"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:40.830587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7800b89-b9a3-4f91-9c8b-f5b1480ed2ea req-751443e4-fa7d-4c3b-b0cc-fd1e08d64f7d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:40.831168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7800b89-b9a3-4f91-9c8b-f5b1480ed2ea req-751443e4-fa7d-4c3b-b0cc-fd1e08d64f7d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:40.831628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7800b89-b9a3-4f91-9c8b-f5b1480ed2ea req-751443e4-fa7d-4c3b-b0cc-fd1e08d64f7d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:40.886507 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d7800b89-b9a3-4f91-9c8b-f5b1480ed2ea req-751443e4-fa7d-4c3b-b0cc-fd1e08d64f7d service nova] Creating event network-vif-plugged:1ae474c0-bff8-4514-9ff0-4e4609198c44 for instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 on nch2-master-1 Aug 06 20:56:40.903372 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d7800b89-b9a3-4f91-9c8b-f5b1480ed2ea req-751443e4-fa7d-4c3b-b0cc-fd1e08d64f7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117461 Aug 06 20:56:40.905496 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 490/968] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:40.920975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:40.925512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:40.949152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:40.951243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:40.951980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:40.952756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:40.953233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:40.962528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:41.212275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:41.234050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:41.237847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:41.252674 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e0c21828-ba43-46eb-87a9-8b1911dd6521 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1443 microversion: 2.75 time: 0.345880 Aug 06 20:56:41.253286 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 491/969] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:40 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1443 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:41.270435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:41.271114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:41.301565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:41.302136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:41.302556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:41.305590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:41.306076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:41.309909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:41.528607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:41.541225 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a70f0422-a112-463c-84d3-ba23e79af079 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.908868 Aug 06 20:56:41.545297 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 479/970] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:40 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:41.554937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-08874c44-9cef-46b4-a090-41a2f1f4bbe3 req-702caad6-5a30-40e1-98c7-4ce67b7a6e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d5617c-e074-40e2-961a-27e0db7198df", "name": "network-vif-deleted", "tag": "46f0b675-2387-4217-a1b4-a3c373145493"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:41.617121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-08874c44-9cef-46b4-a090-41a2f1f4bbe3 req-702caad6-5a30-40e1-98c7-4ce67b7a6e35 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:41.625112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-08874c44-9cef-46b4-a090-41a2f1f4bbe3 req-702caad6-5a30-40e1-98c7-4ce67b7a6e35 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:41.628046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-08874c44-9cef-46b4-a090-41a2f1f4bbe3 req-702caad6-5a30-40e1-98c7-4ce67b7a6e35 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:41.679271 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-08874c44-9cef-46b4-a090-41a2f1f4bbe3 req-702caad6-5a30-40e1-98c7-4ce67b7a6e35 service nova] Creating event network-vif-deleted:46f0b675-2387-4217-a1b4-a3c373145493 for instance 33d5617c-e074-40e2-961a-27e0db7198df on nch2-master-1 Aug 06 20:56:41.704027 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-08874c44-9cef-46b4-a090-41a2f1f4bbe3 req-702caad6-5a30-40e1-98c7-4ce67b7a6e35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154364 Aug 06 20:56:41.714088 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 480/971] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:41.721441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-890234f5-444f-47ed-8cec-8c4215ca5093 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729daae0d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:41.789159 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-890234f5-444f-47ed-8cec-8c4215ca5093 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.072893 Aug 06 20:56:41.790877 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 481/972] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:41 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:41.802578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:41.803749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:41.834426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:41.837349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:41.838143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:41.843836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:41.845124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:41.845753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:41.872443 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df HTTP/1.1 Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:56:41.876465 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:56:41.878199 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '33d5617c-e074-40e2-961a-27e0db7198df'} Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:41.879894 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:56:41.881620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:41.885810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:41.890354 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-76a45369-b72a-4d4f-b88b-eb570aa20c7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 404 len: 111 microversion: 2.1 time: 0.097979 Aug 06 20:56:41.902145 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 482/973] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:41 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:56:41.915876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:41.918001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:41.934957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:41.935886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:41.936511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:41.937421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:41.939135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:41.941114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:42.124792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:42.137363 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cd13b227-92e6-4ee1-9fcc-4e9fb80fa536 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.877239 Aug 06 20:56:42.142012 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 492/974] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:41 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:42.155759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d2832427-635a-45d7-b337-aa901b21199c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'create', calling method: .version_select at 0x7f729dd4fdc0>, body: {"keypair": {"name": "tempest-keypair-1978650633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuKlXMgym0fs8yZvnwnxLQktiY8vNErz1FbhqHA37G5Vj2LaPSjsbcavpbiGxRA+DZkTi5z98Y6dqS1cUCzElDNpodP76HZjUrZY81vY2M3fh4Vwg+/1C62jsrfoLCYeA=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:42.219312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d2832427-635a-45d7-b337-aa901b21199c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Getting quotas for project 8fd242c56a3f436c9cf158e68253218c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:42.239759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d2832427-635a-45d7-b337-aa901b21199c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Getting quotas for user dff69a9a061a454685cfc57c1675f4b9 and project 8fd242c56a3f436c9cf158e68253218c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:42.275582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:42.310371 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d2832427-635a-45d7-b337-aa901b21199c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167027 Aug 06 20:56:42.312655 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 493/975] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 20:56:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:42.322197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:42.324579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:42.338087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:42.339637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:42.346148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:42.347649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:42.348624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:42.350971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:42.468124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:42.469965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:42.470438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:42.473730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lazy-loading 'fault' on Instance uuid 38c38326-9f95-435f-a2c9-7acac5f45a48 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:56:42.603151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:42.633900 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fbc0629f-8687-4046-b757-e66983d3d4ec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1317 microversion: 2.1 time: 0.729659 Aug 06 20:56:42.643066 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 483/976] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:41 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1317 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:42.660029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:42.661454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:42.674138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:42.674935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:42.675681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:42.676640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:42.684213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:42.684950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:43.111772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:43.125633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:43.130050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9067baeaf4a422b85297540fa940079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60674e881dc407296dd58e190b26164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:43.159427 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f67dcd77-67d0-4a95-a319-e336e5c00f0d tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 200 len: 1448 microversion: 2.75 time: 0.838759 Aug 06 20:56:43.164659 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 494/977] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:42 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 1448 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:56:43.177029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8f467c6c-3219-4265-b62b-85aadd57e724 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dd0ff70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:43.263702 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8f467c6c-3219-4265-b62b-85aadd57e724 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.096998 Aug 06 20:56:43.264777 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 495/978] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:43 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:43.359610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:43.574946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:43.583425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:43.589871 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e6829e9-dc24-469c-a4ed-41f670dd5922 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.945334 Aug 06 20:56:43.590785 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 484/979] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:42 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:43.610459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:43.616314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:43.643764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:43.645055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:43.646361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:43.647222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:43.652546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:43.653105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:43.780913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f22e2e4-2cd4-45ba-8b29-296c1a0c5688 tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] Action: 'create', calling method: .version_select at 0x7f729ddba160>, body: {"security_group": {"name": "tempest-securitygroup-1987921460", "description": "tempest-description-1713442781"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:44.016377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:44.029515 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dabb5b99-665a-4b23-b260-0072b295e2d5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.436574 Aug 06 20:56:44.031290 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 485/980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:43 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:44.037869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:44.039101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:44.052229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:44.054308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:44.055080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:44.056106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:44.057037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:44.057708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:44.251629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:44.264798 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd7fc081-69d5-4fd2-9dfd-58a492797123 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1317 microversion: 2.1 time: 0.231560 Aug 06 20:56:44.266035 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 486/981] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:44 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:44.268729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=11 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:44.273460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5aee2080-ac29-4dd5-883e-4523f6ec96f0 req-89e8e4ff-7b8a-484f-a2fe-b0a27ce917a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87d6735-5d42-4f96-aac5-55b50a1a804f", "tag": "270cefb5-0f7a-43e8-8015-bdf5afc1c875"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:44.292487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5aee2080-ac29-4dd5-883e-4523f6ec96f0 req-89e8e4ff-7b8a-484f-a2fe-b0a27ce917a9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:44.293137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5aee2080-ac29-4dd5-883e-4523f6ec96f0 req-89e8e4ff-7b8a-484f-a2fe-b0a27ce917a9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:44.294352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5aee2080-ac29-4dd5-883e-4523f6ec96f0 req-89e8e4ff-7b8a-484f-a2fe-b0a27ce917a9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:44.312088 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5aee2080-ac29-4dd5-883e-4523f6ec96f0 req-89e8e4ff-7b8a-484f-a2fe-b0a27ce917a9 service nova] Creating event network-changed:270cefb5-0f7a-43e8-8015-bdf5afc1c875 for instance a87d6735-5d42-4f96-aac5-55b50a1a804f on nch2-master-1 Aug 06 20:56:44.318628 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5aee2080-ac29-4dd5-883e-4523f6ec96f0 req-89e8e4ff-7b8a-484f-a2fe-b0a27ce917a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050926 Aug 06 20:56:44.322794 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 487/982] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:44.329163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bfe60e78-0f5a-4d43-949d-38d889284a9e req-9446b532-4e0e-4481-9cf3-b79ba3569484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3430daca-5138-453b-ac23-d26121ec1723", "tag": "60b0a41b-3a28-4cea-8be3-d62d09a8354e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:44.344451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bfe60e78-0f5a-4d43-949d-38d889284a9e req-9446b532-4e0e-4481-9cf3-b79ba3569484 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:44.345251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bfe60e78-0f5a-4d43-949d-38d889284a9e req-9446b532-4e0e-4481-9cf3-b79ba3569484 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:44.345929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bfe60e78-0f5a-4d43-949d-38d889284a9e req-9446b532-4e0e-4481-9cf3-b79ba3569484 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:44.359604 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bfe60e78-0f5a-4d43-949d-38d889284a9e req-9446b532-4e0e-4481-9cf3-b79ba3569484 service nova] Creating event network-changed:60b0a41b-3a28-4cea-8be3-d62d09a8354e for instance 3430daca-5138-453b-ac23-d26121ec1723 on nch1-master-1 Aug 06 20:56:44.378314 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bfe60e78-0f5a-4d43-949d-38d889284a9e req-9446b532-4e0e-4481-9cf3-b79ba3569484 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040907 Aug 06 20:56:44.380255 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 488/983] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:44.396304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:44.397440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] [instance: 38c38326-9f95-435f-a2c9-7acac5f45a48] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:44.412753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:44.416726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:44.418498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:44.421723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:44.422436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:44.423114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:44.445004 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] HTTP exception thrown: Instance 38c38326-9f95-435f-a2c9-7acac5f45a48 could not be found. Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Request method failure captured: Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 HTTP/1.1 Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUvRGDJmvsy9BuQmbyyEs6dRpmp-W95X3GohVmSKp7zw4caghpq5Upqhy10oKziLHdNqqJnsikHj_qNMknK-9iNVOq3GULawdaKTqC6byHopTwtzzT3eOwcsnmw-EJrXnu5Hf09tA_aeQltT5wv3kaBRcILpioyckm3vuRFXv0FJQQ Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.75 Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f60674e881dc407296dd58e190b26164 Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersAdmin275Test-154836656 Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:56:44.447717 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f60674e881dc407296dd58e190b26164"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f60674e881dc407296dd58e190b26164", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f60674e881dc407296dd58e190b26164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f60674e881dc407296dd58e190b26164"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersAdmin275Test-154836656 Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f60674e881dc407296dd58e190b26164 Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersAdmin275Test-154836656 Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersAdmin275Test-154836656-project Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e9067baeaf4a422b85297540fa940079 Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersAdmin275Test-154836656-project Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 38c38326-9f95-435f-a2c9-7acac5f45a48 could not be found. Aug 06 20:56:44.449221 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '38c38326-9f95-435f-a2c9-7acac5f45a48'} Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c38326-9f95-435f-a2c9-7acac5f45a48 could not be found. Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:56:44.449984 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c38326-9f95-435f-a2c9-7acac5f45a48 could not be found. Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c38326-9f95-435f-a2c9-7acac5f45a48 could not be found. Aug 06 20:56:44.451235 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:56:44.453799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] Returning 404 to user: Instance 38c38326-9f95-435f-a2c9-7acac5f45a48 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:56:44.455618 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eac7a906-80c1-40c0-8b58-dd2cec1b6b48 tempest-ServersAdmin275Test-154836656 tempest-ServersAdmin275Test-154836656-project] 10.222.0.33 "GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48" status: 404 len: 111 microversion: 2.75 time: 0.072879 Aug 06 20:56:44.456409 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 489/984] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:56:44 2022] GET /compute/v2.1/servers/38c38326-9f95-435f-a2c9-7acac5f45a48 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:56:44.463420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb881140-d03a-43ed-a4f3-068a7f0a5666 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729daaea60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:44.471032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=12 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:44.524959 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb881140-d03a-43ed-a4f3-068a7f0a5666 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.066863 Aug 06 20:56:44.527032 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 490/985] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:44 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:44.619996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:44.621236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:44.636341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:44.639069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:44.641631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:44.643962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:44.647234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:44.650189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:45.332300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:45.341428 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c5480e66-4242-4eb4-89a4-dc47afff7fb7 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.725479 Aug 06 20:56:45.347072 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 491/986] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:44 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:45.364998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:45.365854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:45.373114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:45.373908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:45.374688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:45.375672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:45.376344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:45.377025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:45.606520 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f22e2e4-2cd4-45ba-8b29-296c1a0c5688 tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.340072 Aug 06 20:56:45.608221 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 496/987] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:56:43 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:45.623922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:45.636592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:45.661267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:45.662575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:45.663174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:45.663987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:45.667052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:45.667052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:45.820069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:45.835398 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4f01615e-c353-403f-8018-a8f2814b032d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.486130 Aug 06 20:56:45.838447 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 492/988] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:45 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:45.845466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-73f07258-adbb-4d5d-9453-72f8a2b1f4cb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729daceca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:45.918385 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-73f07258-adbb-4d5d-9453-72f8a2b1f4cb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.078255 Aug 06 20:56:45.919980 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 493/989] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:45 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:45.928006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16a3daf4-66f7-4d1d-8e74-e79b383d3d87 tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] Action: 'create', calling method: .version_select at 0x7f729db5a310>, body: {"security_group": {"name": "tempest-securitygroup-1176163922", "description": "tempest-description-60850647"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:46.291031 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16a3daf4-66f7-4d1d-8e74-e79b383d3d87 tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.369034 Aug 06 20:56:46.291942 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 494/990] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:56:45 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:46.339713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:46.356747 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-194f0bf2-cc4f-4dc4-94b4-54e83349864f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1317 microversion: 2.1 time: 0.736379 Aug 06 20:56:46.359694 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 497/991] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:45 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:46.391662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:46.393089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:46.401383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:46.401896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:46.402348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:46.403102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:46.403626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:46.404597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:46.614974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:46.643258 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ed7d1026-5e6f-42a1-ad4d-25a47d400713 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.279030 Aug 06 20:56:46.654769 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 498/992] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:46 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:46.679028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b341222e-e2c7-41df-a2ce-2ba67a0543a4 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] Action: 'create', calling method: .version_select at 0x7f729db09430>, body: {"security_group": {"name": "tempest-securitygroup-65139297", "description": "tempest-description-423307987"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:46.689235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f13e4d7c-4fd7-49e9-afcd-8df574ad1fc3 req-f79b5a37-b3d0-4ae9-9c30-3455bdde69f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bd8825-f9af-4d7f-b63e-25909fe77863", "tag": "7d823470-4659-430a-ac3f-9fa524a8441e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:46.725639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f13e4d7c-4fd7-49e9-afcd-8df574ad1fc3 req-f79b5a37-b3d0-4ae9-9c30-3455bdde69f3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:46.732456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f13e4d7c-4fd7-49e9-afcd-8df574ad1fc3 req-f79b5a37-b3d0-4ae9-9c30-3455bdde69f3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:46.733167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f13e4d7c-4fd7-49e9-afcd-8df574ad1fc3 req-f79b5a37-b3d0-4ae9-9c30-3455bdde69f3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:46.765406 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f13e4d7c-4fd7-49e9-afcd-8df574ad1fc3 req-f79b5a37-b3d0-4ae9-9c30-3455bdde69f3 service nova] Creating event network-changed:7d823470-4659-430a-ac3f-9fa524a8441e for instance 35bd8825-f9af-4d7f-b63e-25909fe77863 on nch1-master-1 Aug 06 20:56:46.772619 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f13e4d7c-4fd7-49e9-afcd-8df574ad1fc3 req-f79b5a37-b3d0-4ae9-9c30-3455bdde69f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115584 Aug 06 20:56:46.778777 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 499/993] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:46.862483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:46.865373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:46.891597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:46.897414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:46.897964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:46.898760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:46.899229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:46.899661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:47.109331 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b341222e-e2c7-41df-a2ce-2ba67a0543a4 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.807475 Aug 06 20:56:47.110271 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 495/994] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:56:46 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:56:47.115203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:47.130483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1027025944", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:47.141411 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b8fcb99-860d-4438-8a6d-30fc2065748d tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.284279 Aug 06 20:56:47.161327 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 500/995] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:46 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:47.176210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-89025e03-9514-4228-9b78-0901bb2b4d96 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dd98e50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:47.258774 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-89025e03-9514-4228-9b78-0901bb2b4d96 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.095289 Aug 06 20:56:47.267185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] validate_networks() for [('5d497235-5173-4b4c-802d-29c9feaf9b47', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:56:47.273775 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 501/996] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:47 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:47.278499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdffbec8-b07d-4a55-a0d7-e5bb60e0d1a8 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] Action: 'create', calling method: .version_select at 0x7f729dd46ee0>, body: {"security_group": {"name": "tempest-securitygroup-1234482285", "description": "tempest-description-152906453"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:47.579103 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fdffbec8-b07d-4a55-a0d7-e5bb60e0d1a8 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.304080 Aug 06 20:56:47.579960 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 502/997] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:56:47 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:47.585039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:47.585977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:47.609716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:47.611277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:47.611788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:47.612539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:47.613562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:47.614006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:47.854777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:47.867593 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-32eca2e9-fed4-4dca-897e-65d53e0e2938 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1317 microversion: 2.1 time: 0.285291 Aug 06 20:56:47.869492 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 503/998] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:47 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:47.887627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-79b611b8-274b-4334-bcea-74ffa16b1b11 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] Calling method '.version_select at 0x7f729dd460d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:47.891272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:47.894925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:47.895477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:47.896094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:47.896521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:47.906047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:47.906887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:47.907616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:47.908546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:47.908998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:47.910123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:47.930403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Getting quotas for project 8fd242c56a3f436c9cf158e68253218c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:47.936621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Getting quotas for user dff69a9a061a454685cfc57c1675f4b9 and project 8fd242c56a3f436c9cf158e68253218c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:47.952201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:56:47.955834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:56:48.029821 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-10fe7c0b-ceec-4c04-b755-de92467d2149 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.914693 Aug 06 20:56:48.038578 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 496/999] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:56:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:56:48.055206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:48.056138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:48.068881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:48.070009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:48.071149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:48.073094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:48.073786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:48.075208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:48.332305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:48.348583 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-277eb84c-8318-488c-bc54-d91375202275 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.306364 Aug 06 20:56:48.349488 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 497/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:48 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:48.359982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b8f92f85-54f1-456b-a5e5-7a9c4c7ce5ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:48.360715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b8f92f85-54f1-456b-a5e5-7a9c4c7ce5ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:48.469294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b8f92f85-54f1-456b-a5e5-7a9c4c7ce5ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:48.477320 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b8f92f85-54f1-456b-a5e5-7a9c4c7ce5ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1225 microversion: 2.1 time: 0.126610 Aug 06 20:56:48.479067 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 498/1001] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:48 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:48.484148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:48.485000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:48.493932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:48.494703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:48.505856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:48.508145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:48.510566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:48.515045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:48.765806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:48.774932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-edaedd95-336d-432c-9bc7-45fbdd8d4769 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.294563 Aug 06 20:56:48.775868 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 499/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:48 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:48.787009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7bd51baf-ddae-4681-813f-7430e66ec900 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729daa60d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:48.895827 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7bd51baf-ddae-4681-813f-7430e66ec900 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.117186 Aug 06 20:56:48.896555 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 500/1003] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:48 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:48.908990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:48.910704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:48.929795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:48.933692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:48.934353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:48.935234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:48.937529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:48.938127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:49.210781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:49.226934 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f1e03d8b-340b-49c2-8d1a-25ddb88276f2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1317 microversion: 2.1 time: 0.328397 Aug 06 20:56:49.239869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 501/1004] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:48 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:49.369974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:49.370700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:49.384913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:49.385726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:49.386380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:49.387338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:49.387975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:49.389001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:49.780851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:49.797441 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a24877cc-93f6-4513-acb9-6370b9781e89 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.431230 Aug 06 20:56:49.798778 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 502/1005] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:49 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:49.804886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:49.805853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:49.824466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:49.825533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:49.825987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:49.827067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:49.830149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:49.831730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:50.040445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:50.052925 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-060f0196-7b78-4202-8c89-317e2bd4c1b6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1295 microversion: 2.1 time: 0.251415 Aug 06 20:56:50.054126 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 503/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:49 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1295 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:50.069087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:50.070784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:50.085848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:50.093092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:50.093790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:50.094769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:50.095612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:50.096384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:50.416344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:50.434964 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-86ca0e73-c3af-4354-a00e-077eeea870bd tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.377667 Aug 06 20:56:50.446596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 504/1007] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:50 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:50.451564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6239d9c1-8779-49fb-835f-6099c2a1fbfb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db5a310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:50.511138 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6239d9c1-8779-49fb-835f-6099c2a1fbfb tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.070908 Aug 06 20:56:50.511912 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 505/1008] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:50 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:50.526882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:50.526882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:50.537594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:50.538043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:50.538837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:50.539576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:50.540738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:50.541214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:50.838757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:50.846786 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3a448d9c-c940-40e1-a97c-ee194858c98e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1317 microversion: 2.1 time: 0.325805 Aug 06 20:56:50.847433 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 506/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:50 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:51.192388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-42295109", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:51.320958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:56:51.729100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:51.730287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:51.730979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:51.731572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:51.732171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:51.749872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:51.750416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:51.753595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:51.759206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:51.761434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:51.761907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:51.794298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Getting quotas for project 1558d5dbaa704f40a3b6436b4b6c0e51. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:51.801789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Getting quotas for user ea7293bc4816483dbcd0f96536814d2c and project 1558d5dbaa704f40a3b6436b4b6c0e51. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:51.827572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:56:51.830830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:56:51.851725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:51.902674 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-76d31f10-a2ef-4036-ae2c-e8b4906eea2a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053554 Aug 06 20:56:51.913469 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 507/1010] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:56:51.913469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:51.913469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:51.921655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:51.922038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:51.922765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:51.923713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:51.924930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:51.925519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:52.041381 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-79b611b8-274b-4334-bcea-74ffa16b1b11 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13603 microversion: 2.1 time: 4.168773 Aug 06 20:56:52.042384 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 504/1011] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Aug 6 20:56:47 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13603 bytes in 4170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:56:52.058806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:52.059702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:52.072486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:52.073405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:52.074026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:52.079884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:52.080461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:52.080909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:52.263956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=34 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:52.265188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:52.278028 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2634492e-6b15-4b23-8ff8-d3fe02c9d2d1 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.372407 Aug 06 20:56:52.283817 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 508/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:51 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:52.295998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-6a12fd92-f1ce-47d8-b4be-12be37bc6823 req-9c31c824-e394-4ca2-af6b-b34286b88bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3430daca-5138-453b-ac23-d26121ec1723", "name": "network-vif-plugged", "status": "completed", "tag": "60b0a41b-3a28-4cea-8be3-d62d09a8354e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:52.321549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:52.329066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6a12fd92-f1ce-47d8-b4be-12be37bc6823 req-9c31c824-e394-4ca2-af6b-b34286b88bdf service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:52.329962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6a12fd92-f1ce-47d8-b4be-12be37bc6823 req-9c31c824-e394-4ca2-af6b-b34286b88bdf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:52.330590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6a12fd92-f1ce-47d8-b4be-12be37bc6823 req-9c31c824-e394-4ca2-af6b-b34286b88bdf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:52.343774 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a16c8482-8447-45c7-ba5d-b3caf06e7afa tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1325 microversion: 2.1 time: 0.299187 Aug 06 20:56:52.344632 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 505/1013] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:52 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:52.352398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:52.353494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:52.358374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-6a12fd92-f1ce-47d8-b4be-12be37bc6823 req-9c31c824-e394-4ca2-af6b-b34286b88bdf service nova] Creating event network-vif-plugged:60b0a41b-3a28-4cea-8be3-d62d09a8354e for instance 3430daca-5138-453b-ac23-d26121ec1723 on nch1-master-1 Aug 06 20:56:52.363415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:52.364531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:52.365272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:52.366563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:52.367248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:52.367915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:52.372635 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-6a12fd92-f1ce-47d8-b4be-12be37bc6823 req-9c31c824-e394-4ca2-af6b-b34286b88bdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086299 Aug 06 20:56:52.376918 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 509/1014] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:52.395624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c0403a5-3384-417d-90a3-d881aafb56d4 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729daae670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:52.511711 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1c0403a5-3384-417d-90a3-d881aafb56d4 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.133483 Aug 06 20:56:52.512610 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 510/1015] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:52 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:52.519456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:52.520623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:52.529260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:52.530161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:52.530825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:52.531738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:52.532365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:52.533009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:52.708194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:52.720015 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5002dcfe-65f2-4eb8-b014-36ddb6b22969 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.373723 Aug 06 20:56:52.735215 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 506/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:52 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:52.749644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-711147861", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:52.842253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:56:53.191012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:56:53.191828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:56:53.191828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:56:53.192250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:56:53.192854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:56:53.195648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:53.203992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:53.204673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:53.205286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:53.206776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:53.207422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:53.208023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:53.211428 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-008398d5-17bb-453d-afbb-afa1924520e2 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1317 microversion: 2.1 time: 0.696576 Aug 06 20:56:53.212155 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 511/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:52 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:53.221554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf7e7b12-5525-4947-945b-dc339658098f tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] Calling method '.version_select at 0x7f729dacef70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:53.255606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Getting quotas for project 1558d5dbaa704f40a3b6436b4b6c0e51. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:56:53.267905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Getting quotas for user ea7293bc4816483dbcd0f96536814d2c and project 1558d5dbaa704f40a3b6436b4b6c0e51. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:56:53.291847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:56:53.296473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:56:53.348769 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bfa55408-e7c1-4e39-8046-51ed97b9eb66 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610520 Aug 06 20:56:53.349879 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 507/1018] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:56:53.356132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d01981cd-433d-4f41-8e8a-021c6c1d978b req-8e550a02-022a-45b3-b037-2517f662d8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "427263c2-5964-4973-bdce-cd5949254cdd", "tag": "5db6450b-21d9-4d3b-8219-6e11c9499b1b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:53.371026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d01981cd-433d-4f41-8e8a-021c6c1d978b req-8e550a02-022a-45b3-b037-2517f662d8f4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:53.371637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d01981cd-433d-4f41-8e8a-021c6c1d978b req-8e550a02-022a-45b3-b037-2517f662d8f4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:53.372099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d01981cd-433d-4f41-8e8a-021c6c1d978b req-8e550a02-022a-45b3-b037-2517f662d8f4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:53.393153 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d01981cd-433d-4f41-8e8a-021c6c1d978b req-8e550a02-022a-45b3-b037-2517f662d8f4 service nova] Creating event network-changed:5db6450b-21d9-4d3b-8219-6e11c9499b1b for instance 427263c2-5964-4973-bdce-cd5949254cdd on nch2-master-1 Aug 06 20:56:53.401750 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d01981cd-433d-4f41-8e8a-021c6c1d978b req-8e550a02-022a-45b3-b037-2517f662d8f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050106 Aug 06 20:56:53.403555 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 508/1019] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:53.411528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:53.414061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:53.424632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:53.426576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:53.427099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:53.428364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:53.428847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:53.429760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:53.682218 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf7e7b12-5525-4947-945b-dc339658098f tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.468442 Aug 06 20:56:53.683174 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 512/1020] 10.222.0.33 () {58 vars in 1191 bytes} [Sat Aug 6 20:56:53 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:53.688278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-99a57e27-cce9-4d52-964e-ac99586febdc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:53.689179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-99a57e27-cce9-4d52-964e-ac99586febdc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:53.717201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:53.737005 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1e6ba624-eb58-4b83-baaf-503f4b95492e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.329724 Aug 06 20:56:53.741325 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 509/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:53 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:53.754114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:53.763509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:53.796411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:53.797095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-99a57e27-cce9-4d52-964e-ac99586febdc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:53.797730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:53.807978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:53.807978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:53.807978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:53.807978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:53.808499 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-99a57e27-cce9-4d52-964e-ac99586febdc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1213 microversion: 2.1 time: 0.122319 Aug 06 20:56:53.808499 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 513/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:53 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:53.813628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b5e8f49b-8a26-4d62-8500-85960b28570e tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db5a3a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:53.880814 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b5e8f49b-8a26-4d62-8500-85960b28570e tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.071164 Aug 06 20:56:53.884262 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 514/1023] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:53 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:53.897445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-856b0953-9240-4e10-8f9d-edfe14cbea04 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] Calling method '.version_select at 0x7f729daa6a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:54.028454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:54.043763 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2120f93f-d2bd-4011-abda-3470402af428 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1325 microversion: 2.1 time: 0.296408 Aug 06 20:56:54.043763 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 510/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:53 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1325 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:54.067479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:54.069260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:54.088297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:54.090110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:54.090582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:54.091321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:54.094245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:54.094908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:54.204305 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-856b0953-9240-4e10-8f9d-edfe14cbea04 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/bbd1b8b8-24b5-47c3-8781-68fe907b830c" status: 202 len: 0 microversion: 2.1 time: 0.317975 Aug 06 20:56:54.205511 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 515/1025] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:56:53 2022] DELETE /compute/v2.1/os-security-groups/bbd1b8b8-24b5-47c3-8781-68fe907b830c => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:56:54.214655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4783c3b3-1a39-436a-a121-a253fc1f9060 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] Calling method '.version_select at 0x7f729daa6e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:54.589709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4783c3b3-1a39-436a-a121-a253fc1f9060 tempest-SecurityGroupsTestAdminJSON-389934510 tempest-SecurityGroupsTestAdminJSON-389934510-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/d742edcb-f3df-4951-99c8-982d704d0a5c" status: 202 len: 0 microversion: 2.1 time: 0.380305 Aug 06 20:56:54.590918 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 516/1026] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:56:54 2022] DELETE /compute/v2.1/os-security-groups/d742edcb-f3df-4951-99c8-982d704d0a5c => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:56:54.596168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:54.597995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:54.624491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:54.626887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:54.627351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:54.633922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:54.650269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:54.652021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:54.654914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:54.666161 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-66360c7f-10d4-4c1c-805e-1c4b5fcb0a50 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.611344 Aug 06 20:56:54.669306 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 511/1027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:54 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:54.679619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-4fbaa6d8-a6aa-4ca8-9e70-d0e5f33d6d36 req-a62a9046-5cb3-43c1-87e9-7d838ff7f5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bd8825-f9af-4d7f-b63e-25909fe77863", "name": "network-vif-plugged", "status": "completed", "tag": "7d823470-4659-430a-ac3f-9fa524a8441e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:54.705551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4fbaa6d8-a6aa-4ca8-9e70-d0e5f33d6d36 req-a62a9046-5cb3-43c1-87e9-7d838ff7f5e1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:54.709370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4fbaa6d8-a6aa-4ca8-9e70-d0e5f33d6d36 req-a62a9046-5cb3-43c1-87e9-7d838ff7f5e1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:54.710097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4fbaa6d8-a6aa-4ca8-9e70-d0e5f33d6d36 req-a62a9046-5cb3-43c1-87e9-7d838ff7f5e1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:54.732928 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-4fbaa6d8-a6aa-4ca8-9e70-d0e5f33d6d36 req-a62a9046-5cb3-43c1-87e9-7d838ff7f5e1 service nova] Creating event network-vif-plugged:7d823470-4659-430a-ac3f-9fa524a8441e for instance 35bd8825-f9af-4d7f-b63e-25909fe77863 on nch1-master-1 Aug 06 20:56:54.739289 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-4fbaa6d8-a6aa-4ca8-9e70-d0e5f33d6d36 req-a62a9046-5cb3-43c1-87e9-7d838ff7f5e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068071 Aug 06 20:56:54.740133 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 512/1028] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:54.746434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-83880b5b-348b-4fa2-9367-b36f62cfe9a4 tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] Calling method '.version_select at 0x7f729dde30d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:54.850823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:54.860954 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-85261e50-83fe-4dbd-9fd4-b285c3de62e0 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1467 microversion: 2.1 time: 0.267992 Aug 06 20:56:54.861731 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 517/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:54 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1467 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:54.867390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:54.868166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:54.889702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:54.890228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:54.894235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:54.896165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:54.897505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:54.898564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:54.934147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:55.215839 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-83880b5b-348b-4fa2-9367-b36f62cfe9a4 tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e499321d-424e-419e-beb5-8d8f44c38627" status: 202 len: 0 microversion: 2.1 time: 0.474111 Aug 06 20:56:55.216441 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 513/1030] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:56:54 2022] DELETE /compute/v2.1/os-security-groups/e499321d-424e-419e-beb5-8d8f44c38627 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:56:55.226085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:55.226905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:55.242859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:55.243367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:55.243822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:55.244564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:55.245032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:55.245510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:55.250192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:55.294703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:55.311856 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-af08eb56-41d7-4601-ae71-d1636d5d31f8 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.447942 Aug 06 20:56:55.322614 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 518/1031] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:54 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:55.322614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-beffbf9d-d420-4f36-b6a8-3935a83122e9 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:55.322614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-beffbf9d-d420-4f36-b6a8-3935a83122e9 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:55.331643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beffbf9d-d420-4f36-b6a8-3935a83122e9 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:55.332114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beffbf9d-d420-4f36-b6a8-3935a83122e9 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:55.332645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beffbf9d-d420-4f36-b6a8-3935a83122e9 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:55.333214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beffbf9d-d420-4f36-b6a8-3935a83122e9 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:55.333689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beffbf9d-d420-4f36-b6a8-3935a83122e9 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:55.334098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beffbf9d-d420-4f36-b6a8-3935a83122e9 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:55.427246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:55.441356 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c1d458aa-5638-44d2-90db-23ac5ce6fd90 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1271 microversion: 2.1 time: 0.220742 Aug 06 20:56:55.442500 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 514/1032] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:55 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:55.451037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8a7378b9-3399-4b63-8a1b-ad376be46a93 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dd259d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:55.564669 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8a7378b9-3399-4b63-8a1b-ad376be46a93 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.120839 Aug 06 20:56:55.572372 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 515/1033] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:55 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:55.577461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:55.578299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:55.585945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:55.586754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:55.587393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:55.588368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:55.588991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:55.589588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:55.686860 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-beffbf9d-d420-4f36-b6a8-3935a83122e9 tempest-ServersOnMultiNodesTest-971822849 tempest-ServersOnMultiNodesTest-971822849-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1618 microversion: 2.1 time: 0.372454 Aug 06 20:56:55.687648 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 519/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:55 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1618 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:55.698882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74cde019-33ed-4fb9-a7fd-62d27f4c1491 tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] Calling method '.version_select at 0x7f729dab4040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:56.312141 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74cde019-33ed-4fb9-a7fd-62d27f4c1491 tempest-SecurityGroupsTestAdminJSON-1228882060 tempest-SecurityGroupsTestAdminJSON-1228882060-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/2e8cd2fc-b8c1-4486-9c3f-ebe86318c306" status: 202 len: 0 microversion: 2.1 time: 0.622520 Aug 06 20:56:56.312876 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 520/1035] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:56:55 2022] DELETE /compute/v2.1/os-security-groups/2e8cd2fc-b8c1-4486-9c3f-ebe86318c306 => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:56:56.322960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:56.323811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:56.352702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:56.353792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:56.357151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:56.358248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:56.362414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:56.363227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:56.420342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:56.430370 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21989935-7aba-4e6a-ad82-280e7eb5dd51 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1325 microversion: 2.1 time: 0.856659 Aug 06 20:56:56.431213 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 516/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:55 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1325 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:56.437579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:56.438852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:56.454960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:56.456419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:56.457073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:56.458008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:56.458686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:56.459324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:56.504386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:56:56.715162 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d462d82b-51c2-426d-8c65-7b82a85ff561 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 204 len: 0 microversion: 2.1 time: 0.276652 Aug 06 20:56:56.717733 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 517/1037] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:56:56 2022] DELETE /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:56:56.736516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:56.738279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:56.756446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:56.757068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:56.757571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:56.758378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:56.761350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:56.762098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:56.769672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:56.786445 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2251562b-e9bd-4a21-a245-a27fe9bac491 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.472056 Aug 06 20:56:56.789956 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 521/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:56 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:56.802463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:56.805244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:56.821464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:56.822226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:56.825283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:56.826257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:56.827006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:56.828916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:56.991574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:57.004697 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e101c27-7f25-463b-8040-480e2624146d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1271 microversion: 2.1 time: 0.210215 Aug 06 20:56:57.022593 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 522/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:56 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:57.036673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9e887331-03da-4c5a-9493-11768d87de75 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db5a550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:57.110275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9e887331-03da-4c5a-9493-11768d87de75 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1428 microversion: 2.1 time: 0.083956 Aug 06 20:56:57.120523 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 523/1040] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:57 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:57.132100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:57.133989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:57.147718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:57.149353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:57.150016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:57.153426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:57.154593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:57.155194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:57.369378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:57.385007 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-82f7bd67-ba72-463e-8a85-b82d63685dce tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1388 microversion: 2.1 time: 0.665721 Aug 06 20:56:57.385975 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 518/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:56 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1388 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:57.451634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:57.453241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:57.457440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:57.473167 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba19283a-195c-4de8-93d0-f15d2eae65fe tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1473 microversion: 2.1 time: 0.350809 Aug 06 20:56:57.477131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:57.478288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:57.479529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:57.481089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:57.481750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:57.482379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:57.490869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 524/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:57 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1473 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:57.714906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:57.723059 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8a21a01-ae77-43df-a021-c8d1a2e95cdf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1325 microversion: 2.1 time: 0.274718 Aug 06 20:56:57.724133 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 519/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:57 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1325 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:56:57.814920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:57.815660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:57.823327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:57.824150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:57.824599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:57.825301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:57.825757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:57.826249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.026677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:58.030791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:58.031912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:58.039802 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a74aa6a6-d593-4ba5-8be4-7a62c0a60670 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.227865 Aug 06 20:56:58.040321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.041052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.041426 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 525/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:57 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:58.043052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.044316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.044944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.045530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.130902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a9f2f25-b8da-467c-9f5f-ab0eca1212d4 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729daa6280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:58.220250 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a9f2f25-b8da-467c-9f5f-ab0eca1212d4 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1437 microversion: 2.1 time: 0.097577 Aug 06 20:56:58.230320 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 526/1045] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:58 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1437 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:58.235780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-611966f9-b931-4985-aa51-250d164a97c6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729db6a8b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:58.296651 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-611966f9-b931-4985-aa51-250d164a97c6 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 200 len: 1437 microversion: 2.1 time: 0.064640 Aug 06 20:56:58.297362 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 527/1046] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:56:58 2022] GET /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 1437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:58.312221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ab365410-87d8-49eb-ad4d-42876b10a183 req-94e80a84-ef83-46c1-84e0-4afd1c36023c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427263c2-5964-4973-bdce-cd5949254cdd", "name": "network-vif-plugged", "status": "completed", "tag": "5db6450b-21d9-4d3b-8219-6e11c9499b1b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:58.333742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ab365410-87d8-49eb-ad4d-42876b10a183 req-94e80a84-ef83-46c1-84e0-4afd1c36023c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.334587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ab365410-87d8-49eb-ad4d-42876b10a183 req-94e80a84-ef83-46c1-84e0-4afd1c36023c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.335984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ab365410-87d8-49eb-ad4d-42876b10a183 req-94e80a84-ef83-46c1-84e0-4afd1c36023c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.361771 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ab365410-87d8-49eb-ad4d-42876b10a183 req-94e80a84-ef83-46c1-84e0-4afd1c36023c service nova] Creating event network-vif-plugged:5db6450b-21d9-4d3b-8219-6e11c9499b1b for instance 427263c2-5964-4973-bdce-cd5949254cdd on nch2-master-1 Aug 06 20:56:58.385247 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ab365410-87d8-49eb-ad4d-42876b10a183 req-94e80a84-ef83-46c1-84e0-4afd1c36023c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082926 Aug 06 20:56:58.386157 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 528/1047] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:58.397167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:58.401916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:58.420530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.422954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.423686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.424733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.427781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.430114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.475812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:58.490251 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d377a10a-63aa-40f2-bfc9-088ab216ccaa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1313 microversion: 2.1 time: 0.465153 Aug 06 20:56:58.501394 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 520/1048] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:58 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:58.507771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:58.508560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:58.514965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.515843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.516460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.517339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.518051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.519313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.755063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:58.766053 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-41773a26-4a36-4d55-ad07-c8957720331b tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1587 microversion: 2.1 time: 0.263314 Aug 06 20:56:58.766732 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 521/1049] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:58 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1587 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:58.789456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:58.795145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:58.795779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:58.800282 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4c767fec-16f5-427b-9115-929f69ad6dbf tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1466 microversion: 2.1 time: 0.410830 Aug 06 20:56:58.800974 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 529/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:58 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1466 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:58.809462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.810628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.811366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:58.811997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.818985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.820581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.821784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:58.822250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.832351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.833074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.833723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:58.834647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:58.835255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:58.835862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:59.069776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:59.077529 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5aca65ca-9fe4-4de3-ba19-fd30a967bc1e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1325 microversion: 2.1 time: 0.275542 Aug 06 20:56:59.078920 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 530/1051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:58 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1325 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:59.084491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-affa3d18-b9e1-4904-ab82-912050fc36b0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:59.085000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-affa3d18-b9e1-4904-ab82-912050fc36b0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:59.091202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-affa3d18-b9e1-4904-ab82-912050fc36b0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:59.091908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-affa3d18-b9e1-4904-ab82-912050fc36b0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:59.092922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-affa3d18-b9e1-4904-ab82-912050fc36b0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:59.093805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-affa3d18-b9e1-4904-ab82-912050fc36b0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:59.094435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-affa3d18-b9e1-4904-ab82-912050fc36b0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:59.095046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-affa3d18-b9e1-4904-ab82-912050fc36b0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:59.203448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:59.213327 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46856ed5-81af-4b48-b379-a170b4fcf172 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 200 len: 1473 microversion: 2.1 time: 0.430960 Aug 06 20:56:59.218675 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 522/1052] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:58 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 1473 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:59.228167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d56930e-00ad-4c22-abe6-e63c72b83bb3 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dde30d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:59.312333 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-affa3d18-b9e1-4904-ab82-912050fc36b0 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232029 Aug 06 20:56:59.313757 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 531/1053] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 20:56:59 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:59.326757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:59.327732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:59.336830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:59.338471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:59.339259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:59.340174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:59.341018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:59.341686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:59.716554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:56:59.725323 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eed11978-fc1b-4048-a028-a5fd9e6fdbcb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.410071 Aug 06 20:56:59.729051 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 532/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:59 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:56:59.745525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-14cb2f1a-7617-4c27-ae93-76afcea719eb req-5d5a5661-e710-44a1-ac77-db9ac7b2be34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3430daca-5138-453b-ac23-d26121ec1723", "name": "network-vif-deleted", "tag": "60b0a41b-3a28-4cea-8be3-d62d09a8354e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:56:59.770737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-14cb2f1a-7617-4c27-ae93-76afcea719eb req-5d5a5661-e710-44a1-ac77-db9ac7b2be34 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:59.771216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-14cb2f1a-7617-4c27-ae93-76afcea719eb req-5d5a5661-e710-44a1-ac77-db9ac7b2be34 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:59.771648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-14cb2f1a-7617-4c27-ae93-76afcea719eb req-5d5a5661-e710-44a1-ac77-db9ac7b2be34 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:59.795952 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-14cb2f1a-7617-4c27-ae93-76afcea719eb req-5d5a5661-e710-44a1-ac77-db9ac7b2be34 service nova] Creating event network-vif-deleted:60b0a41b-3a28-4cea-8be3-d62d09a8354e for instance 3430daca-5138-453b-ac23-d26121ec1723 on nch1-master-1 Aug 06 20:56:59.803073 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-14cb2f1a-7617-4c27-ae93-76afcea719eb req-5d5a5661-e710-44a1-ac77-db9ac7b2be34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071361 Aug 06 20:56:59.813707 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 533/1055] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:59.820661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:56:59.821494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:56:59.831891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:59.833879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:59.835147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:56:59.836902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:56:59.837623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:56:59.838374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.131327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:00.141800 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-808523c7-1fa6-4d73-8a39-2b32b26653d2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1313 microversion: 2.1 time: 0.326342 Aug 06 20:57:00.161932 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 534/1056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:59 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:00.169105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2facbc9f-98a8-46bf-8447-f686b1835a25 req-a8ea8c7e-a21c-45ef-b367-74aa5065c603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a", "tag": "bdd3d1a4-abad-49cb-b7ea-1c1d4d3bba83"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:00.184602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2facbc9f-98a8-46bf-8447-f686b1835a25 req-a8ea8c7e-a21c-45ef-b367-74aa5065c603 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.185449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2facbc9f-98a8-46bf-8447-f686b1835a25 req-a8ea8c7e-a21c-45ef-b367-74aa5065c603 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.186195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2facbc9f-98a8-46bf-8447-f686b1835a25 req-a8ea8c7e-a21c-45ef-b367-74aa5065c603 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.202036 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2facbc9f-98a8-46bf-8447-f686b1835a25 req-a8ea8c7e-a21c-45ef-b367-74aa5065c603 service nova] Creating event network-changed:bdd3d1a4-abad-49cb-b7ea-1c1d4d3bba83 for instance 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a on nch1-master-1 Aug 06 20:57:00.207608 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2facbc9f-98a8-46bf-8447-f686b1835a25 req-a8ea8c7e-a21c-45ef-b367-74aa5065c603 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044055 Aug 06 20:57:00.209121 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 535/1057] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:00.216492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:00.217199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:00.227417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.228237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.228923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.229903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.230859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.231977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.300237 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4d56930e-00ad-4c22-abe6-e63c72b83bb3 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "DELETE /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d" status: 204 len: 0 microversion: 2.1 time: 1.078374 Aug 06 20:57:00.301570 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 523/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:56:59 2022] DELETE /compute/v2.1/images/99110b08-a8c6-4cdd-b83e-9147ad37911d => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:00.311167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:00.312132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3430daca-5138-453b-ac23-d26121ec1723] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:00.319933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.320811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.321496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.322702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.323514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.324307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.342154 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] HTTP exception thrown: Instance 3430daca-5138-453b-ac23-d26121ec1723 could not be found. Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Request method failure captured: Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 HTTP/1.1 Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUEMYCUboqC3YtaC8K6tYR4k23m1Yp-GKm2f3ElGr7nYavjPnmtCYNjrOtwKV2c2d_bUl2zrsasXf7RLD66h4PykGKdl-I33sHcIWXFp5f_ik2QHXjE3KeHf4NIh4r2awFQxsyCFstJRqR5WtKFkb4V4eXFSyID7LQQfqLJkDTWlc0 Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:00.343976 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0e3164f8b4943eeb85883a0fa08efaa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 10aebae8bbbd4ea88b9cbf85d3438ed1 Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 3430daca-5138-453b-ac23-d26121ec1723 could not be found. Aug 06 20:57:00.345593 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '3430daca-5138-453b-ac23-d26121ec1723'} Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3430daca-5138-453b-ac23-d26121ec1723 could not be found. Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:00.346629 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3430daca-5138-453b-ac23-d26121ec1723 could not be found. Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3430daca-5138-453b-ac23-d26121ec1723 could not be found. Aug 06 20:57:00.348133 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.364696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Returning 404 to user: Instance 3430daca-5138-453b-ac23-d26121ec1723 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:00.368093 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6da4c3ce-d30b-4097-b382-cdb3a50d9cf1 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723" status: 404 len: 111 microversion: 2.1 time: 0.060842 Aug 06 20:57:00.369811 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 524/1059] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:00 2022] GET /compute/v2.1/servers/3430daca-5138-453b-ac23-d26121ec1723 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:00.379617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-952fa387-661b-4fae-9416-7c1c2c5fc675 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '.version_select at 0x7f729dd0f790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:00.452576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:00.460521 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-952fa387-661b-4fae-9416-7c1c2c5fc675 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] HTTP exception thrown: Image not found. Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-952fa387-661b-4fae-9416-7c1c2c5fc675 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Request method failure captured: Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c HTTP/1.1 Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVLEIvWlOKBVbbmLAAR0lMlQTgeB7afqmPz9cAYB2PEGuQLcitddQvt-uuNP2Fsc6rKY2GviZBixPFZmjRmOAkJ_IYSD9pXFRISGmFQrpoXOvwFwuX3sZWlgHRpuQq_4RsigYSP8-tQmpvFq_SYB_YFsIwHtDChe_GTRHUu-Vpdewg Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7397d6b602604e2caa60f16aee28c950 Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerTestJSON-1524795796 Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:00.463633 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7397d6b602604e2caa60f16aee28c950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7397d6b602604e2caa60f16aee28c950", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7397d6b602604e2caa60f16aee28c950"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7397d6b602604e2caa60f16aee28c950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerTestJSON-1524795796 Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7397d6b602604e2caa60f16aee28c950 Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1524795796 Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerTestJSON-1524795796-project Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 096b2f40a81a4627af9ae5c7b83fc619 Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerTestJSON-1524795796-project Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'a491739a-09ed-40fc-a71b-db92bc42198c'} Aug 06 20:57:00.465272 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a491739a-09ed-40fc-a71b-db92bc42198c to delete Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:00.466276 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a491739a-09ed-40fc-a71b-db92bc42198c could not be found. Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:00.467743 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:57:00.470166 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:00.472444 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b37beb0c-b758-49c6-b642-b43ee468ab70 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1325 microversion: 2.1 time: 0.253522 Aug 06 20:57:00.472576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-952fa387-661b-4fae-9416-7c1c2c5fc675 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:00.474308 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-952fa387-661b-4fae-9416-7c1c2c5fc675 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "DELETE /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c" status: 404 len: 62 microversion: 2.1 time: 0.101932 Aug 06 20:57:00.478079 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 525/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:00 2022] DELETE /compute/v2.1/images/a491739a-09ed-40fc-a71b-db92bc42198c => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:57:00.481843 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 536/1061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:00 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:00.483527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:00.484033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:00.487704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:00.488330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:00.491579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.492318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.492876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.493614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.494077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.494512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.505239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.505616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.506132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.506955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.507512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.508170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.537380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:00.540263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:00.640512 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d16b2bda-4996-4e20-8235-d0391daac4ce tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 204 len: 0 microversion: 2.1 time: 0.160965 Aug 06 20:57:00.642028 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 526/1062] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:00 2022] DELETE /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:00.659698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:00.660973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:00.667110 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a215a5bf-320b-4cb7-b6a3-31857f41fb18 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 204 len: 0 microversion: 2.1 time: 0.184484 Aug 06 20:57:00.669675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.670509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.671290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.672338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.673058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.673845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.678698 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 537/1063] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:00 2022] DELETE /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:00.688631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:00.690443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:00.698783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.701982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.702522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.703619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.704431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.706329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.851373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:00.859098 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-34e57e9d-ec9b-44a0-8a16-a4a4e4dd1fcd tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1472 microversion: 2.1 time: 0.179071 Aug 06 20:57:00.859673 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 538/1064] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:00 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:00.864717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:00.865326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:00.871194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.871681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.872117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:00.872890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:00.873416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:00.873855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.011423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:01.019542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:01.022883 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-43618477-4419-4c5b-93a2-ddcc3f2f30e1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.162213 Aug 06 20:57:01.023765 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 539/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:00 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:01.160268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1020466507", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:01.218462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:57:01.272795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:01.282413 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-05e71bde-00f0-46d5-acb9-3c3b91f19bda tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1473 microversion: 2.1 time: 0.634683 Aug 06 20:57:01.294597 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 527/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:00 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1473 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:01.294597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:01.294597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:01.296358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.297118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.297965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.299114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.300296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.301396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.421235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:57:01.421659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:57:01.422135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:57:01.422568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:57:01.423268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:57:01.439047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.439524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.441991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.442804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.443276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.443711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.463305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Getting quotas for project 61b980ff8dca4c84bb452d09d55c37ef. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:01.468423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Getting quotas for user 46557175a8504db78843b5d56b1413cf and project 61b980ff8dca4c84bb452d09d55c37ef. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:01.480759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:57:01.483433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:57:01.530494 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b63a6b0a-f5ab-4338-9b90-478eb428df08 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504978 Aug 06 20:57:01.530809 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 540/1067] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:57:01.543706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:01.544337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:01.555783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.556314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.556740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.557490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.557957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.558429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.714596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:01.725426 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-59ea0fa1-2e77-4db5-937f-4239a99c6c67 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1522 microversion: 2.1 time: 0.189311 Aug 06 20:57:01.726455 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 541/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:01 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:01.738136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65625040-d12e-4906-8c90-6a11fcadf7b7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:01.739656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-65625040-d12e-4906-8c90-6a11fcadf7b7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:01.760304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:01.769244 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b7143d3d-ef7e-4944-9d62-ae12c174a0ee tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1313 microversion: 2.1 time: 0.483217 Aug 06 20:57:01.782684 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 528/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:01 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:01.789496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:01.790446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:01.797317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.798134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.798935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.800568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.801336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.802211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.813967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-65625040-d12e-4906-8c90-6a11fcadf7b7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:01.823179 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65625040-d12e-4906-8c90-6a11fcadf7b7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1222 microversion: 2.1 time: 0.095139 Aug 06 20:57:01.835001 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 542/1070] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:01 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:01.880936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:01.881893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:01.888479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.888981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.889417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:01.890150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:01.890860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:01.891304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.052121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:02.060524 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c1df9af-c54f-410a-bf19-38daa9fbf7d9 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1522 microversion: 2.1 time: 0.276253 Aug 06 20:57:02.061123 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 529/1071] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:01 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:02.067799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:02.068625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:02.069614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:02.075837 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-517d36c3-7e16-4c49-85be-59b5a23f2d45 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1472 microversion: 2.1 time: 0.198988 Aug 06 20:57:02.078040 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 543/1072] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:01 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:02.083484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fbabce09-1c28-4c46-a8d9-807ac998ec86 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-681578881"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:02.085995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fbabce09-1c28-4c46-a8d9-807ac998ec86 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:02.088996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.089715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.090436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.091393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.092288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.093047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.093186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbabce09-1c28-4c46-a8d9-807ac998ec86 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.093595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbabce09-1c28-4c46-a8d9-807ac998ec86 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.094126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbabce09-1c28-4c46-a8d9-807ac998ec86 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.095033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbabce09-1c28-4c46-a8d9-807ac998ec86 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.095664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbabce09-1c28-4c46-a8d9-807ac998ec86 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.096357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbabce09-1c28-4c46-a8d9-807ac998ec86 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.340036 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fbabce09-1c28-4c46-a8d9-807ac998ec86 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd/action" status: 202 len: 0 microversion: 2.1 time: 0.260027 Aug 06 20:57:02.341420 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 544/1073] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:02 2022] POST /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 20:57:02.352400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f032a83b-51bb-497d-8530-e6d901e56d92 req-aa75d646-be7b-4078-b879-2150089f38ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d99126-c9b5-4b1e-8bb6-92dc1dd048da", "tag": "7aebd8b0-07de-4d6e-88bc-b0ebb90332e3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:02.359209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:02.371584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f032a83b-51bb-497d-8530-e6d901e56d92 req-aa75d646-be7b-4078-b879-2150089f38ef service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.372375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f032a83b-51bb-497d-8530-e6d901e56d92 req-aa75d646-be7b-4078-b879-2150089f38ef service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.372985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f032a83b-51bb-497d-8530-e6d901e56d92 req-aa75d646-be7b-4078-b879-2150089f38ef service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.373632 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2bf9ec65-53f9-4e78-9a28-f2894d4ec9c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.311150 Aug 06 20:57:02.374351 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 530/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:02 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:02.386808 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f032a83b-51bb-497d-8530-e6d901e56d92 req-aa75d646-be7b-4078-b879-2150089f38ef service nova] Creating event network-changed:7aebd8b0-07de-4d6e-88bc-b0ebb90332e3 for instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da on nch1-master-1 Aug 06 20:57:02.391645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-eed4c682-96d0-4eb5-9109-45c2acac646a req-12460abe-0636-4f3c-8962-dafee20e94e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0af8fc-0b76-4863-bb2d-699fc8f3cde9", "name": "network-vif-unplugged", "status": "completed", "tag": "1ae474c0-bff8-4514-9ff0-4e4609198c44"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:02.392795 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f032a83b-51bb-497d-8530-e6d901e56d92 req-aa75d646-be7b-4078-b879-2150089f38ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049249 Aug 06 20:57:02.394905 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 545/1075] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:02.401734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:02.402816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:02.406647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-eed4c682-96d0-4eb5-9109-45c2acac646a req-12460abe-0636-4f3c-8962-dafee20e94e0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.407144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-eed4c682-96d0-4eb5-9109-45c2acac646a req-12460abe-0636-4f3c-8962-dafee20e94e0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.407625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-eed4c682-96d0-4eb5-9109-45c2acac646a req-12460abe-0636-4f3c-8962-dafee20e94e0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.411107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.411934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.412622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.413588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.414270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.414938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.422362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:02.424335 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-eed4c682-96d0-4eb5-9109-45c2acac646a req-12460abe-0636-4f3c-8962-dafee20e94e0 service nova] Creating event network-vif-unplugged:1ae474c0-bff8-4514-9ff0-4e4609198c44 for instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 on nch2-master-1 Aug 06 20:57:02.430609 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-eed4c682-96d0-4eb5-9109-45c2acac646a req-12460abe-0636-4f3c-8962-dafee20e94e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054894 Aug 06 20:57:02.431656 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 531/1076] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:02.439421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:02.440714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:02.447771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.448265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.448771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.449791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.450260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.450739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.576649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:02.585274 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8138392-1862-432a-b0e7-98339cca6295 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1473 microversion: 2.1 time: 0.188853 Aug 06 20:57:02.585853 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 546/1077] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:02 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1473 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:02.592376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-14d8cb5a-538a-46cf-aae3-4207f96b7faf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '.version_select at 0x7f729db5a670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:02.604705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:02.622025 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b668a036-a89b-466a-95e3-7fefa1aa8a96 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1587 microversion: 2.1 time: 0.187440 Aug 06 20:57:02.622817 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 532/1078] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:02 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1587 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:02.728765 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-14d8cb5a-538a-46cf-aae3-4207f96b7faf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/images/263d412d-6a8a-45bb-9ac3-6ad345703929" status: 204 len: 0 microversion: 2.1 time: 0.141495 Aug 06 20:57:02.729340 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 547/1079] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:02 2022] DELETE /compute/v2.1/images/263d412d-6a8a-45bb-9ac3-6ad345703929 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:02.738830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8745c0b7-7918-472f-8d7b-ec3ee99ea4af tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '.version_select at 0x7f729dcb28b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:02.761401 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-8745c0b7-7918-472f-8d7b-ec3ee99ea4af tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Image not found. Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8745c0b7-7918-472f-8d7b-ec3ee99ea4af tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/images/263d412d-6a8a-45bb-9ac3-6ad345703929 HTTP/1.1 Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:02.763610 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '263d412d-6a8a-45bb-9ac3-6ad345703929'} Aug 06 20:57:02.764946 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:57:02.765804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 263d412d-6a8a-45bb-9ac3-6ad345703929 Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:57:02.767006 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 263d412d-6a8a-45bb-9ac3-6ad345703929 could not be found. Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:57:02.769074 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:02.770494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8745c0b7-7918-472f-8d7b-ec3ee99ea4af tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:02.771476 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8745c0b7-7918-472f-8d7b-ec3ee99ea4af tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/images/263d412d-6a8a-45bb-9ac3-6ad345703929" status: 404 len: 62 microversion: 2.1 time: 0.031217 Aug 06 20:57:02.771476 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 533/1080] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:02 2022] GET /compute/v2.1/images/263d412d-6a8a-45bb-9ac3-6ad345703929 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:57:02.774163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:02.774865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:02.782254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.783136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.784319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.785140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.785797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.787287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.789568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:02.790191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:02.797609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.798355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.799606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.800910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.801577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.802225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.947063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:02.957397 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b48609fe-a935-4fca-a44d-dbf4057b5399 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1542 microversion: 2.1 time: 0.186933 Aug 06 20:57:02.958107 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 548/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:02 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1542 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:02.963585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:02.964579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:02.972397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.973295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.973974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:02.974740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:02.975199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:02.975618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:03.063264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:03.071542 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a1050d9-c069-4a0f-817f-2b1f095b3657 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1226 microversion: 2.1 time: 0.111978 Aug 06 20:57:03.072392 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 549/1082] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:02 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:03.102087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:03.102746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:03.109662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:03.110160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:03.110648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:03.112289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:03.113099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:03.113539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:03.217421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:03.265880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:03.275256 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71b49be2-471f-43f2-97db-f6bf8e9f703b tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1472 microversion: 2.1 time: 0.177173 Aug 06 20:57:03.275856 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 550/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:03 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:03.286625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:03.326953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:03.335423 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-80b38919-6c88-4d76-8610-bbfe46fbe722 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1313 microversion: 2.1 time: 0.549812 Aug 06 20:57:03.336180 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 534/1084] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:02 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:03.395295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:03.395907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:03.402759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:03.403259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:03.403696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:03.404395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:03.404853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:03.405334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:03.548383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:03.557643 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6d8566ae-a0d5-4852-9043-e566da028f99 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.166852 Aug 06 20:57:03.562755 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 551/1085] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:03 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:03.607683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:03.608303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:03.615382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:03.615876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:03.616312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:03.617010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:03.617466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:03.617896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:03.747859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:03.756048 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a0cecf12-f773-4ea8-ae0a-b12daad8f067 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1473 microversion: 2.1 time: 0.152310 Aug 06 20:57:03.756626 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 535/1086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:03 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1473 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:03.978250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:03.978881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:03.984947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:03.985432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:03.985870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:03.987751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:03.988228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:03.988661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.092141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:04.092889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:04.100763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.101262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.101709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.102736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.103371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.103811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.119746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:04.129240 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-755b465f-fc92-45e5-8452-170e851b7e7c tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1542 microversion: 2.1 time: 0.154662 Aug 06 20:57:04.129968 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 552/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:03 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1542 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:04.168499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:04.177300 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-288a6125-4d96-4a61-a1aa-a27d3f291ed2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1226 microversion: 2.1 time: 0.088994 Aug 06 20:57:04.177885 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 536/1088] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:04 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:04.297507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:04.298119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:04.307437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.307929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.308363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.309066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.309517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.309937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.355480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:04.356252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:04.359523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:04.365400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.366176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.366639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.369150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.369150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.372211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.559646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:04.568042 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c26a40a-24cf-4e26-beaf-f7456576352f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1313 microversion: 2.1 time: 0.216278 Aug 06 20:57:04.578623 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 537/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:04 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:04.578623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7c07934b-b977-441a-8755-e8e78e015837 req-acb2da3a-3844-4c01-82e4-a86b0b768193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bd8825-f9af-4d7f-b63e-25909fe77863", "tag": "7d823470-4659-430a-ac3f-9fa524a8441e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:04.585571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7c07934b-b977-441a-8755-e8e78e015837 req-acb2da3a-3844-4c01-82e4-a86b0b768193 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.586053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7c07934b-b977-441a-8755-e8e78e015837 req-acb2da3a-3844-4c01-82e4-a86b0b768193 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.586483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7c07934b-b977-441a-8755-e8e78e015837 req-acb2da3a-3844-4c01-82e4-a86b0b768193 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.604691 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7c07934b-b977-441a-8755-e8e78e015837 req-acb2da3a-3844-4c01-82e4-a86b0b768193 service nova] Creating event network-changed:7d823470-4659-430a-ac3f-9fa524a8441e for instance 35bd8825-f9af-4d7f-b63e-25909fe77863 on nch1-master-1 Aug 06 20:57:04.609631 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7c07934b-b977-441a-8755-e8e78e015837 req-acb2da3a-3844-4c01-82e4-a86b0b768193 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038754 Aug 06 20:57:04.610221 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 538/1090] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:04.616411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:04.617561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:04.623253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.623737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.624179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.624878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.625334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.625762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.677274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:04.685979 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78871077-54cc-495c-839c-7c83f1ac5777 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1472 microversion: 2.1 time: 0.392399 Aug 06 20:57:04.687208 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 553/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:04 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:04.764669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:04.778921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:04.780546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:04.783425 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a1b27b38-b818-4401-a5eb-1445f48da610 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.171930 Aug 06 20:57:04.785030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:04.788525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.789017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.789453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.791442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:04.792073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:04.792511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:04.797625 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 539/1092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:04 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:05.155651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:05.156498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:05.167183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.169800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.170253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.171023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.171599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.172534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.210602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:05.222091 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc92cda6-f94b-47d1-afd3-fda31468db33 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1473 microversion: 2.1 time: 0.448390 Aug 06 20:57:05.223808 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 554/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:04 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1473 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:05.230001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:05.230745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:05.238864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.239378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.239817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.241692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.242302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.242797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.349577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:05.360089 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0d7bf1e5-49ad-41b1-9912-59da1af3d86d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1540 microversion: 2.1 time: 0.211414 Aug 06 20:57:05.362790 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 540/1094] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:05 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1540 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:05.368493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:05.385239 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8eb3e0df-6811-4ef0-896f-6befe6623b68 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1280 microversion: 2.1 time: 0.160337 Aug 06 20:57:05.387268 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 555/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:05 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1280 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:05.592306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:05.593480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:05.602302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.603328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.603961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.604906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.605551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.606166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.662760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-07b9ecd3-f847-47f2-88d7-37d8ede72c48 req-46975a1b-7593-4461-8426-424be5022a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0af8fc-0b76-4863-bb2d-699fc8f3cde9", "name": "network-vif-deleted", "tag": "1ae474c0-bff8-4514-9ff0-4e4609198c44"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:05.676003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-07b9ecd3-f847-47f2-88d7-37d8ede72c48 req-46975a1b-7593-4461-8426-424be5022a28 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.676574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-07b9ecd3-f847-47f2-88d7-37d8ede72c48 req-46975a1b-7593-4461-8426-424be5022a28 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.677091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-07b9ecd3-f847-47f2-88d7-37d8ede72c48 req-46975a1b-7593-4461-8426-424be5022a28 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.693287 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-07b9ecd3-f847-47f2-88d7-37d8ede72c48 req-46975a1b-7593-4461-8426-424be5022a28 service nova] Creating event network-vif-deleted:1ae474c0-bff8-4514-9ff0-4e4609198c44 for instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 on nch2-master-1 Aug 06 20:57:05.699155 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-07b9ecd3-f847-47f2-88d7-37d8ede72c48 req-46975a1b-7593-4461-8426-424be5022a28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042496 Aug 06 20:57:05.700191 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 556/1096] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:05.709628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:05.710514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:05.719278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.719853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.720360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.721253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.721727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.722320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.899020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096b2f40a81a4627af9ae5c7b83fc619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7397d6b602604e2caa60f16aee28c950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:05.926224 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6f8ef463-dfee-4e36-90e2-ff84aa7e8b65 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 200 len: 1302 microversion: 2.1 time: 0.221673 Aug 06 20:57:05.928074 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 557/1097] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:05 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 1302 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:05.934864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:05.935841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:05.946366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.947499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.948708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:05.951233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:05.952978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:05.953729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:06.112818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:06.125571 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e9559563-4ba0-44c6-a92f-162809a23fd7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1313 microversion: 2.1 time: 0.535709 Aug 06 20:57:06.130663 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 541/1098] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:05 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:06.244461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:06.245083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:06.255365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:06.255783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:06.256224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:06.264437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:06.266913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:06.268159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:06.293964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:06.310530 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a7ea602-217e-4c78-9c0c-511a5b497ddc tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1542 microversion: 2.1 time: 0.379521 Aug 06 20:57:06.328098 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 558/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:05 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1542 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:06.384094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:06.385718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:06.397092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:06.401053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:06.402008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:06.404084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:06.405144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:06.406118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:06.476485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:06.546889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:06.557406 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f3636a36-9d97-4b2a-8e62-dfc2e7bb6fbf tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 200 len: 1302 microversion: 2.1 time: 0.317626 Aug 06 20:57:06.561494 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 542/1100] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:06 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 1302 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:06.570514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:06.571564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:06.578679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:06.579820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:06.581219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:06.582480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:06.583233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:06.584069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:06.710413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:06.725956 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f3b0995b-22ba-416d-aa1a-c5b2b8bb99bf tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1280 microversion: 2.1 time: 0.162894 Aug 06 20:57:06.726993 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 543/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:06 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:06.951235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:06.952229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] [instance: 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:06.969672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:06.970509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:06.972861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:06.980938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:06.981737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:06.982490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.014443 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] HTTP exception thrown: Instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 could not be found. Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Request method failure captured: Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 HTTP/1.1 Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVLEIvWlOKBVbbmLAAR0lMlQTgeB7afqmPz9cAYB2PEGuQLcitddQvt-uuNP2Fsc6rKY2GviZBixPFZmjRmOAkJ_IYSD9pXFRISGmFQrpoXOvwFwuX3sZWlgHRpuQq_4RsigYSP8-tQmpvFq_SYB_YFsIwHtDChe_GTRHUu-Vpdewg Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7397d6b602604e2caa60f16aee28c950 Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerTestJSON-1524795796 Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:07.016909 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7397d6b602604e2caa60f16aee28c950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7397d6b602604e2caa60f16aee28c950", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7397d6b602604e2caa60f16aee28c950"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7397d6b602604e2caa60f16aee28c950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerTestJSON-1524795796 Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7397d6b602604e2caa60f16aee28c950 Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1524795796 Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerTestJSON-1524795796-project Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 096b2f40a81a4627af9ae5c7b83fc619 Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerTestJSON-1524795796-project Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 could not be found. Aug 06 20:57:07.019395 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7f0af8fc-0b76-4863-bb2d-699fc8f3cde9'} Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 could not be found. Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:07.020131 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 could not be found. Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 could not be found. Aug 06 20:57:07.021486 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.026362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] Returning 404 to user: Instance 7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:07.028545 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-63e0fcae-7224-4cbf-8925-9982a61f6ed0 tempest-ImagesOneServerTestJSON-1524795796 tempest-ImagesOneServerTestJSON-1524795796-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9" status: 404 len: 111 microversion: 2.1 time: 0.083657 Aug 06 20:57:07.029765 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 544/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:06 2022] GET /compute/v2.1/servers/7f0af8fc-0b76-4863-bb2d-699fc8f3cde9 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:07.113387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:07.123978 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8b8e9287-bcb5-4441-bd90-28441b4cd7df tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1540 microversion: 2.1 time: 0.742397 Aug 06 20:57:07.126496 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 559/1103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:06 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1540 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:07.151339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:07.152193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:07.166718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.167560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.169538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.172712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.173517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.175696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.339088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:07.340116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:07.351547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.357257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.358046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.359006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.360075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.361719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.636724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:07.645376 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1a886da2-0160-4046-937b-52e168454a0e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1313 microversion: 2.1 time: 0.499801 Aug 06 20:57:07.646258 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 545/1104] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:07 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:07.654373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-78e8a54e-39d3-4a0b-ad09-9c22a5f2b044 req-55602ea8-7b83-4a3e-8106-30eebf82ae96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a", "name": "network-vif-plugged", "status": "completed", "tag": "bdd3d1a4-abad-49cb-b7ea-1c1d4d3bba83"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:07.696811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-78e8a54e-39d3-4a0b-ad09-9c22a5f2b044 req-55602ea8-7b83-4a3e-8106-30eebf82ae96 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.697600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-78e8a54e-39d3-4a0b-ad09-9c22a5f2b044 req-55602ea8-7b83-4a3e-8106-30eebf82ae96 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.698259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-78e8a54e-39d3-4a0b-ad09-9c22a5f2b044 req-55602ea8-7b83-4a3e-8106-30eebf82ae96 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.712107 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-78e8a54e-39d3-4a0b-ad09-9c22a5f2b044 req-55602ea8-7b83-4a3e-8106-30eebf82ae96 service nova] Creating event network-vif-plugged:bdd3d1a4-abad-49cb-b7ea-1c1d4d3bba83 for instance 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a on nch1-master-1 Aug 06 20:57:07.717273 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-78e8a54e-39d3-4a0b-ad09-9c22a5f2b044 req-55602ea8-7b83-4a3e-8106-30eebf82ae96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069585 Aug 06 20:57:07.718343 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 546/1105] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:07.725601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:07.726826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 814b0a3e-029c-47e3-b686-a3d2473a44e5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:07.745233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.745809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.746320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.747397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.748082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.748723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.764478 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] HTTP exception thrown: Instance 814b0a3e-029c-47e3-b686-a3d2473a44e5 could not be found. Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Request method failure captured: Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 HTTP/1.1 Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUEMYCUboqC3YtaC8K6tYR4k23m1Yp-GKm2f3ElGr7nYavjPnmtCYNjrOtwKV2c2d_bUl2zrsasXf7RLD66h4PykGKdl-I33sHcIWXFp5f_ik2QHXjE3KeHf4NIh4r2awFQxsyCFstJRqR5WtKFkb4V4eXFSyID7LQQfqLJkDTWlc0 Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:07.767452 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0e3164f8b4943eeb85883a0fa08efaa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 10aebae8bbbd4ea88b9cbf85d3438ed1 Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 814b0a3e-029c-47e3-b686-a3d2473a44e5 could not be found. Aug 06 20:57:07.769771 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '814b0a3e-029c-47e3-b686-a3d2473a44e5'} Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814b0a3e-029c-47e3-b686-a3d2473a44e5 could not be found. Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:07.770498 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814b0a3e-029c-47e3-b686-a3d2473a44e5 could not be found. Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814b0a3e-029c-47e3-b686-a3d2473a44e5 could not be found. Aug 06 20:57:07.774116 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:07.779457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Returning 404 to user: Instance 814b0a3e-029c-47e3-b686-a3d2473a44e5 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:07.780349 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ab876bf-b0ba-437b-80df-6623421c3341 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5" status: 404 len: 111 microversion: 2.1 time: 0.060695 Aug 06 20:57:07.780935 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 547/1106] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:07 2022] GET /compute/v2.1/servers/814b0a3e-029c-47e3-b686-a3d2473a44e5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:07.787152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:07.787924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:07.794639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.795215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.795737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.796545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.797256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.797759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.844647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:07.853396 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16e89a10-a364-4446-808e-e3276d4756ae tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1541 microversion: 2.1 time: 0.518646 Aug 06 20:57:07.853987 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 560/1107] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:07 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1541 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:07.859013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7060ef8e-7aed-41c9-bf29-6e3097f74058 req-6b8ec530-0fd5-415f-a789-fc844062a32c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814b0a3e-029c-47e3-b686-a3d2473a44e5", "name": "network-vif-deleted", "tag": "1b24865d-9fb9-4d82-b0d8-cdc42c0ec4de"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:07.870207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7060ef8e-7aed-41c9-bf29-6e3097f74058 req-6b8ec530-0fd5-415f-a789-fc844062a32c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.871197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7060ef8e-7aed-41c9-bf29-6e3097f74058 req-6b8ec530-0fd5-415f-a789-fc844062a32c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.871676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7060ef8e-7aed-41c9-bf29-6e3097f74058 req-6b8ec530-0fd5-415f-a789-fc844062a32c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.885895 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7060ef8e-7aed-41c9-bf29-6e3097f74058 req-6b8ec530-0fd5-415f-a789-fc844062a32c service nova] Creating event network-vif-deleted:1b24865d-9fb9-4d82-b0d8-cdc42c0ec4de for instance 814b0a3e-029c-47e3-b686-a3d2473a44e5 on nch2-master-1 Aug 06 20:57:07.891187 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7060ef8e-7aed-41c9-bf29-6e3097f74058 req-6b8ec530-0fd5-415f-a789-fc844062a32c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035727 Aug 06 20:57:07.892427 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 561/1108] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:07.897790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:07.898465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:07.906337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.907062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.907753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.908729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:07.909413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:07.910085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:07.950418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:08.103626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a6de1ac-3f0e-474a-b1a5-c60699151771 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 204 len: 0 microversion: 2.1 time: 0.209494 Aug 06 20:57:08.104600 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 562/1109] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:07 2022] DELETE /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:08.119032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:08.120186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:08.130009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:08.132918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:08.134092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:08.134976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:08.135667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:08.136306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:08.166857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:08.177983 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e9bc577e-afd2-48a3-9ea5-e9e3604bca53 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1322 microversion: 2.1 time: 0.395246 Aug 06 20:57:08.182734 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 548/1110] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:07 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:08.203029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:08.203844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:08.217332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:08.218105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:08.218596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:08.219306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:08.223032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:08.223532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:08.421504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:08.440916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:08.442410 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7681cfb6-1950-4265-8ca1-30642a4a09ea tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1473 microversion: 2.1 time: 0.333364 Aug 06 20:57:08.446785 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 563/1111] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:08 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:08.452625 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71fc900f-6e66-48c1-bd7c-2f6fd9f08786 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1535 microversion: 2.1 time: 0.267574 Aug 06 20:57:08.468486 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 549/1112] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:08 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1535 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:08.667672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:08.668570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:08.678182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:08.678715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:08.679166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:08.680078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:08.680545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:08.680973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:08.876005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:08.877594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:08.884918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:08.885720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:08.886376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:08.887436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:08.888099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:08.888724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.057139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:09.071012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:09.072664 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eae20563-2d09-45e9-87c8-1808e4e1a4fa tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1313 microversion: 2.1 time: 0.409323 Aug 06 20:57:09.073562 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 564/1113] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:08 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:09.080871 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf9a202b-08f0-4cbd-bb8d-5e146eaeda7b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1473 microversion: 2.1 time: 0.208293 Aug 06 20:57:09.090917 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 550/1114] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:08 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1473 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:09.203236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:09.203851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:09.210742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.211238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.211899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.212607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.213074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.213680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.375374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:09.386934 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-757bfb4c-11cb-49e0-903a-4e3174961f4e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1322 microversion: 2.1 time: 0.187374 Aug 06 20:57:09.388233 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 565/1115] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:09 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:09.470066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:09.471318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:09.481598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:09.483800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:09.493637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.495830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.496542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.497519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.498211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.499228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.501842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.502787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.510697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.512141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.513389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.514030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.761129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:09.769918 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-95e84aad-8014-4599-8fe5-cb670d9c6797 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1473 microversion: 2.1 time: 0.304190 Aug 06 20:57:09.771328 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 551/1116] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:09 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:09.776219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e3048e11-40ef-4e69-b70b-85b2fe4131d5 req-4f6569b3-135e-497d-b711-bf8bcee3a5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427263c2-5964-4973-bdce-cd5949254cdd", "name": "network-vif-plugged", "status": "completed", "tag": "5db6450b-21d9-4d3b-8219-6e11c9499b1b"}, {"server_uuid": "a4d99126-c9b5-4b1e-8bb6-92dc1dd048da", "name": "network-vif-plugged", "status": "completed", "tag": "7aebd8b0-07de-4d6e-88bc-b0ebb90332e3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:09.787894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e3048e11-40ef-4e69-b70b-85b2fe4131d5 req-4f6569b3-135e-497d-b711-bf8bcee3a5f8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.788666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e3048e11-40ef-4e69-b70b-85b2fe4131d5 req-4f6569b3-135e-497d-b711-bf8bcee3a5f8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.789550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e3048e11-40ef-4e69-b70b-85b2fe4131d5 req-4f6569b3-135e-497d-b711-bf8bcee3a5f8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.794886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:09.807223 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e3048e11-40ef-4e69-b70b-85b2fe4131d5 req-4f6569b3-135e-497d-b711-bf8bcee3a5f8 service nova] Creating event network-vif-plugged:5db6450b-21d9-4d3b-8219-6e11c9499b1b for instance 427263c2-5964-4973-bdce-cd5949254cdd on nch2-master-1 Aug 06 20:57:09.808025 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e3048e11-40ef-4e69-b70b-85b2fe4131d5 req-4f6569b3-135e-497d-b711-bf8bcee3a5f8 service nova] Creating event network-vif-plugged:7aebd8b0-07de-4d6e-88bc-b0ebb90332e3 for instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da on nch1-master-1 Aug 06 20:57:09.817496 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e3048e11-40ef-4e69-b70b-85b2fe4131d5 req-4f6569b3-135e-497d-b711-bf8bcee3a5f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044587 Aug 06 20:57:09.818774 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 552/1117] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:09.924289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-40149091-eeef-4f51-8199-5e5c941426bd req-64af3be3-4b2a-43a1-9138-70234fd47c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b5de59-fb8f-457a-9774-022b018a6dc8", "tag": "e2592709-0db4-458e-bbf4-e202458e65e5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:09.931355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:09.935235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-40149091-eeef-4f51-8199-5e5c941426bd req-64af3be3-4b2a-43a1-9138-70234fd47c08 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.936089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-40149091-eeef-4f51-8199-5e5c941426bd req-64af3be3-4b2a-43a1-9138-70234fd47c08 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.936736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-40149091-eeef-4f51-8199-5e5c941426bd req-64af3be3-4b2a-43a1-9138-70234fd47c08 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.947080 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2c125dff-fc02-4b1d-9f1d-e50e13c70931 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1522 microversion: 2.1 time: 0.472278 Aug 06 20:57:09.947674 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 566/1118] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:09 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:09.967555 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-40149091-eeef-4f51-8199-5e5c941426bd req-64af3be3-4b2a-43a1-9138-70234fd47c08 service nova] Creating event network-changed:e2592709-0db4-458e-bbf4-e202458e65e5 for instance 55b5de59-fb8f-457a-9774-022b018a6dc8 on nch2-master-1 Aug 06 20:57:09.968804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:09.969505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:09.973371 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-40149091-eeef-4f51-8199-5e5c941426bd req-64af3be3-4b2a-43a1-9138-70234fd47c08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053312 Aug 06 20:57:09.974486 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 553/1119] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:09.977034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.977703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.978309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:09.979957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:09.980847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:09.981432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.014023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:10.098144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:10.099676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:10.106721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.107561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.107913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.108932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.109715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.109983 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5647774a-457c-4516-ac29-0f7cded01bb5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 204 len: 0 microversion: 2.1 time: 0.144324 Aug 06 20:57:10.110504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.115010 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 567/1120] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:09 2022] DELETE /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 20:57:10.122659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:10.123383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:10.131133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.131633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.132078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.132833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.133294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.133724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.344406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:10.360911 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d2cb6d8-fe52-4406-8cbd-df9f0f28d13a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1313 microversion: 2.1 time: 0.269852 Aug 06 20:57:10.366601 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 554/1121] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:10 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:10.371146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:10.374154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:10.375042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:10.380699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9105d837-0f95-436e-876b-e75f936d08ce tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1473 microversion: 2.1 time: 0.267243 Aug 06 20:57:10.382469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.383244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.383927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.384853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.385666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.386396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.388649 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 568/1122] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:10 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1473 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:10.411991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:10.412611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:10.429343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.430138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.430786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.431699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.432506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.433156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.718653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:10.734068 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b5f475f-a529-42c2-b4ed-955d7c81d198 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1528 microversion: 2.1 time: 0.363861 Aug 06 20:57:10.735030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 555/1123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:10 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1528 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:10.779422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:10.791032 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f7685e63-d1be-4ba3-ba51-a90521e93e5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1322 microversion: 2.1 time: 0.383564 Aug 06 20:57:10.792321 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 569/1124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:10 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:10.809665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:10.810981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:10.820996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.821577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.822091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:10.823251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:10.823924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:10.824567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.183050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:11.192614 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-26a05e25-e7b2-4f7e-8150-c954cf5e7149 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1431 microversion: 2.1 time: 0.404490 Aug 06 20:57:11.207630 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 556/1125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:10 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1431 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:11.387353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:11.387977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:11.396479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.396974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.397415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.398122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.398852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.399443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.409379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:11.410604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:11.428206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.428708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.429149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.429874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.430332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.430788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.463142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:11.615185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:11.625322 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c7eb0042-827b-453e-a91e-b815a0aa0380 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1462 microversion: 2.1 time: 0.242135 Aug 06 20:57:11.626503 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 570/1126] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:11 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1462 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:11.647610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:11.649625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:11.657587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.658991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.660102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.661855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.663409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.663995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.715380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:11.726194 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b8bf9e21-80e9-4540-bf34-acc54dab3ce5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1470 microversion: 2.1 time: 0.320664 Aug 06 20:57:11.728930 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 557/1127] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:11 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1470 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:11.763243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:11.765425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:11.774836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.775541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.776063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.776865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.777562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.778077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.820540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=24 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:11.852283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:11.856562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.858466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.859338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.860463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.862297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.864603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.865952 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ef351684-bca4-454a-a2be-b9f4d032f601 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1312 microversion: 2.1 time: 0.223100 Aug 06 20:57:11.881262 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 571/1128] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:11 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:11.893620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:11.894699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:11.904783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.906788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'ram', 'cores'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:11.913269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for user 0701f31766dd4eeab9a63f6411c26d6e and project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'ram', 'cores'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:11.916851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.917303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:11.918583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:11.919137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:11.919579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.062801 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7fae50b7-6eb3-4654-baee-838f99870866 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878/action" status: 202 len: 0 microversion: 2.1 time: 0.311333 Aug 06 20:57:12.068419 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 558/1129] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:11 2022] POST /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:12.089144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:12.090786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:12.107855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.108647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.113872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.114828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.115581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.116553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.166346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:12.204668 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f7c10de-f4ef-45b5-a8fc-403d96a83089 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1528 microversion: 2.1 time: 0.322042 Aug 06 20:57:12.206145 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 572/1130] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:11 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1528 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:12.212571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-22a780b2-3d9e-4300-bdff-ec1126f72fb0 req-752dadb9-16e3-4c9a-9726-04ef8e74a54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a7adc6-d32c-4d2b-84be-536c9aebe878", "name": "network-vif-unplugged", "status": "completed", "tag": "397efc42-e695-4b22-a223-76833b924b55"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:12.223822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-22a780b2-3d9e-4300-bdff-ec1126f72fb0 req-752dadb9-16e3-4c9a-9726-04ef8e74a54c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.224599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-22a780b2-3d9e-4300-bdff-ec1126f72fb0 req-752dadb9-16e3-4c9a-9726-04ef8e74a54c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.225198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-22a780b2-3d9e-4300-bdff-ec1126f72fb0 req-752dadb9-16e3-4c9a-9726-04ef8e74a54c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.230991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:12.242990 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-22a780b2-3d9e-4300-bdff-ec1126f72fb0 req-752dadb9-16e3-4c9a-9726-04ef8e74a54c service nova] Creating event network-vif-unplugged:397efc42-e695-4b22-a223-76833b924b55 for instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 on nch1-master-1 Aug 06 20:57:12.252754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-22a780b2-3d9e-4300-bdff-ec1126f72fb0 req-752dadb9-16e3-4c9a-9726-04ef8e74a54c service nova] Instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:57:12.263461 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-22a780b2-3d9e-4300-bdff-ec1126f72fb0 req-752dadb9-16e3-4c9a-9726-04ef8e74a54c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052351 Aug 06 20:57:12.263461 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 573/1131] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:12.268749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5bc14602-8832-4d39-8054-65a943542237 req-5bfa947d-03bf-489d-95e6-0d23283f0600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3246844f-93dc-4826-a925-2438888ba4b2", "name": "network-vif-deleted", "tag": "8ee6ca35-6eb6-4bd9-add8-773df07bbbb4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:12.280015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5bc14602-8832-4d39-8054-65a943542237 req-5bfa947d-03bf-489d-95e6-0d23283f0600 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.280582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5bc14602-8832-4d39-8054-65a943542237 req-5bfa947d-03bf-489d-95e6-0d23283f0600 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.281097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5bc14602-8832-4d39-8054-65a943542237 req-5bfa947d-03bf-489d-95e6-0d23283f0600 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.294814 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5bc14602-8832-4d39-8054-65a943542237 req-5bfa947d-03bf-489d-95e6-0d23283f0600 service nova] Creating event network-vif-deleted:8ee6ca35-6eb6-4bd9-add8-773df07bbbb4 for instance 3246844f-93dc-4826-a925-2438888ba4b2 on nch2-master-1 Aug 06 20:57:12.300704 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5bc14602-8832-4d39-8054-65a943542237 req-5bfa947d-03bf-489d-95e6-0d23283f0600 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038355 Aug 06 20:57:12.301652 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 574/1132] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:12.307363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:12.308178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:12.315630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.316290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.316857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.317795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.318357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.318969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.489017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:12.497597 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-82c9b750-8c3e-42e4-ad7e-bbdda9d9b92f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1469 microversion: 2.1 time: 0.194839 Aug 06 20:57:12.498406 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 575/1133] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:12 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1469 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:12.503120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:12.503729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:12.510248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.510846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.512209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.513288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.513756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.514188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.521956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:12.530681 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d097e991-6df7-46d8-8e5d-867e3065b24e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1322 microversion: 2.1 time: 0.461033 Aug 06 20:57:12.543186 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 559/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:12 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:12.582837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:12.591043 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b75e4066-ba06-4dbe-b3f2-52e0959b1128 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 200 len: 1431 microversion: 2.1 time: 0.091727 Aug 06 20:57:12.591619 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 576/1135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:12 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 1431 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:12.901448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:12.902081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:12.917617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.917617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.917617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:12.918617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:12.919465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:12.919583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:13.232773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:13.234142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:13.238488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:13.243618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:13.244339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:13.244993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:13.246150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:13.246761 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-350c389a-ad05-4911-960f-481d22bed064 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1462 microversion: 2.1 time: 0.349148 Aug 06 20:57:13.247423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:13.248288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:13.250872 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 560/1136] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:12 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1462 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:13.493678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-218777139", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a4d99126-c9b5-4b1e-8bb6-92dc1dd048da"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:13.577034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:57:13.941010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:13.951992 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b5f648fc-d0b7-4fec-bd21-05f7627d10cf tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 200 len: 1528 microversion: 2.1 time: 0.728309 Aug 06 20:57:13.957299 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 577/1137] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:13 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 1528 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:13.977078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:13.978080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:13.996146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:13.998065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.003298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.004460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:14.005148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.005794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.327818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:14.346857 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2730c9ed-e563-46ca-933b-e26f9122d546 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1469 microversion: 2.1 time: 0.378422 Aug 06 20:57:14.347531 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 578/1138] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:13 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1469 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:14.365548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:14.369465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:14.386906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:14.387630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.389912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.390865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:14.395514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.396161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.478455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:57:14.479715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:57:14.480422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:57:14.481073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:57:14.481586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:57:14.493099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:14.493940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.494631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.495589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:14.496296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.496949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.517909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Getting quotas for project 1558d5dbaa704f40a3b6436b4b6c0e51. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:14.523929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Getting quotas for user ea7293bc4816483dbcd0f96536814d2c and project 1558d5dbaa704f40a3b6436b4b6c0e51. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:14.537429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:57:14.540439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:57:14.596928 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-be17666b-6d6c-4928-9d25-2c437eff4a04 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107140 Aug 06 20:57:14.604200 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 561/1139] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 20:57:14.610518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:14.614746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 3246844f-93dc-4826-a925-2438888ba4b2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:14.623064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:14.628087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.628763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.629744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:14.630463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.631161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.649358 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] HTTP exception thrown: Instance 3246844f-93dc-4826-a925-2438888ba4b2 could not be found. Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Request method failure captured: Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 HTTP/1.1 Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUEMYCUboqC3YtaC8K6tYR4k23m1Yp-GKm2f3ElGr7nYavjPnmtCYNjrOtwKV2c2d_bUl2zrsasXf7RLD66h4PykGKdl-I33sHcIWXFp5f_ik2QHXjE3KeHf4NIh4r2awFQxsyCFstJRqR5WtKFkb4V4eXFSyID7LQQfqLJkDTWlc0 Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:14.651600 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0e3164f8b4943eeb85883a0fa08efaa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 10aebae8bbbd4ea88b9cbf85d3438ed1 Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 3246844f-93dc-4826-a925-2438888ba4b2 could not be found. Aug 06 20:57:14.652902 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '3246844f-93dc-4826-a925-2438888ba4b2'} Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3246844f-93dc-4826-a925-2438888ba4b2 could not be found. Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:14.653647 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3246844f-93dc-4826-a925-2438888ba4b2 could not be found. Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3246844f-93dc-4826-a925-2438888ba4b2 could not be found. Aug 06 20:57:14.655284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:14.656786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Returning 404 to user: Instance 3246844f-93dc-4826-a925-2438888ba4b2 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:14.656786 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4ab495f9-33c4-47f4-9566-d3a12cddbc45 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2" status: 404 len: 111 microversion: 2.1 time: 0.047419 Aug 06 20:57:14.657555 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 562/1140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:14 2022] GET /compute/v2.1/servers/3246844f-93dc-4826-a925-2438888ba4b2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:14.667850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-decdf50a-fac4-4b49-8feb-ca95fa5d1284 req-b217bcfc-259e-403c-927e-9ca684e22f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427263c2-5964-4973-bdce-cd5949254cdd", "name": "network-vif-unplugged", "status": "completed", "tag": "5db6450b-21d9-4d3b-8219-6e11c9499b1b"}, {"server_uuid": "73a7adc6-d32c-4d2b-84be-536c9aebe878", "name": "network-vif-plugged", "status": "completed", "tag": "397efc42-e695-4b22-a223-76833b924b55"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:14.687214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-decdf50a-fac4-4b49-8feb-ca95fa5d1284 req-b217bcfc-259e-403c-927e-9ca684e22f04 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:14.687700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-decdf50a-fac4-4b49-8feb-ca95fa5d1284 req-b217bcfc-259e-403c-927e-9ca684e22f04 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.688136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-decdf50a-fac4-4b49-8feb-ca95fa5d1284 req-b217bcfc-259e-403c-927e-9ca684e22f04 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.719022 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-decdf50a-fac4-4b49-8feb-ca95fa5d1284 req-b217bcfc-259e-403c-927e-9ca684e22f04 service nova] Creating event network-vif-unplugged:5db6450b-21d9-4d3b-8219-6e11c9499b1b for instance 427263c2-5964-4973-bdce-cd5949254cdd on nch2-master-1 Aug 06 20:57:14.721201 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-decdf50a-fac4-4b49-8feb-ca95fa5d1284 req-b217bcfc-259e-403c-927e-9ca684e22f04 service nova] Creating event network-vif-plugged:397efc42-e695-4b22-a223-76833b924b55 for instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 on nch1-master-1 Aug 06 20:57:14.741505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-decdf50a-fac4-4b49-8feb-ca95fa5d1284 req-b217bcfc-259e-403c-927e-9ca684e22f04 service nova] Instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:57:14.765834 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-decdf50a-fac4-4b49-8feb-ca95fa5d1284 req-b217bcfc-259e-403c-927e-9ca684e22f04 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.106016 Aug 06 20:57:14.767117 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 563/1141] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:14.778134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-529f38b1-a512-4c8a-8faf-8eff926f8442 req-963e575d-a4e5-4b0a-9c9f-93140e0b9aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427263c2-5964-4973-bdce-cd5949254cdd", "name": "network-vif-deleted", "tag": "5db6450b-21d9-4d3b-8219-6e11c9499b1b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:14.799831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-529f38b1-a512-4c8a-8faf-8eff926f8442 req-963e575d-a4e5-4b0a-9c9f-93140e0b9aab service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:14.805110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-529f38b1-a512-4c8a-8faf-8eff926f8442 req-963e575d-a4e5-4b0a-9c9f-93140e0b9aab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:14.805789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-529f38b1-a512-4c8a-8faf-8eff926f8442 req-963e575d-a4e5-4b0a-9c9f-93140e0b9aab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:14.833289 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-529f38b1-a512-4c8a-8faf-8eff926f8442 req-963e575d-a4e5-4b0a-9c9f-93140e0b9aab service nova] Creating event network-vif-deleted:5db6450b-21d9-4d3b-8219-6e11c9499b1b for instance 427263c2-5964-4973-bdce-cd5949254cdd on nch2-master-1 Aug 06 20:57:14.843188 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-529f38b1-a512-4c8a-8faf-8eff926f8442 req-963e575d-a4e5-4b0a-9c9f-93140e0b9aab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074079 Aug 06 20:57:14.843857 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 564/1142] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:14.862815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-87471443-2914-4b99-a7ad-cde97436c0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:14.864676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-87471443-2914-4b99-a7ad-cde97436c0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:15.070921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-87471443-2914-4b99-a7ad-cde97436c0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:15.072434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:15.081966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-87471443-2914-4b99-a7ad-cde97436c0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1213 microversion: 2.1 time: 0.233948 Aug 06 20:57:15.086410 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 565/1143] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:14 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1213 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:15.093769 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d99c0446-31f2-4982-9f7e-a4e2a57d2e1e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1322 microversion: 2.1 time: 0.731777 Aug 06 20:57:15.095744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:15.096472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:15.097883 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 579/1144] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:14 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1322 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:15.105158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:15.105896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:15.106589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:15.107535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:15.108145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:15.108978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:15.115644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:15.116329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:15.122821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:15.123365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:15.123814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:15.124525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:15.124990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:15.125421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:15.143888 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd HTTP/1.1 Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:15.145970 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:15.147635 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '427263c2-5964-4973-bdce-cd5949254cdd'} Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:15.148563 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:15.150099 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:15.151408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:15.152408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:15.153514 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-319f153a-a6d5-44bf-98ea-ffdb3970380a tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 404 len: 111 microversion: 2.1 time: 0.045585 Aug 06 20:57:15.154393 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 580/1145] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:15 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:15.312999 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8e3c048b-cda5-4eaf-879a-ba4a24f2d20f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d" status: 204 len: 0 microversion: 2.1 time: 0.224958 Aug 06 20:57:15.317344 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 566/1146] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:15 2022] DELETE /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:15.319228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-810189535", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:15.324694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:15.330224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:15.344345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:15.346526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:15.348092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:15.350942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:15.351531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:15.352066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:15.404592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] validate_networks() for [('5d497235-5173-4b4c-802d-29c9feaf9b47', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:57:15.412712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:15.515152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:15.645159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:15.666687 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-303a40b4-f487-4aac-aee3-6919469951a6 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 204 len: 0 microversion: 2.1 time: 0.346732 Aug 06 20:57:15.675101 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 567/1147] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:15 2022] DELETE /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:15.684512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:15.685317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:15.693545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:15.694112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:15.694672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:15.695459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:15.696162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:15.697876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:16.084180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:57:16.084951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:57:16.085492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:57:16.089163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:57:16.089695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:57:16.103219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:16.103923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:16.104630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:16.105613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:16.106282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:16.106743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:16.109124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:16.120230 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-65e9a87b-d9aa-4c55-8b32-b7434aafb16c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1469 microversion: 2.1 time: 0.443725 Aug 06 20:57:16.121411 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 568/1148] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:15 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1469 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:16.126964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:16.127870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:16.130453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Getting quotas for project 8fd242c56a3f436c9cf158e68253218c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:16.136864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Getting quotas for user dff69a9a061a454685cfc57c1675f4b9 and project 8fd242c56a3f436c9cf158e68253218c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:16.137654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:16.138387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:16.139225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:16.140261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:16.140993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:16.142665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:16.152846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:57:16.155218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:57:16.215676 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d46310f-f260-491c-9036-2c1cfe49104e tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.902546 Aug 06 20:57:16.216349 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 581/1149] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:57:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 20:57:16.227065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:16.227843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:16.235039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:16.236342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:16.237069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:16.237923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:16.238721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:16.247755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:16.334986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:16.343960 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-69592dd5-3fbc-4cc6-bdc3-6ff564ee9db4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1209 microversion: 2.1 time: 0.124229 Aug 06 20:57:16.344547 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 582/1150] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:16 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1209 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:16.352227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:16.353800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:16.365341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:16.365840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:16.369906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:16.371224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:16.371628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:16.372082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:16.425913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:16.434243 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7db34394-9ce4-4be6-93d9-c9f771247936 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d" status: 200 len: 1475 microversion: 2.1 time: 0.311483 Aug 06 20:57:16.434864 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 569/1151] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:16 2022] GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d => generated 1475 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:16.453590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ff7acb02-bc27-4c2d-97cb-3119479e018d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:16.454247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ff7acb02-bc27-4c2d-97cb-3119479e018d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:16.541009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ff7acb02-bc27-4c2d-97cb-3119479e018d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:16.552383 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ff7acb02-bc27-4c2d-97cb-3119479e018d tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1224 microversion: 2.1 time: 0.103931 Aug 06 20:57:16.554430 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 570/1152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:16 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:16.569585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:16.580977 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-03f58e30-6492-42db-930c-32718fc09825 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1322 microversion: 2.1 time: 0.231393 Aug 06 20:57:16.582471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 583/1153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:16 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:16.911071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c9cf17ab-ca01-4a23-80cb-e6d8a26adf4f req-9a74ab22-b936-4aff-8d71-71e2d156146b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b5de59-fb8f-457a-9774-022b018a6dc8", "name": "network-vif-plugged", "status": "completed", "tag": "e2592709-0db4-458e-bbf4-e202458e65e5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:16.952213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c9cf17ab-ca01-4a23-80cb-e6d8a26adf4f req-9a74ab22-b936-4aff-8d71-71e2d156146b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:16.953161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c9cf17ab-ca01-4a23-80cb-e6d8a26adf4f req-9a74ab22-b936-4aff-8d71-71e2d156146b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:16.955778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c9cf17ab-ca01-4a23-80cb-e6d8a26adf4f req-9a74ab22-b936-4aff-8d71-71e2d156146b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:17.000182 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c9cf17ab-ca01-4a23-80cb-e6d8a26adf4f req-9a74ab22-b936-4aff-8d71-71e2d156146b service nova] Creating event network-vif-plugged:e2592709-0db4-458e-bbf4-e202458e65e5 for instance 55b5de59-fb8f-457a-9774-022b018a6dc8 on nch2-master-1 Aug 06 20:57:17.021071 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c9cf17ab-ca01-4a23-80cb-e6d8a26adf4f req-9a74ab22-b936-4aff-8d71-71e2d156146b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116739 Aug 06 20:57:17.021994 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 571/1154] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:17.146927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:17.148369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:17.160319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:17.163832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:17.164312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:17.167946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:17.171208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:17.172122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:17.367124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:17.367832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:17.374057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:17.374603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:17.375088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:17.375981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:17.377800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:17.378435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:17.472678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:17.481096 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c452edef-0342-4c86-be02-a8fee36e7c63 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1469 microversion: 2.1 time: 0.338076 Aug 06 20:57:17.481688 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 584/1155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:17 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:17.494694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:17.507253 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b3e50f18-ed3b-4fc3-a397-719f3b0908e9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1265 microversion: 2.1 time: 0.144377 Aug 06 20:57:17.521681 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 572/1156] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:17 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:17.526756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:17.527392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:17.534308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:17.534849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:17.535296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:17.536021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:17.536484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:17.536919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:17.682976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b2ba89f-9190-4caa-b7e6-54d9b9690852 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: .version_select at 0x7f729dc2e0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1812993744", "description": "tempest-description-807593263"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:18.041200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:18.050213 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6fb1e2b0-18be-4135-8f27-95c47bb04398 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d" status: 200 len: 1475 microversion: 2.1 time: 0.527346 Aug 06 20:57:18.062693 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 573/1157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:17 2022] GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d => generated 1475 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:18.065107 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b2ba89f-9190-4caa-b7e6-54d9b9690852 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.568361 Aug 06 20:57:18.066239 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 585/1158] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:57:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:18.072089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:18.072847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:18.085068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:18.092500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:18.094024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:18.098142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:18.107652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:18.108143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:18.109820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:18.112817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:18.113482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:18.113852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:18.114401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:18.114702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:18.122810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:18.123399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:18.272259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:18.287081 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-97d690ac-8d4c-4d3a-b861-df7b45140f38 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1284 microversion: 2.1 time: 0.216375 Aug 06 20:57:18.299293 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 574/1159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:18 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:18.318982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e8570051-30ee-4fde-83ae-274feee6886f req-4b11a54c-e763-425c-967f-09948c20f01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a6fa4c-df67-4379-88ff-45430f0b9a4d", "name": "network-vif-deleted", "tag": "b9c19136-ed57-49e3-8d70-56bec4ee1ca7"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:18.338683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e8570051-30ee-4fde-83ae-274feee6886f req-4b11a54c-e763-425c-967f-09948c20f01d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:18.339238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e8570051-30ee-4fde-83ae-274feee6886f req-4b11a54c-e763-425c-967f-09948c20f01d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:18.339757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e8570051-30ee-4fde-83ae-274feee6886f req-4b11a54c-e763-425c-967f-09948c20f01d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:18.365826 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e8570051-30ee-4fde-83ae-274feee6886f req-4b11a54c-e763-425c-967f-09948c20f01d service nova] Creating event network-vif-deleted:b9c19136-ed57-49e3-8d70-56bec4ee1ca7 for instance f4a6fa4c-df67-4379-88ff-45430f0b9a4d on nch2-master-1 Aug 06 20:57:18.375971 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e8570051-30ee-4fde-83ae-274feee6886f req-4b11a54c-e763-425c-967f-09948c20f01d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074836 Aug 06 20:57:18.378657 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 575/1160] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:18.399522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c0dfa2b7-b895-4ca5-a0a1-07f21cce8e30 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: .version_select at 0x7f729dcb2e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1050068883", "description": "tempest-description-2049718044"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:18.590493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:18.605560 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f0c23949-a46b-45d6-89f3-cc7492a90d10 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1322 microversion: 2.1 time: 0.537938 Aug 06 20:57:18.606165 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 586/1161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:18 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:18.622763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:18.624213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:18.637520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:18.638447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:18.642097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:18.643190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:18.643865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:18.644537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:18.917881 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c0dfa2b7-b895-4ca5-a0a1-07f21cce8e30 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.537456 Aug 06 20:57:18.918985 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 576/1162] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:57:18 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:18.925101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:18.926088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:18.941145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:18.941649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:18.942095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:18.948595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:18.949799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:18.950372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:18.952545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:18.973211 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-277a8033-f4e2-4ab8-8ccc-549fa98d9429 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1535 microversion: 2.1 time: 0.363994 Aug 06 20:57:18.988337 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 587/1163] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:18 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1535 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:19.032579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-235484622", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5b1e8462-873f-4dfe-85ac-93f78c8d5d06"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:19.133520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] validate_networks() for [('5b1e8462-873f-4dfe-85ac-93f78c8d5d06', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:57:19.143600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:19.158473 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-59d2d0b4-fee4-44e3-b666-584adda7bea7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1271 microversion: 2.1 time: 0.236753 Aug 06 20:57:19.160451 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 577/1164] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:18 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:19.173523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:19.174811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:19.197702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:19.201461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:19.205050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:19.207879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:19.208376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:19.215709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:19.265831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:19.266686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:19.267869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:19.268513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lazy-loading 'fault' on Instance uuid f4a6fa4c-df67-4379-88ff-45430f0b9a4d {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:57:19.426111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:19.445121 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d1af9921-f9a2-4484-80ef-fce167369d75 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d" status: 200 len: 1309 microversion: 2.1 time: 0.281895 Aug 06 20:57:19.446873 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 578/1165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:19 2022] GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:19.451743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5a1402a9-fcbf-4dd6-b8ae-46525296085e req-d87f12af-b67d-4c16-9033-1f73da57f628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5f4cef-88c9-4234-b823-bb15b4d351a8", "name": "network-vif-deleted", "tag": "99e7008f-8aa5-4595-804c-937e754dabbe"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:19.467930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5a1402a9-fcbf-4dd6-b8ae-46525296085e req-d87f12af-b67d-4c16-9033-1f73da57f628 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:19.468755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5a1402a9-fcbf-4dd6-b8ae-46525296085e req-d87f12af-b67d-4c16-9033-1f73da57f628 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:19.470039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5a1402a9-fcbf-4dd6-b8ae-46525296085e req-d87f12af-b67d-4c16-9033-1f73da57f628 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:19.493725 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-5a1402a9-fcbf-4dd6-b8ae-46525296085e req-d87f12af-b67d-4c16-9033-1f73da57f628 service nova] Creating event network-vif-deleted:99e7008f-8aa5-4595-804c-937e754dabbe for instance 0b5f4cef-88c9-4234-b823-bb15b4d351a8 on nch1-master-1 Aug 06 20:57:19.504931 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5a1402a9-fcbf-4dd6-b8ae-46525296085e req-d87f12af-b67d-4c16-9033-1f73da57f628 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056626 Aug 06 20:57:19.510125 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 579/1166] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:19.523647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:19.524839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:19.534701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:19.535981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:19.536633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:19.538238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:19.539444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:19.540807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:19.681049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:19.694271 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-58df3ae1-3199-4117-be3a-12acee2d0249 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1282 microversion: 2.1 time: 0.182253 Aug 06 20:57:19.694993 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 580/1167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:19 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:19.722322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:19.722999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:19.740462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:19.742004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:19.743078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:19.745332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:19.745918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:19.747491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.015399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:20.030059 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4bfe36e4-9a9f-4c3b-87b2-03fae2704141 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1470 microversion: 2.1 time: 0.330863 Aug 06 20:57:20.031481 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 581/1168] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:19 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:20.037733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:20.038787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:20.045852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:20.046722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:20.047347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.049585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:20.050228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:20.051136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.327079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:57:20.327726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:57:20.327953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:57:20.328358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:57:20.328807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:57:20.331236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:20.341120 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-131e7822-7f36-43d3-8ec5-eaeeb2bd7bd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1535 microversion: 2.1 time: 0.308107 Aug 06 20:57:20.342292 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 582/1169] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:20 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1535 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:20.342625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:20.344088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:20.344806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.345340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:20.345841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:20.346327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.401132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Getting quotas for project 690e571b106a4305977f2d9166a4433e. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:20.406584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Getting quotas for user 3df9834cd3164d72a4bbd4d71d35df96 and project 690e571b106a4305977f2d9166a4433e. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:20.410344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:20.440026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:57:20.446238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:57:20.540463 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5d405c6-a62c-4d96-b6f5-d83b41efd8aa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.511872 Aug 06 20:57:20.550586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-907e2f35-d052-45e8-b188-e0fcd8ae033f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:20.551203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-907e2f35-d052-45e8-b188-e0fcd8ae033f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] [instance: 5c3a3480-92f2-40bd-80ab-72fffef07c68] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:20.582853 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 588/1170] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 20:57:20.595427 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-907e2f35-d052-45e8-b188-e0fcd8ae033f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] HTTP exception thrown: Instance 5c3a3480-92f2-40bd-80ab-72fffef07c68 could not be found. Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-907e2f35-d052-45e8-b188-e0fcd8ae033f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Request method failure captured: Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/5c3a3480-92f2-40bd-80ab-72fffef07c68/action HTTP/1.1 Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 15 Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWcDhv0NOCwtEz5hknOtWBRsczwfEnPrygefQD7xGD4F0J-fprVh5T_gpULAaMgpPCP6oodYyktHSPIYaXXdffbwzkVRa6B74J2qjj-JqUrPTKHcmA9d7-ivQPu6ukUoTtV-Zy3qu36LuMLMNFivBnRpcjMGO8YRlJ9WkMvXoDpmJA Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:57:20.597949 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb76102372d64079b3571e92331e77ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb76102372d64079b3571e92331e77ae", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7004eb9df0824403a47f7b26d5eaf89c Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: {"migrate": {}} Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:20.599360 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 5c3a3480-92f2-40bd-80ab-72fffef07c68 could not be found. Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '5c3a3480-92f2-40bd-80ab-72fffef07c68', 'body': {'migrate': {}}} Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c3a3480-92f2-40bd-80ab-72fffef07c68 could not be found. Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:20.600188 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c3a3480-92f2-40bd-80ab-72fffef07c68 could not be found. Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c3a3480-92f2-40bd-80ab-72fffef07c68 could not be found. Aug 06 20:57:20.601475 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.602508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-907e2f35-d052-45e8-b188-e0fcd8ae033f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Returning 404 to user: Instance 5c3a3480-92f2-40bd-80ab-72fffef07c68 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:20.602508 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-907e2f35-d052-45e8-b188-e0fcd8ae033f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5c3a3480-92f2-40bd-80ab-72fffef07c68/action" status: 404 len: 111 microversion: 2.1 time: 0.256310 Aug 06 20:57:20.602508 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 583/1171] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:20 2022] POST /compute/v2.1/servers/5c3a3480-92f2-40bd-80ab-72fffef07c68/action => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:20.603879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:20.605671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:20.609210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:20.609835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: f4a6fa4c-df67-4379-88ff-45430f0b9a4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:20.621159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:20.621814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:20.622640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.623267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:20.623788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:20.624222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.638640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:20.639455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:20.640797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.644384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:20.645966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:20.647561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.680412 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] HTTP exception thrown: Instance f4a6fa4c-df67-4379-88ff-45430f0b9a4d could not be found. Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Request method failure captured: Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d HTTP/1.1 Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUEMYCUboqC3YtaC8K6tYR4k23m1Yp-GKm2f3ElGr7nYavjPnmtCYNjrOtwKV2c2d_bUl2zrsasXf7RLD66h4PykGKdl-I33sHcIWXFp5f_ik2QHXjE3KeHf4NIh4r2awFQxsyCFstJRqR5WtKFkb4V4eXFSyID7LQQfqLJkDTWlc0 Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:20.684673 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0e3164f8b4943eeb85883a0fa08efaa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 10aebae8bbbd4ea88b9cbf85d3438ed1 Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance f4a6fa4c-df67-4379-88ff-45430f0b9a4d could not be found. Aug 06 20:57:20.686090 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'f4a6fa4c-df67-4379-88ff-45430f0b9a4d'} Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a6fa4c-df67-4379-88ff-45430f0b9a4d could not be found. Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:20.686986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a6fa4c-df67-4379-88ff-45430f0b9a4d could not be found. Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a6fa4c-df67-4379-88ff-45430f0b9a4d could not be found. Aug 06 20:57:20.688450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:20.694134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Returning 404 to user: Instance f4a6fa4c-df67-4379-88ff-45430f0b9a4d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:20.694134 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-355c7eea-a152-4fc6-b107-e96de8bd1fef tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d" status: 404 len: 111 microversion: 2.1 time: 0.086234 Aug 06 20:57:20.694134 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 584/1172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:20 2022] GET /compute/v2.1/servers/f4a6fa4c-df67-4379-88ff-45430f0b9a4d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:20.702720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7b980520-5fa5-4d4f-81c3-b0c915c65cef req-b0bdd259-ee63-4ffd-b52d-704b55ae0354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a7adc6-d32c-4d2b-84be-536c9aebe878", "name": "network-vif-unplugged", "status": "completed", "tag": "397efc42-e695-4b22-a223-76833b924b55"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:20.728166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7b980520-5fa5-4d4f-81c3-b0c915c65cef req-b0bdd259-ee63-4ffd-b52d-704b55ae0354 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:20.729484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7b980520-5fa5-4d4f-81c3-b0c915c65cef req-b0bdd259-ee63-4ffd-b52d-704b55ae0354 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:20.729932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7b980520-5fa5-4d4f-81c3-b0c915c65cef req-b0bdd259-ee63-4ffd-b52d-704b55ae0354 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:20.771748 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7b980520-5fa5-4d4f-81c3-b0c915c65cef req-b0bdd259-ee63-4ffd-b52d-704b55ae0354 service nova] Creating event network-vif-unplugged:397efc42-e695-4b22-a223-76833b924b55 for instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 on nch1-master-1 Aug 06 20:57:20.792954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-7b980520-5fa5-4d4f-81c3-b0c915c65cef req-b0bdd259-ee63-4ffd-b52d-704b55ae0354 service nova] Instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:57:20.811541 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7b980520-5fa5-4d4f-81c3-b0c915c65cef req-b0bdd259-ee63-4ffd-b52d-704b55ae0354 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120889 Aug 06 20:57:20.818771 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 585/1173] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:20.832064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ec23eef6-93f8-4fa0-bb8f-9acec40f7966 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:20.832825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ec23eef6-93f8-4fa0-bb8f-9acec40f7966 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:20.944844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ec23eef6-93f8-4fa0-bb8f-9acec40f7966 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:20.952965 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ec23eef6-93f8-4fa0-bb8f-9acec40f7966 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1215 microversion: 2.1 time: 0.130233 Aug 06 20:57:20.976686 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 586/1174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:20 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:20.994343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:20.995168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 0b5f4cef-88c9-4234-b823-bb15b4d351a8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:21.013679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:21.016327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:21.017761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:21.018828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:21.020706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:21.021594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:21.023615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:21.037993 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ffb59a2d-eb89-4661-be29-633f62fcd2ea tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1313 microversion: 2.1 time: 0.449764 Aug 06 20:57:21.042227 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 589/1175] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:20 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:21.056562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:21.058162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:21.077129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:21.080169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:21.083867 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] HTTP exception thrown: Instance 0b5f4cef-88c9-4234-b823-bb15b4d351a8 could not be found. Aug 06 20:57:21.084637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:21.089555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:21.090158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:21.090726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Request method failure captured: Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 HTTP/1.1 Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUEMYCUboqC3YtaC8K6tYR4k23m1Yp-GKm2f3ElGr7nYavjPnmtCYNjrOtwKV2c2d_bUl2zrsasXf7RLD66h4PykGKdl-I33sHcIWXFp5f_ik2QHXjE3KeHf4NIh4r2awFQxsyCFstJRqR5WtKFkb4V4eXFSyID7LQQfqLJkDTWlc0 Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:21.091337 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0e3164f8b4943eeb85883a0fa08efaa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 10aebae8bbbd4ea88b9cbf85d3438ed1 Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 0b5f4cef-88c9-4234-b823-bb15b4d351a8 could not be found. Aug 06 20:57:21.092988 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '0b5f4cef-88c9-4234-b823-bb15b4d351a8'} Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b5f4cef-88c9-4234-b823-bb15b4d351a8 could not be found. Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:21.093946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b5f4cef-88c9-4234-b823-bb15b4d351a8 could not be found. Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b5f4cef-88c9-4234-b823-bb15b4d351a8 could not be found. Aug 06 20:57:21.096617 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:21.100349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Returning 404 to user: Instance 0b5f4cef-88c9-4234-b823-bb15b4d351a8 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:21.102015 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-67afd8d6-8846-48e1-bcb5-c1198ef9c540 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8" status: 404 len: 111 microversion: 2.1 time: 0.124099 Aug 06 20:57:21.102801 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 587/1176] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:20 2022] GET /compute/v2.1/servers/0b5f4cef-88c9-4234-b823-bb15b4d351a8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:21.108846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-292072510", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:21.267328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:57:21.584880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:21.598408 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-28413558-de4c-4da0-b594-5a5507f30024 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.553875 Aug 06 20:57:21.599706 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 590/1177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:21 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:21.605586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9d82a863-04b6-46b9-81fb-0fa449804437 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:21.654101 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9d82a863-04b6-46b9-81fb-0fa449804437 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/cd84b490-1adc-4a7f-a8e2-6ddf1fcf3316" status: 204 len: 0 microversion: 2.1 time: 0.052578 Aug 06 20:57:21.655460 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 591/1178] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 20:57:21 2022] DELETE /compute/v2.1/os-server-groups/cd84b490-1adc-4a7f-a8e2-6ddf1fcf3316 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:21.665374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:21.666369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:21.676211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:21.677072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:21.677736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:21.679111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:21.680074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:21.680730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:21.942892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:57:21.943856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:57:21.944519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:57:21.945071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:57:21.945640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:57:21.960010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:21.960493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:21.961128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:21.962076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:21.962538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:21.962990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:21.996831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Getting quotas for project 61b980ff8dca4c84bb452d09d55c37ef. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:21.998534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:22.004677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Getting quotas for user 46557175a8504db78843b5d56b1413cf and project 61b980ff8dca4c84bb452d09d55c37ef. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:22.008216 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce61872e-31ba-4283-8196-aaaaed4509f6 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1535 microversion: 2.1 time: 0.348590 Aug 06 20:57:22.008818 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 592/1179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:21 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1535 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:22.015818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:22.016883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:22.028012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:57:22.030829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:57:22.041173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.041847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.042589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.043350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.043824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.044263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.092804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:22.101874 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4fb9edb2-191b-4de1-afaf-2a9e2c49ef67 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997780 Aug 06 20:57:22.102834 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 588/1180] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:57:22.107923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-69dc22c8-7c1d-485e-8a5d-66aa030b0a16 req-f96e6c65-d2ed-495c-a452-3bb3af71e561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038bd6a9-9d4a-48b8-a1e8-6757e799e4e9", "tag": "f469f0b5-acdf-45dd-9a45-a89f75261c3c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:22.155678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-69dc22c8-7c1d-485e-8a5d-66aa030b0a16 req-f96e6c65-d2ed-495c-a452-3bb3af71e561 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.158104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-69dc22c8-7c1d-485e-8a5d-66aa030b0a16 req-f96e6c65-d2ed-495c-a452-3bb3af71e561 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.164022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:22.169162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-69dc22c8-7c1d-485e-8a5d-66aa030b0a16 req-f96e6c65-d2ed-495c-a452-3bb3af71e561 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.219003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-69dc22c8-7c1d-485e-8a5d-66aa030b0a16 req-f96e6c65-d2ed-495c-a452-3bb3af71e561 service nova] Creating event network-changed:f469f0b5-acdf-45dd-9a45-a89f75261c3c for instance 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 on nch1-master-1 Aug 06 20:57:22.241839 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-69dc22c8-7c1d-485e-8a5d-66aa030b0a16 req-f96e6c65-d2ed-495c-a452-3bb3af71e561 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136528 Aug 06 20:57:22.244036 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 589/1181] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:22.258899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:22.265366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:22.296546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.304010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.304545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.305900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.306383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.307977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.337321 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8822d871-2a71-4177-b5b2-04067cf52567 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425" status: 204 len: 0 microversion: 2.1 time: 0.326294 Aug 06 20:57:22.337950 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 593/1182] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:22 2022] DELETE /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:22.374332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:22.379606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:22.412795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.415528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.416033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.416825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.422647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.423467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.470208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:22.496003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-511cb47e-afd3-4dc6-b161-49bac1575b81 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1267 microversion: 2.1 time: 0.236012 Aug 06 20:57:22.501312 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 590/1183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:22 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:22.518561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef285a93-8953-4898-a8c4-e02a797b08b3 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:22.524172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ef285a93-8953-4898-a8c4-e02a797b08b3 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:22.690079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ef285a93-8953-4898-a8c4-e02a797b08b3 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:22.699767 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ef285a93-8953-4898-a8c4-e02a797b08b3 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1221 microversion: 2.1 time: 0.196993 Aug 06 20:57:22.701532 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 591/1184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:22 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1221 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:22.709023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f3d73e35-c148-45a6-9dbf-cc0b724d9196 req-3ec970fe-4f94-49d1-85a7-2ea9dae88342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cdaea82-6028-42e8-bb20-355bf0215ea8", "tag": "75a6aa9e-9e89-491f-bbf8-78140d2656c4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:22.739883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f3d73e35-c148-45a6-9dbf-cc0b724d9196 req-3ec970fe-4f94-49d1-85a7-2ea9dae88342 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.740396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f3d73e35-c148-45a6-9dbf-cc0b724d9196 req-3ec970fe-4f94-49d1-85a7-2ea9dae88342 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.745289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f3d73e35-c148-45a6-9dbf-cc0b724d9196 req-3ec970fe-4f94-49d1-85a7-2ea9dae88342 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.759310 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f3d73e35-c148-45a6-9dbf-cc0b724d9196 req-3ec970fe-4f94-49d1-85a7-2ea9dae88342 service nova] Creating event network-changed:75a6aa9e-9e89-491f-bbf8-78140d2656c4 for instance 3cdaea82-6028-42e8-bb20-355bf0215ea8 on nch2-master-1 Aug 06 20:57:22.765149 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f3d73e35-c148-45a6-9dbf-cc0b724d9196 req-3ec970fe-4f94-49d1-85a7-2ea9dae88342 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061717 Aug 06 20:57:22.766019 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 592/1185] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:22.773517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:22.774288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:22.782869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.784373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.784905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.785820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.786513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.787116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.830084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:22.849859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:22.946134 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b2867b6e-120f-4d4d-b572-fdf701c1686e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 204 len: 0 microversion: 2.1 time: 0.177806 Aug 06 20:57:22.949926 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 593/1186] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:22 2022] DELETE /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:22.953180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:22.954723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:22.962200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.962738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.963178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:22.963893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:22.964402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:22.964828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.127138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:23.136247 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-935fab8e-e870-4915-bd7b-8ea94ed64fd3 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.187644 Aug 06 20:57:23.136952 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 594/1187] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:22 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:23.142631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:23.143640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:23.154939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.155532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.155982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.156706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.159019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.159761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.194961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:23.203122 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-98a02982-fcc1-4f8c-bcd3-5a4c5843a2d6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1313 microversion: 2.1 time: 0.858077 Aug 06 20:57:23.203841 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 594/1188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:22 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1313 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:23.209863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:23.210738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:23.217197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.217958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.218916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.220303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.220933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.221517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.308975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:23.317635 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-958ac3ac-9a50-44c7-8df8-89a52ecbe071 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425" status: 200 len: 1475 microversion: 2.1 time: 0.179494 Aug 06 20:57:23.318401 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 595/1189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:23 2022] GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 => generated 1475 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:23.363482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:23.371547 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1f598918-8ac4-4698-98cc-4b3bd8210ae0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1528 microversion: 2.1 time: 0.165986 Aug 06 20:57:23.372148 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 595/1190] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:23 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1528 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:23.393809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:23.394427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:23.400945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.401437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.401876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.402683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.403148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.403580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.519455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:23.520089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:23.527782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.528336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.528781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.530130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.530627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.531099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.583058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:23.608845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cc45fcab-9ac6-4557-bfc2-445ef1a4cfd5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1528 microversion: 2.1 time: 0.205268 Aug 06 20:57:23.623530 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 596/1191] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:23 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1528 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:23.634063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b09352db-a3d5-47cd-b4f3-7bba0ae823a5 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:23.635052 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:57:23.635052 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b09352db-a3d5-47cd-b4f3-7bba0ae823a5 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] HTTP exception thrown: Flavor f5e9013f-d318-4d9f-aebe-f26d76d7c28f could not be found. Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b09352db-a3d5-47cd-b4f3-7bba0ae823a5 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Request method failure captured: Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/flavors/f5e9013f-d318-4d9f-aebe-f26d76d7c28f HTTP/1.1 Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tTv3FpVQx2ETkzI_nk40UJxOWE-BWJ9Rc8PVZMiTkuLv90A7KJhjB9CzvOujL0hl_8NFSRySzpVknkFLwLP_ZmLxvD8oOVhnyPD6Jx-ur3gqK0cG8UfDYEoOU0UtznFe9ZPd7m5XogmDTcxyJqoJWQ6Rq2XHTgNhJA79imhjKtJgAw Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 40902914b9a24c9e866171fbbcad74af Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-MigrationsAdminTest-438348689 Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:57:23.653596 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40902914b9a24c9e866171fbbcad74af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40902914b9a24c9e866171fbbcad74af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40902914b9a24c9e866171fbbcad74af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40902914b9a24c9e866171fbbcad74af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-MigrationsAdminTest-438348689 Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 40902914b9a24c9e866171fbbcad74af Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-MigrationsAdminTest-438348689 Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-MigrationsAdminTest-438348689-project-admin Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3028158d6d2f4b83815b724cd13dcb3b Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-MigrationsAdminTest-438348689-project-admin Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: exception: Flavor f5e9013f-d318-4d9f-aebe-f26d76d7c28f could not be found. Aug 06 20:57:23.655729 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'f5e9013f-d318-4d9f-aebe-f26d76d7c28f'} Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f5e9013f-d318-4d9f-aebe-f26d76d7c28f could not be found. Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:23.656469 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor f5e9013f-d318-4d9f-aebe-f26d76d7c28f could not be found. Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f5e9013f-d318-4d9f-aebe-f26d76d7c28f could not be found. Aug 06 20:57:23.657774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:23.660085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b09352db-a3d5-47cd-b4f3-7bba0ae823a5 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Returning 404 to user: Flavor f5e9013f-d318-4d9f-aebe-f26d76d7c28f could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:23.660085 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b09352db-a3d5-47cd-b4f3-7bba0ae823a5 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/f5e9013f-d318-4d9f-aebe-f26d76d7c28f" status: 404 len: 109 microversion: 2.1 time: 0.021985 Aug 06 20:57:23.660085 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 597/1192] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:23 2022] DELETE /compute/v2.1/flavors/f5e9013f-d318-4d9f-aebe-f26d76d7c28f => generated 109 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:23.711265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:23.723425 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75244f9e-290b-41c4-adc2-e9fc18d7d6c0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1275 microversion: 2.1 time: 0.208386 Aug 06 20:57:23.727674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:23.728033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:23.735647 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 596/1193] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:23 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:23.742691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.743209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.743662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.744397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:23.744877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:23.745316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:23.823811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2019279734", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:23.842345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:23.851667 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3c9e9e01-77c2-4510-8009-1059924f2b86 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1225 microversion: 2.1 time: 0.129424 Aug 06 20:57:23.862571 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 598/1194] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:23 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:23.907426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:57:24.158416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:24.159352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:24.174273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.175137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.175800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.176790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.177461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.178099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.282004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:57:24.282683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:57:24.283254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:57:24.283705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:57:24.284291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:57:24.294751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.295235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.295889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.296621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.297079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.298073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.318272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:24.324870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Getting quotas for user 0701f31766dd4eeab9a63f6411c26d6e and project aa51632a6bbf4d26b3db87902d6a17d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:24.347569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:57:24.350335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:57:24.400756 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47c956ac-8722-4ed9-ba43-b2717880ee5c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580748 Aug 06 20:57:24.402082 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 597/1195] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:57:24.413799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:24.415254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:24.421908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.423347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.423966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.424829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.425571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.426187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.496191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:24.509812 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-31baa951-f3be-4e4c-b98e-7258d55ec6de tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.355463 Aug 06 20:57:24.524741 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 599/1196] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:24 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:24.530254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:24.540300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:24.558585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.559298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.559935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.561034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.561694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.562874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.609893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:24.618781 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9cefffde-0397-4647-8b40-45bf8e124e71 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1313 microversion: 2.1 time: 0.214909 Aug 06 20:57:24.619377 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 598/1197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:24 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:24.627423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c5b09e7b-3758-4fb0-8c71-22946e7790c9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:24.628627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c5b09e7b-3758-4fb0-8c71-22946e7790c9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:24.697342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c5b09e7b-3758-4fb0-8c71-22946e7790c9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:24.710341 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c5b09e7b-3758-4fb0-8c71-22946e7790c9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1213 microversion: 2.1 time: 0.088000 Aug 06 20:57:24.711206 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 599/1198] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:24 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:24.745570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:24.746279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:24.755104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.756272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.756979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.758256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.759018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.759494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.836748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:24.846008 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c683b34-1b66-4f52-841e-94a5438fddcd tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425" status: 200 len: 1475 microversion: 2.1 time: 0.319808 Aug 06 20:57:24.846703 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 600/1199] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:24 2022] GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 => generated 1475 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:24.877166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:24.878780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:24.892532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.893116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.893564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.894288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:24.894784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:24.895220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:24.987146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:24.995407 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a70d1538-0b98-4866-a7e3-563a9e3d5c81 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1225 microversion: 2.1 time: 0.124385 Aug 06 20:57:24.996007 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 601/1200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:24 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:25.063742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:25.072662 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-602ee457-cfea-4d04-920b-c76dea841b38 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1327 microversion: 2.1 time: 0.330607 Aug 06 20:57:25.073590 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 600/1201] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:24 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1327 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:25.529635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:25.530268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:25.542044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:25.542843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:25.543293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:25.544018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:25.544479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:25.549069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:25.638306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:25.639104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:25.651635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:25.652146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:25.652603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:25.653330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:25.655203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:25.655757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:25.749412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:25.760336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-24937ae6-b0ac-4336-aa0a-28b2ea960a61 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.234616 Aug 06 20:57:25.761681 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 602/1202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:25 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:25.767833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-30b60603-88ea-42bd-ae78-859a69da72df req-96a7c0ff-474d-45dd-aad9-5bbebfcd0001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc61a7b0-d433-449a-a4a0-c541f208337d", "name": "network-vif-deleted", "tag": "80477638-d273-44c3-a82b-c2d5865cd0fd"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:25.773326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:25.779173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-30b60603-88ea-42bd-ae78-859a69da72df req-96a7c0ff-474d-45dd-aad9-5bbebfcd0001 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:25.779958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-30b60603-88ea-42bd-ae78-859a69da72df req-96a7c0ff-474d-45dd-aad9-5bbebfcd0001 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:25.780667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-30b60603-88ea-42bd-ae78-859a69da72df req-96a7c0ff-474d-45dd-aad9-5bbebfcd0001 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:25.795714 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-30b60603-88ea-42bd-ae78-859a69da72df req-96a7c0ff-474d-45dd-aad9-5bbebfcd0001 service nova] Creating event network-vif-deleted:80477638-d273-44c3-a82b-c2d5865cd0fd for instance dc61a7b0-d433-449a-a4a0-c541f208337d on nch2-master-1 Aug 06 20:57:25.802146 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-30b60603-88ea-42bd-ae78-859a69da72df req-96a7c0ff-474d-45dd-aad9-5bbebfcd0001 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038766 Aug 06 20:57:25.803667 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 603/1203] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:25.809273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:25.810589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:25.819759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:25.821049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:25.821863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:25.822935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:25.823658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:25.824329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.023926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:26.039284 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a885115d-35f1-412d-852a-54b0833509d2 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1265 microversion: 2.1 time: 0.233891 Aug 06 20:57:26.058530 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 604/1204] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:25 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:26.063100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:26.067967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:26.081934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.087038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.087555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.088310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.088774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.089203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.409890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:26.420510 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5f76b8f-315c-4009-851c-45195f4d4859 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1313 microversion: 2.1 time: 0.786017 Aug 06 20:57:26.436684 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 601/1205] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:25 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:26.444868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:26.446336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:26.452817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.453584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.454798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.455679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.456301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.457196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.484280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:26.496042 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3372f74c-2b1e-487c-973f-082b5e36b685 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425" status: 200 len: 1475 microversion: 2.1 time: 0.435822 Aug 06 20:57:26.498036 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 605/1206] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:26 2022] GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 => generated 1475 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:26.507178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:26.509824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:26.523253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.524014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.524645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.525522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.526143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.526770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.580720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:26.596870 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3159452-8357-442c-9cb7-479a1d670337 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1291 microversion: 2.1 time: 0.156116 Aug 06 20:57:26.597510 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 602/1207] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:26 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1291 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:26.661380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d426bf5f-db4b-41f8-bbcf-41ca0660abcc req-427aae20-87d9-489a-aab8-1286ad330d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a7adc6-d32c-4d2b-84be-536c9aebe878", "name": "network-vif-plugged", "status": "completed", "tag": "397efc42-e695-4b22-a223-76833b924b55"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:26.693032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d426bf5f-db4b-41f8-bbcf-41ca0660abcc req-427aae20-87d9-489a-aab8-1286ad330d1b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.693880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d426bf5f-db4b-41f8-bbcf-41ca0660abcc req-427aae20-87d9-489a-aab8-1286ad330d1b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.694527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d426bf5f-db4b-41f8-bbcf-41ca0660abcc req-427aae20-87d9-489a-aab8-1286ad330d1b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.711932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d426bf5f-db4b-41f8-bbcf-41ca0660abcc req-427aae20-87d9-489a-aab8-1286ad330d1b service nova] Creating event network-vif-plugged:397efc42-e695-4b22-a223-76833b924b55 for instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 on nch1-master-1 Aug 06 20:57:26.719154 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d426bf5f-db4b-41f8-bbcf-41ca0660abcc req-427aae20-87d9-489a-aab8-1286ad330d1b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062895 Aug 06 20:57:26.720921 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 603/1208] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:57:26.783653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:26.784879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:26.795247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.796039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.796738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.797747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.798493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.799539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.819798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:26.831399 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d417dcaf-11ca-4902-af6b-911a805b72e9 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.332213 Aug 06 20:57:26.832837 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 606/1209] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:26 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:26.838002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d6449aff-96e7-487b-ac0a-487f0e9fd4d5 req-1c25e4c6-6cc5-4b06-b7f9-2ac09b8b2c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fe03fb-ab4b-4c3c-b371-87fd08dc84ca", "tag": "219bd8a1-4249-40ae-a148-22d89dd3953d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:26.862649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d6449aff-96e7-487b-ac0a-487f0e9fd4d5 req-1c25e4c6-6cc5-4b06-b7f9-2ac09b8b2c00 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:26.863502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d6449aff-96e7-487b-ac0a-487f0e9fd4d5 req-1c25e4c6-6cc5-4b06-b7f9-2ac09b8b2c00 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:26.864191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d6449aff-96e7-487b-ac0a-487f0e9fd4d5 req-1c25e4c6-6cc5-4b06-b7f9-2ac09b8b2c00 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:26.878282 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d6449aff-96e7-487b-ac0a-487f0e9fd4d5 req-1c25e4c6-6cc5-4b06-b7f9-2ac09b8b2c00 service nova] Creating event network-changed:219bd8a1-4249-40ae-a148-22d89dd3953d for instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca on nch2-master-1 Aug 06 20:57:26.883855 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d6449aff-96e7-487b-ac0a-487f0e9fd4d5 req-1c25e4c6-6cc5-4b06-b7f9-2ac09b8b2c00 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049631 Aug 06 20:57:26.885030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 607/1210] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:26.994788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:27.003922 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-89d3ee33-c980-4a71-bec9-2d7f4f6bd0ed tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.226114 Aug 06 20:57:27.004865 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 604/1211] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:26 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:27.060519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:27.061225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:27.083730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.084169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.084630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.085366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.085835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.086311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.430370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:27.432100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:27.433238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:27.438868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce11a716-f9b5-480e-b7b9-25a6d93471c1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 0.381865 Aug 06 20:57:27.445814 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 608/1212] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:27 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:27.447722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.448317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.448768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.449494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.449959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.450393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.461511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:27.461757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:27.469175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.470115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.471083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.472165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.472787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.473534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.740692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid a87d6735-5d42-4f96-aac5-55b50a1a804f {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:57:27.773664 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-597b56f8-8c8b-41dc-a33b-af3051fd4a0e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 2344 microversion: 2.25 time: 0.344688 Aug 06 20:57:27.775153 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 605/1213] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:27 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 2344 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:27.781189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:27.782263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:27.797165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.798756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.801155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.802709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.803621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.804266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.862233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.863392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.864589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.866936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lazy-loading 'fault' on Instance uuid c16c7d7a-6a48-4260-b7d1-451b01c03425 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:57:27.878829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:27.887307 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-872d4b76-a79f-41e4-8c81-31a23fefb6f9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1313 microversion: 2.1 time: 0.439998 Aug 06 20:57:27.894831 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 609/1214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:27 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:27.911076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:27.927609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:27.940352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.946875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.952577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:27.954110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:27.954861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:27.955482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:28.040354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:28.056195 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b0549a5f-f3da-4fce-a515-18a5b02ab039 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425" status: 200 len: 1309 microversion: 2.1 time: 0.279122 Aug 06 20:57:28.058036 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 606/1215] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:27 2022] GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:28.068304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-39d61a3c-4b5b-4b03-a33c-3add0264f80a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:28.073679 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:57:28.073679 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:57:28.076463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d61a3c-4b5b-4b03-a33c-3add0264f80a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:28.077256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d61a3c-4b5b-4b03-a33c-3add0264f80a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:28.077947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d61a3c-4b5b-4b03-a33c-3add0264f80a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:28.079708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d61a3c-4b5b-4b03-a33c-3add0264f80a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:28.080616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d61a3c-4b5b-4b03-a33c-3add0264f80a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:28.081266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d61a3c-4b5b-4b03-a33c-3add0264f80a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:28.118746 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-39d61a3c-4b5b-4b03-a33c-3add0264f80a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.059097 Aug 06 20:57:28.119467 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 607/1216] 10.222.0.33 () {60 vars in 1217 bytes} [Sat Aug 6 20:57:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:57:28.124191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:28.125001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:28.137041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:28.137779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:28.138420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:28.139495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:28.140317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:28.141701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:28.276545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:28.293937 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c7afaaa1-3ddf-4109-ad7b-cebf7eb29adb tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1279 microversion: 2.1 time: 0.395732 Aug 06 20:57:28.296676 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 610/1217] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:27 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1279 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:28.306719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:28.307708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:28.318704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:28.319543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:28.320179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:28.322076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:28.322809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:28.323994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:28.362793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:28.649789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:28.671798 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf70a453-ad56-47f7-afb7-2f18d7908cea tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.546628 Aug 06 20:57:28.674759 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 608/1218] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:28 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:28.685821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:28.687063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:28.716056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:28.722056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:28.727334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:28.728157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:28.728714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:28.734476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.024448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:29.036283 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f58648bd-09d0-43fd-a5b1-3047d7f55d36 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.737450 Aug 06 20:57:29.038951 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 611/1219] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:28 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:29.050416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:29.051474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:29.076433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.077466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.078929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.080201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.081284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.081974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.638456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:29.649592 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-56beb43a-61f9-4ff0-8838-ec677f38df03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1313 microversion: 2.1 time: 0.608714 Aug 06 20:57:29.650304 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 612/1220] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:29 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1313 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:29.655385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:29.657383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: c16c7d7a-6a48-4260-b7d1-451b01c03425] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:29.681274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.682509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.683198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.684132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.684816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.685447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.701928 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] HTTP exception thrown: Instance c16c7d7a-6a48-4260-b7d1-451b01c03425 could not be found. Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Request method failure captured: Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 HTTP/1.1 Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUEMYCUboqC3YtaC8K6tYR4k23m1Yp-GKm2f3ElGr7nYavjPnmtCYNjrOtwKV2c2d_bUl2zrsasXf7RLD66h4PykGKdl-I33sHcIWXFp5f_ik2QHXjE3KeHf4NIh4r2awFQxsyCFstJRqR5WtKFkb4V4eXFSyID7LQQfqLJkDTWlc0 Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:29.704973 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0e3164f8b4943eeb85883a0fa08efaa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 10aebae8bbbd4ea88b9cbf85d3438ed1 Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance c16c7d7a-6a48-4260-b7d1-451b01c03425 could not be found. Aug 06 20:57:29.706386 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'c16c7d7a-6a48-4260-b7d1-451b01c03425'} Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c16c7d7a-6a48-4260-b7d1-451b01c03425 could not be found. Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:29.707230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c16c7d7a-6a48-4260-b7d1-451b01c03425 could not be found. Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c16c7d7a-6a48-4260-b7d1-451b01c03425 could not be found. Aug 06 20:57:29.708525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.709662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:29.711715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Returning 404 to user: Instance c16c7d7a-6a48-4260-b7d1-451b01c03425 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:29.713745 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9b6bda02-c757-4166-9651-27d65199aabc tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425" status: 404 len: 111 microversion: 2.1 time: 0.061967 Aug 06 20:57:29.718875 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 613/1221] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:29 2022] GET /compute/v2.1/servers/c16c7d7a-6a48-4260-b7d1-451b01c03425 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:29.720934 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b203dc32-995a-4afa-8b17-702f48c07fc5 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 1.043611 Aug 06 20:57:29.723338 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 609/1222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:28 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:29.726895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-47fcc4cf-6953-407c-b7a1-2fa85485648d req-33fd7da1-9d79-4940-816b-2b1f06f8a7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16c7d7a-6a48-4260-b7d1-451b01c03425", "name": "network-vif-deleted", "tag": "3c8d9295-154e-4003-bad7-77e541a4a2d4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:29.734239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:29.739362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-47fcc4cf-6953-407c-b7a1-2fa85485648d req-33fd7da1-9d79-4940-816b-2b1f06f8a7bd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.740081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-47fcc4cf-6953-407c-b7a1-2fa85485648d req-33fd7da1-9d79-4940-816b-2b1f06f8a7bd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.740734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-47fcc4cf-6953-407c-b7a1-2fa85485648d req-33fd7da1-9d79-4940-816b-2b1f06f8a7bd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.741874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:29.754024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.754533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.755011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.755731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.756202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.756616 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-47fcc4cf-6953-407c-b7a1-2fa85485648d req-33fd7da1-9d79-4940-816b-2b1f06f8a7bd service nova] Creating event network-vif-deleted:3c8d9295-154e-4003-bad7-77e541a4a2d4 for instance c16c7d7a-6a48-4260-b7d1-451b01c03425 on nch2-master-1 Aug 06 20:57:29.756740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.763044 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-47fcc4cf-6953-407c-b7a1-2fa85485648d req-33fd7da1-9d79-4940-816b-2b1f06f8a7bd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040893 Aug 06 20:57:29.764296 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 614/1223] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:29.772155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-4b119bb2-a57b-424d-860f-a9ff67f8bbbb req-b7ffa492-666a-49dd-9ce5-a60c8611d160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038bd6a9-9d4a-48b8-a1e8-6757e799e4e9", "name": "network-vif-plugged", "status": "completed", "tag": "f469f0b5-acdf-45dd-9a45-a89f75261c3c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:29.786574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4b119bb2-a57b-424d-860f-a9ff67f8bbbb req-b7ffa492-666a-49dd-9ce5-a60c8611d160 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.787479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4b119bb2-a57b-424d-860f-a9ff67f8bbbb req-b7ffa492-666a-49dd-9ce5-a60c8611d160 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.788294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4b119bb2-a57b-424d-860f-a9ff67f8bbbb req-b7ffa492-666a-49dd-9ce5-a60c8611d160 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.805381 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-4b119bb2-a57b-424d-860f-a9ff67f8bbbb req-b7ffa492-666a-49dd-9ce5-a60c8611d160 service nova] Creating event network-vif-plugged:f469f0b5-acdf-45dd-9a45-a89f75261c3c for instance 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 on nch1-master-1 Aug 06 20:57:29.810262 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-4b119bb2-a57b-424d-860f-a9ff67f8bbbb req-b7ffa492-666a-49dd-9ce5-a60c8611d160 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044492 Aug 06 20:57:29.811016 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 615/1224] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:29.817588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:29.818290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:29.825575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.826297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.826963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.827672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.828132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.829123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.904624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:29.913933 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-11868cce-03fc-46da-ac43-5f8bf4830243 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1279 microversion: 2.1 time: 0.189495 Aug 06 20:57:29.914529 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 610/1225] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:29 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:29.923744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:29.924800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: dc61a7b0-d433-449a-a4a0-c541f208337d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:29.931350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.932340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.932962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.933835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:29.934499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:29.935102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:29.951122 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] HTTP exception thrown: Instance dc61a7b0-d433-449a-a4a0-c541f208337d could not be found. Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Request method failure captured: Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d HTTP/1.1 Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUEMYCUboqC3YtaC8K6tYR4k23m1Yp-GKm2f3ElGr7nYavjPnmtCYNjrOtwKV2c2d_bUl2zrsasXf7RLD66h4PykGKdl-I33sHcIWXFp5f_ik2QHXjE3KeHf4NIh4r2awFQxsyCFstJRqR5WtKFkb4V4eXFSyID7LQQfqLJkDTWlc0 Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:29.953018 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0e3164f8b4943eeb85883a0fa08efaa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 10aebae8bbbd4ea88b9cbf85d3438ed1 Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance dc61a7b0-d433-449a-a4a0-c541f208337d could not be found. Aug 06 20:57:29.955471 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'dc61a7b0-d433-449a-a4a0-c541f208337d'} Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc61a7b0-d433-449a-a4a0-c541f208337d could not be found. Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:29.956348 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc61a7b0-d433-449a-a4a0-c541f208337d could not be found. Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc61a7b0-d433-449a-a4a0-c541f208337d could not be found. Aug 06 20:57:29.957759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:29.959073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Returning 404 to user: Instance dc61a7b0-d433-449a-a4a0-c541f208337d could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:29.959073 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6549460e-279e-49cf-b2df-577c30648e0e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d" status: 404 len: 111 microversion: 2.1 time: 0.042651 Aug 06 20:57:29.959073 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 611/1226] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:29 2022] GET /compute/v2.1/servers/dc61a7b0-d433-449a-a4a0-c541f208337d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:29.972816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40bbdb61-5288-4339-956f-179fbf6ad6e4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:30.002296 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40bbdb61-5288-4339-956f-179fbf6ad6e4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/82fbbd24-b4e1-4d95-9266-83c4990a1892" status: 204 len: 0 microversion: 2.1 time: 0.035698 Aug 06 20:57:30.007811 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 612/1227] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 20:57:29 2022] DELETE /compute/v2.1/os-server-groups/82fbbd24-b4e1-4d95-9266-83c4990a1892 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:30.014518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:30.015323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:30.024747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.025523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.026160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.027132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.027750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.028339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.075436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:30.093253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:30.192916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:30.202590 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65c9f819-f18b-4a3e-ab3e-390367cd61d4 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 204 len: 0 microversion: 2.1 time: 0.192390 Aug 06 20:57:30.208193 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 613/1228] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:30 2022] DELETE /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:30.221346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:30.222366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:30.231506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.232201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.232826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.233678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.233982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.235323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.269388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:30.318358 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3990ac10-f4bd-4103-bfd6-dd5dd9a01708 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.505821 Aug 06 20:57:30.324710 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 616/1229] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:29 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:30.362700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c00bd573-828a-433d-9280-3413817a45f8 req-059aaa43-9387-451e-80b5-2653ee7d156a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0a6060-3d45-4cc6-bd81-528b40dbb976", "tag": "c8556477-5b67-40f9-bd2e-4a17626d6a2f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:30.381211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c00bd573-828a-433d-9280-3413817a45f8 req-059aaa43-9387-451e-80b5-2653ee7d156a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.382113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c00bd573-828a-433d-9280-3413817a45f8 req-059aaa43-9387-451e-80b5-2653ee7d156a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.382807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c00bd573-828a-433d-9280-3413817a45f8 req-059aaa43-9387-451e-80b5-2653ee7d156a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.427706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:30.439387 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c00bd573-828a-433d-9280-3413817a45f8 req-059aaa43-9387-451e-80b5-2653ee7d156a service nova] Creating event network-changed:c8556477-5b67-40f9-bd2e-4a17626d6a2f for instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 on nch2-master-1 Aug 06 20:57:30.451734 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c00bd573-828a-433d-9280-3413817a45f8 req-059aaa43-9387-451e-80b5-2653ee7d156a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125511 Aug 06 20:57:30.452018 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-27a7e6a5-aa23-4270-b23a-daccc8913b10 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.241776 Aug 06 20:57:30.454440 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 617/1230] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:30.458652 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 614/1231] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:30 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:30.470018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:30.471113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:30.484077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.486637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8747785f-f379-4585-92b8-6ccb45f2e21e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea0b00ed-84e0-4e19-b008-139ee8117ef4", "device": "/dev/xvdb"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:30.487977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.488760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.489623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8747785f-f379-4585-92b8-6ccb45f2e21e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:30.490997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.495678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.496412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.516845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8747785f-f379-4585-92b8-6ccb45f2e21e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.519501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8747785f-f379-4585-92b8-6ccb45f2e21e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.519970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8747785f-f379-4585-92b8-6ccb45f2e21e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.520699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8747785f-f379-4585-92b8-6ccb45f2e21e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.521414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8747785f-f379-4585-92b8-6ccb45f2e21e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.522002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8747785f-f379-4585-92b8-6ccb45f2e21e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.753691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:30.762415 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3bd67b38-f767-4e88-a47e-02d4aec80cec tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1472 microversion: 2.1 time: 0.304734 Aug 06 20:57:30.763039 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 618/1232] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:30 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1472 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:30.780470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:30.781309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:30.789374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.790081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.790522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.792492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.793146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.793633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.932746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:30.941454 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-86579354-c307-4b20-ab5f-c57077b0142a tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1313 microversion: 2.1 time: 0.165202 Aug 06 20:57:30.942027 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 619/1233] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:30 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:30.947256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:30.947866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:30.954492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.955148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.955588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:30.956282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:30.956738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:30.957165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.101947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:31.109973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-41a4ae79-8279-4918-8103-a27cf4f077d3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 0.166149 Aug 06 20:57:31.110536 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 620/1234] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:30 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:31.114998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:31.115605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:31.121163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.121648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.122089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.122884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.123353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.123782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.256035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:31.263602 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a549a638-05df-4f9a-84a7-c6c20497c22c tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1321 microversion: 2.1 time: 0.152058 Aug 06 20:57:31.264179 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 621/1235] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:31 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:31.344220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:31.345447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:31.351732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.352218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.352660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.353590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.354059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.354490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.588723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:31.598307 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36b25288-e4a1-44c2-93d1-0ac642da11db tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.257912 Aug 06 20:57:31.598838 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 622/1236] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:31 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:31.603549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:31.604355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:31.610808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.611466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.612149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.613051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.614165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.614814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.621516 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8747785f-f379-4585-92b8-6ccb45f2e21e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "POST /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.160872 Aug 06 20:57:31.623333 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 615/1237] 10.222.0.33 () {62 vars in 1364 bytes} [Sat Aug 6 20:57:30 2022] POST /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-volume_attachments => generated 194 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:57:31.785368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:31.786162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:31.794125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.794841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.795263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.796114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.796590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.797029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.848500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:31.856560 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-578535a2-a5f7-41be-ac7c-a90e57bf2301 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.256369 Aug 06 20:57:31.858348 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 623/1238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:31 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:31.864058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-69d3d984-a725-4749-8323-879a8c551bd8 req-09300348-81f4-4fb6-974c-5dd0ff2e5300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdaea82-6028-42e8-bb20-355bf0215ea8", "name": "network-vif-plugged", "status": "completed", "tag": "75a6aa9e-9e89-491f-bbf8-78140d2656c4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:31.875197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-69d3d984-a725-4749-8323-879a8c551bd8 req-09300348-81f4-4fb6-974c-5dd0ff2e5300 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.876712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-69d3d984-a725-4749-8323-879a8c551bd8 req-09300348-81f4-4fb6-974c-5dd0ff2e5300 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.877396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-69d3d984-a725-4749-8323-879a8c551bd8 req-09300348-81f4-4fb6-974c-5dd0ff2e5300 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.891901 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-69d3d984-a725-4749-8323-879a8c551bd8 req-09300348-81f4-4fb6-974c-5dd0ff2e5300 service nova] Creating event network-vif-plugged:75a6aa9e-9e89-491f-bbf8-78140d2656c4 for instance 3cdaea82-6028-42e8-bb20-355bf0215ea8 on nch2-master-1 Aug 06 20:57:31.899620 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-69d3d984-a725-4749-8323-879a8c551bd8 req-09300348-81f4-4fb6-974c-5dd0ff2e5300 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039933 Aug 06 20:57:31.900896 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 624/1239] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:31.965000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:31.965995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:31.977868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.981190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.981974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.984271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:31.984761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:31.985752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:31.986506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=7 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:32.060663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:32.070696 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-182764a2-ba96-4660-9d20-033f10f47e8e tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1472 microversion: 2.1 time: 0.290114 Aug 06 20:57:32.084121 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 616/1240] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:31 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:32.132128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:32.132917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:32.140415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:32.141028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:32.141640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:32.142515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:32.143116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:32.143692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:32.282862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:32.290738 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b567b9af-cf84-4b2a-9c16-d6773702240f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1313 microversion: 2.1 time: 0.331329 Aug 06 20:57:32.304711 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 625/1241] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:31 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:32.310223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:32.310496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:32.311137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:32.318663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:32.319473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:32.320132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:32.320438 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce28c936-8ba9-40cf-95ea-719c7a17faee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 0.192797 Aug 06 20:57:32.321293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:32.321975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:32.322663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:32.334362 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 617/1242] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:32 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:32.530919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bb59a9c5-4ba6-48f5-822e-020efb3ba938 req-d918abfb-9b94-442c-b7a5-5e2c9f2e2cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d7a71f-b21b-4142-bd6a-c7e178308644", "tag": "9da26b08-1938-4d2b-ad2f-1325748518c4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:32.542478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bb59a9c5-4ba6-48f5-822e-020efb3ba938 req-d918abfb-9b94-442c-b7a5-5e2c9f2e2cfa service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:32.543242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bb59a9c5-4ba6-48f5-822e-020efb3ba938 req-d918abfb-9b94-442c-b7a5-5e2c9f2e2cfa service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:32.544082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bb59a9c5-4ba6-48f5-822e-020efb3ba938 req-d918abfb-9b94-442c-b7a5-5e2c9f2e2cfa service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:32.557702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:32.566963 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-13c6d67e-8fe1-4c6e-9644-dd0e7868df32 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1321 microversion: 2.1 time: 0.260626 Aug 06 20:57:32.567738 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 626/1243] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:32 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:32.568181 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bb59a9c5-4ba6-48f5-822e-020efb3ba938 req-d918abfb-9b94-442c-b7a5-5e2c9f2e2cfa service nova] Creating event network-changed:9da26b08-1938-4d2b-ad2f-1325748518c4 for instance 40d7a71f-b21b-4142-bd6a-c7e178308644 on nch2-master-1 Aug 06 20:57:32.573485 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bb59a9c5-4ba6-48f5-822e-020efb3ba938 req-d918abfb-9b94-442c-b7a5-5e2c9f2e2cfa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046513 Aug 06 20:57:32.574306 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 618/1244] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:57:32.622445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:32.623361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:32.632705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:32.635629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:32.636295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:32.637018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:32.637501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:32.637931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:32.700434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=20 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:32.883596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:32.884260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:32.890575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:32.891087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:32.891558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:32.892268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:32.892725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:32.893153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.021238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:33.055338 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aac48b0c-d022-45a4-968e-61588426a699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.438292 Aug 06 20:57:33.067870 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 627/1245] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:32 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:33.083971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:33.093567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:33.094134 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e525f251-d3a5-4da1-87f8-be920a9f83a5 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.214802 Aug 06 20:57:33.094251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:33.095954 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 619/1246] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:32 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:33.117457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.118250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.118903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.119821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.120445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.121038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.311605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:33.312498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:33.319184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.319992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.320662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.321593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.322260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.322927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.501659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10aebae8bbbd4ea88b9cbf85d3438ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e3164f8b4943eeb85883a0fa08efaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:33.511397 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7ae0b8ad-ea31-42a2-b92d-68bd216a6f2f tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 200 len: 1472 microversion: 2.1 time: 0.421818 Aug 06 20:57:33.512216 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 628/1247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:33 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:33.517821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:33.519097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:33.527478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.528228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.529120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.530227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.530944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.531565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.533032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:33.550837 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4fecede0-4483-4ce5-932c-5ce82229119d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1462 microversion: 2.1 time: 0.243176 Aug 06 20:57:33.581175 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 620/1248] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:33 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1462 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:33.715270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d726d48-f5ac-4e78-a1b6-0992457ba305 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:33.720881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d726d48-f5ac-4e78-a1b6-0992457ba305 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Searching by: {'deleted': False, 'project_id': '29517a1e62d0497e8aaa61d568060cdc'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:57:33.726988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d726d48-f5ac-4e78-a1b6-0992457ba305 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.727478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d726d48-f5ac-4e78-a1b6-0992457ba305 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.727917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d726d48-f5ac-4e78-a1b6-0992457ba305 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.728665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d726d48-f5ac-4e78-a1b6-0992457ba305 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.729107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d726d48-f5ac-4e78-a1b6-0992457ba305 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.729536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d726d48-f5ac-4e78-a1b6-0992457ba305 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.745587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:33.755338 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f02f1fe-56d4-41de-ae62-0c54a62de9ea tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 0.241921 Aug 06 20:57:33.755922 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 629/1249] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:33 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:33.760457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:33.761061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:33.768319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.768818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.769318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.770051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.770531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.770984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.857917 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d726d48-f5ac-4e78-a1b6-0992457ba305 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.275337 Aug 06 20:57:33.858773 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 621/1250] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:57:33 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:33.878509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:33.886030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Searching by: {'deleted': False} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:57:33.890976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.892031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.893322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.893322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:33.893720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:33.894148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:33.920578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:33.931926 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-85fb1cf4-21f2-45dc-8fff-262d44baf196 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1321 microversion: 2.1 time: 0.174859 Aug 06 20:57:33.932772 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 630/1251] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:33 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:34.022828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Listed batch of 16 results from cell out of 1000 limit. Returned 16 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 20:57:34.077171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:34.078240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:34.086383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.086913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.087355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.088064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.088605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.089068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.108114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.108603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.109034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.114094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:34.312511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:34.321946 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d2cfbb4-a6ac-458f-91ec-69994a5728c5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.248519 Aug 06 20:57:34.322925 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 631/1252] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:34 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:34.328748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:34.330022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:34.336915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.337511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.338065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.339387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.339903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.340465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.482427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:34.492893 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ee2608e9-155e-4f23-89a8-ffd2e3b34eb4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1324 microversion: 2.1 time: 0.168279 Aug 06 20:57:34.494151 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 632/1253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:34 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:34.537874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:34.539455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] [instance: 29ea4f47-8ba4-49b1-afa0-5b8d50656763] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:34.546190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.546807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.547246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.548616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.549251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.549859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.564734 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] HTTP exception thrown: Instance 29ea4f47-8ba4-49b1-afa0-5b8d50656763 could not be found. Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Request method failure captured: Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 HTTP/1.1 Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUEMYCUboqC3YtaC8K6tYR4k23m1Yp-GKm2f3ElGr7nYavjPnmtCYNjrOtwKV2c2d_bUl2zrsasXf7RLD66h4PykGKdl-I33sHcIWXFp5f_ik2QHXjE3KeHf4NIh4r2awFQxsyCFstJRqR5WtKFkb4V4eXFSyID7LQQfqLJkDTWlc0 Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:34.566383 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0e3164f8b4943eeb85883a0fa08efaa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0e3164f8b4943eeb85883a0fa08efaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: c0e3164f8b4943eeb85883a0fa08efaa Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-981605830 Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 10aebae8bbbd4ea88b9cbf85d3438ed1 Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersOnMultiNodesTest-981605830-project Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 29ea4f47-8ba4-49b1-afa0-5b8d50656763 could not be found. Aug 06 20:57:34.568179 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '29ea4f47-8ba4-49b1-afa0-5b8d50656763'} Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ea4f47-8ba4-49b1-afa0-5b8d50656763 could not be found. Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:34.569156 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ea4f47-8ba4-49b1-afa0-5b8d50656763 could not be found. Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ea4f47-8ba4-49b1-afa0-5b8d50656763 could not be found. Aug 06 20:57:34.571560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:34.573854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] Returning 404 to user: Instance 29ea4f47-8ba4-49b1-afa0-5b8d50656763 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:34.573854 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d1c04f2c-8f1a-4850-b7e7-16a7440a0577 tempest-ServersOnMultiNodesTest-981605830 tempest-ServersOnMultiNodesTest-981605830-project] 10.222.0.33 "GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763" status: 404 len: 111 microversion: 2.1 time: 0.035917 Aug 06 20:57:34.573854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 633/1254] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:34 2022] GET /compute/v2.1/servers/29ea4f47-8ba4-49b1-afa0-5b8d50656763 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:34.589028 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3f46370e-f423-4136-97e2-9fb7b1440f25 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 25619 microversion: 2.1 time: 0.715010 Aug 06 20:57:34.589638 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 622/1255] 10.222.0.33 () {58 vars in 1171 bytes} [Sat Aug 6 20:57:33 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 25619 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:57:34.591868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a5ab8795-c77f-4770-9afe-5b03fc645e29 req-0905368f-bbba-41cb-a30c-c2332f504a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ea4f47-8ba4-49b1-afa0-5b8d50656763", "name": "network-vif-deleted", "tag": "71613f4b-7fc6-4bb5-9e51-23c21414dd51"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:34.604603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a5ab8795-c77f-4770-9afe-5b03fc645e29 req-0905368f-bbba-41cb-a30c-c2332f504a1d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.605089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a5ab8795-c77f-4770-9afe-5b03fc645e29 req-0905368f-bbba-41cb-a30c-c2332f504a1d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.605530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a5ab8795-c77f-4770-9afe-5b03fc645e29 req-0905368f-bbba-41cb-a30c-c2332f504a1d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.627655 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a5ab8795-c77f-4770-9afe-5b03fc645e29 req-0905368f-bbba-41cb-a30c-c2332f504a1d service nova] Creating event network-vif-deleted:71613f4b-7fc6-4bb5-9e51-23c21414dd51 for instance 29ea4f47-8ba4-49b1-afa0-5b8d50656763 on nch1-master-1 Aug 06 20:57:34.634073 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a5ab8795-c77f-4770-9afe-5b03fc645e29 req-0905368f-bbba-41cb-a30c-c2332f504a1d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046862 Aug 06 20:57:34.643605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dab70e25-2dab-4bc6-9854-327a142f12ff tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:34.646896 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 634/1256] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:57:34.653062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dab70e25-2dab-4bc6-9854-327a142f12ff tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Searching by: {'deleted': False, 'project_id': '29517a1e62d0497e8aaa61d568060cdc'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:57:34.659390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dab70e25-2dab-4bc6-9854-327a142f12ff tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.659881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dab70e25-2dab-4bc6-9854-327a142f12ff tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.660318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dab70e25-2dab-4bc6-9854-327a142f12ff tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.661044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dab70e25-2dab-4bc6-9854-327a142f12ff tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.661500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dab70e25-2dab-4bc6-9854-327a142f12ff tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.661930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dab70e25-2dab-4bc6-9854-327a142f12ff tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.699002 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dab70e25-2dab-4bc6-9854-327a142f12ff tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?tenant_id=1558d5dbaa704f40a3b6436b4b6c0e51" status: 200 len: 15 microversion: 2.1 time: 0.059751 Aug 06 20:57:34.700141 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 623/1257] 10.222.0.33 () {58 vars in 1231 bytes} [Sat Aug 6 20:57:34 2022] GET /compute/v2.1/servers/detail?tenant_id=1558d5dbaa704f40a3b6436b4b6c0e51 => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:34.720019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:34.729649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Searching by: {'tenant_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'deleted': False} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:57:34.738003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.738662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.739153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.739904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.740372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.740805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.777051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:34.777679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:34.785425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.785919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.786538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.787411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:34.788128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:34.788568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:34.874365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 20:57:35.007915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:35.018304 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-483466cd-6584-4917-af5c-381fed9ae661 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 0.245677 Aug 06 20:57:35.019137 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 624/1258] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:34 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:35.022987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.023468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.024406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.037462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:35.038265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:35.045271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.045771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.046508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.047253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.048171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.048893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.210455 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b035c050-6628-4680-a6b5-2c0a44e0930c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1558d5dbaa704f40a3b6436b4b6c0e51" status: 200 len: 4822 microversion: 2.1 time: 0.494501 Aug 06 20:57:35.210611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:35.211895 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 635/1259] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Aug 6 20:57:34 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1558d5dbaa704f40a3b6436b4b6c0e51 => generated 4822 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:35.218523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c21fcaf5-5c15-4a9b-86d2-e65ef5d71c47 req-ef9fe8d3-1acb-40ce-b2f8-350a03cd60f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fe03fb-ab4b-4c3c-b371-87fd08dc84ca", "name": "network-vif-plugged", "status": "completed", "tag": "219bd8a1-4249-40ae-a148-22d89dd3953d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:35.230828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c21fcaf5-5c15-4a9b-86d2-e65ef5d71c47 req-ef9fe8d3-1acb-40ce-b2f8-350a03cd60f2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.231926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c21fcaf5-5c15-4a9b-86d2-e65ef5d71c47 req-ef9fe8d3-1acb-40ce-b2f8-350a03cd60f2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.232365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c21fcaf5-5c15-4a9b-86d2-e65ef5d71c47 req-ef9fe8d3-1acb-40ce-b2f8-350a03cd60f2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.242415 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-91320fc9-0ae1-4a18-9d72-6c91ef0128d2 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1321 microversion: 2.1 time: 0.210199 Aug 06 20:57:35.243955 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c21fcaf5-5c15-4a9b-86d2-e65ef5d71c47 req-ef9fe8d3-1acb-40ce-b2f8-350a03cd60f2 service nova] Creating event network-vif-plugged:219bd8a1-4249-40ae-a148-22d89dd3953d for instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca on nch2-master-1 Aug 06 20:57:35.244554 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 625/1260] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:35 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:35.250023 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c21fcaf5-5c15-4a9b-86d2-e65ef5d71c47 req-ef9fe8d3-1acb-40ce-b2f8-350a03cd60f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036060 Aug 06 20:57:35.251493 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 636/1261] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:35.264823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3fa34e5-d426-4f3c-8d78-24f2bd52b739 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:35.271887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f3fa34e5-d426-4f3c-8d78-24f2bd52b739 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Searching by: {'tenant_id': '29517a1e62d0497e8aaa61d568060cdc', 'deleted': False} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:57:35.276917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3fa34e5-d426-4f3c-8d78-24f2bd52b739 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.277644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3fa34e5-d426-4f3c-8d78-24f2bd52b739 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.278285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3fa34e5-d426-4f3c-8d78-24f2bd52b739 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.279050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3fa34e5-d426-4f3c-8d78-24f2bd52b739 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.279511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3fa34e5-d426-4f3c-8d78-24f2bd52b739 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.280142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3fa34e5-d426-4f3c-8d78-24f2bd52b739 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.314174 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3fa34e5-d426-4f3c-8d78-24f2bd52b739 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=29517a1e62d0497e8aaa61d568060cdc" status: 200 len: 15 microversion: 2.1 time: 0.056920 Aug 06 20:57:35.314950 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 626/1262] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Aug 6 20:57:35 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=29517a1e62d0497e8aaa61d568060cdc => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:35.337967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b9cf516-757b-4edb-921c-ddf78261ee31 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:35.344770 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9b9cf516-757b-4edb-921c-ddf78261ee31 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010452 Aug 06 20:57:35.345243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:35.345993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:35.346470 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 637/1263] 10.222.0.33 () {58 vars in 1189 bytes} [Sat Aug 6 20:57:35 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:35.358583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.358890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.359562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.360962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.361534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.362425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.367490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-829de335-bef5-484f-93b6-0e094e01e34e tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:35.370042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-829de335-bef5-484f-93b6-0e094e01e34e tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:35.377034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-829de335-bef5-484f-93b6-0e094e01e34e tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.377534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-829de335-bef5-484f-93b6-0e094e01e34e tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.377976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-829de335-bef5-484f-93b6-0e094e01e34e tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.378793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-829de335-bef5-484f-93b6-0e094e01e34e tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.379193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-829de335-bef5-484f-93b6-0e094e01e34e tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.379625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-829de335-bef5-484f-93b6-0e094e01e34e tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.551503 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-829de335-bef5-484f-93b6-0e094e01e34e tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action" status: 202 len: 0 microversion: 2.1 time: 0.187901 Aug 06 20:57:35.553561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 638/1264] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:35 2022] POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:57:35.561519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:35.562088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:35.568905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.569402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.569840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.571081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.571700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.572175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.572796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:35.584482 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d591ecf5-75ec-43cc-a471-cf1858fb0f4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.243995 Aug 06 20:57:35.585454 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 627/1265] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:35 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:35.592383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:35.599726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:35.600724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:57:35.605931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.606830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.608046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.608934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.609562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.610179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.729660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 20:57:35.796653 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c49b052b-b9cb-44c8-bdcd-58c7ec390ecc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers?status=error" status: 200 len: 337 microversion: 2.1 time: 0.209803 Aug 06 20:57:35.797287 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 628/1266] 10.222.0.33 () {58 vars in 1150 bytes} [Sat Aug 6 20:57:35 2022] GET /compute/v2.1/servers?status=error => generated 337 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:35.809569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-28dc3afd-848c-4060-a984-cbfe97c63c5d tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:35.812229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-28dc3afd-848c-4060-a984-cbfe97c63c5d tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:35.819227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28dc3afd-848c-4060-a984-cbfe97c63c5d tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.819798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28dc3afd-848c-4060-a984-cbfe97c63c5d tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.820522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28dc3afd-848c-4060-a984-cbfe97c63c5d tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.821328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28dc3afd-848c-4060-a984-cbfe97c63c5d tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.821862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28dc3afd-848c-4060-a984-cbfe97c63c5d tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.822364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28dc3afd-848c-4060-a984-cbfe97c63c5d tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.826842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:35.916547 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-28dc3afd-848c-4060-a984-cbfe97c63c5d tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action" status: 202 len: 0 microversion: 2.1 time: 0.110726 Aug 06 20:57:35.917748 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 629/1267] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:35 2022] POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:57:35.926624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08930670-4b12-4812-86e6-f9ea18148bd1 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:35.927380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-08930670-4b12-4812-86e6-f9ea18148bd1 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:35.944992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08930670-4b12-4812-86e6-f9ea18148bd1 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.945576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08930670-4b12-4812-86e6-f9ea18148bd1 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.946598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08930670-4b12-4812-86e6-f9ea18148bd1 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.947355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08930670-4b12-4812-86e6-f9ea18148bd1 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:35.948082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08930670-4b12-4812-86e6-f9ea18148bd1 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:35.948718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08930670-4b12-4812-86e6-f9ea18148bd1 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:35.971731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:35.983557 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d71569ba-1558-4738-8697-d17ba4b457b1 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1520 microversion: 2.1 time: 0.428083 Aug 06 20:57:35.993940 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 639/1268] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:35 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:36.018077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:36.019009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:36.025685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.026212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.026882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.027594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.028051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.029012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.075352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:36.162163 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7313ef43-4b71-4ed2-b558-6755262ab954 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 204 len: 0 microversion: 2.1 time: 0.149128 Aug 06 20:57:36.163428 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 640/1269] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:36 2022] DELETE /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:36.170035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:36.170367 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08930670-4b12-4812-86e6-f9ea18148bd1 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1613 microversion: 2.1 time: 0.248312 Aug 06 20:57:36.170905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:36.171263 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 630/1270] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:35 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1613 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:36.175999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:36.176822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:36.177932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.178512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.179058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.179968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.180493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.180991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.182862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.183508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.184120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.184807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.185430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.186007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.334833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:36.337647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:36.350610 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7cb99ead-6df8-4aed-9d79-db08ab747a0a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 0.180969 Aug 06 20:57:36.350610 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 641/1271] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:36 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:36.351045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab1631e5-516e-4ea6-86ab-641f007d7ba8 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:36.351480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab1631e5-516e-4ea6-86ab-641f007d7ba8 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:36.352286 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5eeabfc9-8339-4d45-a30a-0e3a4f655302 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1526 microversion: 2.1 time: 0.179773 Aug 06 20:57:36.353838 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 631/1272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:36 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1526 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:36.359120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:36.360264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:36.367183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.367699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.368143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.368860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.369320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.369746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.372969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab1631e5-516e-4ea6-86ab-641f007d7ba8 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.373664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab1631e5-516e-4ea6-86ab-641f007d7ba8 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.374258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab1631e5-516e-4ea6-86ab-641f007d7ba8 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.375007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab1631e5-516e-4ea6-86ab-641f007d7ba8 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.376092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab1631e5-516e-4ea6-86ab-641f007d7ba8 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.376531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab1631e5-516e-4ea6-86ab-641f007d7ba8 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.534843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:36.544272 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e921c260-9cff-484a-98ec-0e607fea6d52 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1321 microversion: 2.1 time: 0.189138 Aug 06 20:57:36.545250 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 632/1273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:36 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:36.605517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:36.606132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:36.613749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.614242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.614712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.615424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.615881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.616304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.772729 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab1631e5-516e-4ea6-86ab-641f007d7ba8 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1613 microversion: 2.1 time: 0.425171 Aug 06 20:57:36.773531 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 642/1274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:36 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1613 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:36.794505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:36.799450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:36.803954 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b420fea6-997f-419a-8f4b-f349311e185f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.202380 Aug 06 20:57:36.804783 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 633/1275] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:36 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:36.811550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:57:36.822157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.822863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.823540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.824299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:36.824971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:36.826164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:36.930615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 20:57:36.993598 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-911b4751-a7e5-4c65-8681-a58334f0818c tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 2646 microversion: 2.1 time: 0.203777 Aug 06 20:57:36.994922 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 643/1276] 10.222.0.33 () {58 vars in 1190 bytes} [Sat Aug 6 20:57:36 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 2646 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:37.007531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6994417b-44e4-49c4-aba4-76d7534f1f6b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:37.015873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6994417b-44e4-49c4-aba4-76d7534f1f6b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:57:37.021399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6994417b-44e4-49c4-aba4-76d7534f1f6b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.021944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6994417b-44e4-49c4-aba4-76d7534f1f6b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.022585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6994417b-44e4-49c4-aba4-76d7534f1f6b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.023661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6994417b-44e4-49c4-aba4-76d7534f1f6b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.024413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6994417b-44e4-49c4-aba4-76d7534f1f6b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.025104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6994417b-44e4-49c4-aba4-76d7534f1f6b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.109558 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6994417b-44e4-49c4-aba4-76d7534f1f6b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.105707 Aug 06 20:57:37.110849 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 634/1277] 10.222.0.33 () {58 vars in 1196 bytes} [Sat Aug 6 20:57:37 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:37.122824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5cc48cf3-7322-4a2b-8483-9595205425cc tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:37.125375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5cc48cf3-7322-4a2b-8483-9595205425cc tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:37.138054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cc48cf3-7322-4a2b-8483-9595205425cc tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.139001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cc48cf3-7322-4a2b-8483-9595205425cc tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.140452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cc48cf3-7322-4a2b-8483-9595205425cc tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.142358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cc48cf3-7322-4a2b-8483-9595205425cc tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.143076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cc48cf3-7322-4a2b-8483-9595205425cc tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.143507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cc48cf3-7322-4a2b-8483-9595205425cc tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.229303 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5cc48cf3-7322-4a2b-8483-9595205425cc tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action" status: 202 len: 0 microversion: 2.1 time: 0.110745 Aug 06 20:57:37.234582 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 644/1278] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:37 2022] POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:37.241654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:37.244404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:37.251270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.251716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.252161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.252870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.253337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.253766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.265853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8c4c6548-8275-4378-86af-3576ab55e33a req-7befb568-d767-4d29-a432-8455b9cf14a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0a6060-3d45-4cc6-bd81-528b40dbb976", "name": "network-vif-plugged", "status": "completed", "tag": "c8556477-5b67-40f9-bd2e-4a17626d6a2f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:37.275993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8c4c6548-8275-4378-86af-3576ab55e33a req-7befb568-d767-4d29-a432-8455b9cf14a8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.276410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8c4c6548-8275-4378-86af-3576ab55e33a req-7befb568-d767-4d29-a432-8455b9cf14a8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.276855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8c4c6548-8275-4378-86af-3576ab55e33a req-7befb568-d767-4d29-a432-8455b9cf14a8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.288638 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8c4c6548-8275-4378-86af-3576ab55e33a req-7befb568-d767-4d29-a432-8455b9cf14a8 service nova] Creating event network-vif-plugged:c8556477-5b67-40f9-bd2e-4a17626d6a2f for instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 on nch2-master-1 Aug 06 20:57:37.293930 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8c4c6548-8275-4378-86af-3576ab55e33a req-7befb568-d767-4d29-a432-8455b9cf14a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031698 Aug 06 20:57:37.294930 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 645/1279] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:57:37.340861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:57:37.341366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:57:37.341846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:57:37.342295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:57:37.342736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:57:37.371724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:37.373077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:37.380499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.381136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.381648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.382370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.382899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.383541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.388071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:37.430781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:37.449281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.450302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.452038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.453248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.454142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.455554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.505104 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb83eeae-dcfb-4ad7-8f21-81862bc4ada2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action" status: 202 len: 1066 microversion: 2.1 time: 0.266686 Aug 06 20:57:37.506232 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 635/1280] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:37 2022] POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action => generated 1066 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 06 20:57:37.523666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:37.524466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:37.535922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.536485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.537195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.537999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.539384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.540423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.616756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:37.627933 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-191bec38-df2f-4016-be6c-c22bff1cbd43 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 0.264598 Aug 06 20:57:37.629523 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 646/1281] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:37 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:37.648113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:37.649710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:37.680283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.680792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.681245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.681975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.682448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.682926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.791558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:37.801169 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d991ac0e-883b-4b50-9a09-966195980ae4 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1526 microversion: 2.1 time: 0.292385 Aug 06 20:57:37.801970 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 636/1282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:37 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1526 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:37.810990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:37.812584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:37.820084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.821058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.821684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.822382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.822866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.823294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.851681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:37.861364 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a5318173-c38f-465c-9267-013ee5322ace tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1470 microversion: 2.1 time: 0.230505 Aug 06 20:57:37.862327 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 647/1283] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:37 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:37.874769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-120aa6a4-c6a6-4584-957a-ba64ed8ff79d tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Calling method '.version_select at 0x7f729dcb2790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:37.927618 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-120aa6a4-c6a6-4584-957a-ba64ed8ff79d tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025" status: 200 len: 637 microversion: 2.1 time: 0.064005 Aug 06 20:57:37.928419 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 648/1284] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:57:37 2022] GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025 => generated 637 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:37.939533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:37.940169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:37.946579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.947124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.947572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.948287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:37.948758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:37.949194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:37.968905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:37.977356 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2b4cf541-11a3-42a8-b8b8-225a410c7059 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1321 microversion: 2.1 time: 0.174070 Aug 06 20:57:37.977959 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 637/1285] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:37 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:37.983064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ddd8e93d-da6e-4b26-a67b-486b9242356c tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Action: 'update_all', calling method: .version_select at 0x7f729d8e9c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:38.030601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ddd8e93d-da6e-4b26-a67b-486b9242356c tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:38.036307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ddd8e93d-da6e-4b26-a67b-486b9242356c tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for user 8c4455ce2f604175bc7bbcb68a9fae93 and project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:38.085966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:38.093978 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-25d79976-02d2-4dd3-b677-fc04c7c8a204 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.164774 Aug 06 20:57:38.095505 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 649/1286] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:37 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:38.267993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:38.268589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:38.274615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:38.275219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:38.275555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:38.276254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:38.276709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:38.277135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:38.304253 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ddd8e93d-da6e-4b26-a67b-486b9242356c tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 61 microversion: 2.1 time: 0.325242 Aug 06 20:57:38.304985 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 638/1287] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 20:57:37 2022] PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 61 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:38.314737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e29a4c7-534b-4347-99a3-aef5998857ff tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Calling method '.version_select at 0x7f729d8e9670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:38.416182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid a87d6735-5d42-4f96-aac5-55b50a1a804f {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:57:38.431286 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-39b680db-0c8c-4f78-8112-78215abc074d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 2422 microversion: 2.25 time: 0.167862 Aug 06 20:57:38.431864 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 650/1288] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:38 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 2422 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:57:38.452914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:38.455588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:38.457428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:38.463642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:38.464092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:38.464738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:38.465638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:38.465911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:38.466347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:38.492604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'flavor' on Instance uuid a87d6735-5d42-4f96-aac5-55b50a1a804f {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:57:38.505191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Going to try to live migrate instance to nch1-master-1 {{(pid=142462) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 20:57:38.561096 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e29a4c7-534b-4347-99a3-aef5998857ff tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "DELETE /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.250710 Aug 06 20:57:38.561843 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 639/1289] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Aug 6 20:57:38 2022] DELETE /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata/os_version => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 20:57:38.570388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ebf48e76-2756-4093-97c5-5e95e1990a8f tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Calling method '.version_select at 0x7f729d8e94c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:38.611133 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ebf48e76-2756-4093-97c5-5e95e1990a8f tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 37 microversion: 2.1 time: 0.044460 Aug 06 20:57:38.611954 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 640/1290] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 20:57:38 2022] GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 37 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 20:57:38.622518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b680564a-a10d-4705-941e-cb9da1323385 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Action: 'update_all', calling method: .version_select at 0x7f729dae8310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:38.674267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b680564a-a10d-4705-941e-cb9da1323385 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:38.679528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b680564a-a10d-4705-941e-cb9da1323385 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for user 8c4455ce2f604175bc7bbcb68a9fae93 and project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:38.935042 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b680564a-a10d-4705-941e-cb9da1323385 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 61 microversion: 2.1 time: 0.315314 Aug 06 20:57:38.935042 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 641/1291] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 20:57:38 2022] PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 61 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 20:57:38.940515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:38.941114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:38.947887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:38.948625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:38.949236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:38.950106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:38.950763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:38.951377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.146414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:39.154578 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-322bf7f6-99fa-4cee-8076-529e506c9942 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 0.219236 Aug 06 20:57:39.155237 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 642/1292] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:38 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:39.160333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:39.160937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:39.167436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:39.167915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:39.168349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.169043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:39.169491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:39.169911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.300468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:39.308420 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e95a4b1-2e7a-4ca0-b82c-e5d84624ef05 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1526 microversion: 2.1 time: 0.152013 Aug 06 20:57:39.309032 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 643/1293] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:39 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:39.314189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:39.314834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:39.321500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:39.321500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:39.321500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.322096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:39.322614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:39.323015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.450422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:39.458011 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c0cbe711-9779-488b-9531-45f1bff4fe68 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1470 microversion: 2.1 time: 0.148025 Aug 06 20:57:39.458585 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 644/1294] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:39 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:39.467136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-140ec85a-04ea-4522-b756-afd94947ee5b tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Calling method '.version_select at 0x7f729dae8d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:39.508185 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-140ec85a-04ea-4522-b756-afd94947ee5b tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.048332 Aug 06 20:57:39.509712 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 645/1295] 10.222.0.33 () {58 vars in 1290 bytes} [Sat Aug 6 20:57:39 2022] GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata/os_distro => generated 33 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:39.514346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:39.515084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:39.529068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:39.532184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:39.533426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.545715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:39.548062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:39.550254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.712335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:39.720715 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4b33bd4d-e903-4fde-8ab5-2b7cfdf2b43d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1321 microversion: 2.1 time: 0.209961 Aug 06 20:57:39.721312 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 646/1296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:39 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:39.725736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:39.726339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:39.732005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:39.732485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:39.732918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.733601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:39.734055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:39.735127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.863676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:39.871115 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-86b4f9c9-7b1c-469c-aa53-d3fa3ec53047 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1315 microversion: 2.1 time: 0.148863 Aug 06 20:57:39.871682 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 647/1297] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:39 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:39.875964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7b5d6299-55a3-4b33-a4d8-25bdf97c0066 req-6bd001ea-8c48-48b7-8e2a-4a1d690fa3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d7a71f-b21b-4142-bd6a-c7e178308644", "name": "network-vif-plugged", "status": "completed", "tag": "9da26b08-1938-4d2b-ad2f-1325748518c4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:39.886528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7b5d6299-55a3-4b33-a4d8-25bdf97c0066 req-6bd001ea-8c48-48b7-8e2a-4a1d690fa3f9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:39.887031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7b5d6299-55a3-4b33-a4d8-25bdf97c0066 req-6bd001ea-8c48-48b7-8e2a-4a1d690fa3f9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:39.887610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7b5d6299-55a3-4b33-a4d8-25bdf97c0066 req-6bd001ea-8c48-48b7-8e2a-4a1d690fa3f9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:39.891856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:39.899937 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7b5d6299-55a3-4b33-a4d8-25bdf97c0066 req-6bd001ea-8c48-48b7-8e2a-4a1d690fa3f9 service nova] Creating event network-vif-plugged:9da26b08-1938-4d2b-ad2f-1325748518c4 for instance 40d7a71f-b21b-4142-bd6a-c7e178308644 on nch2-master-1 Aug 06 20:57:39.908599 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7b5d6299-55a3-4b33-a4d8-25bdf97c0066 req-6bd001ea-8c48-48b7-8e2a-4a1d690fa3f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035568 Aug 06 20:57:39.909782 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 648/1298] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:39.916096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42aaad48-3df4-4c62-b6ff-55766cf8573b tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Action: 'update_all', calling method: .version_select at 0x7f729d941af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:39.995324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-42aaad48-3df4-4c62-b6ff-55766cf8573b tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:40.005100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-42aaad48-3df4-4c62-b6ff-55766cf8573b tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for user 8c4455ce2f604175bc7bbcb68a9fae93 and project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:40.190147 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42aaad48-3df4-4c62-b6ff-55766cf8573b tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 61 microversion: 2.1 time: 0.278901 Aug 06 20:57:40.191930 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 649/1299] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 20:57:39 2022] PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 61 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:40.197779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:40.198716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:40.206692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.207186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.208425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.209075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.209517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.210103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.363931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:40.374610 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7eb8b68c-874a-4914-8d8c-3ed32413e6af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1313 microversion: 2.1 time: 0.180576 Aug 06 20:57:40.376006 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 650/1300] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:40 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:40.378321 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-219c898e-1d43-48af-828f-caea2d8bbd3a tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/action" status: 202 len: 0 microversion: 2.25 time: 1.928994 Aug 06 20:57:40.379276 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 651/1301] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 20:57:38 2022] POST /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/action => generated 0 bytes in 1930 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 06 20:57:40.384102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:40.384836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:40.388323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0e1d2501-016d-4007-bd71-70482ac37cbc tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Calling method '.version_select at 0x7f729daf0c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:40.396764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.397319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.397761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.398504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.399012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.399449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.455398 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0e1d2501-016d-4007-bd71-70482ac37cbc tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 61 microversion: 2.1 time: 0.077793 Aug 06 20:57:40.456031 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 651/1302] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 20:57:40 2022] GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 61 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:40.479638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:40.484198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:40.485621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:40.489450 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72d752bd-7192-4973-b407-e7e29af1c41b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1484 microversion: 2.1 time: 0.108843 Aug 06 20:57:40.490046 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 652/1303] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:40 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1484 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:40.497538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:40.502199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.502854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.503750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.505139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.505978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.507076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.509404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-2ac7f55f-125c-48c1-91ec-47a39650949b req-8a2bd790-50e3-47a4-a276-05e7c003c36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cdaea82-6028-42e8-bb20-355bf0215ea8", "name": "network-vif-deleted", "tag": "75a6aa9e-9e89-491f-bbf8-78140d2656c4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:40.524449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2ac7f55f-125c-48c1-91ec-47a39650949b req-8a2bd790-50e3-47a4-a276-05e7c003c36a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.525347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2ac7f55f-125c-48c1-91ec-47a39650949b req-8a2bd790-50e3-47a4-a276-05e7c003c36a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.525948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2ac7f55f-125c-48c1-91ec-47a39650949b req-8a2bd790-50e3-47a4-a276-05e7c003c36a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.556396 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-2ac7f55f-125c-48c1-91ec-47a39650949b req-8a2bd790-50e3-47a4-a276-05e7c003c36a service nova] Creating event network-vif-deleted:75a6aa9e-9e89-491f-bbf8-78140d2656c4 for instance 3cdaea82-6028-42e8-bb20-355bf0215ea8 on nch2-master-1 Aug 06 20:57:40.576331 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-2ac7f55f-125c-48c1-91ec-47a39650949b req-8a2bd790-50e3-47a4-a276-05e7c003c36a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070089 Aug 06 20:57:40.583743 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 653/1304] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:40.591318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6d3d3bf-01bf-46af-93da-7958c8110672 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Action: 'update_all', calling method: .version_select at 0x7f729dd3f1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:40.663957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e6d3d3bf-01bf-46af-93da-7958c8110672 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:40.672067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e6d3d3bf-01bf-46af-93da-7958c8110672 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for user 8c4455ce2f604175bc7bbcb68a9fae93 and project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:40.734693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:40.745054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:40.747445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:40.749158 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5252f912-8356-425c-8339-99f2368d8e9c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.282321 Aug 06 20:57:40.750581 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 652/1305] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:40 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:40.756746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:40.757566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:40.764129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.764979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.765610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.767147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.767681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.768168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.855042 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6d3d3bf-01bf-46af-93da-7958c8110672 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 61 microversion: 2.1 time: 0.269690 Aug 06 20:57:40.855655 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 654/1306] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 20:57:40 2022] PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 61 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:40.863926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:40.864687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:40.871115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.871612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.872064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.872786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:40.873252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:40.873739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:40.940229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:40.948287 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-69781a39-364f-4307-9ebc-3c3f3ec1d8ad tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1470 microversion: 2.1 time: 0.196013 Aug 06 20:57:40.948868 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 653/1307] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:40 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:40.954269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b8af214-d468-4d45-a80a-ff91aa9951e5 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Action: 'update_all', calling method: .version_select at 0x7f729d869430>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:41.004296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9b8af214-d468-4d45-a80a-ff91aa9951e5 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:41.010186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9b8af214-d468-4d45-a80a-ff91aa9951e5 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for user 8c4455ce2f604175bc7bbcb68a9fae93 and project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:41.105744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:41.114834 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28428eca-40b5-426d-8bce-5ee6794c0d5e tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1321 microversion: 2.1 time: 0.258130 Aug 06 20:57:41.115499 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 655/1308] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:40 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:41.120344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:41.121035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:41.130024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.130621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.131153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.132007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.132604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.133039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.320224 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b8af214-d468-4d45-a80a-ff91aa9951e5 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 64 microversion: 2.1 time: 0.370151 Aug 06 20:57:41.320832 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 654/1309] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 20:57:40 2022] PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 64 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:41.330338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a6b8ee56-37ab-483f-b2d3-efe68bf3b006 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Calling method '.version_select at 0x7f729d869820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:41.358862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:41.375306 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a6b8ee56-37ab-483f-b2d3-efe68bf3b006 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 64 microversion: 2.1 time: 0.048856 Aug 06 20:57:41.376017 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 655/1310] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 20:57:41 2022] GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 64 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 20:57:41.377006 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d3505af-2cdf-4581-8023-498c14741569 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1503 microversion: 2.1 time: 0.259537 Aug 06 20:57:41.377806 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 656/1311] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:41 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:41.393997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4b687a22-7270-4796-87d6-aad8929dd34c tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Action: 'update_all', calling method: .version_select at 0x7f729dae8040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:41.396709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:41.397372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:41.404297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.404797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.405243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.405951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.406971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.407597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.449992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4b687a22-7270-4796-87d6-aad8929dd34c tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:41.456107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4b687a22-7270-4796-87d6-aad8929dd34c tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for user 8c4455ce2f604175bc7bbcb68a9fae93 and project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:41.576864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:41.586211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7df0a35e-50ee-44af-bd16-0e1bce6c967f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1463 microversion: 2.1 time: 0.193293 Aug 06 20:57:41.586818 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 657/1312] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:41 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1463 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:41.600577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1812993744"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:41.601425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:41.607713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.608198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.608637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.609366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.609898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.610348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.752824 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.network.security_group_api [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Adding security group 40e04532-23c2-4bf6-b215-f7328a78a10b to port 219bd8a1-4249-40ae-a148-22d89dd3953d Aug 06 20:57:41.768036 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4b687a22-7270-4796-87d6-aad8929dd34c tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 61 microversion: 2.1 time: 0.383025 Aug 06 20:57:41.769072 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 656/1313] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 20:57:41 2022] PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 61 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:41.774353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:41.775321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:41.784658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.785481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.786419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.787248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.787927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.788538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.844517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.846121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.846613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.847091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lazy-loading 'fault' on Instance uuid 3cdaea82-6028-42e8-bb20-355bf0215ea8 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:57:41.913241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff69a9a061a454685cfc57c1675f4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd242c56a3f436c9cf158e68253218c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:41.922565 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bcfa35cf-5c4a-456e-9059-495903cbc5a6 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 200 len: 1314 microversion: 2.1 time: 0.152196 Aug 06 20:57:41.923696 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 657/1314] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:41 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:41.929087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fe172f35-704d-4cb4-9f82-010bd2b53b62 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:41.929718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fe172f35-704d-4cb4-9f82-010bd2b53b62 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:41.936627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe172f35-704d-4cb4-9f82-010bd2b53b62 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.937174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe172f35-704d-4cb4-9f82-010bd2b53b62 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.938173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe172f35-704d-4cb4-9f82-010bd2b53b62 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:41.938927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe172f35-704d-4cb4-9f82-010bd2b53b62 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:41.939565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe172f35-704d-4cb4-9f82-010bd2b53b62 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:41.940246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe172f35-704d-4cb4-9f82-010bd2b53b62 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.084448 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fe172f35-704d-4cb4-9f82-010bd2b53b62 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1614 microversion: 2.1 time: 0.159769 Aug 06 20:57:42.085199 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 658/1315] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:41 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1614 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:42.089567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:42.090170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:42.097441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.098228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.099161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.102075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.102871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.103633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.172117 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eac25fc4-e09c-4bdd-a314-6bf1d19ba2d5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca/action" status: 202 len: 0 microversion: 2.1 time: 0.575139 Aug 06 20:57:42.176437 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 658/1316] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:41 2022] POST /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:42.182058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-44b639f5-ffa9-4215-9048-8b790ee73ab3 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Action: 'update', calling method: .version_select at 0x7f729dc8f790>, body: {"meta": {"os_version": "alt"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:42.264714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-44b639f5-ffa9-4215-9048-8b790ee73ab3 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:42.267116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:42.274856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-44b639f5-ffa9-4215-9048-8b790ee73ab3 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for user 8c4455ce2f604175bc7bbcb68a9fae93 and project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:42.279623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:42.281161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:42.282757 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a18a57db-cc99-4b48-831c-d64ede0ddff3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.196597 Aug 06 20:57:42.283495 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 659/1317] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:42 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:42.302173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:42.302829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:42.319459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.320119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.320671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.321921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.322741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.323458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.535546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:42.543912 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-81e25259-a285-4674-a4ad-a76a660c6462 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1470 microversion: 2.1 time: 0.249453 Aug 06 20:57:42.544890 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 660/1318] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:42 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:42.550568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:42.551383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:42.557277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.558158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.558581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.559258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.559820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.560856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.593327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3028158d6d2f4b83815b724cd13dcb3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40902914b9a24c9e866171fbbcad74af', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:42.594850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] flavor_id is None. Assuming migration. {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 06 20:57:42.595401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 20:57:42.602496 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-44b639f5-ffa9-4215-9048-8b790ee73ab3 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.424537 Aug 06 20:57:42.603677 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 659/1319] 10.222.0.33 () {60 vars in 1313 bytes} [Sat Aug 6 20:57:42 2022] PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata/os_version => generated 31 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:42.614746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:42.616160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:42.623740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.624467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.625644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.626959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.628365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.629253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.741562 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-60f33254-36b0-4a41-a945-a1cb347ed5c0 tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976/action" status: 202 len: 0 microversion: 2.1 time: 0.195797 Aug 06 20:57:42.742711 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 661/1320] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:42 2022] POST /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:42.748158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1050068883"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:42.748922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:42.756671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.757375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.758526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.759260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.759724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.760152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.826870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:42.836366 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-884dea27-1b42-4f68-b18f-8fc8c732cfcd tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1471 microversion: 2.1 time: 0.229971 Aug 06 20:57:42.836961 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 660/1321] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:42 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:42.841577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-86755c4b-1580-4314-8387-954a79716e9b req-8d51e34a-cbbd-4de0-9981-4c031332c28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fe03fb-ab4b-4c3c-b371-87fd08dc84ca", "tag": "219bd8a1-4249-40ae-a148-22d89dd3953d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:42.852293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-86755c4b-1580-4314-8387-954a79716e9b req-8d51e34a-cbbd-4de0-9981-4c031332c28c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.853268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-86755c4b-1580-4314-8387-954a79716e9b req-8d51e34a-cbbd-4de0-9981-4c031332c28c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.853712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-86755c4b-1580-4314-8387-954a79716e9b req-8d51e34a-cbbd-4de0-9981-4c031332c28c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.865999 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-86755c4b-1580-4314-8387-954a79716e9b req-8d51e34a-cbbd-4de0-9981-4c031332c28c service nova] Creating event network-changed:219bd8a1-4249-40ae-a148-22d89dd3953d for instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca on nch2-master-1 Aug 06 20:57:42.871258 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-86755c4b-1580-4314-8387-954a79716e9b req-8d51e34a-cbbd-4de0-9981-4c031332c28c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032848 Aug 06 20:57:42.872044 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 661/1322] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:42.878108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fc1ba969-2f72-431f-bd98-f95b872e7307 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Calling method '.version_select at 0x7f729dcf8ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:42.936692 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.network.security_group_api [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Adding security group 564bb03a-a55a-43ba-8fd0-ae9db6245a21 to port 219bd8a1-4249-40ae-a148-22d89dd3953d Aug 06 20:57:42.958813 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fc1ba969-2f72-431f-bd98-f95b872e7307 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 58 microversion: 2.1 time: 0.085688 Aug 06 20:57:42.959534 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 662/1323] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 20:57:42 2022] GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 58 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:42.967951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:42.968774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:42.985061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.985563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.986011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:42.986774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:42.987242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:42.987681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.255412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:43.266122 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-909c06c8-4b65-41c1-ad0d-418b274564ca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1472 microversion: 2.1 time: 0.305488 Aug 06 20:57:43.267150 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 663/1324] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:42 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:43.271986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:43.272760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:43.281834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.283333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.284146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.285747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.286381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.287496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.320267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lazy-loading 'flavor' on Instance uuid 40d7a71f-b21b-4142-bd6a-c7e178308644 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:57:43.379717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:43.404340 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb6c6ce9-7279-4a42-bf46-282b1a3ef439 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644/action" status: 202 len: 0 microversion: 2.1 time: 0.135488 Aug 06 20:57:43.405396 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 664/1325] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:43 2022] POST /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:43.430354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:43.431144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 3cdaea82-6028-42e8-bb20-355bf0215ea8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:43.446980 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b3922ed1-f9b8-4b5e-bcde-bfb0537e08a6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca/action" status: 202 len: 0 microversion: 2.1 time: 0.702489 Aug 06 20:57:43.448118 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 662/1326] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:42 2022] POST /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:43.452804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.457152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.458664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.459321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e6bf45db-0fee-48dc-ae9e-a65e11619e69 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Action: 'update_all', calling method: .version_select at 0x7f729d869430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:43.459611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.460096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.460537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.492948 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Instance 3cdaea82-6028-42e8-bb20-355bf0215ea8 could not be found. Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 HTTP/1.1 Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:43.494708 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 3cdaea82-6028-42e8-bb20-355bf0215ea8 could not be found. Aug 06 20:57:43.496233 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '3cdaea82-6028-42e8-bb20-355bf0215ea8'} Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cdaea82-6028-42e8-bb20-355bf0215ea8 could not be found. Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:43.497913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cdaea82-6028-42e8-bb20-355bf0215ea8 could not be found. Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cdaea82-6028-42e8-bb20-355bf0215ea8 could not be found. Aug 06 20:57:43.499369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:43.501844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Instance 3cdaea82-6028-42e8-bb20-355bf0215ea8 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:43.501844 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e4b24f62-24a7-4cb8-9a5c-3112595f526b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8" status: 404 len: 111 microversion: 2.1 time: 0.086707 Aug 06 20:57:43.501844 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 665/1327] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:43 2022] GET /compute/v2.1/servers/3cdaea82-6028-42e8-bb20-355bf0215ea8 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:43.505044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:43.505651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:43.513352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.513819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.514817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.515653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.516123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.516558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.568734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=43 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:43.570924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e6bf45db-0fee-48dc-ae9e-a65e11619e69 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:43.578839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e6bf45db-0fee-48dc-ae9e-a65e11619e69 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for user 8c4455ce2f604175bc7bbcb68a9fae93 and project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:43.874272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:43.888077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:43.891609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:43.893964 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f0e1cd01-494c-4e3f-bece-3aff46f5d769 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.392502 Aug 06 20:57:43.894841 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 666/1328] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:43 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:43.900494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1f0baba-b202-43f5-86c8-7324bc6eb4ea tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:43.901404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d1f0baba-b202-43f5-86c8-7324bc6eb4ea tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:43.908792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1f0baba-b202-43f5-86c8-7324bc6eb4ea tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.910644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1f0baba-b202-43f5-86c8-7324bc6eb4ea tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.911983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1f0baba-b202-43f5-86c8-7324bc6eb4ea tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.912805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1f0baba-b202-43f5-86c8-7324bc6eb4ea tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.913342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1f0baba-b202-43f5-86c8-7324bc6eb4ea tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.913855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1f0baba-b202-43f5-86c8-7324bc6eb4ea tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.934626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e6bf45db-0fee-48dc-ae9e-a65e11619e69 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 61 microversion: 2.1 time: 0.484905 Aug 06 20:57:43.935362 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 663/1329] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 20:57:43 2022] PUT /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 61 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:43.943860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c292be34-9780-4cc3-a32d-1f1ac3cbff17 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:43.944940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c292be34-9780-4cc3-a32d-1f1ac3cbff17 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:43.955371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c292be34-9780-4cc3-a32d-1f1ac3cbff17 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.956022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c292be34-9780-4cc3-a32d-1f1ac3cbff17 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.956468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c292be34-9780-4cc3-a32d-1f1ac3cbff17 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:43.957647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c292be34-9780-4cc3-a32d-1f1ac3cbff17 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:43.958179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c292be34-9780-4cc3-a32d-1f1ac3cbff17 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:43.970633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c292be34-9780-4cc3-a32d-1f1ac3cbff17 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.153744 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c292be34-9780-4cc3-a32d-1f1ac3cbff17 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.216294 Aug 06 20:57:44.155059 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 664/1330] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 20:57:43 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca/os-security-groups => generated 1158 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:44.164555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-21ad4e48-b180-4ed0-bbba-e4f656708ae7 req-8abc3560-7a57-4748-8f1a-8330663fa7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fe03fb-ab4b-4c3c-b371-87fd08dc84ca", "tag": "219bd8a1-4249-40ae-a148-22d89dd3953d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:44.178053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-21ad4e48-b180-4ed0-bbba-e4f656708ae7 req-8abc3560-7a57-4748-8f1a-8330663fa7f7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:44.178700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-21ad4e48-b180-4ed0-bbba-e4f656708ae7 req-8abc3560-7a57-4748-8f1a-8330663fa7f7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:44.179260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-21ad4e48-b180-4ed0-bbba-e4f656708ae7 req-8abc3560-7a57-4748-8f1a-8330663fa7f7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.191966 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-21ad4e48-b180-4ed0-bbba-e4f656708ae7 req-8abc3560-7a57-4748-8f1a-8330663fa7f7 service nova] Creating event network-changed:219bd8a1-4249-40ae-a148-22d89dd3953d for instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca on nch2-master-1 Aug 06 20:57:44.197615 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-21ad4e48-b180-4ed0-bbba-e4f656708ae7 req-8abc3560-7a57-4748-8f1a-8330663fa7f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040597 Aug 06 20:57:44.198283 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 665/1331] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:44.204060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed9dd376-bb45-4400-bd69-778ad85aa463 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '.version_select at 0x7f729d88ff70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:44.222428 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d1f0baba-b202-43f5-86c8-7324bc6eb4ea tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1630 microversion: 2.1 time: 0.326041 Aug 06 20:57:44.223443 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 667/1332] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:43 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1630 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:44.231856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:44.232726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:44.237582 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-ed9dd376-bb45-4400-bd69-778ad85aa463 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Image not found. Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed9dd376-bb45-4400-bd69-778ad85aa463 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/images/263d412d-6a8a-45bb-9ac3-6ad345703929 HTTP/1.1 Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:44.240029 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '263d412d-6a8a-45bb-9ac3-6ad345703929'} Aug 06 20:57:44.241332 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 263d412d-6a8a-45bb-9ac3-6ad345703929 to delete Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:44.242566 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 263d412d-6a8a-45bb-9ac3-6ad345703929 could not be found. Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:44.243784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed9dd376-bb45-4400-bd69-778ad85aa463 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:44.245173 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ed9dd376-bb45-4400-bd69-778ad85aa463 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/images/263d412d-6a8a-45bb-9ac3-6ad345703929" status: 404 len: 62 microversion: 2.1 time: 0.042129 Aug 06 20:57:44.246156 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 666/1333] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:44 2022] DELETE /compute/v2.1/images/263d412d-6a8a-45bb-9ac3-6ad345703929 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:57:44.250193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6683bb4-a323-4ada-8c2e-35453ab82403 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Action: 'create', calling method: .version_select at 0x7f729d8d14c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:44.261012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:44.261539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:44.261999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.262845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:44.263430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:44.263908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.305637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c6683bb4-a323-4ada-8c2e-35453ab82403 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:44.310788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c6683bb4-a323-4ada-8c2e-35453ab82403 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Getting quotas for user 8c4455ce2f604175bc7bbcb68a9fae93 and project ebc37ffeaeb945f08545e6cf756fad64. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:44.496263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:44.505628 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c21fa92-7ffd-49d9-9bc5-e73146a932a5 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1470 microversion: 2.1 time: 0.280894 Aug 06 20:57:44.506317 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 668/1334] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:44 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:44.519108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:44.521003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:44.528226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:44.528722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:44.529176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.530186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:44.530690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:44.532410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.580197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:44.624486 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c6683bb4-a323-4ada-8c2e-35453ab82403 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "POST /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 85 microversion: 2.1 time: 0.378038 Aug 06 20:57:44.625458 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 667/1335] 10.222.0.33 () {60 vars in 1281 bytes} [Sat Aug 6 20:57:44 2022] POST /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 85 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:44.631230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e6f7247-57cf-4522-97aa-b2d3ab7e5252 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: .version_select at 0x7f729d871550>, body: {"security_group": {"name": " tempest-securitygroup -1551907643 ", "description": "tempest-description-1095574184"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:44.707672 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c32e5443-dcb2-44df-949e-0ea025d93454 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 204 len: 0 microversion: 2.1 time: 0.193555 Aug 06 20:57:44.708780 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 669/1336] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:44 2022] DELETE /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:44.714775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:44.715427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:44.726085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:44.726930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:44.727678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.728773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:44.729255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:44.729898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.747563 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd HTTP/1.1 Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:44.749374 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:44.751387 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '427263c2-5964-4973-bdce-cd5949254cdd'} Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:44.752187 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:44.753453 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:44.756339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:44.756339 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c2a4496-923f-43b8-86a4-3b88bcf47761 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 404 len: 111 microversion: 2.1 time: 0.041079 Aug 06 20:57:44.756339 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 670/1337] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:44 2022] DELETE /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:44.759036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:44.759663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:44.767449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:44.768920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:44.769389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.770281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:44.771016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:44.771466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:44.941731 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e6f7247-57cf-4522-97aa-b2d3ab7e5252 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.314968 Aug 06 20:57:44.942410 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 668/1338] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:57:44 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:44.948231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6599fc00-87f6-4bda-a97c-7f2f179bec53 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] Calling method '.version_select at 0x7f729d8313a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:45.002851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:45.003505 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6599fc00-87f6-4bda-a97c-7f2f179bec53 tempest-ImagesMetadataTestJSON-553348201 tempest-ImagesMetadataTestJSON-553348201-project] 10.222.0.33 "GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata" status: 200 len: 85 microversion: 2.1 time: 0.058905 Aug 06 20:57:45.003709 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 669/1339] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 20:57:44 2022] GET /compute/v2.1/images/49d29761-233a-4c1b-84b4-0339d74e4025/metadata => generated 85 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:57:45.008395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:45.009869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:45.017962 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2097ace6-9bb8-4d0f-9d14-2b706ec218c8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1472 microversion: 2.1 time: 0.265078 Aug 06 20:57:45.018614 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 671/1340] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:44 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:45.019287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.019797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.020235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.021109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.021574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.022101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.040407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:45.041772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 427263c2-5964-4973-bdce-cd5949254cdd] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:45.052687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.053571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.054472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.055812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.056751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.057391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.075016 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd HTTP/1.1 Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:45.076855 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:45.079476 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '427263c2-5964-4973-bdce-cd5949254cdd'} Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:45.080353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. Aug 06 20:57:45.082068 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:45.083486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Instance 427263c2-5964-4973-bdce-cd5949254cdd could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:45.083486 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-42c1031d-3a31-4744-9857-813b42c77846 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd" status: 404 len: 111 microversion: 2.1 time: 0.059953 Aug 06 20:57:45.083486 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 672/1341] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:45 2022] GET /compute/v2.1/servers/427263c2-5964-4973-bdce-cd5949254cdd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:45.088657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:45.094050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:45.096764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.097253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.097697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.098450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.098944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.099384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.308487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:45.325553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:45.328213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:45.329813 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-63816732-297b-4192-9bb1-b0a37140c16c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.245664 Aug 06 20:57:45.330457 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 673/1342] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:45 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:45.335942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84a3afb8-f674-47e2-a27c-1d90782decf1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729dd3fca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:45.408028 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-84a3afb8-f674-47e2-a27c-1d90782decf1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929" status: 200 len: 224 microversion: 2.1 time: 0.075808 Aug 06 20:57:45.409251 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 674/1343] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 20:57:45 2022] GET /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929 => generated 224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:45.419097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1e72d8f9-1795-4e45-835f-49f4d7e08cfb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '.version_select at 0x7f729dbe1ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:45.445094 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1e72d8f9-1795-4e45-835f-49f4d7e08cfb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978650633" status: 202 len: 0 microversion: 2.1 time: 0.034074 Aug 06 20:57:45.446450 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 675/1344] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 20:57:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978650633 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:45.452261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c9083bb-3899-4355-bee8-1bb49dd4bbc5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:45.453225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c9083bb-3899-4355-bee8-1bb49dd4bbc5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:45.462148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c9083bb-3899-4355-bee8-1bb49dd4bbc5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.463139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c9083bb-3899-4355-bee8-1bb49dd4bbc5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.463961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c9083bb-3899-4355-bee8-1bb49dd4bbc5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.464944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c9083bb-3899-4355-bee8-1bb49dd4bbc5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.465862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c9083bb-3899-4355-bee8-1bb49dd4bbc5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.466324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c9083bb-3899-4355-bee8-1bb49dd4bbc5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.574048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:45.593663 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-defe3883-5575-4e52-807a-6d7ef1feeaff tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1712 microversion: 2.1 time: 0.587292 Aug 06 20:57:45.597512 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 670/1345] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:45 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1712 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:45.603365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-816d897f-2696-4d4b-8d4a-308ec40434d6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d871160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:45.697527 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c9083bb-3899-4355-bee8-1bb49dd4bbc5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1613 microversion: 2.1 time: 0.249408 Aug 06 20:57:45.698622 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 676/1346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:45 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1613 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:45.705440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:45.706704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:45.723711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.724469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.725259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.726788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.727585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.728270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.960082 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-816d897f-2696-4d4b-8d4a-308ec40434d6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929" status: 202 len: 0 microversion: 2.1 time: 0.361174 Aug 06 20:57:45.963966 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 671/1347] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:57:45 2022] DELETE /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:45.966537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:45.967148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:45.976580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.986172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.987187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:45.988098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:45.988577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:45.989015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.026242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:46.036334 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] HTTP exception thrown: Cannot 'migrate' instance 40d7a71f-b21b-4142-bd6a-c7e178308644 while it is in vm_state suspended Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Request method failure captured: Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644/action HTTP/1.1 Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 15 Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWcDhv0NOCwtEz5hknOtWBRsczwfEnPrygefQD7xGD4F0J-fprVh5T_gpULAaMgpPCP6oodYyktHSPIYaXXdffbwzkVRa6B74J2qjj-JqUrPTKHcmA9d7-ivQPu6ukUoTtV-Zy3qu36LuMLMNFivBnRpcjMGO8YRlJ9WkMvXoDpmJA Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:57:46.037968 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb76102372d64079b3571e92331e77ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb76102372d64079b3571e92331e77ae", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7004eb9df0824403a47f7b26d5eaf89c Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: {"migrate": {}} Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:46.039492 ncdv-master-1 devstack@n-api.service[142461]: exception: Cannot 'migrate' instance 40d7a71f-b21b-4142-bd6a-c7e178308644 while it is in vm_state suspended Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '40d7a71f-b21b-4142-bd6a-c7e178308644', 'body': {'migrate': {}}} Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40d7a71f-b21b-4142-bd6a-c7e178308644 in vm_state suspended. Cannot resize while the instance is in this state. Aug 06 20:57:46.040561 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 40d7a71f-b21b-4142-bd6a-c7e178308644 while it is in vm_state suspended Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.042989 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.045615 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.045615 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.045615 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:46.045615 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:46.045615 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 40d7a71f-b21b-4142-bd6a-c7e178308644 while it is in vm_state suspended Aug 06 20:57:46.045615 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.045615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Returning 409 to user: Cannot 'migrate' instance 40d7a71f-b21b-4142-bd6a-c7e178308644 while it is in vm_state suspended {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:46.045615 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01e739a5-7068-41f1-9b66-e90dd70d2e07 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644/action" status: 409 len: 148 microversion: 2.1 time: 0.077658 Aug 06 20:57:46.045615 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 672/1348] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:45 2022] POST /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644/action => generated 148 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:57:46.050374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-106482b5-a02a-4835-a97d-a98ce94466ff tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d871310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:46.053162 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-56bf4b6a-2a0e-4df6-9347-c21fb29ac30c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1470 microversion: 2.1 time: 0.353116 Aug 06 20:57:46.056030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 677/1349] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:45 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1470 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:46.070372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:46.071298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:46.078319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.078859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.079310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.080023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.080480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.081124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.088444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-106482b5-a02a-4835-a97d-a98ce94466ff tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:57:46.089060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.security_group_api [None req-106482b5-a02a-4835-a97d-a98ce94466ff tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group 7def743e-bd9e-4e67-86d9-888aa57d4929 not found {{(pid=142461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:57:46.089967 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-106482b5-a02a-4835-a97d-a98ce94466ff tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:57:46.089967 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-1c9a5e87-48d0-465c-a4b8-efbbecf72c48'] Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-106482b5-a02a-4835-a97d-a98ce94466ff tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929 HTTP/1.1 Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:46.115656 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: exception: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-1c9a5e87-48d0-465c-a4b8-efbbecf72c48'] Aug 06 20:57:46.117114 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7def743e-bd9e-4e67-86d9-888aa57d4929'} Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:46.117923 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c9a5e87-48d0-465c-a4b8-efbbecf72c48'] Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:57:46.119544 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c9a5e87-48d0-465c-a4b8-efbbecf72c48'] Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c9a5e87-48d0-465c-a4b8-efbbecf72c48'] Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.120632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c9a5e87-48d0-465c-a4b8-efbbecf72c48'] Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-106482b5-a02a-4835-a97d-a98ce94466ff tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-1c9a5e87-48d0-465c-a4b8-efbbecf72c48'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:46.121886 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-106482b5-a02a-4835-a97d-a98ce94466ff tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929" status: 404 len: 194 microversion: 2.1 time: 0.076483 Aug 06 20:57:46.122668 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 673/1350] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 20:57:46 2022] GET /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:46.127763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b3f4d82a-0e90-4669-b1b9-615a10e47f8f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b3f4d82a-0e90-4669-b1b9-615a10e47f8f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Request method failure captured: Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8/action HTTP/1.1 Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 39 Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWcDhv0NOCwtEz5hknOtWBRsczwfEnPrygefQD7xGD4F0J-fprVh5T_gpULAaMgpPCP6oodYyktHSPIYaXXdffbwzkVRa6B74J2qjj-JqUrPTKHcmA9d7-ivQPu6ukUoTtV-Zy3qu36LuMLMNFivBnRpcjMGO8YRlJ9WkMvXoDpmJA Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:57:46.132738 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb76102372d64079b3571e92331e77ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb76102372d64079b3571e92331e77ae", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7004eb9df0824403a47f7b26d5eaf89c Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: {"os-resetState": {"state": "invalid"}} Aug 06 20:57:46.134222 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '55b5de59-fb8f-457a-9774-022b018a6dc8', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'invalid' Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.135342 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:57:46.136766 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 06 20:57:46.137960 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.137960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b3f4d82a-0e90-4669-b1b9-615a10e47f8f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:46.137960 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b3f4d82a-0e90-4669-b1b9-615a10e47f8f tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8/action" status: 400 len: 144 microversion: 2.1 time: 0.010304 Aug 06 20:57:46.137960 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 674/1351] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:46 2022] POST /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8/action => generated 144 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:57:46.142880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e2590a33-3ae1-4c70-bbca-ce8257b00f1e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: .version_select at 0x7f729d8719d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1112748380", "description": "tempest-description-1588148147"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:46.293143 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e2590a33-3ae1-4c70-bbca-ce8257b00f1e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.156597 Aug 06 20:57:46.305552 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 675/1352] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:57:46 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:46.320744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8555a470-0a3a-41cf-97f2-91a8d24ccfd5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8555a470-0a3a-41cf-97f2-91a8d24ccfd5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Request method failure captured: Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8/action HTTP/1.1 Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 31 Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWcDhv0NOCwtEz5hknOtWBRsczwfEnPrygefQD7xGD4F0J-fprVh5T_gpULAaMgpPCP6oodYyktHSPIYaXXdffbwzkVRa6B74J2qjj-JqUrPTKHcmA9d7-ivQPu6ukUoTtV-Zy3qu36LuMLMNFivBnRpcjMGO8YRlJ9WkMvXoDpmJA Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:57:46.325164 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb76102372d64079b3571e92331e77ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb76102372d64079b3571e92331e77ae", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7004eb9df0824403a47f7b26d5eaf89c Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: {"os-resetState": {"state": 1}} Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:46.326836 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '55b5de59-fb8f-457a-9774-022b018a6dc8', 'body': {'os-resetState': {'state': 1}}} Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 1 Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:46.328409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 06 20:57:46.330720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.333238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8555a470-0a3a-41cf-97f2-91a8d24ccfd5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:46.333238 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8555a470-0a3a-41cf-97f2-91a8d24ccfd5 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8/action" status: 400 len: 120 microversion: 2.1 time: 0.020780 Aug 06 20:57:46.333238 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 676/1353] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:57:46 2022] POST /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8/action => generated 120 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:57:46.335716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f8f05a4-5924-4d02-95aa-39025067ec23 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: .version_select at 0x7f729d7c9dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-715724728", "description": "tempest-description-70717491"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:46.432734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:46.441943 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eb4d256b-7e29-44a2-9d28-d55a961a08ac tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.384881 Aug 06 20:57:46.442845 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 678/1354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:46 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:46.457933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4374441b-359b-41e1-a8c3-8292303e20a8 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:46.462107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4374441b-359b-41e1-a8c3-8292303e20a8 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Failed to fetch instance by id 999 {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 06 20:57:46.463182 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-4374441b-359b-41e1-a8c3-8292303e20a8 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4374441b-359b-41e1-a8c3-8292303e20a8 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Request method failure captured: Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 37 Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWcDhv0NOCwtEz5hknOtWBRsczwfEnPrygefQD7xGD4F0J-fprVh5T_gpULAaMgpPCP6oodYyktHSPIYaXXdffbwzkVRa6B74J2qjj-JqUrPTKHcmA9d7-ivQPu6ukUoTtV-Zy3qu36LuMLMNFivBnRpcjMGO8YRlJ9WkMvXoDpmJA Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:57:46.467146 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/eb76102372d64079b3571e92331e77ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_eb76102372d64079b3571e92331e77ae", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/eb76102372d64079b3571e92331e77ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: eb76102372d64079b3571e92331e77ae Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1909557099 Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7004eb9df0824403a47f7b26d5eaf89c Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1909557099-project-admin Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: {"os-resetState": {"state": "error"}} Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:46.469543 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 999 could not be found. Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:57:46.470768 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4374441b-359b-41e1-a8c3-8292303e20a8 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:46.472256 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4374441b-359b-41e1-a8c3-8292303e20a8 tempest-ServersAdminNegativeTestJSON-1909557099 tempest-ServersAdminNegativeTestJSON-1909557099-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025478 Aug 06 20:57:46.476972 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 679/1355] 10.222.0.33 () {60 vars in 1179 bytes} [Sat Aug 6 20:57:46 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:57:46.481830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:46.482519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:46.504516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.505163 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f8f05a4-5924-4d02-95aa-39025067ec23 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.174650 Aug 06 20:57:46.505313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.505732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.513637 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 677/1356] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:57:46 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:46.513844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.513844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.513844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.514080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:46.514080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:46.520669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.522102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.522572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.523324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.523799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.524237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.554236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:46.645476 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-db52cdda-a8f6-44ad-9585-05941190bf0d tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "DELETE /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 204 len: 0 microversion: 2.1 time: 0.137675 Aug 06 20:57:46.646744 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 678/1357] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:46 2022] DELETE /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:46.652504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-91d07d01-e994-4902-8cb4-bf477987ba62 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: .version_select at 0x7f729d7c9820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-59973448", "description": "tempest-description-1739340960"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:46.775861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:46.788311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:46.790233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:46.793394 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e980b63a-725e-458a-8660-bd4b749f0909 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.319431 Aug 06 20:57:46.793394 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 680/1358] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:46 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:46.798124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:46.798767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:46.805742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.806244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.806869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.807747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.808212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.808649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.847110 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-91d07d01-e994-4902-8cb4-bf477987ba62 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.198885 Aug 06 20:57:46.848461 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 679/1359] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:57:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:46.854642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:46.856052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:46.856180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:46.865823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.865823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.865823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.867051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:46.867051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:46.867423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:46.883309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:46.971343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:46.979567 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-09dc03d8-f12e-4334-aa98-a504362b2125 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1712 microversion: 2.1 time: 0.185905 Aug 06 20:57:46.980143 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 681/1360] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:46 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1712 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:46.985152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c353ccc0-625a-4a61-946e-4797afa09c4b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '.version_select at 0x7f729dd3fdc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:47.009783 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-c353ccc0-625a-4a61-946e-4797afa09c4b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Image not found. Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c353ccc0-625a-4a61-946e-4797afa09c4b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/images/f6cf34dc-5f40-49c3-8de0-95e7030c6ee0 HTTP/1.1 Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:47.011618 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'f6cf34dc-5f40-49c3-8de0-95e7030c6ee0'} Aug 06 20:57:47.013244 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f6cf34dc-5f40-49c3-8de0-95e7030c6ee0 to delete Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:47.014264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f6cf34dc-5f40-49c3-8de0-95e7030c6ee0 could not be found. Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:47.015793 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c353ccc0-625a-4a61-946e-4797afa09c4b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:47.017522 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c353ccc0-625a-4a61-946e-4797afa09c4b tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/images/f6cf34dc-5f40-49c3-8de0-95e7030c6ee0" status: 404 len: 62 microversion: 2.1 time: 0.031954 Aug 06 20:57:47.018746 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 682/1361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:46 2022] DELETE /compute/v2.1/images/f6cf34dc-5f40-49c3-8de0-95e7030c6ee0 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:57:47.025878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb83ee40-f83d-45e4-94f1-0b4f8cebcad3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729dcb2820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:47.026936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:47.035857 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ebe9c3fc-4b09-4457-9c61-ceb4167735d9 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1468 microversion: 2.1 time: 0.185874 Aug 06 20:57:47.038623 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 680/1362] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:46 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1468 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:47.042091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:47.043074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:47.050323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.051448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.051899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:47.053221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.053695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.054141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:47.054893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=20 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:47.074084 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df HTTP/1.1 Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:47.075821 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.077428 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '33d5617c-e074-40e2-961a-27e0db7198df'} Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:47.078408 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.079693 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.081000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:47.081000 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f82d9f4d-3a5d-4fd3-bb9f-aa313d6182a7 tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "DELETE /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 404 len: 111 microversion: 2.1 time: 0.039572 Aug 06 20:57:47.081000 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 681/1363] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:47 2022] DELETE /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:47.084655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:47.085271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:47.091724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.092227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.092672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:47.093573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.094036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.094590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:47.243554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:47.253034 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d4f811f-750d-4043-af32-e9885974be32 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1470 microversion: 2.1 time: 0.174109 Aug 06 20:57:47.253940 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 682/1364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:47 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:47.258573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:47.259418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] [instance: 33d5617c-e074-40e2-961a-27e0db7198df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:47.268780 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb83ee40-f83d-45e4-94f1-0b4f8cebcad3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.254179 Aug 06 20:57:47.269373 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 683/1365] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:57:47 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:47.275749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.276255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.276701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:47.277417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.277886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.278320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:47.283635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4eac6ed2-6937-4ea8-888a-9d668072de29 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729dcb2e50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:47.293973 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] HTTP exception thrown: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Request method failure captured: Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df HTTP/1.1 Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tVlzTjsna5JxLurZzLPvny70EtMOoVeqmW4SgCJTc-DGnlvLRlUlP0tp9-vSStxKajlpN4MB767Nd4WDxUPuQWXWQhfN9OqlN7VM2x-Cnt4dzX4vIpJJQxIO9HyqrPEWzhe_rpQlQ_p49BFo2o89WM-NtxxpGov5zooRI1-lnySOzw Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:47.295562 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8fd242c56a3f436c9cf158e68253218c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8fd242c56a3f436c9cf158e68253218c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8fd242c56a3f436c9cf158e68253218c Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-277777965 Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dff69a9a061a454685cfc57c1675f4b9 Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-277777965-project Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.297747 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '33d5617c-e074-40e2-961a-27e0db7198df'} Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:47.299282 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. Aug 06 20:57:47.300678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:47.302113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] Returning 404 to user: Instance 33d5617c-e074-40e2-961a-27e0db7198df could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:47.302113 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c90e4f96-92f6-403f-b8de-ece2a8738abb tempest-ImagesOneServerNegativeTestJSON-277777965 tempest-ImagesOneServerNegativeTestJSON-277777965-project] 10.222.0.33 "GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df" status: 404 len: 111 microversion: 2.1 time: 0.042667 Aug 06 20:57:47.302113 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 683/1366] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:47 2022] GET /compute/v2.1/servers/33d5617c-e074-40e2-961a-27e0db7198df => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:47.467598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:47.469166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:47.475995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.476487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.477074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:47.477844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.478246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.478700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:47.659450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:47.682424 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f2bba65-874a-47a5-86c6-d7b9c05f0175 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.221452 Aug 06 20:57:47.683410 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 684/1367] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:47 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:47.817208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:47.818365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:47.827024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.828360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.828998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:47.829910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:47.830748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:47.831428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:48.069589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:48.074104 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4eac6ed2-6937-4ea8-888a-9d668072de29 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5ffcc428-a1f2-42cb-8792-7d0595852b5b" status: 202 len: 0 microversion: 2.1 time: 0.794798 Aug 06 20:57:48.080825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:48.081785 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 684/1368] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:57:47 2022] DELETE /compute/v2.1/os-security-groups/5ffcc428-a1f2-42cb-8792-7d0595852b5b => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:48.082996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:48.084543 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5489b914-2508-4e6d-a48c-757bc5be1987 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.272380 Aug 06 20:57:48.085939 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 685/1369] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:47 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:57:48.099249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:48.099249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:48.110812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:48.111666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:48.118443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:48.120039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:48.120191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:48.120739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:48.121212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:48.121940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:48.122129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:48.123057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:48.123970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:48.125495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:48.126055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:48.126609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:48.341963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:48.353256 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e28aa99d-1cb9-4b73-96de-1a5dcf5a156b tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1468 microversion: 2.1 time: 0.250879 Aug 06 20:57:48.353855 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 686/1370] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:48 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1468 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:48.360009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-89c2b063-c524-456d-a86b-390c564ffbb3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d8713a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:48.398348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-89c2b063-c524-456d-a86b-390c564ffbb3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:57:48.399203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.security_group_api [None req-89c2b063-c524-456d-a86b-390c564ffbb3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b not found {{(pid=142461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:57:48.399893 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-89c2b063-c524-456d-a86b-390c564ffbb3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:57:48.399893 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-0a1fc1f4-4bbc-4b7d-a0bf-bc2dee5879b0'] Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-89c2b063-c524-456d-a86b-390c564ffbb3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-security-groups/5ffcc428-a1f2-42cb-8792-7d0595852b5b HTTP/1.1 Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:48.402571 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: exception: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-0a1fc1f4-4bbc-4b7d-a0bf-bc2dee5879b0'] Aug 06 20:57:48.404177 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '5ffcc428-a1f2-42cb-8792-7d0595852b5b'} Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:48.405142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a1fc1f4-4bbc-4b7d-a0bf-bc2dee5879b0'] Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:57:48.406731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a1fc1f4-4bbc-4b7d-a0bf-bc2dee5879b0'] Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a1fc1f4-4bbc-4b7d-a0bf-bc2dee5879b0'] Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:48.408098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:48.410869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:48.410869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:48.410869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:48.410869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:48.410869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:57:48.410869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a1fc1f4-4bbc-4b7d-a0bf-bc2dee5879b0'] Aug 06 20:57:48.410869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:48.412997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-89c2b063-c524-456d-a86b-390c564ffbb3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:57:48.412997 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-0a1fc1f4-4bbc-4b7d-a0bf-bc2dee5879b0'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:48.414430 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-89c2b063-c524-456d-a86b-390c564ffbb3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/5ffcc428-a1f2-42cb-8792-7d0595852b5b" status: 404 len: 194 microversion: 2.1 time: 0.059639 Aug 06 20:57:48.415183 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 687/1371] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 20:57:48 2022] GET /compute/v2.1/os-security-groups/5ffcc428-a1f2-42cb-8792-7d0595852b5b => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:48.420469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:48.421091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:48.430536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:48.431059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:48.431507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:48.432224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:48.433062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:48.433509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:48.524730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:48.535167 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28c4751d-041a-4eb9-be73-d964bcb6e6f6 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1712 microversion: 2.1 time: 0.451477 Aug 06 20:57:48.536058 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 685/1372] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:48 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1712 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:48.540883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3073746d-fc6d-42e9-91d2-6d82ad424cf8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729dd4fdc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:48.647375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:48.657490 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-03906471-440d-45cc-809c-381674c72bb6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1470 microversion: 2.1 time: 0.240638 Aug 06 20:57:48.658434 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 688/1373] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:48 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1470 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:48.704130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:48.704702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:48.711358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:48.711853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:48.712291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:48.713219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:48.713794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:48.714389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:48.965069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:48.977832 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd00001c-aa4a-4e1f-abe0-c8766b8c8c0f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.277597 Aug 06 20:57:48.978443 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 689/1374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:48 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:48.993689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-49412ab0-5042-4640-af14-0dc92fc035bb req-66aab5ad-b94f-41f6-a9e7-c3561acd1fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d7a71f-b21b-4142-bd6a-c7e178308644", "name": "network-vif-deleted", "tag": "9da26b08-1938-4d2b-ad2f-1325748518c4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:49.009019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49412ab0-5042-4640-af14-0dc92fc035bb req-66aab5ad-b94f-41f6-a9e7-c3561acd1fc9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.009884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49412ab0-5042-4640-af14-0dc92fc035bb req-66aab5ad-b94f-41f6-a9e7-c3561acd1fc9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.011261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49412ab0-5042-4640-af14-0dc92fc035bb req-66aab5ad-b94f-41f6-a9e7-c3561acd1fc9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:49.028276 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-49412ab0-5042-4640-af14-0dc92fc035bb req-66aab5ad-b94f-41f6-a9e7-c3561acd1fc9 service nova] Creating event network-vif-deleted:9da26b08-1938-4d2b-ad2f-1325748518c4 for instance 40d7a71f-b21b-4142-bd6a-c7e178308644 on nch2-master-1 Aug 06 20:57:49.037471 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-49412ab0-5042-4640-af14-0dc92fc035bb req-66aab5ad-b94f-41f6-a9e7-c3561acd1fc9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050483 Aug 06 20:57:49.044019 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 690/1375] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:49.113958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:49.115545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:49.123680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.124222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.130031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:49.130987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.131730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.132345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:49.275896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:49.290698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:49.292609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:49.294016 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-030ecdcd-5696-45bb-aeed-e2381b886693 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.184437 Aug 06 20:57:49.294978 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 691/1376] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:49 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:57:49.374038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:49.375338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:49.386694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.387684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.388136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:49.388847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.389335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.389765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:49.410454 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3073746d-fc6d-42e9-91d2-6d82ad424cf8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4228a6b7-2f0d-4aac-847f-6a54991745ef" status: 202 len: 0 microversion: 2.1 time: 0.872752 Aug 06 20:57:49.415080 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 686/1377] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:57:48 2022] DELETE /compute/v2.1/os-security-groups/4228a6b7-2f0d-4aac-847f-6a54991745ef => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:49.420663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-93c23606-53a8-4034-907a-547a93e8ed00 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729dd0fa60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:49.463885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.464384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.476410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:49.477507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lazy-loading 'fault' on Instance uuid 40d7a71f-b21b-4142-bd6a-c7e178308644 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:57:49.510893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-93c23606-53a8-4034-907a-547a93e8ed00 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:57:49.517437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.security_group_api [None req-93c23606-53a8-4034-907a-547a93e8ed00 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group 4228a6b7-2f0d-4aac-847f-6a54991745ef not found {{(pid=142462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:57:49.519014 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-93c23606-53a8-4034-907a-547a93e8ed00 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:57:49.519014 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-6c1364a8-398e-4a7c-adcd-06e3c56177ac'] Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-93c23606-53a8-4034-907a-547a93e8ed00 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-security-groups/4228a6b7-2f0d-4aac-847f-6a54991745ef HTTP/1.1 Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:49.525430 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: exception: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-6c1364a8-398e-4a7c-adcd-06e3c56177ac'] Aug 06 20:57:49.528380 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4228a6b7-2f0d-4aac-847f-6a54991745ef'} Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:49.529342 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c1364a8-398e-4a7c-adcd-06e3c56177ac'] Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:57:49.530815 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c1364a8-398e-4a7c-adcd-06e3c56177ac'] Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c1364a8-398e-4a7c-adcd-06e3c56177ac'] Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:49.532141 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:49.533925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:49.533925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:49.533925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:49.533925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:49.533925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:57:49.533925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c1364a8-398e-4a7c-adcd-06e3c56177ac'] Aug 06 20:57:49.533925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:49.535788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-93c23606-53a8-4034-907a-547a93e8ed00 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:57:49.535788 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-6c1364a8-398e-4a7c-adcd-06e3c56177ac'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:49.538462 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-93c23606-53a8-4034-907a-547a93e8ed00 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/4228a6b7-2f0d-4aac-847f-6a54991745ef" status: 404 len: 194 microversion: 2.1 time: 0.120227 Aug 06 20:57:49.547179 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 687/1378] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 20:57:49 2022] GET /compute/v2.1/os-security-groups/4228a6b7-2f0d-4aac-847f-6a54991745ef => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:49.556118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ee1732de-0b97-4129-8155-5f27b09e7667 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729dde3c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:49.598304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:49.613470 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5e4f6d04-4e32-4659-8f36-759a575b3cce tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 200 len: 1311 microversion: 2.1 time: 0.243280 Aug 06 20:57:49.623229 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 692/1379] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:49 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 1311 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:49.635018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:49.635568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:49.648822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.649732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.650964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:49.653070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.653909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.657259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:49.952857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:49.965440 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75c0ccfa-97c2-4788-a965-9544f61e282f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1712 microversion: 2.1 time: 0.346949 Aug 06 20:57:49.968738 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 693/1380] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:49 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1712 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:49.974479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:49.975212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:49.992324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.994226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.994226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:49.994766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:49.995239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:49.995849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:50.449423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:50.463655 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2d15a930-6d70-4f44-a190-1ee488e228d8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1470 microversion: 2.1 time: 0.494695 Aug 06 20:57:50.465382 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 694/1381] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:49 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1470 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:50.476596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:50.477406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:50.490512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:50.491397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:50.492224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:50.493224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:50.493912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:50.494774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:50.517990 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ee1732de-0b97-4129-8155-5f27b09e7667 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/16e881c9-fd13-4f3a-848d-de6899b051e4" status: 202 len: 0 microversion: 2.1 time: 0.967702 Aug 06 20:57:50.523561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 688/1382] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:57:49 2022] DELETE /compute/v2.1/os-security-groups/16e881c9-fd13-4f3a-848d-de6899b051e4 => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:57:50.528921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:50.531265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:50.549120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:50.549856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:50.550985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:50.552635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:50.553505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:50.554518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:50.873655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:50.888160 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74b0f24f-6712-41dc-91bd-e229a882c9e8 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.421195 Aug 06 20:57:50.888765 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 695/1383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:50 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:50.893618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02899c56-4320-4f52-98a8-a4492c435491 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d7c9940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:50.974131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-02899c56-4320-4f52-98a8-a4492c435491 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:57:50.974994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.security_group_api [None req-02899c56-4320-4f52-98a8-a4492c435491 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group 16e881c9-fd13-4f3a-848d-de6899b051e4 not found {{(pid=142461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:57:50.975984 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-02899c56-4320-4f52-98a8-a4492c435491 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:57:50.975984 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-1615288d-0924-47ed-be99-c4cb9e051dbb'] Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02899c56-4320-4f52-98a8-a4492c435491 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-security-groups/16e881c9-fd13-4f3a-848d-de6899b051e4 HTTP/1.1 Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:50.980577 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: exception: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-1615288d-0924-47ed-be99-c4cb9e051dbb'] Aug 06 20:57:50.981997 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '16e881c9-fd13-4f3a-848d-de6899b051e4'} Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:50.982954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1615288d-0924-47ed-be99-c4cb9e051dbb'] Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:57:50.984680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1615288d-0924-47ed-be99-c4cb9e051dbb'] Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1615288d-0924-47ed-be99-c4cb9e051dbb'] Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:50.985769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:50.987048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:50.987048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:50.987048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:50.987048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:50.987048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:57:50.987048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1615288d-0924-47ed-be99-c4cb9e051dbb'] Aug 06 20:57:50.987048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:50.990257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02899c56-4320-4f52-98a8-a4492c435491 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:57:50.990257 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-1615288d-0924-47ed-be99-c4cb9e051dbb'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:50.991796 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02899c56-4320-4f52-98a8-a4492c435491 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/16e881c9-fd13-4f3a-848d-de6899b051e4" status: 404 len: 194 microversion: 2.1 time: 0.102105 Aug 06 20:57:50.993114 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 696/1384] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 20:57:50 2022] GET /compute/v2.1/os-security-groups/16e881c9-fd13-4f3a-848d-de6899b051e4 => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:51.000147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:51.001116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 40d7a71f-b21b-4142-bd6a-c7e178308644] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:51.007483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:51.013456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.014383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.015015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.015834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.016392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.016918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.036220 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] HTTP exception thrown: Instance 40d7a71f-b21b-4142-bd6a-c7e178308644 could not be found. Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Request method failure captured: Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 HTTP/1.1 Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWbVKszFpjsw0C_feW9wVSjCUpXUXvBuN8q-4jk1YGGE_GEQYtBXmg1yQLcrtQ8nlCzU1KPsjfjNuYYXpsblcBuFPqOO4PnVu4QIobuQXc3_dtf8Qb-tb8cJcJBOHASNhdUPujBVtsWid_3YX9f64L7f-7403MRUpFyxkoMMmlobY4 Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 61b980ff8dca4c84bb452d09d55c37ef Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1936453757 Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:51.037646 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/61b980ff8dca4c84bb452d09d55c37ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_61b980ff8dca4c84bb452d09d55c37ef", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/61b980ff8dca4c84bb452d09d55c37ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/61b980ff8dca4c84bb452d09d55c37ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1936453757 Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 61b980ff8dca4c84bb452d09d55c37ef Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1936453757 Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersAdminNegativeTestJSON-1936453757-project Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 46557175a8504db78843b5d56b1413cf Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1936453757-project Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 40d7a71f-b21b-4142-bd6a-c7e178308644 could not be found. Aug 06 20:57:51.039309 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '40d7a71f-b21b-4142-bd6a-c7e178308644'} Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d7a71f-b21b-4142-bd6a-c7e178308644 could not be found. Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:51.040270 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d7a71f-b21b-4142-bd6a-c7e178308644 could not be found. Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d7a71f-b21b-4142-bd6a-c7e178308644 could not be found. Aug 06 20:57:51.042844 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:51.044412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Returning 404 to user: Instance 40d7a71f-b21b-4142-bd6a-c7e178308644 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:51.044412 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0fa0b349-145a-4b08-b444-8018356b5c12 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644" status: 404 len: 111 microversion: 2.1 time: 0.044436 Aug 06 20:57:51.044634 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 697/1385] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:50 2022] GET /compute/v2.1/servers/40d7a71f-b21b-4142-bd6a-c7e178308644 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:51.053707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:51.054639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:51.063600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.064077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.064982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.065877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.066485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.067085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.089204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:51.099959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:51.102872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:51.110642 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a0d0726-e17c-4086-b7b2-9d1e1214369b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.585228 Aug 06 20:57:51.111868 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 689/1386] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:50 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:51.131016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bb3bfae8-bfbe-46ef-a508-ef80a02f55e1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729dcf8ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:51.184097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4604780fce5b4ece8cb20354efb53569', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff0aae88974b5a893b71e0d6b34257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:51.195288 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-425c54d1-e302-4ead-942b-255a8a348a63 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 200 len: 1644 microversion: 2.1 time: 0.148751 Aug 06 20:57:51.210178 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 698/1387] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:51 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 1644 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:51.215879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:51.216848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:51.229828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.230874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.231534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.233031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.235194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.235973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.272649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:57:51.344668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:51.424505 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-759f4c26-cf05-4942-b75b-58850ba958ed tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 204 len: 0 microversion: 2.1 time: 0.207751 Aug 06 20:57:51.426885 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 699/1388] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:51 2022] DELETE /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:57:51.446565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ba11fa77-fba2-46a4-b1f0-5be63657ef11 req-e3533650-aff0-4ea2-a4ca-167462137720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87d6735-5d42-4f96-aac5-55b50a1a804f", "name": "network-vif-unplugged", "status": "completed", "tag": "270cefb5-0f7a-43e8-8015-bdf5afc1c875"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:51.474003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ba11fa77-fba2-46a4-b1f0-5be63657ef11 req-e3533650-aff0-4ea2-a4ca-167462137720 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.474667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ba11fa77-fba2-46a4-b1f0-5be63657ef11 req-e3533650-aff0-4ea2-a4ca-167462137720 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.475628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ba11fa77-fba2-46a4-b1f0-5be63657ef11 req-e3533650-aff0-4ea2-a4ca-167462137720 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.506394 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ba11fa77-fba2-46a4-b1f0-5be63657ef11 req-e3533650-aff0-4ea2-a4ca-167462137720 service nova] Creating event network-vif-unplugged:270cefb5-0f7a-43e8-8015-bdf5afc1c875 for instance a87d6735-5d42-4f96-aac5-55b50a1a804f on nch2-master-1 Aug 06 20:57:51.520524 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ba11fa77-fba2-46a4-b1f0-5be63657ef11 req-e3533650-aff0-4ea2-a4ca-167462137720 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090277 Aug 06 20:57:51.521344 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 700/1389] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:51.534470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-aeae612f-3c64-4b7b-b36b-42a3118fd322 req-b4c20f22-8695-4ddd-9d26-8c09ac4c631c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bd8825-f9af-4d7f-b63e-25909fe77863", "name": "network-vif-deleted", "tag": "7d823470-4659-430a-ac3f-9fa524a8441e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:51.572111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-aeae612f-3c64-4b7b-b36b-42a3118fd322 req-b4c20f22-8695-4ddd-9d26-8c09ac4c631c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.573053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-aeae612f-3c64-4b7b-b36b-42a3118fd322 req-b4c20f22-8695-4ddd-9d26-8c09ac4c631c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.575334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-aeae612f-3c64-4b7b-b36b-42a3118fd322 req-b4c20f22-8695-4ddd-9d26-8c09ac4c631c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.634119 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-aeae612f-3c64-4b7b-b36b-42a3118fd322 req-b4c20f22-8695-4ddd-9d26-8c09ac4c631c service nova] Creating event network-vif-deleted:7d823470-4659-430a-ac3f-9fa524a8441e for instance 35bd8825-f9af-4d7f-b63e-25909fe77863 on nch1-master-1 Aug 06 20:57:51.642916 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-aeae612f-3c64-4b7b-b36b-42a3118fd322 req-b4c20f22-8695-4ddd-9d26-8c09ac4c631c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120070 Aug 06 20:57:51.644353 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 701/1390] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:51.651509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:51.652407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:51.672814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.677088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.677814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.679567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.680371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.680832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.721073 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bb3bfae8-bfbe-46ef-a508-ef80a02f55e1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.607914 Aug 06 20:57:51.722271 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 690/1391] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:57:51 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:51.727741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:51.728659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:51.747045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.747790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.748480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.749489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.750251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.750953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.785445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:52.055434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:52.075399 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f3b83b2-92db-4c5e-8d68-82572e4ceb70 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1476 microversion: 2.1 time: 0.345353 Aug 06 20:57:52.076196 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 691/1392] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:51 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:52.103432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e2673d0f-1227-4eb2-b308-448c6c0cd7b6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: .version_select at 0x7f729dde3e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-614252825", "description": "tempest-description-1523118418"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:52.289306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=10 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:52.338021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:52.349636 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e66d07d8-e2f7-4619-a0ea-9b3f1baeab01 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1476 microversion: 2.1 time: 0.703786 Aug 06 20:57:52.358079 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 702/1393] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:51 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1476 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:52.364542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:52.365464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:52.379611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:52.388615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:52.389684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:52.391445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:52.392285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:52.393095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:52.731028 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e2673d0f-1227-4eb2-b308-448c6c0cd7b6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.641867 Aug 06 20:57:52.733398 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 692/1394] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:57:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:52.738559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:52.739389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:52.751511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:52.752027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:52.752479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:52.763801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:52.764327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:52.765413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.037638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:53.054846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:53.061213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:53.065491 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c9657a03-008e-4f02-ada6-e6a5c7ffc9e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.330874 Aug 06 20:57:53.066386 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 693/1395] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:52 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:53.090382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:53.091119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:53.101757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.102666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.103438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.104362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.105050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.105644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.146979 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] HTTP exception thrown: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Request method failure captured: Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 HTTP/1.1 Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUjP8xy0NEHzW-iD4JKYpCc8cnJjwtcBnz4gU8ynHZOreKvTOw28mYUzrBf0yPCA__bnsHqzUoCKQ9cVlMiCU0jO9qBqmyDgrOIZO5DA7Jm55w5VtjlecGxJifFKaPzyd1Dk9xif7w_-nGMExgdECriE9PArfqkCD7yKWTPMPFEcEE Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:53.148836 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2eff0aae88974b5a893b71e0d6b34257", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 4604780fce5b4ece8cb20354efb53569 Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:53.150287 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '35bd8825-f9af-4d7f-b63e-25909fe77863'} Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:53.151191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:53.152424 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.155189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Returning 404 to user: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:53.157525 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0946dfff-10f3-435e-8747-43512ec1503e tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 404 len: 111 microversion: 2.1 time: 0.089745 Aug 06 20:57:53.158462 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 694/1396] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:53 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:53.165959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cc3c1654-d038-446c-b02e-c0feac9824d8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: .version_select at 0x7f729dde3820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2129891934", "description": "tempest-description-547905078"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:53.167712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:53.176693 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a19a3e66-e0be-483d-9ff7-eef4afa1342e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.817045 Aug 06 20:57:53.182600 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 703/1397] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:52 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:53.193438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:53.194061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:53.208838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.209351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.209798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.210523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.211015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.219231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.709015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:53.721642 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-35a87481-22b1-4b5b-a66e-6b6d32c9f464 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1476 microversion: 2.1 time: 0.537822 Aug 06 20:57:53.728734 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 704/1398] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:53 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1476 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:53.735838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:53.736535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:53.752363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.752866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.753314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.760934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.761509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.762024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.790027 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] HTTP exception thrown: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Request method failure captured: Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 HTTP/1.1 Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUjP8xy0NEHzW-iD4JKYpCc8cnJjwtcBnz4gU8ynHZOreKvTOw28mYUzrBf0yPCA__bnsHqzUoCKQ9cVlMiCU0jO9qBqmyDgrOIZO5DA7Jm55w5VtjlecGxJifFKaPzyd1Dk9xif7w_-nGMExgdECriE9PArfqkCD7yKWTPMPFEcEE Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:53.793378 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2eff0aae88974b5a893b71e0d6b34257", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 4604780fce5b4ece8cb20354efb53569 Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.794894 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '70d48166-5304-479e-998a-4ca89870b1a2'} Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:53.795975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.798487 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.800133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Returning 404 to user: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:53.803435 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-04eaee8e-1653-44e8-9191-56cf9635ad0f tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "DELETE /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 404 len: 111 microversion: 2.1 time: 0.073458 Aug 06 20:57:53.804031 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 705/1399] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:53 2022] DELETE /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:53.808679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:53.811658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:53.821618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.822389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.830014 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cc3c1654-d038-446c-b02e-c0feac9824d8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.669389 Aug 06 20:57:53.849540 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 695/1400] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:57:53 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:53.857824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-32b98639-c27a-4762-b1c1-73002483f6b0 req-260ea4f6-8f88-408f-9522-4e3835e1cceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87d6735-5d42-4f96-aac5-55b50a1a804f", "tag": "270cefb5-0f7a-43e8-8015-bdf5afc1c875"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:53.862202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.868093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.870177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-32b98639-c27a-4762-b1c1-73002483f6b0 req-260ea4f6-8f88-408f-9522-4e3835e1cceb service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.870402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.870681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-32b98639-c27a-4762-b1c1-73002483f6b0 req-260ea4f6-8f88-408f-9522-4e3835e1cceb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.871128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-32b98639-c27a-4762-b1c1-73002483f6b0 req-260ea4f6-8f88-408f-9522-4e3835e1cceb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.873021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.889062 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-32b98639-c27a-4762-b1c1-73002483f6b0 req-260ea4f6-8f88-408f-9522-4e3835e1cceb service nova] Creating event network-changed:270cefb5-0f7a-43e8-8015-bdf5afc1c875 for instance a87d6735-5d42-4f96-aac5-55b50a1a804f on nch2-master-1 Aug 06 20:57:53.895701 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-32b98639-c27a-4762-b1c1-73002483f6b0 req-260ea4f6-8f88-408f-9522-4e3835e1cceb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045005 Aug 06 20:57:53.896606 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 696/1401] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:53.901697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:53.902448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:53.910826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.911329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.912803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.914234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.914817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.915258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.937251 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] HTTP exception thrown: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Request method failure captured: Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 HTTP/1.1 Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUjP8xy0NEHzW-iD4JKYpCc8cnJjwtcBnz4gU8ynHZOreKvTOw28mYUzrBf0yPCA__bnsHqzUoCKQ9cVlMiCU0jO9qBqmyDgrOIZO5DA7Jm55w5VtjlecGxJifFKaPzyd1Dk9xif7w_-nGMExgdECriE9PArfqkCD7yKWTPMPFEcEE Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:53.940292 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2eff0aae88974b5a893b71e0d6b34257", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 4604780fce5b4ece8cb20354efb53569 Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.941980 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '70d48166-5304-479e-998a-4ca89870b1a2'} Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:53.942785 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:53.947337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:53.950837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Returning 404 to user: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:53.951934 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bde78d73-08b5-4963-b2d7-81b1112f493c tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 404 len: 111 microversion: 2.1 time: 0.054235 Aug 06 20:57:53.957736 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 697/1402] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:53 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:53.966756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-45f19d63-acbc-428d-b52d-be1747f2fbbc tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '.version_select at 0x7f729ddc0c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:54.002344 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-45f19d63-acbc-428d-b52d-be1747f2fbbc tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601269215" status: 202 len: 0 microversion: 2.1 time: 0.042806 Aug 06 20:57:54.006460 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 698/1403] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 20:57:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601269215 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:54.078127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-143339745", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5b1e8462-873f-4dfe-85ac-93f78c8d5d06"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:54.173033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] validate_networks() for [('5b1e8462-873f-4dfe-85ac-93f78c8d5d06', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:57:54.318289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=7 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:54.427054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46557175a8504db78843b5d56b1413cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61b980ff8dca4c84bb452d09d55c37ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:54.496384 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f072b4a7-d7e9-455c-b8dc-53b3b7804dfc tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 200 len: 1476 microversion: 2.1 time: 0.691250 Aug 06 20:57:54.499425 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 706/1404] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:53 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 1476 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:54.519917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:54.523437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:54.552921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:54.554690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:54.555568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:54.557262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:54.558361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:54.559023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:54.966330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:54.976123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:54.977655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:54.978889 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-62442fd0-de02-4680-bf22-f6dae74e9741 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.477575 Aug 06 20:57:54.979459 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 707/1405] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:54 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:55.001630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:55.002401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:55.008721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:55.011390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:55.013410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:55.014357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:55.016228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:55.016838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:55.550139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:55.564567 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-55e6ac54-e65f-4f28-bb56-0f47cc86d973 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.584045 Aug 06 20:57:55.590275 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 708/1406] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:54 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:55.596448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:55.597603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:55.635079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:55.635847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:55.637670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:55.640363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:55.641069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:55.645344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.022305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:57:56.023295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:57:56.025691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:57:56.028111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:57:56.031394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:57:56.060631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.065735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.066680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.067187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:56.068248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.071183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.082172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.091882 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ce4990f-4deb-4dba-8643-c7b83ea13f6b tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1476 microversion: 2.1 time: 0.499689 Aug 06 20:57:56.092707 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 709/1407] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:55 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1476 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:56.106226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:56.115432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Getting quotas for project 690e571b106a4305977f2d9166a4433e. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:56.123369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2bb2776f-cfe5-4cac-a08b-a7b1d1bbe349 req-cd239fea-83d4-4ab2-8feb-211646b9bc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d99126-c9b5-4b1e-8bb6-92dc1dd048da", "name": "network-vif-unplugged", "status": "completed", "tag": "7aebd8b0-07de-4d6e-88bc-b0ebb90332e3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:56.127642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Getting quotas for user 3df9834cd3164d72a4bbd4d71d35df96 and project 690e571b106a4305977f2d9166a4433e. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:56.153960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2bb2776f-cfe5-4cac-a08b-a7b1d1bbe349 req-cd239fea-83d4-4ab2-8feb-211646b9bc4b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.157269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2bb2776f-cfe5-4cac-a08b-a7b1d1bbe349 req-cd239fea-83d4-4ab2-8feb-211646b9bc4b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.157754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2bb2776f-cfe5-4cac-a08b-a7b1d1bbe349 req-cd239fea-83d4-4ab2-8feb-211646b9bc4b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.163595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:57:56.169060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:57:56.194253 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2bb2776f-cfe5-4cac-a08b-a7b1d1bbe349 req-cd239fea-83d4-4ab2-8feb-211646b9bc4b service nova] Creating event network-vif-unplugged:7aebd8b0-07de-4d6e-88bc-b0ebb90332e3 for instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da on nch1-master-1 Aug 06 20:57:56.207284 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2bb2776f-cfe5-4cac-a08b-a7b1d1bbe349 req-cd239fea-83d4-4ab2-8feb-211646b9bc4b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107794 Aug 06 20:57:56.208779 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 710/1408] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:56.216564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:56.217276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] [instance: 55b5de59-fb8f-457a-9774-022b018a6dc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:56.237734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.238503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.239140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.242449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.243128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.243740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.245405 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb186f7a-f6ef-4edb-9d85-78eb4828d8a8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.171755 Aug 06 20:57:56.248858 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 699/1409] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 20:57:56.257896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e47c980e-027b-4658-8410-2cdadd133592 req-06aff2ff-4e99-4563-b0bd-27df5d014091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b5de59-fb8f-457a-9774-022b018a6dc8", "name": "network-vif-deleted", "tag": "e2592709-0db4-458e-bbf4-e202458e65e5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:56.271193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e47c980e-027b-4658-8410-2cdadd133592 req-06aff2ff-4e99-4563-b0bd-27df5d014091 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.272477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e47c980e-027b-4658-8410-2cdadd133592 req-06aff2ff-4e99-4563-b0bd-27df5d014091 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.273241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e47c980e-027b-4658-8410-2cdadd133592 req-06aff2ff-4e99-4563-b0bd-27df5d014091 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.297894 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e47c980e-027b-4658-8410-2cdadd133592 req-06aff2ff-4e99-4563-b0bd-27df5d014091 service nova] Creating event network-vif-deleted:e2592709-0db4-458e-bbf4-e202458e65e5 for instance 55b5de59-fb8f-457a-9774-022b018a6dc8 on nch2-master-1 Aug 06 20:57:56.306095 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] HTTP exception thrown: Instance 55b5de59-fb8f-457a-9774-022b018a6dc8 could not be found. Aug 06 20:57:56.307375 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e47c980e-027b-4658-8410-2cdadd133592 req-06aff2ff-4e99-4563-b0bd-27df5d014091 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056970 Aug 06 20:57:56.308534 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 700/1410] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:56.315096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84b6309e-3741-4634-bbaa-57928794df2e tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Request method failure captured: Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 HTTP/1.1 Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWbVKszFpjsw0C_feW9wVSjCUpXUXvBuN8q-4jk1YGGE_GEQYtBXmg1yQLcrtQ8nlCzU1KPsjfjNuYYXpsblcBuFPqOO4PnVu4QIobuQXc3_dtf8Qb-tb8cJcJBOHASNhdUPujBVtsWid_3YX9f64L7f-7403MRUpFyxkoMMmlobY4 Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 61b980ff8dca4c84bb452d09d55c37ef Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1936453757 Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:56.315661 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/61b980ff8dca4c84bb452d09d55c37ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_61b980ff8dca4c84bb452d09d55c37ef", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/61b980ff8dca4c84bb452d09d55c37ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/61b980ff8dca4c84bb452d09d55c37ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1936453757 Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 61b980ff8dca4c84bb452d09d55c37ef Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1936453757 Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersAdminNegativeTestJSON-1936453757-project Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 46557175a8504db78843b5d56b1413cf Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1936453757-project Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 55b5de59-fb8f-457a-9774-022b018a6dc8 could not be found. Aug 06 20:57:56.317076 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '55b5de59-fb8f-457a-9774-022b018a6dc8'} Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b5de59-fb8f-457a-9774-022b018a6dc8 could not be found. Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:56.317849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b5de59-fb8f-457a-9774-022b018a6dc8 could not be found. Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b5de59-fb8f-457a-9774-022b018a6dc8 could not be found. Aug 06 20:57:56.319111 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.321569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] Returning 404 to user: Instance 55b5de59-fb8f-457a-9774-022b018a6dc8 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:56.321569 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1f57d0aa-d18e-4ed3-8d98-0b5cbca54cc7 tempest-ServersAdminNegativeTestJSON-1936453757 tempest-ServersAdminNegativeTestJSON-1936453757-project] 10.222.0.33 "GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8" status: 404 len: 111 microversion: 2.1 time: 0.107232 Aug 06 20:57:56.322030 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 711/1411] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:56 2022] GET /compute/v2.1/servers/55b5de59-fb8f-457a-9774-022b018a6dc8 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:56.323026 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:57:56.323026 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:57:56.339506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:56.340296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:56.359273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.359273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.370410 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-84b6309e-3741-4634-bbaa-57928794df2e tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1007064571" status: 202 len: 0 microversion: 2.1 time: 0.060089 Aug 06 20:57:56.371570 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 701/1412] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 20:57:56 2022] DELETE /compute/v2.1/flavors/1007064571 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:56.373392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.378246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.378841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.379133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c6ca2bd-ad4a-4247-a3a1-6868f8134a19 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:56.379951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0c6ca2bd-ad4a-4247-a3a1-6868f8134a19 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:56.381162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.572820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0c6ca2bd-ad4a-4247-a3a1-6868f8134a19 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:56.581561 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c6ca2bd-ad4a-4247-a3a1-6868f8134a19 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1215 microversion: 2.1 time: 0.208717 Aug 06 20:57:56.582156 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 702/1413] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:56 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:56.602449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-50c107d4-86df-4ef5-903c-bbf875e029a4 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:56.687943 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-50c107d4-86df-4ef5-903c-bbf875e029a4 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.098518 Aug 06 20:57:56.689310 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 703/1414] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:57:56 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:56.704751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:56.705427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:56.713489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.713994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.714441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.715199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.715746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.716085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.766458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:56.781027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:56.788132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:56.789782 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba750840-0d21-4a52-a5ba-e581db9215da tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.466604 Aug 06 20:57:56.793675 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 712/1415] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:56 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:56.806345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc1f499f-d3ca-490c-bce8-8a5f1512cdb3 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:56.807565 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:57:56.807565 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:57:56.847894 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc1f499f-d3ca-490c-bce8-8a5f1512cdb3 tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/846281360" status: 202 len: 0 microversion: 2.1 time: 0.051042 Aug 06 20:57:56.855710 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 713/1416] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 20:57:56 2022] DELETE /compute/v2.1/flavors/846281360 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:57:56.872043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc2a55ca-03dc-4070-a5dd-70b913c4297e tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:56.907004 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc2a55ca-03dc-4070-a5dd-70b913c4297e tempest-ServersWithSpecificFlavorTestJSON-147032247 tempest-ServersWithSpecificFlavorTestJSON-147032247-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049395 Aug 06 20:57:56.920508 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 714/1417] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:57:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:56.956361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:56.957198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:56.960921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:56.967913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.969009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.969709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.970515 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6779e176-d534-4dcf-9715-a9169c51c2f4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.279672 Aug 06 20:57:56.970703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:56.971145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:56.971742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.974444 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 704/1418] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:56 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:56.991607 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] HTTP exception thrown: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Request method failure captured: Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 HTTP/1.1 Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUjP8xy0NEHzW-iD4JKYpCc8cnJjwtcBnz4gU8ynHZOreKvTOw28mYUzrBf0yPCA__bnsHqzUoCKQ9cVlMiCU0jO9qBqmyDgrOIZO5DA7Jm55w5VtjlecGxJifFKaPzyd1Dk9xif7w_-nGMExgdECriE9PArfqkCD7yKWTPMPFEcEE Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:56.993775 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2eff0aae88974b5a893b71e0d6b34257", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 4604780fce5b4ece8cb20354efb53569 Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:56.995341 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '35bd8825-f9af-4d7f-b63e-25909fe77863'} Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:56.996183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:56.997413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:56.998680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Returning 404 to user: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:56.998680 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f504799b-b1a9-40a3-beff-20d48ae35788 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 404 len: 111 microversion: 2.1 time: 0.063583 Aug 06 20:57:57.001762 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 715/1419] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:56 2022] DELETE /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:57.008366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:57.008999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 35bd8825-f9af-4d7f-b63e-25909fe77863] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:57.016414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.017105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.017586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.018474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.018963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.019396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.036482 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] HTTP exception thrown: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Request method failure captured: Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 HTTP/1.1 Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUjP8xy0NEHzW-iD4JKYpCc8cnJjwtcBnz4gU8ynHZOreKvTOw28mYUzrBf0yPCA__bnsHqzUoCKQ9cVlMiCU0jO9qBqmyDgrOIZO5DA7Jm55w5VtjlecGxJifFKaPzyd1Dk9xif7w_-nGMExgdECriE9PArfqkCD7yKWTPMPFEcEE Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:57.039442 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2eff0aae88974b5a893b71e0d6b34257", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 4604780fce5b4ece8cb20354efb53569 Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:57.040808 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '35bd8825-f9af-4d7f-b63e-25909fe77863'} Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:57.041822 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. Aug 06 20:57:57.043046 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.044156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Returning 404 to user: Instance 35bd8825-f9af-4d7f-b63e-25909fe77863 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:57.044156 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15c8d355-2598-4afe-86e5-104b57d2ea59 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863" status: 404 len: 111 microversion: 2.1 time: 0.039654 Aug 06 20:57:57.044156 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 705/1420] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:57 2022] GET /compute/v2.1/servers/35bd8825-f9af-4d7f-b63e-25909fe77863 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:57:57.054898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:57.055483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:57.067511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.068137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.068659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.070046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.070753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.071239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.094298 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] HTTP exception thrown: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Request method failure captured: Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 HTTP/1.1 Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tUjP8xy0NEHzW-iD4JKYpCc8cnJjwtcBnz4gU8ynHZOreKvTOw28mYUzrBf0yPCA__bnsHqzUoCKQ9cVlMiCU0jO9qBqmyDgrOIZO5DA7Jm55w5VtjlecGxJifFKaPzyd1Dk9xif7w_-nGMExgdECriE9PArfqkCD7yKWTPMPFEcEE Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:57:57.096507 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2eff0aae88974b5a893b71e0d6b34257", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 4604780fce5b4ece8cb20354efb53569 Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.097880 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '70d48166-5304-479e-998a-4ca89870b1a2'} Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:57.098669 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.099880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.102610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Returning 404 to user: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:57.103689 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9368c164-38c1-47a3-b8cc-8aae99b995cb tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "DELETE /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 404 len: 111 microversion: 2.1 time: 0.054852 Aug 06 20:57:57.104431 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 716/1421] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:57:57 2022] DELETE /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:57.113912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:57.114557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] [instance: 70d48166-5304-479e-998a-4ca89870b1a2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:57.115343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:57.115983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:57.122312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.122843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.123289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.126450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.126995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.127439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.128890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.129672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.129863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.130533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.131021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.131452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.215099 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] HTTP exception thrown: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Request method failure captured: Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 HTTP/1.1 Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tUjP8xy0NEHzW-iD4JKYpCc8cnJjwtcBnz4gU8ynHZOreKvTOw28mYUzrBf0yPCA__bnsHqzUoCKQ9cVlMiCU0jO9qBqmyDgrOIZO5DA7Jm55w5VtjlecGxJifFKaPzyd1Dk9xif7w_-nGMExgdECriE9PArfqkCD7yKWTPMPFEcEE Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:57:57.217473 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2eff0aae88974b5a893b71e0d6b34257", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eff0aae88974b5a893b71e0d6b34257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 2eff0aae88974b5a893b71e0d6b34257 Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879 Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 4604780fce5b4ece8cb20354efb53569 Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1994632879-project Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.219168 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '70d48166-5304-479e-998a-4ca89870b1a2'} Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:57:57.219906 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. Aug 06 20:57:57.221105 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:57:57.222210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] Returning 404 to user: Instance 70d48166-5304-479e-998a-4ca89870b1a2 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:57:57.224692 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5729d439-bfd5-4d3f-9996-0b28decf97c4 tempest-ServersWithSpecificFlavorTestJSON-1994632879 tempest-ServersWithSpecificFlavorTestJSON-1994632879-project] 10.222.0.33 "GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2" status: 404 len: 111 microversion: 2.1 time: 0.109510 Aug 06 20:57:57.225342 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 706/1422] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:57 2022] GET /compute/v2.1/servers/70d48166-5304-479e-998a-4ca89870b1a2 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:57:57.605877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:57.606510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:57.628857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.630186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.633221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.634657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.635331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.635965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.810637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:57.820584 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aac292a3-99d8-42b7-a63a-658cc925c70b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1267 microversion: 2.1 time: 0.218470 Aug 06 20:57:57.825718 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 707/1423] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:57 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:57.840850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:57.841753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:57.854904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.855962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.856652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.859993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.860749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.861427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.876887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:57.889907 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce7cd0f2-6a9b-4983-9915-18519af787f3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1476 microversion: 2.1 time: 0.777856 Aug 06 20:57:57.891029 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 717/1424] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:57 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1476 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:57.999400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:58.000425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:58.037355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:58.039230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:58.039885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:58.043286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:58.048776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:58.049523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:58.383750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:58.399535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:58.402492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:58.407555 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d42d1504-9a43-4e42-b3b1-08ccbb88b365 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.579562 Aug 06 20:57:58.430043 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 708/1425] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:57 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:57:58.689651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:58.729407 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-45b66869-48a2-48db-89a7-1d7e3e64883a tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.729897 Aug 06 20:57:58.730116 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 718/1426] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:57 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:58.849280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:58.850011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:58.858331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:58.858884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:58.859317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:58.860057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:58.872608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:58.873348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:58.914115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:58.914967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:58.931445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:58.933510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:58.934220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:58.937205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:58.939292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:58.940809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:59.234614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:59.250936 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6bdd8e9a-6e5c-4307-8a95-e10d6ab18633 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1273 microversion: 2.1 time: 0.404584 Aug 06 20:57:59.257749 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 709/1427] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:58 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1273 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:59.283890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-917b3103-0c92-4163-bdb5-3bb06efa4a8a req-a6fb5331-6b35-44c2-b97a-aee36a78458d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d99126-c9b5-4b1e-8bb6-92dc1dd048da", "name": "network-vif-plugged", "status": "completed", "tag": "7aebd8b0-07de-4d6e-88bc-b0ebb90332e3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:59.317115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-917b3103-0c92-4163-bdb5-3bb06efa4a8a req-a6fb5331-6b35-44c2-b97a-aee36a78458d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:59.322157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-917b3103-0c92-4163-bdb5-3bb06efa4a8a req-a6fb5331-6b35-44c2-b97a-aee36a78458d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:59.323651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-917b3103-0c92-4163-bdb5-3bb06efa4a8a req-a6fb5331-6b35-44c2-b97a-aee36a78458d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:59.368606 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-917b3103-0c92-4163-bdb5-3bb06efa4a8a req-a6fb5331-6b35-44c2-b97a-aee36a78458d service nova] Creating event network-vif-plugged:7aebd8b0-07de-4d6e-88bc-b0ebb90332e3 for instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da on nch1-master-1 Aug 06 20:57:59.377923 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-917b3103-0c92-4163-bdb5-3bb06efa4a8a req-a6fb5331-6b35-44c2-b97a-aee36a78458d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118629 Aug 06 20:57:59.408975 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 710/1428] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:59.446492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:59.447748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:59.471993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:59.474423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:59.475122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:59.489454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:59.490386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:59.491985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:59.505215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:59.515729 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-26dc4561-46bf-4b5b-ad65-8ae1a4a8d0a8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1476 microversion: 2.1 time: 0.607304 Aug 06 20:57:59.519612 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 719/1429] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:58 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1476 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:59.999874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-263769bb-eea6-4501-8182-2921e88421be tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Action: 'create', calling method: .version_select at 0x7f729d956790>, body: {"keypair": {"name": "tempest-keypair-360942912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLeomjhOBWgYkk4HKKi7qHi0N6K8IDVYievJ5pA6jy+dodl5yAaFJSWPvpBELEK1umU9GLIq1MrMdflJisttjSUy8DN2sB1Q8uSaBpi3VVy0uODG4daLAcyBxd3PJN74g=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:00.039548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-263769bb-eea6-4501-8182-2921e88421be tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:00.048970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-263769bb-eea6-4501-8182-2921e88421be tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for user 663839a7e8d042a39ec1a29494a99d91 and project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:00.085551 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-263769bb-eea6-4501-8182-2921e88421be tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.564533 Aug 06 20:58:00.091738 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 720/1430] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Aug 6 20:57:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 566 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 06 20:58:00.097176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:00.097878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:00.108269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:00.108950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:00.109727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:00.111209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:00.111947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:00.112629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:00.490214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:00.500497 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f8e9b72-bb0f-4105-9c8d-7cfddad485da tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.411370 Aug 06 20:58:00.501778 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 721/1431] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:00 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:00.588529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:00.598064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:00.613580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:00.617801 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-85553d69-b03a-465f-a361-3b35cb9e57c2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 1.179500 Aug 06 20:58:00.618446 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 711/1432] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:57:59 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:58:00.639554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cd1e555a-b178-4e44-8b73-b6db0f4c6901 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729dd0f3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:00.659183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-261373005", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "a17c0b0a-6719-44f2-8dc6-4a0cb498bc1f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:00.662436 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cd1e555a-b178-4e44-8b73-b6db0f4c6901 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-360942912" status: 200 len: 511 microversion: 2.2 time: 0.041853 Aug 06 20:58:00.664981 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 712/1433] 10.222.0.33 () {60 vars in 1255 bytes} [Sat Aug 6 20:58:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-360942912 => generated 511 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:00.678202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:00.685081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:00.701094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:00.703814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:00.704621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:00.707934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:00.709577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:00.711244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:00.749504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] validate_networks() for [('a17c0b0a-6719-44f2-8dc6-4a0cb498bc1f', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:58:01.163806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:01.182940 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e05c3e6-6244-43fc-b0f3-8130c66e92b5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1315 microversion: 2.1 time: 0.506464 Aug 06 20:58:01.196617 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 713/1434] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:00 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:01.203290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:01.204113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:01.213873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.216090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.216802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.223481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.224258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.224915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.462650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:58:01.463490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:58:01.464128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:58:01.464793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:58:01.465260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:58:01.494130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.495287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.496368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.497712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.498184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.501774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.552134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Getting quotas for project 764e8bbcc05b47e5a647cf2a0fe82a20. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:01.563483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Getting quotas for user d43d0d15118242b7a60cc34c512fbe5e and project 764e8bbcc05b47e5a647cf2a0fe82a20. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:01.591549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:58:01.595070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:58:01.636731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:01.649046 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3dfabd66-2ee0-46d3-ad43-4a1c4dbe6a20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1476 microversion: 2.1 time: 0.450862 Aug 06 20:58:01.657638 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 714/1435] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:01 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1476 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:01.657781 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-14e428d0-d604-47b4-9fd9-93ca04f57f6f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154350 Aug 06 20:58:01.658357 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 722/1436] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:58:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:58:01.683664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d6b3661a-d5e9-4423-b07a-ca91402ef29d req-5f9d46df-f317-43a6-ba68-e98d56d16c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c18108b-a584-4fe0-a1a1-e7f7eb300922", "tag": "e950bacb-e8ac-4c5c-91b3-0ae6955869ba"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:01.687338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f556d7b0-a40f-4776-a83b-f773f45191ea tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729dd0fdc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:01.716557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d6b3661a-d5e9-4423-b07a-ca91402ef29d req-5f9d46df-f317-43a6-ba68-e98d56d16c38 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.718006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d6b3661a-d5e9-4423-b07a-ca91402ef29d req-5f9d46df-f317-43a6-ba68-e98d56d16c38 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.719331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d6b3661a-d5e9-4423-b07a-ca91402ef29d req-5f9d46df-f317-43a6-ba68-e98d56d16c38 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.735691 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d6b3661a-d5e9-4423-b07a-ca91402ef29d req-5f9d46df-f317-43a6-ba68-e98d56d16c38 service nova] Creating event network-changed:e950bacb-e8ac-4c5c-91b3-0ae6955869ba for instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 on nch1-master-1 Aug 06 20:58:01.742256 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d6b3661a-d5e9-4423-b07a-ca91402ef29d req-5f9d46df-f317-43a6-ba68-e98d56d16c38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064897 Aug 06 20:58:01.743010 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f556d7b0-a40f-4776-a83b-f773f45191ea tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-360942912" status: 204 len: 0 microversion: 2.2 time: 0.083627 Aug 06 20:58:01.743693 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 723/1437] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:01.744039 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 715/1438] 10.222.0.33 () {60 vars in 1258 bytes} [Sat Aug 6 20:58:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-360942912 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:01.754849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:01.755968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:01.757349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:01.757990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:01.767589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.769543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.771409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.773831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.777170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.778165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.778842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.779233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.780422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.781499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.782133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.782993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:02.440688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:02.449892 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f519bb74-532c-44ad-a17c-22c1959383af tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.703629 Aug 06 20:58:02.454407 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 716/1439] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:01 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:02.459537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b975eb59-cdee-48e9-8fd9-5901cc3b8a5b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:02.460358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b975eb59-cdee-48e9-8fd9-5901cc3b8a5b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:02.603812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b975eb59-cdee-48e9-8fd9-5901cc3b8a5b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:02.618798 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b975eb59-cdee-48e9-8fd9-5901cc3b8a5b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1207 microversion: 2.1 time: 0.162971 Aug 06 20:58:02.620542 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 717/1440] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:02 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1207 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:02.630220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:02.645002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:02.651573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-de0f5a8c-3330-4368-924c-408e2029317c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Action: 'create', calling method: .version_select at 0x7f72a04bc1f0>, body: {"keypair": {"name": "tempest-keypair-1221676046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj36JK+HTFJtYp4jDrUMWDOxKe1845MeIzohc60QDeymOaNQjyPKtioZv5t/1tSjnmnKR3PJC7qF3NOk5v7WyIm6RNTcgJh1RWrsuIuZ81ScBVS/aE/IjBRZw1dbQz9Mg=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:02.652479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:02.655929 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f69c4b5-c14c-4b24-9e10-f31f0e96b7c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.909559 Aug 06 20:58:02.659267 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 724/1441] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:58:01 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:58:02.683017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:02.685878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:02.708301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:02.710298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:02.714956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:02.715833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:02.716319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:02.716756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:02.738842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-de0f5a8c-3330-4368-924c-408e2029317c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:02.751555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-de0f5a8c-3330-4368-924c-408e2029317c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for user 663839a7e8d042a39ec1a29494a99d91 and project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:02.777503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:02.826401 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-de0f5a8c-3330-4368-924c-408e2029317c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.204252 Aug 06 20:58:02.827620 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 718/1442] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Aug 6 20:58:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 06 20:58:02.837408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:02.840631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:02.855464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:02.855960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:02.857139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:02.867005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:02.867850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:02.868485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:03.371052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:03.380938 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b1dd4d47-5dc8-42ed-9d63-f8d4b8769d6f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1462 microversion: 2.1 time: 0.547630 Aug 06 20:58:03.392199 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 719/1443] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:02 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1462 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:03.397090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7d8d3435-d3c2-45c2-814b-040903544772 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729dc6ea60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:03.447039 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7d8d3435-d3c2-45c2-814b-040903544772 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221676046" status: 204 len: 0 microversion: 2.2 time: 0.053535 Aug 06 20:58:03.447651 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 720/1444] 10.222.0.33 () {60 vars in 1261 bytes} [Sat Aug 6 20:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221676046 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:03.456356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:03.456964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:03.479295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:03.479814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:03.480253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:03.480961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:03.481425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:03.483969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:03.515589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:03.524080 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f81b8a51-f23b-4ed4-ab44-6433165328cd tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1315 microversion: 2.1 time: 0.860756 Aug 06 20:58:03.529026 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 725/1445] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:02 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:03.548497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-20a9b9f7-43ad-46f2-8ee7-6a153f59ef89 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Action: 'create', calling method: .version_select at 0x7f729d785e50>, body: {"keypair": {"name": "tempest-keypair-1930796979", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:03.581575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-20a9b9f7-43ad-46f2-8ee7-6a153f59ef89 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:03.593496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-20a9b9f7-43ad-46f2-8ee7-6a153f59ef89 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for user 663839a7e8d042a39ec1a29494a99d91 and project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:03.616270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:03.666934 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-20a9b9f7-43ad-46f2-8ee7-6a153f59ef89 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.126727 Aug 06 20:58:03.674981 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 726/1446] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Aug 6 20:58:03 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 06 20:58:03.692238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:03.693071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:03.734019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:03.734578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:03.735044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:03.735775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:03.742097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:03.742659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.046927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:04.050509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:04.054784 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01e3f85c-8530-4c6a-90c3-675d21c5f459 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.378319 Aug 06 20:58:04.059033 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 727/1447] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:03 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:04.064087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:04.066122 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ecdac024-bb7c-4cac-87b9-e4ff6a87c379 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1462 microversion: 2.1 time: 0.613721 Aug 06 20:58:04.067477 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 721/1448] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:03 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1462 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:04.069851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:04.073435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46cc5098-4ee4-43a5-b827-e08411eabfd4 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729dd4f550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:04.084849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.085826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.086446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.088192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.088806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.089386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.102686 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46cc5098-4ee4-43a5-b827-e08411eabfd4 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930796979" status: 204 len: 0 microversion: 2.2 time: 0.033607 Aug 06 20:58:04.110578 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 722/1449] 10.222.0.33 () {60 vars in 1261 bytes} [Sat Aug 6 20:58:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930796979 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:04.121626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:04.122863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:04.158629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.166605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.167452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.169608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.170981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.173295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.287869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:04.305864 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e489bb3-0f4a-4756-b165-f463aab1650c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1265 microversion: 2.1 time: 0.245158 Aug 06 20:58:04.307587 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 728/1450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:04 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:04.316098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:04.328332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:04.334775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.335491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.336552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.337880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.338717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.339326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.471840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:58:04.472416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:58:04.472930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:58:04.473438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:58:04.473768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:58:04.524872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:04.535679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:04.537673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:04.539056 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a0932de1-795b-4dac-8ffa-2e4902a4b381 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1813 microversion: 2.25 time: 0.434038 Aug 06 20:58:04.557474 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 723/1451] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:58:04 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1813 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:58:04.564425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:04.570916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.571647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.572274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.573144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.573937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.574523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.585099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-97ce2e7b-b436-4a1a-aef1-6530585dbf65 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Action: 'create', calling method: .version_select at 0x7f729de22700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1635587147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0iLtqrPB1FtU8fjp9O1ww5VYlpORw48cPlGMIQW39EZACGwy6EkVjLeDp294xMl1LpasNrVS/hBAL7xuAYwLKok4jP8Zn1fv77Lp3Gw4oSqTzbJ/F5EsxTmkwkdYaMcQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:04.609571 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-39b8f08d-b27d-4bcd-9e02-7a900231a7eb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action" status: 202 len: 1066 microversion: 2.1 time: 0.299142 Aug 06 20:58:04.610878 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 729/1452] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:58:04 2022] POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action => generated 1066 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 06 20:58:04.644176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-97ce2e7b-b436-4a1a-aef1-6530585dbf65 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:04.650153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-97ce2e7b-b436-4a1a-aef1-6530585dbf65 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for user 663839a7e8d042a39ec1a29494a99d91 and project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:04.685592 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-97ce2e7b-b436-4a1a-aef1-6530585dbf65 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.125706 Aug 06 20:58:04.688425 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 724/1453] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Aug 6 20:58:04 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 06 20:58:04.704133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:04.705069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:04.712589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.713510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.714159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.715276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.715943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.716609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.798866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1835497504", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:04.857357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:58:04.910689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:04.919648 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a9251e5-4731-41fe-bcfa-8f272dc04db7 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1315 microversion: 2.1 time: 0.221106 Aug 06 20:58:04.920936 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 725/1454] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:04 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:04.940932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:04.943151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:04.957677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:04.959861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.961121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.961860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.962704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.963587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.964091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:05.000242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:05.457038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:58:05.458219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:58:05.460473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:58:05.461890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:58:05.463545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:58:05.484811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:05.485509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:05.486188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:05.487604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:05.488211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:05.488831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:05.508489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Getting quotas for project 9129b06bfc47457c954b8c5af61bdb7e. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:05.516339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Getting quotas for user ad26fc0c618f4a548c64863f640dcf95 and project 9129b06bfc47457c954b8c5af61bdb7e. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:05.538538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:58:05.541953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:58:05.622870 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f951f38f-e444-49f9-87d9-4e2e4eceb958 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.010587 Aug 06 20:58:05.623570 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 730/1455] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:58:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:58:05.634063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:05.646239 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c27e3545-af77-4f64-a64c-7d895623fd3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.723942 Aug 06 20:58:05.648964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2766706-9c35-4911-bf8b-f3fd29add609 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Action: 'create', calling method: .version_select at 0x7f729d785af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1912186456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwsr2B5KUtdWhyffpPs3vmo0FnnmuNVbvGBX43d+U6kiBNMyWwNZU6TTUyyGugUu/vLMQYdHh95uk8PtbVFiEpRIEa3uy3rj4Xa3MLL7sA+38jCoVD9Jou7CJojV4WYVQ=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:05.659602 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 726/1456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:04 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:05.667835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:05.668578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:05.682959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:05.683670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:05.684336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:05.685167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:05.685972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:05.686338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:05.702447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c2766706-9c35-4911-bf8b-f3fd29add609 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:05.719410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c2766706-9c35-4911-bf8b-f3fd29add609 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for user 663839a7e8d042a39ec1a29494a99d91 and project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:05.783986 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2766706-9c35-4911-bf8b-f3fd29add609 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.152807 Aug 06 20:58:05.799476 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 731/1457] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Aug 6 20:58:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 06 20:58:05.825948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:05.828599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:05.856354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:05.857104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:05.857883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:05.859848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:05.860642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:05.861246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.026662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:06.039595 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a1119b44-b1c9-4eb5-a1bb-1fc4efada170 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.377789 Aug 06 20:58:06.042287 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 727/1458] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:05 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:06.048537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:06.049537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:06.065473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:06.066327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:06.067313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.068222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:06.069094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:06.069994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.118968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:06.342912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:06.351840 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9121bcf-c042-4c3a-a855-fd278fcce091 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1307 microversion: 2.1 time: 0.533755 Aug 06 20:58:06.358789 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 732/1459] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:05 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1307 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:06.377614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-db162da2-ae64-486d-ab7e-14d7fe6f2174 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:06.381642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db162da2-ae64-486d-ab7e-14d7fe6f2174 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:06.401752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:06.412863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:06.414399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:06.415930 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bff9025a-701f-42f1-b138-533e54418b4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1803 microversion: 2.25 time: 0.372212 Aug 06 20:58:06.416523 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 728/1460] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:58:06 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1803 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:58:06.453856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f9c9d4fc-9adc-4553-acba-80893a226dff tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Action: 'create', calling method: .version_select at 0x7f729de22940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1968587756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPe+iwSlqQX8NgPamRaYtIQSMN8b94D1trYJK2CFxondYgzcrQ/94JwlZIYpViINziVs8hp/nydUOqwdTx3CVfu+a1ytqs0WXoOxbVSRS5PgibjMob1fU70SKtANMXefg=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:06.499072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f9c9d4fc-9adc-4553-acba-80893a226dff tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:06.509956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f9c9d4fc-9adc-4553-acba-80893a226dff tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for user 663839a7e8d042a39ec1a29494a99d91 and project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:06.539203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-db162da2-ae64-486d-ab7e-14d7fe6f2174 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:06.553369 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-db162da2-ae64-486d-ab7e-14d7fe6f2174 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1214 microversion: 2.1 time: 0.176166 Aug 06 20:58:06.554145 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 733/1461] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:06 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:06.572983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:06.573938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:06.581609 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f9c9d4fc-9adc-4553-acba-80893a226dff tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.133265 Aug 06 20:58:06.592336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:06.592733 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 729/1462] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Aug 6 20:58:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 06 20:58:06.593867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:06.594960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.596965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:06.598655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:06.600630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.609942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21d36a9a-1b37-41db-95d0-8279b78617b9 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '.version_select at 0x7f729dcf8c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:06.618506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d36a9a-1b37-41db-95d0-8279b78617b9 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:06.619415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d36a9a-1b37-41db-95d0-8279b78617b9 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:06.620472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d36a9a-1b37-41db-95d0-8279b78617b9 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.646040 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21d36a9a-1b37-41db-95d0-8279b78617b9 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3209 microversion: 2.25 time: 0.050792 Aug 06 20:58:06.648709 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 730/1463] 10.222.0.33 () {60 vars in 1184 bytes} [Sat Aug 6 20:58:06 2022] GET /compute/v2.1/os-migrations => generated 3209 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:58:06.664261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-328dc29d-0372-4652-b2d9-aa08e2237a8c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729ddc0670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:06.677155 ncdv-master-1 devstack@n-api.service[142462]: WARNING oslo_db.sqlalchemy.utils [None req-328dc29d-0372-4652-b2d9-aa08e2237a8c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 06 20:58:06.698879 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-328dc29d-0372-4652-b2d9-aa08e2237a8c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.046372 Aug 06 20:58:06.700933 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 731/1464] 10.222.0.33 () {60 vars in 1177 bytes} [Sat Aug 6 20:58:06 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:06.710117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:06.710957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:06.723747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:06.724254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:06.724702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.725424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:06.725885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:06.726343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.912482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid a87d6735-5d42-4f96-aac5-55b50a1a804f {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:58:06.973022 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c751fc23-19fc-45a7-93fa-417f4d17e72d tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 2422 microversion: 2.25 time: 0.270225 Aug 06 20:58:06.987437 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 732/1465] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:58:06 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 2422 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:58:07.008807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.009855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:07.025598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.026689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.027423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.030877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.031892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.032560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.126470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:07.148253 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f912609b-db22-4f27-8f6e-23a9fbb7db4b tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1315 microversion: 2.1 time: 0.592516 Aug 06 20:58:07.151513 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 734/1466] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:06 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:07.165135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc97ce58-c5c1-4524-89e4-916c098b5020 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729d785160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.208720 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc97ce58-c5c1-4524-89e4-916c098b5020 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1968587756" status: 204 len: 0 microversion: 2.2 time: 0.054377 Aug 06 20:58:07.209619 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 735/1467] 10.222.0.33 () {60 vars in 1321 bytes} [Sat Aug 6 20:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1968587756 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:07.222378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.225140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:07.243571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.245571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.247168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.248463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.251550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.253445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.287100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:07.298705 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fbd279bd-20de-4338-818c-97efc3938bb7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.308534 Aug 06 20:58:07.302177 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 733/1468] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:06 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:07.325742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.327687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:07.345532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.346159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.346639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.348002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.348647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.349884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.705409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid a87d6735-5d42-4f96-aac5-55b50a1a804f {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:58:07.705639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:07.718776 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72272e50-3959-4e0b-a1e7-ef4d95265ff0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.414066 Aug 06 20:58:07.719510 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 734/1469] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:07 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:07.724588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-949e8077-c84c-4bb8-b67c-a922677fe957 req-a793cee8-3b26-437a-8a6f-331adfc402f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27865ac3-9a8a-4568-ba57-3f022b07ba93", "tag": "7fe99f75-e61b-480d-9d57-8f00ee43c6ca"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:07.743076 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-56f7231a-0788-4690-bd93-3aa6d434b523 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 2422 microversion: 2.25 time: 0.532103 Aug 06 20:58:07.745335 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 736/1470] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:58:07 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 2422 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:58:07.747095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-949e8077-c84c-4bb8-b67c-a922677fe957 req-a793cee8-3b26-437a-8a6f-331adfc402f3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.747818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-949e8077-c84c-4bb8-b67c-a922677fe957 req-a793cee8-3b26-437a-8a6f-331adfc402f3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.749496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-949e8077-c84c-4bb8-b67c-a922677fe957 req-a793cee8-3b26-437a-8a6f-331adfc402f3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.751274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-190b9eef-645d-4e06-ac36-f257af9a2238 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729d76dee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.771877 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-190b9eef-645d-4e06-ac36-f257af9a2238 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1912186456" status: 204 len: 0 microversion: 2.2 time: 0.025225 Aug 06 20:58:07.772810 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 737/1471] 10.222.0.33 () {60 vars in 1321 bytes} [Sat Aug 6 20:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1912186456 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:07.778753 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-949e8077-c84c-4bb8-b67c-a922677fe957 req-a793cee8-3b26-437a-8a6f-331adfc402f3 service nova] Creating event network-changed:7fe99f75-e61b-480d-9d57-8f00ee43c6ca for instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 on nch2-master-1 Aug 06 20:58:07.779853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.780475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:07.786898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.787387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.787822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.788525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.789024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.789649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.793795 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-949e8077-c84c-4bb8-b67c-a922677fe957 req-a793cee8-3b26-437a-8a6f-331adfc402f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072793 Aug 06 20:58:07.794422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 735/1472] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:07.814106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.814872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:07.830995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.830995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.830995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.831534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.835034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.835500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.921263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:07.929404 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9682305c-b81c-4e29-889c-7a7a30ca1bc7 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1272 microversion: 2.1 time: 0.133180 Aug 06 20:58:07.929991 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 736/1473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:07 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:07.936771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c806e8db-93b0-4350-bab6-8782c04c2619 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729ddc0b80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.960834 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c806e8db-93b0-4350-bab6-8782c04c2619 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1635587147" status: 204 len: 0 microversion: 2.2 time: 0.029375 Aug 06 20:58:07.961595 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 737/1474] 10.222.0.33 () {60 vars in 1321 bytes} [Sat Aug 6 20:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1635587147 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:07.969564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.970074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:07.976758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.977249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.977692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.978997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.978997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.979383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.144316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lazy-loading 'services' on Instance uuid a87d6735-5d42-4f96-aac5-55b50a1a804f {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:58:08.262131 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d745c1c4-98c1-4304-a295-fdd326d801fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-volume_attachments/ea0b00ed-84e0-4e19-b008-139ee8117ef4" status: 202 len: 0 microversion: 2.25 time: 0.298835 Aug 06 20:58:08.262782 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 738/1475] 10.222.0.33 () {60 vars in 1457 bytes} [Sat Aug 6 20:58:07 2022] DELETE /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-volume_attachments/ea0b00ed-84e0-4e19-b008-139ee8117ef4 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:08.270502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32e91db3-5eb7-46f4-b85a-9be9947de371 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Action: 'create', calling method: .version_select at 0x7f729d9ea0d0>, body: {"keypair": {"name": "tempest-keypair-185797843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqUOXJHEWPeMTmfj2wXaMQE5XY1AMH7EVc6bcWHz5N/tgv/JUy6hQBi4fAVyPeN2aLJ/ttcrWe9MJ0c+evOsj9/3044/eMZyWBL7WHPrBrum+Z91jLcW1ASx8zK9Nw/tQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:08.289482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-32e91db3-5eb7-46f4-b85a-9be9947de371 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:08.296333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-32e91db3-5eb7-46f4-b85a-9be9947de371 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for user 663839a7e8d042a39ec1a29494a99d91 and project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:08.324455 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-32e91db3-5eb7-46f4-b85a-9be9947de371 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.060349 Aug 06 20:58:08.325436 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 739/1476] 10.222.0.33 () {62 vars in 1199 bytes} [Sat Aug 6 20:58:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 06 20:58:08.334297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:08.335124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:08.344619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.345122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.345579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.346345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.346844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.347282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.426250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:08.435025 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-464520a7-ac42-4ff9-9b16-c789be1bdea5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1307 microversion: 2.1 time: 0.661152 Aug 06 20:58:08.436534 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 738/1477] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:07 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1307 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:08.442170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d720c734-a4e1-423a-bbfb-5c93f0e46e74 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:08.449951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d720c734-a4e1-423a-bbfb-5c93f0e46e74 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:08.456910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d720c734-a4e1-423a-bbfb-5c93f0e46e74 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.457324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d720c734-a4e1-423a-bbfb-5c93f0e46e74 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.457765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d720c734-a4e1-423a-bbfb-5c93f0e46e74 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.458478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d720c734-a4e1-423a-bbfb-5c93f0e46e74 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.458968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d720c734-a4e1-423a-bbfb-5c93f0e46e74 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.459394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d720c734-a4e1-423a-bbfb-5c93f0e46e74 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.494775 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d720c734-a4e1-423a-bbfb-5c93f0e46e74 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056922 Aug 06 20:58:08.495394 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 739/1478] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 20:58:08 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:58:08.504640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:08.505398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:08.508953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:08.512305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.513036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.514485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.515691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.516348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.516974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.517555 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9e2525e9-eae1-4f95-9bde-b348fec081f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1315 microversion: 2.1 time: 0.189119 Aug 06 20:58:08.518136 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 740/1479] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:08 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:08.533623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-97bc3cd6-7714-45dd-93c9-fdaefc479136 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729da1faf0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:08.545303 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-97bc3cd6-7714-45dd-93c9-fdaefc479136 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-185797843" status: 200 len: 512 microversion: 2.2 time: 0.025846 Aug 06 20:58:08.546219 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 741/1480] 10.222.0.33 () {60 vars in 1255 bytes} [Sat Aug 6 20:58:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-185797843 => generated 512 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:08.557404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d406d8ea-2432-4666-b68a-a9e1c0564806 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729d9ea3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:08.561803 ncdv-master-1 devstack@n-api.service[142462]: WARNING oslo_db.sqlalchemy.utils [None req-d406d8ea-2432-4666-b68a-a9e1c0564806 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 06 20:58:08.567314 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d406d8ea-2432-4666-b68a-a9e1c0564806 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.013813 Aug 06 20:58:08.567987 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 742/1481] 10.222.0.33 () {60 vars in 1177 bytes} [Sat Aug 6 20:58:08 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:58:08.579508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-67d4efd8-25d5-4263-b6c7-ee7b23c5288c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729d9b4310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:08.599201 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-67d4efd8-25d5-4263-b6c7-ee7b23c5288c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185797843" status: 204 len: 0 microversion: 2.2 time: 0.024610 Aug 06 20:58:08.599897 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 743/1482] 10.222.0.33 () {60 vars in 1258 bytes} [Sat Aug 6 20:58:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185797843 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 20:58:08.609416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Action: 'create', calling method: .version_select at 0x7f729d9b49d0>, body: {"keypair": {"name": "tempest-keypair-895392383", "type": "x509"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:08.625130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:08.630417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for user 663839a7e8d042a39ec1a29494a99d91 and project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:08.646323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.processutils [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp42_zygdl/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp42_zygdl/temp.key -subj /CN=663839a7e8d042a39ec1a29494a99d91 -extensions v3_req_client {{(pid=142462) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 06 20:58:08.805873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:08.813493 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e45a26e-0c24-4df2-b017-ad0408932d03 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.316891 Aug 06 20:58:08.814298 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 740/1483] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:08 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:08.819880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:08.820649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:08.827885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.828598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.829208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.829912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.830377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.830833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.837844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.processutils [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp42_zygdl/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp42_zygdl/temp.key -subj /CN=663839a7e8d042a39ec1a29494a99d91 -extensions v3_req_client" returned: 0 in 0.191s {{(pid=142462) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 06 20:58:08.840207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.processutils [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp42_zygdl/temp.key -password pass: {{(pid=142462) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 06 20:58:08.867602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.processutils [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp42_zygdl/temp.key -password pass:" returned: 0 in 0.027s {{(pid=142462) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 06 20:58:08.921088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:08.927903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Getting quotas for user 663839a7e8d042a39ec1a29494a99d91 and project 6a59301a44bb4936a40bc62a7059501c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:08.948929 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4a851650-352f-45b1-a095-f4ba722b2b73 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.343345 Aug 06 20:58:08.950123 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 744/1484] 10.222.0.33 () {62 vars in 1198 bytes} [Sat Aug 6 20:58:08 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 345 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:08.957109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:08.957817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:08.965069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.965606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.966052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:08.966912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:08.967446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:08.967884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.050136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:09.063806 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-73257ec3-ad31-4093-bb70-a3150a49df73 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1272 microversion: 2.1 time: 0.111269 Aug 06 20:58:09.077834 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 745/1485] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:08 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:09.077834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95c564d0-5883-4cc3-ae14-288862701b22 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729d9b4dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:09.087909 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-95c564d0-5883-4cc3-ae14-288862701b22 tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-895392383" status: 200 len: 1533 microversion: 2.2 time: 0.020503 Aug 06 20:58:09.089688 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 746/1486] 10.222.0.33 () {60 vars in 1255 bytes} [Sat Aug 6 20:58:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-895392383 => generated 1533 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:09.096679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-79cfa407-f157-49ac-869d-fef6385e5177 req-e627884a-aa65-4ef3-9673-de64ad1c3185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c18108b-a584-4fe0-a1a1-e7f7eb300922", "name": "network-vif-plugged", "status": "completed", "tag": "e950bacb-e8ac-4c5c-91b3-0ae6955869ba"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:09.113733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-79cfa407-f157-49ac-869d-fef6385e5177 req-e627884a-aa65-4ef3-9673-de64ad1c3185 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.114461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-79cfa407-f157-49ac-869d-fef6385e5177 req-e627884a-aa65-4ef3-9673-de64ad1c3185 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.114988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-79cfa407-f157-49ac-869d-fef6385e5177 req-e627884a-aa65-4ef3-9673-de64ad1c3185 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.134276 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-79cfa407-f157-49ac-869d-fef6385e5177 req-e627884a-aa65-4ef3-9673-de64ad1c3185 service nova] Creating event network-vif-plugged:e950bacb-e8ac-4c5c-91b3-0ae6955869ba for instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 on nch1-master-1 Aug 06 20:58:09.142610 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-79cfa407-f157-49ac-869d-fef6385e5177 req-e627884a-aa65-4ef3-9673-de64ad1c3185 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051035 Aug 06 20:58:09.143653 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 747/1487] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:09.151093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-de1de8ab-f044-4cec-bcde-bfe293870fbc tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729d9ea8b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:09.158590 ncdv-master-1 devstack@n-api.service[142462]: WARNING oslo_db.sqlalchemy.utils [None req-de1de8ab-f044-4cec-bcde-bfe293870fbc tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 06 20:58:09.165811 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-de1de8ab-f044-4cec-bcde-bfe293870fbc tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.019817 Aug 06 20:58:09.167035 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 748/1488] 10.222.0.33 () {60 vars in 1177 bytes} [Sat Aug 6 20:58:09 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:09.180117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f0bd097d-2843-46cd-b158-fcb699febd2c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] Calling method '.version_select at 0x7f729d9b49d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:09.205714 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f0bd097d-2843-46cd-b158-fcb699febd2c tempest-KeyPairsV22TestJSON-1845879483 tempest-KeyPairsV22TestJSON-1845879483-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-895392383" status: 204 len: 0 microversion: 2.2 time: 0.031225 Aug 06 20:58:09.206719 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 749/1489] 10.222.0.33 () {60 vars in 1258 bytes} [Sat Aug 6 20:58:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-895392383 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:09.218317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:09.234888 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c62767c5-2328-4f3f-b357-0e0adf800ac1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.418535 Aug 06 20:58:09.250244 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 741/1490] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:08 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:09.458245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:09.459312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:09.470736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.471446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.472052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.473136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.473987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.474769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.508518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2748ecc9-6a3e-45da-b53a-eb25c6d746f1 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:09.511990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2748ecc9-6a3e-45da-b53a-eb25c6d746f1 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:09.519498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2748ecc9-6a3e-45da-b53a-eb25c6d746f1 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.520789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2748ecc9-6a3e-45da-b53a-eb25c6d746f1 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.521484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2748ecc9-6a3e-45da-b53a-eb25c6d746f1 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.522458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2748ecc9-6a3e-45da-b53a-eb25c6d746f1 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.523212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2748ecc9-6a3e-45da-b53a-eb25c6d746f1 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.523871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2748ecc9-6a3e-45da-b53a-eb25c6d746f1 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.586903 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2748ecc9-6a3e-45da-b53a-eb25c6d746f1 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.083225 Aug 06 20:58:09.587882 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 742/1491] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 20:58:09 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:09.592774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:09.599875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:09.619517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.620025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.620476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.621197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.621658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.622462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.766765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:09.774731 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf2e2cf9-62fc-45e6-9a9e-f00f47b523b4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1307 microversion: 2.1 time: 0.322105 Aug 06 20:58:09.775362 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 750/1492] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:09 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1307 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:09.834987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:09.835601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:09.843782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.844379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.844712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.845539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.845885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.846325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:10.034576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:10.037025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:10.051290 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e710883-e40a-4ff1-a0cc-e987add948be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.219446 Aug 06 20:58:10.052705 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 751/1493] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:09 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:58:10.054900 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9aa2659a-e465-49ce-b9bc-8b840c3dfad0 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1315 microversion: 2.1 time: 0.464526 Aug 06 20:58:10.056464 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 743/1494] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:09 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:10.086331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:10.087014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:10.094873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:10.095434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:10.095892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:10.096609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:10.097077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:10.097536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:10.263055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:10.263771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:10.291824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:10.292567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:10.293024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:10.296120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:10.296779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:10.297231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:10.411899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:10.424788 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-13f9fd2c-ef6a-4322-a6e4-38562279f54f tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1314 microversion: 2.1 time: 0.341963 Aug 06 20:58:10.426691 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 752/1495] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:10 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:10.798268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:10.798948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:10.808305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:10.808818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:10.809264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:10.810175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:10.811523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:10.812287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:10.824422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:10.837609 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6ee8aed0-f8bd-4b77-9b67-9675c367f8f3 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.583564 Aug 06 20:58:10.838215 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 744/1496] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:10 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:58:11.074117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:11.074809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:11.090139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.093098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.096035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.097340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.106119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.108400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.142674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:11.147146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:11.169506 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ef22972-b6d3-4ee4-8a4b-181f92fd23ed tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1307 microversion: 2.1 time: 0.376724 Aug 06 20:58:11.177447 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 753/1497] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:10 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:11.210170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:11.211191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:11.221475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:11.228207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.229875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.232909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.233935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.234418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.236573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.445561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:11.462444 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-65615090-10a6-4ee7-8e64-72f0a875bd2f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1502 microversion: 2.1 time: 0.280544 Aug 06 20:58:11.463913 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 754/1498] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:11 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:11.489554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:11.490191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:11.510601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.512353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.516820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.518969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.521413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.522051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.559149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:11.628836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:11.650993 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6dd58fd5-581b-4eb4-9471-bd1516244066 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.577322 Aug 06 20:58:11.672406 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 745/1499] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:11 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:58:11.680473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-614252825"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:11.690182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:11.704362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.709208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.710010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.711068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.711750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.712408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.817654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:11.840553 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce853e60-6b16-4e8f-a7c6-eef7a06a388e tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1314 microversion: 2.1 time: 0.374374 Aug 06 20:58:11.843382 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 755/1500] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:11 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:11.873619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:11.874536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:11.896828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.898373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.898855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.899596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:11.900068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:11.921367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:11.995972 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.network.security_group_api [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Adding security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 to port e950bacb-e8ac-4c5c-91b3-0ae6955869ba Aug 06 20:58:12.176582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:12.194205 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d877519-6d91-4dca-a719-617bc83e7b94 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1477 microversion: 2.1 time: 0.339368 Aug 06 20:58:12.208585 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 756/1501] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:11 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1477 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:12.217148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:12.219112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:12.231244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:12.232596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:12.233299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:12.234276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:12.235100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:12.235788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:12.447426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:12.457632 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-099f9cc6-bfc7-4835-8ec7-db646ee1219f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1307 microversion: 2.1 time: 0.247147 Aug 06 20:58:12.460178 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 757/1502] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:12 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1307 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:12.680330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:12.681357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:12.694948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:12.695452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:12.696166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:12.696887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:12.697524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:12.698105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:12.964082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:12.975475 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-436d276a-f99a-4829-ab40-d5e1d2270dcd tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.300714 Aug 06 20:58:12.976515 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 758/1503] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:12 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:12.994607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:12.995466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:13.008337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:13.008833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:13.009624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:13.010757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:13.014401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:13.017385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:13.294981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:13.306975 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfc6b900-e450-4454-8069-f3c606c12532 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1314 microversion: 2.1 time: 0.328974 Aug 06 20:58:13.309461 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 759/1504] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:12 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:13.327947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5afad22c-4bdc-4681-8c21-be0930ea3831 req-49bebbb5-530b-4768-bce3-cd0081303340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27865ac3-9a8a-4568-ba57-3f022b07ba93", "name": "network-vif-plugged", "status": "completed", "tag": "7fe99f75-e61b-480d-9d57-8f00ee43c6ca"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:13.340278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5afad22c-4bdc-4681-8c21-be0930ea3831 req-49bebbb5-530b-4768-bce3-cd0081303340 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:13.341020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5afad22c-4bdc-4681-8c21-be0930ea3831 req-49bebbb5-530b-4768-bce3-cd0081303340 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:13.342374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5afad22c-4bdc-4681-8c21-be0930ea3831 req-49bebbb5-530b-4768-bce3-cd0081303340 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:13.356167 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-5afad22c-4bdc-4681-8c21-be0930ea3831 req-49bebbb5-530b-4768-bce3-cd0081303340 service nova] Creating event network-vif-plugged:7fe99f75-e61b-480d-9d57-8f00ee43c6ca for instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 on nch2-master-1 Aug 06 20:58:13.361838 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5afad22c-4bdc-4681-8c21-be0930ea3831 req-49bebbb5-530b-4768-bce3-cd0081303340 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051095 Aug 06 20:58:13.362484 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 760/1505] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:13.367567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:13.376000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:13.385982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:13.387447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:13.389486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:13.390232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:13.390742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:13.391233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:13.657898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:13.684048 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b9c023ca-597a-449b-a7b8-90d42ba7590f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1476 microversion: 2.1 time: 0.319978 Aug 06 20:58:13.686596 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 761/1506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:13 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:13.692268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-478b4ce5-9e32-4183-9bc6-060e6678dc88 req-ba121b9f-3170-4002-9f65-6a49c2f9255d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f1e6bd-79f0-4d0a-88db-fbcc77835370", "tag": "e9b8c1ec-2928-4f49-b70e-b639f643a169"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:13.710173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-478b4ce5-9e32-4183-9bc6-060e6678dc88 req-ba121b9f-3170-4002-9f65-6a49c2f9255d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:13.710703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-478b4ce5-9e32-4183-9bc6-060e6678dc88 req-ba121b9f-3170-4002-9f65-6a49c2f9255d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:13.711137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-478b4ce5-9e32-4183-9bc6-060e6678dc88 req-ba121b9f-3170-4002-9f65-6a49c2f9255d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:13.724540 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-478b4ce5-9e32-4183-9bc6-060e6678dc88 req-ba121b9f-3170-4002-9f65-6a49c2f9255d service nova] Creating event network-changed:e9b8c1ec-2928-4f49-b70e-b639f643a169 for instance f2f1e6bd-79f0-4d0a-88db-fbcc77835370 on nch2-master-1 Aug 06 20:58:13.729542 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-478b4ce5-9e32-4183-9bc6-060e6678dc88 req-ba121b9f-3170-4002-9f65-6a49c2f9255d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041363 Aug 06 20:58:13.730155 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 762/1507] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:13.736145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:13.736848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:13.744402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:13.745152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:13.745766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:13.746479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:13.747392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:13.747392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:13.918302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:13.931789 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8576134-92c9-459c-9578-d94cb55cc772 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1307 microversion: 2.1 time: 0.200124 Aug 06 20:58:13.932422 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bb8e5bd0-1699-4ab7-96f9-2992b991dbd2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922/action" status: 202 len: 0 microversion: 2.1 time: 2.258612 Aug 06 20:58:13.933363 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 746/1508] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:58:11 2022] POST /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922/action => generated 0 bytes in 2260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:13.943026 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 763/1509] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:13 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:13.944821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d381a0ee-3f87-4b8f-b64a-d4d8d6deefdf tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d7c9c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:13.998958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:13.999573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:14.012087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:14.012878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:14.013384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:14.014311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:14.014852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:14.015242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:14.254023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:14.268577 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b9eba64-f52d-4473-8c4c-21513ad928a7 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.273925 Aug 06 20:58:14.276987 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 764/1510] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:13 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:58:14.340806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:14.342905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:14.361303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:14.363291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:14.365079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:14.366770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:14.370229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:14.370965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:14.693577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-d381a0ee-3f87-4b8f-b64a-d4d8d6deefdf tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9b710b39-c9c8-4e79-95de-59492c6e46e2 in use.", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:58:14.695355 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-d381a0ee-3f87-4b8f-b64a-d4d8d6deefdf tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security Group 9b710b39-c9c8-4e79-95de-59492c6e46e2 in use. Aug 06 20:58:14.695355 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-3caac1b7-349e-4dee-a345-b72c99568ad7'] Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d381a0ee-3f87-4b8f-b64a-d4d8d6deefdf tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-security-groups/9b710b39-c9c8-4e79-95de-59492c6e46e2 HTTP/1.1 Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:14.697348 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: exception: Security Group 9b710b39-c9c8-4e79-95de-59492c6e46e2 in use. Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-3caac1b7-349e-4dee-a345-b72c99568ad7'] Aug 06 20:58:14.699182 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '9b710b39-c9c8-4e79-95de-59492c6e46e2'} Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:14.700199 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9b710b39-c9c8-4e79-95de-59492c6e46e2 in use. Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3caac1b7-349e-4dee-a345-b72c99568ad7'] Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9b710b39-c9c8-4e79-95de-59492c6e46e2 in use. Aug 06 20:58:14.702769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3caac1b7-349e-4dee-a345-b72c99568ad7'] Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9b710b39-c9c8-4e79-95de-59492c6e46e2 in use. Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3caac1b7-349e-4dee-a345-b72c99568ad7'] Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:14.704274 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:14.706125 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:14.706125 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:14.706125 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:14.706125 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9b710b39-c9c8-4e79-95de-59492c6e46e2 in use. Aug 06 20:58:14.706125 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3caac1b7-349e-4dee-a345-b72c99568ad7'] Aug 06 20:58:14.706125 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:14.710575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d381a0ee-3f87-4b8f-b64a-d4d8d6deefdf tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 400 to user: Security Group 9b710b39-c9c8-4e79-95de-59492c6e46e2 in use. Aug 06 20:58:14.710575 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-3caac1b7-349e-4dee-a345-b72c99568ad7'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:14.710575 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d381a0ee-3f87-4b8f-b64a-d4d8d6deefdf tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9b710b39-c9c8-4e79-95de-59492c6e46e2" status: 400 len: 185 microversion: 2.1 time: 0.770147 Aug 06 20:58:14.710575 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 747/1511] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:13 2022] DELETE /compute/v2.1/os-security-groups/9b710b39-c9c8-4e79-95de-59492c6e46e2 => generated 185 bytes in 771 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:58:14.725468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:14.726111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:14.743330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:14.744545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:14.745674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:14.748662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:14.749522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:14.751456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:14.762019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:14.775285 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2ba8dca6-07e6-45fb-9fc8-2160d5c8aaa2 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1314 microversion: 2.1 time: 0.449976 Aug 06 20:58:14.775869 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 765/1512] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:14 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:14.784818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a512d70b-1158-486a-8862-1b8e25bfb094 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:14.788952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a512d70b-1158-486a-8862-1b8e25bfb094 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:14.801944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a512d70b-1158-486a-8862-1b8e25bfb094 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:14.802949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a512d70b-1158-486a-8862-1b8e25bfb094 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:14.803570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a512d70b-1158-486a-8862-1b8e25bfb094 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:14.804457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a512d70b-1158-486a-8862-1b8e25bfb094 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:14.805155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a512d70b-1158-486a-8862-1b8e25bfb094 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:14.806419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a512d70b-1158-486a-8862-1b8e25bfb094 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:14.972084 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a512d70b-1158-486a-8862-1b8e25bfb094 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922/action" status: 202 len: 0 microversion: 2.1 time: 0.190817 Aug 06 20:58:14.976616 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 766/1513] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:58:14 2022] POST /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:14.989450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:14.990902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:15.005766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:15.007216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:15.007900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:15.026989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:15.027817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:15.031553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:15.425752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:15.438234 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9df16294-56fd-4496-9476-b472a1d047a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1486 microversion: 2.1 time: 0.459782 Aug 06 20:58:15.454374 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 767/1514] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:14 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1486 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:15.463663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:15.464304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:15.480501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:15.481008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:15.481460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:15.482422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:15.482928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:15.483370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:15.498326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:15.541239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:15.554816 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1332f38-d371-4881-8370-601ffaae2394 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1476 microversion: 2.1 time: 0.843203 Aug 06 20:58:15.558796 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 748/1515] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:14 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1476 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:15.568324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:15.569523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:15.579476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:15.580426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:15.581084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:15.582048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:15.583052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:15.583752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:15.914770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:15.926309 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-857b7615-2bef-4f75-b91d-8ec799ee7ba2 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1572 microversion: 2.1 time: 0.470478 Aug 06 20:58:15.926943 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 768/1516] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:15 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1572 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:15.946922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-86b054de-3043-4b82-8c4a-ff50641ab5d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:15.949252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-86b054de-3043-4b82-8c4a-ff50641ab5d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:15.968953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86b054de-3043-4b82-8c4a-ff50641ab5d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:15.969548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86b054de-3043-4b82-8c4a-ff50641ab5d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:15.970065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86b054de-3043-4b82-8c4a-ff50641ab5d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:15.970888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86b054de-3043-4b82-8c4a-ff50641ab5d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:15.972410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86b054de-3043-4b82-8c4a-ff50641ab5d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:15.974849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-86b054de-3043-4b82-8c4a-ff50641ab5d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:16.154433 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-86b054de-3043-4b82-8c4a-ff50641ab5d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93/action" status: 202 len: 0 microversion: 2.1 time: 0.222671 Aug 06 20:58:16.155873 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 769/1517] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:58:15 2022] POST /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:16.161962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:16.163060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:16.179712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:16.180477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:16.182866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:16.183628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:16.186333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:16.186823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:16.547191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=26 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:16.664628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:16.677580 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2318f4ab-a3e0-4dae-8f8b-4e9269dde9a9 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 1.116057 Aug 06 20:58:16.678476 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 749/1518] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:15 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:16.703030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ff4e6e88-a2cb-46a2-b9a3-93da9cc8a98e req-ae22f1ce-9b1e-44ed-8e17-8b2c25630cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c18108b-a584-4fe0-a1a1-e7f7eb300922", "tag": "e950bacb-e8ac-4c5c-91b3-0ae6955869ba"}, {"server_uuid": "0f0a6060-3d45-4cc6-bd81-528b40dbb976", "name": "network-vif-unplugged", "status": "completed", "tag": "c8556477-5b67-40f9-bd2e-4a17626d6a2f"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:16.725598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ff4e6e88-a2cb-46a2-b9a3-93da9cc8a98e req-ae22f1ce-9b1e-44ed-8e17-8b2c25630cd0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:16.726425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ff4e6e88-a2cb-46a2-b9a3-93da9cc8a98e req-ae22f1ce-9b1e-44ed-8e17-8b2c25630cd0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:16.727103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ff4e6e88-a2cb-46a2-b9a3-93da9cc8a98e req-ae22f1ce-9b1e-44ed-8e17-8b2c25630cd0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:16.749242 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ff4e6e88-a2cb-46a2-b9a3-93da9cc8a98e req-ae22f1ce-9b1e-44ed-8e17-8b2c25630cd0 service nova] Creating event network-changed:e950bacb-e8ac-4c5c-91b3-0ae6955869ba for instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 on nch1-master-1 Aug 06 20:58:16.753583 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ff4e6e88-a2cb-46a2-b9a3-93da9cc8a98e req-ae22f1ce-9b1e-44ed-8e17-8b2c25630cd0 service nova] Creating event network-vif-unplugged:c8556477-5b67-40f9-bd2e-4a17626d6a2f for instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 on nch1-master-1 Aug 06 20:58:16.771295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-ff4e6e88-a2cb-46a2-b9a3-93da9cc8a98e req-ae22f1ce-9b1e-44ed-8e17-8b2c25630cd0 service nova] Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:58:16.793530 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ff4e6e88-a2cb-46a2-b9a3-93da9cc8a98e req-ae22f1ce-9b1e-44ed-8e17-8b2c25630cd0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.109491 Aug 06 20:58:16.797089 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 750/1519] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:16.812488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:16.814084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:16.829168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:16.829680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:16.830125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:16.831080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:16.831707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:16.832305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:16.900751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:16.910295 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eb226e14-e148-4d68-9f88-96b9183bafb9 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1314 microversion: 2.1 time: 0.752939 Aug 06 20:58:16.911143 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 770/1520] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:16 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:16.917439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:16.918341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:16.943350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:16.945153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:16.950449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:16.951533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:16.957353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:16.958038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:16.973988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:17.452779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:17.468137 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d3a0326-ff5f-4623-a7b3-5517db52744e tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1476 microversion: 2.1 time: 0.553571 Aug 06 20:58:17.470416 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 771/1521] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:16 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1476 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:17.484204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:17.486358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:17.505164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:17.505679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:17.507685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:17.508785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:17.509569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:17.510208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:17.581180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:17.604296 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66fa5493-f8a5-427d-92ba-c34149c904b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 200 len: 1471 microversion: 2.1 time: 0.801160 Aug 06 20:58:17.608166 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 751/1522] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:16 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 1471 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:17.631714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce3a1778-8055-41f3-aaa5-5c337ae8f9c1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2082596021"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:17.634643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ce3a1778-8055-41f3-aaa5-5c337ae8f9c1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:17.645979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3a1778-8055-41f3-aaa5-5c337ae8f9c1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:17.655372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3a1778-8055-41f3-aaa5-5c337ae8f9c1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:17.657272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3a1778-8055-41f3-aaa5-5c337ae8f9c1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:17.658715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3a1778-8055-41f3-aaa5-5c337ae8f9c1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:17.659616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3a1778-8055-41f3-aaa5-5c337ae8f9c1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:17.660273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3a1778-8055-41f3-aaa5-5c337ae8f9c1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:17.992615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:18.003630 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f90ee38-f499-4198-894a-5a7a1e96ebe8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1570 microversion: 2.1 time: 0.527862 Aug 06 20:58:18.004713 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 772/1523] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:17 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1570 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:18.018165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:18.024074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:18.035613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:18.036708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:18.037374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:18.039094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:18.039408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:18.039845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:18.064718 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce3a1778-8055-41f3-aaa5-5c337ae8f9c1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93/action" status: 202 len: 0 microversion: 2.1 time: 0.426297 Aug 06 20:58:18.075179 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 752/1524] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:58:17 2022] POST /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 20:58:18.081816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:18.082538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:18.121790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:18.122288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:18.122879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:18.123509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:18.123978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:18.124407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:18.491047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:18.503187 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-582d886f-6c74-4181-832d-ccc73220ce14 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.496671 Aug 06 20:58:18.504305 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 773/1525] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:18 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:18.509222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2129891934"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:18.509898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:18.517515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:18.518144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:18.518851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:18.519696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:18.520281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:18.520803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:18.718585 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.network.security_group_api [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Adding security group f865725e-3a8d-4e44-b8a0-945ff17e8845 to port e950bacb-e8ac-4c5c-91b3-0ae6955869ba Aug 06 20:58:18.846352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:18.863220 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-948d3d2c-c5d3-4094-9c36-92baeec494ff tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1314 microversion: 2.1 time: 0.785573 Aug 06 20:58:18.864149 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 753/1526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:18 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:18.868782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0441d858-9c18-4e3a-80e8-bb70499ea7e4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d7d94c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:18.945908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=34 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:18.988389 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0441d858-9c18-4e3a-80e8-bb70499ea7e4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.120207 Aug 06 20:58:18.992462 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 754/1527] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:18 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:19.007647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:19.008841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:19.024510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:19.025555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:19.026262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:19.029897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:19.032094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:19.033153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:19.399260 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-98163c8c-6931-43ea-ba0d-b62f601b9b0a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922/action" status: 202 len: 0 microversion: 2.1 time: 0.893737 Aug 06 20:58:19.400889 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 774/1528] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:58:18 2022] POST /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:19.406703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-05c9bd5b-37a1-4de3-8bf1-d930042bed2b req-8c892851-8614-474b-9374-483dd381ffb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0a6060-3d45-4cc6-bd81-528b40dbb976", "tag": "c8556477-5b67-40f9-bd2e-4a17626d6a2f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:19.426857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-05c9bd5b-37a1-4de3-8bf1-d930042bed2b req-8c892851-8614-474b-9374-483dd381ffb9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:19.427348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-05c9bd5b-37a1-4de3-8bf1-d930042bed2b req-8c892851-8614-474b-9374-483dd381ffb9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:19.427785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-05c9bd5b-37a1-4de3-8bf1-d930042bed2b req-8c892851-8614-474b-9374-483dd381ffb9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:19.474916 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-05c9bd5b-37a1-4de3-8bf1-d930042bed2b req-8c892851-8614-474b-9374-483dd381ffb9 service nova] Creating event network-changed:c8556477-5b67-40f9-bd2e-4a17626d6a2f for instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 on nch1-master-1 Aug 06 20:58:19.502409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-05c9bd5b-37a1-4de3-8bf1-d930042bed2b req-8c892851-8614-474b-9374-483dd381ffb9 service nova] Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:58:19.540737 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-05c9bd5b-37a1-4de3-8bf1-d930042bed2b req-8c892851-8614-474b-9374-483dd381ffb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135384 Aug 06 20:58:19.542229 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 775/1529] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:19.555498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d5a91db-bc90-4eca-9651-0ef54e250af1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d96c0d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:19.811444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:19.817648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-2d5a91db-bc90-4eca-9651-0ef54e250af1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f865725e-3a8d-4e44-b8a0-945ff17e8845 in use.", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:58:19.818780 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-2d5a91db-bc90-4eca-9651-0ef54e250af1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security Group f865725e-3a8d-4e44-b8a0-945ff17e8845 in use. Aug 06 20:58:19.818780 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-da5f4efa-2ef7-454a-8d83-0df120754b7b'] Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d5a91db-bc90-4eca-9651-0ef54e250af1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-security-groups/f865725e-3a8d-4e44-b8a0-945ff17e8845 HTTP/1.1 Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:58:19.822835 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: exception: Security Group f865725e-3a8d-4e44-b8a0-945ff17e8845 in use. Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-da5f4efa-2ef7-454a-8d83-0df120754b7b'] Aug 06 20:58:19.824369 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'f865725e-3a8d-4e44-b8a0-945ff17e8845'} Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:19.825365 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f865725e-3a8d-4e44-b8a0-945ff17e8845 in use. Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da5f4efa-2ef7-454a-8d83-0df120754b7b'] Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f865725e-3a8d-4e44-b8a0-945ff17e8845 in use. Aug 06 20:58:19.829021 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da5f4efa-2ef7-454a-8d83-0df120754b7b'] Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f865725e-3a8d-4e44-b8a0-945ff17e8845 in use. Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da5f4efa-2ef7-454a-8d83-0df120754b7b'] Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:19.831893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:19.835921 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:19.835921 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:19.835921 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:19.835921 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f865725e-3a8d-4e44-b8a0-945ff17e8845 in use. Aug 06 20:58:19.835921 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da5f4efa-2ef7-454a-8d83-0df120754b7b'] Aug 06 20:58:19.835921 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:19.836752 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c054d819-283f-4e65-9189-428e272957ee tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1476 microversion: 2.1 time: 0.835271 Aug 06 20:58:19.836752 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 755/1530] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:18 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1476 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:19.836752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-73dbb3cd-3622-4603-a549-2bc753e0fb73 req-97d2f34c-2a3d-4737-adb5-22964f9274d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c18108b-a584-4fe0-a1a1-e7f7eb300922", "tag": "e950bacb-e8ac-4c5c-91b3-0ae6955869ba"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:19.849164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d5a91db-bc90-4eca-9651-0ef54e250af1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 400 to user: Security Group f865725e-3a8d-4e44-b8a0-945ff17e8845 in use. Aug 06 20:58:19.849164 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-da5f4efa-2ef7-454a-8d83-0df120754b7b'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:19.850404 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d5a91db-bc90-4eca-9651-0ef54e250af1 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f865725e-3a8d-4e44-b8a0-945ff17e8845" status: 400 len: 185 microversion: 2.1 time: 0.306070 Aug 06 20:58:19.854639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-73dbb3cd-3622-4603-a549-2bc753e0fb73 req-97d2f34c-2a3d-4737-adb5-22964f9274d7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:19.855162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-73dbb3cd-3622-4603-a549-2bc753e0fb73 req-97d2f34c-2a3d-4737-adb5-22964f9274d7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:19.855576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-73dbb3cd-3622-4603-a549-2bc753e0fb73 req-97d2f34c-2a3d-4737-adb5-22964f9274d7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:19.856256 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 776/1531] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:19 2022] DELETE /compute/v2.1/os-security-groups/f865725e-3a8d-4e44-b8a0-945ff17e8845 => generated 185 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:58:19.864372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:19.865681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:19.874830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:19.875511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:19.876018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:19.876834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:19.877392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:19.877940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:19.881214 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-73dbb3cd-3622-4603-a549-2bc753e0fb73 req-97d2f34c-2a3d-4737-adb5-22964f9274d7 service nova] Creating event network-changed:e950bacb-e8ac-4c5c-91b3-0ae6955869ba for instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 on nch1-master-1 Aug 06 20:58:19.900932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-73dbb3cd-3622-4603-a549-2bc753e0fb73 req-97d2f34c-2a3d-4737-adb5-22964f9274d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069602 Aug 06 20:58:19.902486 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 756/1532] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:19.914617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:19.916079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:19.928602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:19.929112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:19.929577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:19.930305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:19.935636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:19.936186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:19.983340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:58:20.093330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:20.111151 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6259bd2b-7297-42dc-a699-4ba8bd77742f tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 204 len: 0 microversion: 2.1 time: 0.206075 Aug 06 20:58:20.112130 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 757/1533] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:58:19 2022] DELETE /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:20.124411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:20.125433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:20.143207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:20.144117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:20.144753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:20.145695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:20.146580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:20.147177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:20.308733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:20.335180 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71f26797-f5c6-4376-a605-334cf6faa317 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.476827 Aug 06 20:58:20.336966 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 777/1534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:19 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:20.350853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a3445dfd-beb3-4410-9071-03fc32e69a34 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d92cf70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:20.422310 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a3445dfd-beb3-4410-9071-03fc32e69a34 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.082470 Aug 06 20:58:20.423657 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 778/1535] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:20 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:20.429261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:20.430194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:20.448070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:20.448070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:20.448070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:20.448070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:20.448420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:20.448420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:20.600993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:20.610825 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3aeb20ec-5122-47a5-accd-050d0d6aea54 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1314 microversion: 2.1 time: 0.497051 Aug 06 20:58:20.614043 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 758/1536] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:20 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:20.804752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:20.816729 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6b78a448-b439-4f8a-bbf6-9fa6a6981114 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1645 microversion: 2.1 time: 0.391756 Aug 06 20:58:20.820658 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 779/1537] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:20 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1645 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:20.851368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:20.852287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:20.866198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:20.867553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:20.868074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:20.868867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:20.869399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:20.870056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:21.141994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:21.152165 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dcb95a9f-4786-4abb-ad64-c6b1d19de654 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1476 microversion: 2.1 time: 0.304575 Aug 06 20:58:21.168110 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 759/1538] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:20 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:21.359282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:21.361869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:21.386025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:21.394275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:21.395605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:21.402175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:21.405401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:21.407726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:21.441102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7baf01bf-284a-43a1-b7a4-cf20f769c262 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d7a11f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:21.539873 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7baf01bf-284a-43a1-b7a4-cf20f769c262 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.105318 Aug 06 20:58:21.541010 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 760/1539] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:21 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:21.633360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:21.633988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:21.654438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:21.655400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:21.658639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:21.660852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:21.681693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:21.685176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:21.986736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:22.006501 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-96d62970-235a-4b36-b22a-35990072b0c4 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.648912 Aug 06 20:58:22.022604 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 780/1540] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:21 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:22.022604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a781f3ee-73ed-49c6-b894-310e0d694595 req-ce1a3a4d-3fb6-47ee-a641-84ec2c25903c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f1e6bd-79f0-4d0a-88db-fbcc77835370", "name": "network-vif-plugged", "status": "completed", "tag": "e9b8c1ec-2928-4f49-b70e-b639f643a169"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:22.047147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a781f3ee-73ed-49c6-b894-310e0d694595 req-ce1a3a4d-3fb6-47ee-a641-84ec2c25903c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:22.047723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a781f3ee-73ed-49c6-b894-310e0d694595 req-ce1a3a4d-3fb6-47ee-a641-84ec2c25903c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:22.049813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a781f3ee-73ed-49c6-b894-310e0d694595 req-ce1a3a4d-3fb6-47ee-a641-84ec2c25903c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:22.068788 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a781f3ee-73ed-49c6-b894-310e0d694595 req-ce1a3a4d-3fb6-47ee-a641-84ec2c25903c service nova] Creating event network-vif-plugged:e9b8c1ec-2928-4f49-b70e-b639f643a169 for instance f2f1e6bd-79f0-4d0a-88db-fbcc77835370 on nch2-master-1 Aug 06 20:58:22.089316 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a781f3ee-73ed-49c6-b894-310e0d694595 req-ce1a3a4d-3fb6-47ee-a641-84ec2c25903c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077063 Aug 06 20:58:22.096500 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 781/1541] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:22.116760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:22.121908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:22.148700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:22.151078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:22.151564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:22.157428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:22.158053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:22.159080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:22.163061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:22.182069 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fbff27c1-8ed8-4ae2-93b5-83f06a9548bf tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1314 microversion: 2.1 time: 0.542924 Aug 06 20:58:22.187653 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 761/1542] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:21 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:22.206676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:22.207247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:22.235720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:22.237641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:22.239261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:22.240047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:22.240532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:22.240977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:22.513811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:22.524264 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a3a3a5fb-5173-4e4e-8c37-a129358b991c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1474 microversion: 2.1 time: 0.333750 Aug 06 20:58:22.527716 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 762/1543] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:22 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1474 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:22.557798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e44db00e-b4dd-46d6-af86-a1ac18bfd567 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d78d310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:22.789581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:22.804993 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5df05915-0ccd-43b7-b92d-816f30a990f8 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1645 microversion: 2.1 time: 0.704072 Aug 06 20:58:22.821869 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 782/1544] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:22 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1645 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:23.030217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:23.031032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:23.038949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:23.043289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:23.043893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:23.045055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:23.045576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:23.046086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:23.358509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:23.373157 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e82e7100-7005-4d55-a34b-c8f348b1544e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.345512 Aug 06 20:58:23.373970 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 783/1545] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:23 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:58:23.385042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:23.387336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:23.400696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:23.403662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:23.404300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:23.408407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:23.409283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:23.410015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:24.759707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:24.771225 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b55d4260-8bdd-4b0d-a610-fd11d6548e49 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1314 microversion: 2.1 time: 1.391899 Aug 06 20:58:24.775318 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 784/1546] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:23 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1314 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:24.781450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:24.782540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:24.798489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:24.803339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:24.805834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:24.806639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:24.807135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:24.807568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:25.652387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:25.666019 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e0d963bd-67a4-4bee-bd65-9392336f8a92 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1471 microversion: 2.1 time: 0.889342 Aug 06 20:58:25.676997 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 785/1547] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:24 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1471 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:25.687140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:25.689869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:25.717250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:25.717758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:25.721430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:25.722221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:25.722734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:25.723174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:26.050534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:26.097261 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0d47475c-2fd7-4aa5-b8ec-940c87f82dfa tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 200 len: 1466 microversion: 2.1 time: 0.414738 Aug 06 20:58:26.101664 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 786/1548] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:25 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 1466 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:26.142253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-19476830-0f9f-4177-84b0-1c186d47bc75 req-dd558298-7c41-4442-aa85-7251ffe5736a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27865ac3-9a8a-4568-ba57-3f022b07ba93", "name": "network-vif-plugged", "status": "completed", "tag": "7fe99f75-e61b-480d-9d57-8f00ee43c6ca"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:26.214697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-19476830-0f9f-4177-84b0-1c186d47bc75 req-dd558298-7c41-4442-aa85-7251ffe5736a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:26.215189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-19476830-0f9f-4177-84b0-1c186d47bc75 req-dd558298-7c41-4442-aa85-7251ffe5736a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:26.216398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-19476830-0f9f-4177-84b0-1c186d47bc75 req-dd558298-7c41-4442-aa85-7251ffe5736a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:26.238582 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-19476830-0f9f-4177-84b0-1c186d47bc75 req-dd558298-7c41-4442-aa85-7251ffe5736a service nova] Creating event network-vif-plugged:7fe99f75-e61b-480d-9d57-8f00ee43c6ca for instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 on nch2-master-1 Aug 06 20:58:26.248380 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-19476830-0f9f-4177-84b0-1c186d47bc75 req-dd558298-7c41-4442-aa85-7251ffe5736a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142437 Aug 06 20:58:26.251792 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 787/1549] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:26.296055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:26.303533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:26.329823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:26.341940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:26.342619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:26.343561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:26.344856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:26.346969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:26.774591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:26.786604 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d036d7e6-93a7-4d7b-9e68-b68f429aeb91 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.531988 Aug 06 20:58:26.792565 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 788/1550] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:26 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:26.813705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b1cecfa-fe88-43e8-9f74-b3d95a6a0405 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:26.815428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5b1cecfa-fe88-43e8-9f74-b3d95a6a0405 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:26.849577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b1cecfa-fe88-43e8-9f74-b3d95a6a0405 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:26.853915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b1cecfa-fe88-43e8-9f74-b3d95a6a0405 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:26.854731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b1cecfa-fe88-43e8-9f74-b3d95a6a0405 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:26.855763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b1cecfa-fe88-43e8-9f74-b3d95a6a0405 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:26.859715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b1cecfa-fe88-43e8-9f74-b3d95a6a0405 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:26.861087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b1cecfa-fe88-43e8-9f74-b3d95a6a0405 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:27.064629 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b1cecfa-fe88-43e8-9f74-b3d95a6a0405 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "POST /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976/action" status: 202 len: 0 microversion: 2.1 time: 0.269752 Aug 06 20:58:27.065864 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 789/1551] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:58:26 2022] POST /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:27.076565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:27.077628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:27.086160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:27.087394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:27.087877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:27.088608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:27.089154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:27.089589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:27.123732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:27.557864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:27.577059 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e936f022-a154-4b37-8b01-f96a1bed6579 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1463 microversion: 2.1 time: 0.503590 Aug 06 20:58:27.577788 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 790/1552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:27 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1463 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:28.084353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3525d44a-fbee-4a20-a1a2-bd0de530210a tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Calling method '.version_select at 0x7f729d929dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:28.085323 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:58:28.085323 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:58:28.086979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3525d44a-fbee-4a20-a1a2-bd0de530210a tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e1bb7e1a44f44711b773bfbe44125567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eb5c85d76f425aaf4126ca694ae8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3525d44a-fbee-4a20-a1a2-bd0de530210a tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Request method failure captured: Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXwGt6dSqG89ZMjS3by5Qqh9q2XpNcXoV0NIF399OLKG21fYuEgpVMdM8JulV_vYip164tuFZdw4rQGDGvPTRgJPGCHAunDgfgLgjnQYu4uiyYpyHbJLYtbp0cex574ztbv4cstN4nD93im8IpsiLMnkf5wco0lv45yWMbFXaLQtxc Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:58:28.088947 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_63eb5c85d76f425aaf4126ca694ae8b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e1bb7e1a44f44711b773bfbe44125567 Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: action_args: {} Aug 06 20:58:28.091425 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:58:28.092433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 06 20:58:28.093928 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:28.098565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3525d44a-fbee-4a20-a1a2-bd0de530210a tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:28.109240 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3525d44a-fbee-4a20-a1a2-bd0de530210a tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.522909 Aug 06 20:58:28.109887 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 791/1553] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Aug 6 20:58:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 532 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:28.123284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-6d34e80e-faf9-4631-aadb-27c1a81dfde3 req-8686c9e6-7102-4790-9431-49e9ae0803ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c18108b-a584-4fe0-a1a1-e7f7eb300922", "name": "network-vif-deleted", "tag": "e950bacb-e8ac-4c5c-91b3-0ae6955869ba"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:28.156445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6d34e80e-faf9-4631-aadb-27c1a81dfde3 req-8686c9e6-7102-4790-9431-49e9ae0803ed service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:28.156941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6d34e80e-faf9-4631-aadb-27c1a81dfde3 req-8686c9e6-7102-4790-9431-49e9ae0803ed service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:28.162215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6d34e80e-faf9-4631-aadb-27c1a81dfde3 req-8686c9e6-7102-4790-9431-49e9ae0803ed service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:28.209605 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-6d34e80e-faf9-4631-aadb-27c1a81dfde3 req-8686c9e6-7102-4790-9431-49e9ae0803ed service nova] Creating event network-vif-deleted:e950bacb-e8ac-4c5c-91b3-0ae6955869ba for instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 on nch1-master-1 Aug 06 20:58:28.222132 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-6d34e80e-faf9-4631-aadb-27c1a81dfde3 req-8686c9e6-7102-4790-9431-49e9ae0803ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109223 Aug 06 20:58:28.223799 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 792/1554] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:28.237224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:28.243964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:28.264765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:28.265267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:28.265715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:28.266453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:28.272956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:28.273443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:28.682777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:28.696921 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-afd900e5-ba8a-484c-aa93-593dde98c75b tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1470 microversion: 2.1 time: 0.466846 Aug 06 20:58:28.704129 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 793/1555] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:28 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1470 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:28.724466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:28.724466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:28.741535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:28.742027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:28.744126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:28.744872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:28.745342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:28.745779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:28.776384 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 HTTP/1.1 Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:58:28.785604 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:28.787189 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '8c18108b-a584-4fe0-a1a1-e7f7eb300922'} Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:28.787986 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:28.789604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:28.791471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:28.791471 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b49da835-6744-464e-88c3-65149b826948 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 404 len: 111 microversion: 2.1 time: 0.082718 Aug 06 20:58:28.794868 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 794/1556] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:28 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:29.069823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c64314a3-da93-46b1-b8bc-b8dbe8a02114 tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Calling method '.version_select at 0x7f729d96c160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:29.097754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c64314a3-da93-46b1-b8bc-b8dbe8a02114 tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:29.103385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c64314a3-da93-46b1-b8bc-b8dbe8a02114 tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:29.105884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c64314a3-da93-46b1-b8bc-b8dbe8a02114 tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:29.143156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c64314a3-da93-46b1-b8bc-b8dbe8a02114 tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:29.143944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c64314a3-da93-46b1-b8bc-b8dbe8a02114 tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:29.144827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c64314a3-da93-46b1-b8bc-b8dbe8a02114 tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:29.172031 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c64314a3-da93-46b1-b8bc-b8dbe8a02114 tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/9129b06bfc47457c954b8c5af61bdb7e?start=2022-08-05T20%3A58%3A27.590973&end=2022-08-07T20%3A58%3A27.590973" status: 200 len: 695 microversion: 2.1 time: 0.375370 Aug 06 20:58:29.173387 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 795/1557] 10.222.0.33 () {58 vars in 1412 bytes} [Sat Aug 6 20:58:28 2022] GET /compute/v2.1/os-simple-tenant-usage/9129b06bfc47457c954b8c5af61bdb7e?start=2022-08-05T20%3A58%3A27.590973&end=2022-08-07T20%3A58%3A27.590973 => generated 695 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:29.178728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:29.179702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:29.188605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:29.190275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:29.191200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:29.192771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:29.194252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:29.195029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:29.404694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:29.417739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03c571c4-9d3a-434b-9165-3c51f2ad8f3c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.243049 Aug 06 20:58:29.419836 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 796/1558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:29 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:29.425615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c2e4fe6-3dad-44f4-b4b6-1026921d729b tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Calling method '.version_select at 0x7f729d92c310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:29.427193 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:58:29.427193 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:58:29.428555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1c2e4fe6-3dad-44f4-b4b6-1026921d729b tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e1bb7e1a44f44711b773bfbe44125567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eb5c85d76f425aaf4126ca694ae8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c2e4fe6-3dad-44f4-b4b6-1026921d729b tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Request method failure captured: Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXwGt6dSqG89ZMjS3by5Qqh9q2XpNcXoV0NIF399OLKG21fYuEgpVMdM8JulV_vYip164tuFZdw4rQGDGvPTRgJPGCHAunDgfgLgjnQYu4uiyYpyHbJLYtbp0cex574ztbv4cstN4nD93im8IpsiLMnkf5wco0lv45yWMbFXaLQtxc Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:58:29.430361 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_63eb5c85d76f425aaf4126ca694ae8b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e1bb7e1a44f44711b773bfbe44125567 Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: action_args: {} Aug 06 20:58:29.432414 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:58:29.433452 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 06 20:58:29.434914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:29.437841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c2e4fe6-3dad-44f4-b4b6-1026921d729b tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:29.438918 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c2e4fe6-3dad-44f4-b4b6-1026921d729b tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017878 Aug 06 20:58:29.439929 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 797/1559] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:58:29 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:29.448685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f4ebcc47-98ba-4324-b9ce-deaa33df0b78 req-173a143f-507c-4c53-93ea-67c77ce413c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0a6060-3d45-4cc6-bd81-528b40dbb976", "name": "network-vif-plugged", "status": "completed", "tag": "c8556477-5b67-40f9-bd2e-4a17626d6a2f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:29.463192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f4ebcc47-98ba-4324-b9ce-deaa33df0b78 req-173a143f-507c-4c53-93ea-67c77ce413c7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:29.464034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f4ebcc47-98ba-4324-b9ce-deaa33df0b78 req-173a143f-507c-4c53-93ea-67c77ce413c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:29.464977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f4ebcc47-98ba-4324-b9ce-deaa33df0b78 req-173a143f-507c-4c53-93ea-67c77ce413c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:29.479503 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f4ebcc47-98ba-4324-b9ce-deaa33df0b78 req-173a143f-507c-4c53-93ea-67c77ce413c7 service nova] Creating event network-vif-plugged:c8556477-5b67-40f9-bd2e-4a17626d6a2f for instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 on nch1-master-1 Aug 06 20:58:29.487384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-f4ebcc47-98ba-4324-b9ce-deaa33df0b78 req-173a143f-507c-4c53-93ea-67c77ce413c7 service nova] Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:58:29.503737 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f4ebcc47-98ba-4324-b9ce-deaa33df0b78 req-173a143f-507c-4c53-93ea-67c77ce413c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062047 Aug 06 20:58:29.504646 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 798/1560] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:29.513081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-014b369b-0a24-4abc-88fd-6efb6d2c3d02 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d982f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:29.966769 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-014b369b-0a24-4abc-88fd-6efb6d2c3d02 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9b710b39-c9c8-4e79-95de-59492c6e46e2" status: 202 len: 0 microversion: 2.1 time: 0.459856 Aug 06 20:58:29.967624 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 799/1561] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:29 2022] DELETE /compute/v2.1/os-security-groups/9b710b39-c9c8-4e79-95de-59492c6e46e2 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:29.985506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a87e234-40eb-4b3a-acb7-a25c77b44985 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '.version_select at 0x7f729d96c310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:30.046764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a87e234-40eb-4b3a-acb7-a25c77b44985 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:30.047336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a87e234-40eb-4b3a-acb7-a25c77b44985 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:30.048776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a87e234-40eb-4b3a-acb7-a25c77b44985 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:30.067740 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e44db00e-b4dd-46d6-af86-a1ac18bfd567 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 7.511568 Aug 06 20:58:30.072507 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 763/1562] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:22 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 7521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:58:30.083137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ba5c197-cb73-4d40-9c0b-d22fab685315 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Calling method '.version_select at 0x7f729d74e160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:30.090629 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:58:30.090629 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:58:30.094051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a87e234-40eb-4b3a-acb7-a25c77b44985 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:30.098806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1ba5c197-cb73-4d40-9c0b-d22fab685315 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e1bb7e1a44f44711b773bfbe44125567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eb5c85d76f425aaf4126ca694ae8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:30.099810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a87e234-40eb-4b3a-acb7-a25c77b44985 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:30.100850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a87e234-40eb-4b3a-acb7-a25c77b44985 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ba5c197-cb73-4d40-9c0b-d22fab685315 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Request method failure captured: Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tXwGt6dSqG89ZMjS3by5Qqh9q2XpNcXoV0NIF399OLKG21fYuEgpVMdM8JulV_vYip164tuFZdw4rQGDGvPTRgJPGCHAunDgfgLgjnQYu4uiyYpyHbJLYtbp0cex574ztbv4cstN4nD93im8IpsiLMnkf5wco0lv45yWMbFXaLQtxc Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:30.103032 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_63eb5c85d76f425aaf4126ca694ae8b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e1bb7e1a44f44711b773bfbe44125567 Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 20:58:30.104684 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:58:30.105743 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 06 20:58:30.107458 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:30.114375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ba5c197-cb73-4d40-9c0b-d22fab685315 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:30.117789 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ba5c197-cb73-4d40-9c0b-d22fab685315 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.039556 Aug 06 20:58:30.118955 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 764/1563] 10.222.0.33 () {58 vars in 1179 bytes} [Sat Aug 6 20:58:30 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:30.127547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:30.128630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:30.140004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:30.140994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:30.141668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:30.142618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:30.143268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:30.143941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:30.149844 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a87e234-40eb-4b3a-acb7-a25c77b44985 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/9129b06bfc47457c954b8c5af61bdb7e?start=2022-08-05T20%3A58%3A27.590973&end=2022-08-07T20%3A58%3A27.590973" status: 200 len: 695 microversion: 2.1 time: 0.175312 Aug 06 20:58:30.150658 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 800/1564] 10.222.0.33 () {58 vars in 1412 bytes} [Sat Aug 6 20:58:29 2022] GET /compute/v2.1/os-simple-tenant-usage/9129b06bfc47457c954b8c5af61bdb7e?start=2022-08-05T20%3A58%3A27.590973&end=2022-08-07T20%3A58%3A27.590973 => generated 695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:30.167395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1d4e2b3e-919d-49e3-8349-a3c5f746323e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729da1f1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:30.168977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:30.709529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:30.726014 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12353c7e-aa67-495d-a07a-2ed03a65f53c tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1470 microversion: 2.1 time: 0.604134 Aug 06 20:58:30.728708 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 765/1565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:30 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1470 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:30.772026 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1d4e2b3e-919d-49e3-8349-a3c5f746323e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f865725e-3a8d-4e44-b8a0-945ff17e8845" status: 202 len: 0 microversion: 2.1 time: 0.617366 Aug 06 20:58:30.772687 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 801/1566] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:30 2022] DELETE /compute/v2.1/os-security-groups/f865725e-3a8d-4e44-b8a0-945ff17e8845 => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:30.793442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4698acf1-fa2b-4a12-8143-52240b168ffe tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Calling method '.version_select at 0x7f729da1f430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:30.849968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4698acf1-fa2b-4a12-8143-52240b168ffe tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:30.850470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4698acf1-fa2b-4a12-8143-52240b168ffe tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:30.850944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4698acf1-fa2b-4a12-8143-52240b168ffe tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:30.937814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4698acf1-fa2b-4a12-8143-52240b168ffe tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:30.941296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4698acf1-fa2b-4a12-8143-52240b168ffe tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:30.942068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4698acf1-fa2b-4a12-8143-52240b168ffe tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:30.980029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Calling method '.version_select at 0x7f729d776160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:30.980982 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:58:30.980982 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:58:30.982436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:30.983203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:30.983911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:31.075182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:31.077521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:31.079495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:31.097167 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4698acf1-fa2b-4a12-8143-52240b168ffe tempest-TenantUsagesTestJSON-1763563341 tempest-TenantUsagesTestJSON-1763563341-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-05T20%3A58%3A27.590973&end=2022-08-07T20%3A58%3A27.590973&detailed=1" status: 200 len: 19039 microversion: 2.1 time: 0.314270 Aug 06 20:58:31.098159 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 802/1567] 10.222.0.33 () {58 vars in 1335 bytes} [Sat Aug 6 20:58:30 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-05T20%3A58%3A27.590973&end=2022-08-07T20%3A58%3A27.590973&detailed=1 => generated 19039 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:58:31.104103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:31.105586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:31.123843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:31.124918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:31.125623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:31.126806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:31.127666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:31.128457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:31.148429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:31.155831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:31.157050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:31.180353 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc680d13-92c9-4949-a640-308f138dedae tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.450637 Aug 06 20:58:31.183906 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 766/1568] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:58:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:31.214361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ccd14fd0-0728-42c2-afed-9b1f932ad7d6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'create', calling method: .version_select at 0x7f729d7a18b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1725721833", "description": "tempest-description-1741036040"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:31.786349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:31.796546 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e195c49d-cd79-4cf6-8633-71cad2695104 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.696952 Aug 06 20:58:31.818744 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 803/1569] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:31 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:31.839023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e287859b-aacc-4ce6-970d-0e566b2b31d6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d92c790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:31.991357 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ccd14fd0-0728-42c2-afed-9b1f932ad7d6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.793742 Aug 06 20:58:31.991978 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e287859b-aacc-4ce6-970d-0e566b2b31d6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.156624 Aug 06 20:58:31.992667 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 804/1570] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:31 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:32.001950 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 767/1571] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 20:58:31 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:32.007228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5149f29c-6ce8-4b8c-a83d-b4361eca6936 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Calling method '.version_select at 0x7f729d785d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:32.008337 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:58:32.008337 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:58:32.010870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:32.011024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5149f29c-6ce8-4b8c-a83d-b4361eca6936 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e1bb7e1a44f44711b773bfbe44125567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eb5c85d76f425aaf4126ca694ae8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:32.015295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5149f29c-6ce8-4b8c-a83d-b4361eca6936 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Request method failure captured: Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tXwGt6dSqG89ZMjS3by5Qqh9q2XpNcXoV0NIF399OLKG21fYuEgpVMdM8JulV_vYip164tuFZdw4rQGDGvPTRgJPGCHAunDgfgLgjnQYu4uiyYpyHbJLYtbp0cex574ztbv4cstN4nD93im8IpsiLMnkf5wco0lv45yWMbFXaLQtxc Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:32.017459 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_63eb5c85d76f425aaf4126ca694ae8b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e1bb7e1a44f44711b773bfbe44125567 Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '1'} Aug 06 20:58:32.019632 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:58:32.021056 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 06 20:58:32.023048 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.027473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5149f29c-6ce8-4b8c-a83d-b4361eca6936 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:32.028680 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5149f29c-6ce8-4b8c-a83d-b4361eca6936 tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.025603 Aug 06 20:58:32.032423 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 768/1572] 10.222.0.33 () {58 vars in 1173 bytes} [Sat Aug 6 20:58:32 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:32.041352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:32.042444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:32.046416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:32.046958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:32.047666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:32.049117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:32.049791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:32.051784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:32.063299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:32.065617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:32.066811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:32.068302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:32.070127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:32.071849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:32.132006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:58:32.354378 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-74d0fb3d-978a-45a5-ae6f-27363bbe7a07 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 204 len: 0 microversion: 2.1 time: 0.350641 Aug 06 20:58:32.356584 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 805/1573] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:58:31 2022] DELETE /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:32.369063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5e381d29-241c-4946-8712-992df81e8b6c tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Action: 'update', calling method: .version_select at 0x7f729da1f9d0>, body: {"security_group": {"name": "tempest-sg-hth-388205381", "description": "tempest-description-hth-1747758536"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:32.780870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:32.795673 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee8f326a-1c06-4715-ae4a-afc50d211f54 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1470 microversion: 2.1 time: 0.760455 Aug 06 20:58:32.811599 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 769/1574] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:32 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1470 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:32.838020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71e4b7c4-ce0c-4388-9355-a7fe444a09e7 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Calling method '.version_select at 0x7f729d7a15e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:32.851787 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:58:32.851787 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:58:32.853415 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-71e4b7c4-ce0c-4388-9355-a7fe444a09e7 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] HTTP exception thrown: Hypervisor with ID 'd9e363a0-4bc4-45d6-9774-f3c9167b321a' could not be found. Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71e4b7c4-ce0c-4388-9355-a7fe444a09e7 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Request method failure captured: Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hypervisors/d9e363a0-4bc4-45d6-9774-f3c9167b321a/uptime HTTP/1.1 Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tXxZji5zJjrvIAmVHMBxh95oEydhENbqGEa5h9196t0nCYC52Lih8O1Wvgjl__njfW8c19u8djSMHguNzZtRgQmkUl_liIttNP4CrcaWjLHFghgNs7cYw1TwLzx7BHTcdLh6f5BlHxKIKSBBNT75GYK3nf8y3DOAKmTFm8CWZGiHB4 Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4d7fb4d2b40d46379171fc2c3a2e2907 Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-726648537 Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:58:32.870159 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d7fb4d2b40d46379171fc2c3a2e2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d7fb4d2b40d46379171fc2c3a2e2907", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d7fb4d2b40d46379171fc2c3a2e2907"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d7fb4d2b40d46379171fc2c3a2e2907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-726648537 Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4d7fb4d2b40d46379171fc2c3a2e2907 Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-726648537 Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: fddb3590455f4d75967b3eece154e619 Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: exception: Hypervisor with ID 'd9e363a0-4bc4-45d6-9774-f3c9167b321a' could not be found. Aug 06 20:58:32.872895 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'd9e363a0-4bc4-45d6-9774-f3c9167b321a'} Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd9e363a0-4bc4-45d6-9774-f3c9167b321a' Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 06 20:58:32.873872 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd9e363a0-4bc4-45d6-9774-f3c9167b321a' could not be found. Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:32.875678 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.877482 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:32.877482 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:32.877482 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:32.877482 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:32.877482 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:32.877482 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd9e363a0-4bc4-45d6-9774-f3c9167b321a' could not be found. Aug 06 20:58:32.877482 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:32.879830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71e4b7c4-ce0c-4388-9355-a7fe444a09e7 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Returning 404 to user: Hypervisor with ID 'd9e363a0-4bc4-45d6-9774-f3c9167b321a' could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:32.880881 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71e4b7c4-ce0c-4388-9355-a7fe444a09e7 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/d9e363a0-4bc4-45d6-9774-f3c9167b321a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.066558 Aug 06 20:58:32.881633 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 770/1575] 10.222.0.33 () {58 vars in 1278 bytes} [Sat Aug 6 20:58:32 2022] GET /compute/v2.1/os-hypervisors/d9e363a0-4bc4-45d6-9774-f3c9167b321a/uptime => generated 123 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:32.901337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:32.904545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:32.918745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:32.922316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:32.925654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:32.928688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:32.929361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:32.933168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:33.344843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:33.363425 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7f882a90-b0f9-4cef-8c3e-5a892fcde5aa tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1469 microversion: 2.1 time: 0.472831 Aug 06 20:58:33.365216 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 771/1576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:32 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1469 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:33.390958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:33.395849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:33.403238 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5e381d29-241c-4946-8712-992df81e8b6c tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/0f280511-90ed-46a2-908b-74fbf61139e1" status: 200 len: 217 microversion: 2.1 time: 1.038757 Aug 06 20:58:33.406128 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 806/1577] 10.222.0.33 () {60 vars in 1290 bytes} [Sat Aug 6 20:58:32 2022] PUT /compute/v2.1/os-security-groups/0f280511-90ed-46a2-908b-74fbf61139e1 => generated 217 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:33.421313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Calling method '.version_select at 0x7f729d929310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:33.437305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:33.438311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:33.441533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:33.442412 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:58:33.442412 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:58:33.446633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:33.450923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:33.451647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:33.453262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:33.453918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:33.455020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:33.550937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:33.568395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:33.579633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:33.580379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:33.611023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:33.611775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:33.612518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:33.641192 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d8cfda4e-288d-4559-bf62-57dcafec8e2d tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.232762 Aug 06 20:58:33.653361 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 807/1578] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 20:58:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:33.665708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43cf20fd-57a2-43f5-bd08-eb32fd16abf4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729da1f9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:33.809395 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-43cf20fd-57a2-43f5-bd08-eb32fd16abf4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.153928 Aug 06 20:58:33.810150 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 808/1579] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:33 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:33.829291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b14b431d-d43a-4134-a4b8-3890c2366458 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d90fe50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:34.253338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:34.263931 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d1bd2455-bd7c-4a5d-b3ed-e93eb4b61548 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1471 microversion: 2.1 time: 0.897532 Aug 06 20:58:34.270862 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 772/1580] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:33 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1471 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:34.278822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dce4fb09-8461-40a9-b7d7-5368093786ec tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Calling method '.version_select at 0x7f729d776d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:34.294854 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:58:34.294854 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:58:34.298538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dce4fb09-8461-40a9-b7d7-5368093786ec tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e1bb7e1a44f44711b773bfbe44125567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63eb5c85d76f425aaf4126ca694ae8b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dce4fb09-8461-40a9-b7d7-5368093786ec tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Request method failure captured: Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tXwGt6dSqG89ZMjS3by5Qqh9q2XpNcXoV0NIF399OLKG21fYuEgpVMdM8JulV_vYip164tuFZdw4rQGDGvPTRgJPGCHAunDgfgLgjnQYu4uiyYpyHbJLYtbp0cex574ztbv4cstN4nD93im8IpsiLMnkf5wco0lv45yWMbFXaLQtxc Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:34.302966 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_63eb5c85d76f425aaf4126ca694ae8b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/63eb5c85d76f425aaf4126ca694ae8b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 63eb5c85d76f425aaf4126ca694ae8b7 Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657 Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e1bb7e1a44f44711b773bfbe44125567 Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1610065657-project Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '1'} Aug 06 20:58:34.304829 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:58:34.305846 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 06 20:58:34.307382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:34.310032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dce4fb09-8461-40a9-b7d7-5368093786ec tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:34.312988 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dce4fb09-8461-40a9-b7d7-5368093786ec tempest-HypervisorAdminNegativeTestJSON-1610065657 tempest-HypervisorAdminNegativeTestJSON-1610065657-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.040790 Aug 06 20:58:34.316714 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 773/1581] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 20:58:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:34.330567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-428883020", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "7d8596f8-6e4f-4113-9082-5897ec6f05e0"}, {"uuid": "bdce8429-42a4-4ff0-8dfc-a3383f3f46b1"}, {"uuid": "7d8596f8-6e4f-4113-9082-5897ec6f05e0"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:34.475846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] validate_networks() for [('7d8596f8-6e4f-4113-9082-5897ec6f05e0', None, None, None, None, None), ('bdce8429-42a4-4ff0-8dfc-a3383f3f46b1', None, None, None, None, None), ('7d8596f8-6e4f-4113-9082-5897ec6f05e0', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:58:34.710529 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b14b431d-d43a-4134-a4b8-3890c2366458 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/0f280511-90ed-46a2-908b-74fbf61139e1" status: 200 len: 217 microversion: 2.1 time: 0.895233 Aug 06 20:58:34.711939 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 809/1582] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 20:58:33 2022] GET /compute/v2.1/os-security-groups/0f280511-90ed-46a2-908b-74fbf61139e1 => generated 217 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:34.718075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:34.720937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:34.742190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:34.745150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:34.747039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:34.752683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:34.753536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:34.754172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:35.237629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:35.255132 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b5895cbc-bbd8-4737-b5bf-d34caa2254db tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1470 microversion: 2.1 time: 0.541854 Aug 06 20:58:35.256029 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 810/1583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:34 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1470 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:35.262885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cfe07763-7fea-4ddf-89c9-4a9c7c718d85 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Calling method '.version_select at 0x7f729d9291f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:35.263678 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:58:35.263678 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:58:35.264570 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-cfe07763-7fea-4ddf-89c9-4a9c7c718d85 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] HTTP exception thrown: Hypervisor with ID 'ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac' could not be found. Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cfe07763-7fea-4ddf-89c9-4a9c7c718d85 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Request method failure captured: Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-hypervisors/ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac HTTP/1.1 Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXxZji5zJjrvIAmVHMBxh95oEydhENbqGEa5h9196t0nCYC52Lih8O1Wvgjl__njfW8c19u8djSMHguNzZtRgQmkUl_liIttNP4CrcaWjLHFghgNs7cYw1TwLzx7BHTcdLh6f5BlHxKIKSBBNT75GYK3nf8y3DOAKmTFm8CWZGiHB4 Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 4d7fb4d2b40d46379171fc2c3a2e2907 Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-726648537 Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 20:58:35.267332 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d7fb4d2b40d46379171fc2c3a2e2907"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d7fb4d2b40d46379171fc2c3a2e2907", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d7fb4d2b40d46379171fc2c3a2e2907"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d7fb4d2b40d46379171fc2c3a2e2907"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-726648537 Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 4d7fb4d2b40d46379171fc2c3a2e2907 Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-726648537 Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: fddb3590455f4d75967b3eece154e619 Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: exception: Hypervisor with ID 'ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac' could not be found. Aug 06 20:58:35.269839 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac'} Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac' Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 06 20:58:35.270844 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 20:58:35.272580 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac' could not be found. Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac' could not be found. Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cfe07763-7fea-4ddf-89c9-4a9c7c718d85 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] Returning 404 to user: Hypervisor with ID 'ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac' could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:35.274003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cfe07763-7fea-4ddf-89c9-4a9c7c718d85 tempest-HypervisorAdminNegativeTestJSON-726648537 tempest-HypervisorAdminNegativeTestJSON-726648537-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac" status: 404 len: 123 microversion: 2.1 time: 0.011739 Aug 06 20:58:35.294793 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 811/1584] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Aug 6 20:58:35 2022] GET /compute/v2.1/os-hypervisors/ac01a3c3-9bab-42fc-af0d-bf5b2ee1d1ac => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:35.311183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:35.311824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:35.327573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:35.328319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:35.328944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:35.329829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:35.331924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:35.332552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:35.825231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:35.837277 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8e6850ff-1bbc-493f-84ea-62d28c6ab0e6 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1469 microversion: 2.1 time: 0.539067 Aug 06 20:58:35.837915 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 812/1585] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:35 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1469 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:35.850519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-16031719-5dca-432f-b114-b2efe072dd66 req-bd2c122e-4008-4d95-874d-8d7a318632b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0a6060-3d45-4cc6-bd81-528b40dbb976", "name": "network-vif-unplugged", "status": "completed", "tag": "c8556477-5b67-40f9-bd2e-4a17626d6a2f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:35.875565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-16031719-5dca-432f-b114-b2efe072dd66 req-bd2c122e-4008-4d95-874d-8d7a318632b4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:35.880267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-16031719-5dca-432f-b114-b2efe072dd66 req-bd2c122e-4008-4d95-874d-8d7a318632b4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:35.881429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-16031719-5dca-432f-b114-b2efe072dd66 req-bd2c122e-4008-4d95-874d-8d7a318632b4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:35.919032 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-16031719-5dca-432f-b114-b2efe072dd66 req-bd2c122e-4008-4d95-874d-8d7a318632b4 service nova] Creating event network-vif-unplugged:c8556477-5b67-40f9-bd2e-4a17626d6a2f for instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 on nch2-master-1 Aug 06 20:58:35.932032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-16031719-5dca-432f-b114-b2efe072dd66 req-bd2c122e-4008-4d95-874d-8d7a318632b4 service nova] Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:58:35.970151 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-16031719-5dca-432f-b114-b2efe072dd66 req-bd2c122e-4008-4d95-874d-8d7a318632b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126141 Aug 06 20:58:35.971360 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 813/1586] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:35.982680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9677024c-e3ab-49fc-8f32-66a86e14f1a3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d9b48b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:37.471865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:58:37.473340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:58:37.473998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:58:37.474616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:58:37.475207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:58:37.505658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:37.506175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:37.506839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:37.507770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:37.508397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:37.509953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:37.536287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Getting quotas for project 710cf2b1bc504e8090132ca97890a791. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:37.546149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Getting quotas for user 91d180c9584c49b296a1db51fbe50694 and project 710cf2b1bc504e8090132ca97890a791. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:37.576426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:58:37.585964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:58:37.660152 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9677024c-e3ab-49fc-8f32-66a86e14f1a3 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/0f280511-90ed-46a2-908b-74fbf61139e1" status: 202 len: 0 microversion: 2.1 time: 1.687375 Aug 06 20:58:37.660869 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 814/1587] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:35 2022] DELETE /compute/v2.1/os-security-groups/0f280511-90ed-46a2-908b-74fbf61139e1 => generated 0 bytes in 1689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:37.666112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15e495d0-4faa-49aa-99e5-7d3186512455 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729da1f5e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:37.667264 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d6e20145-2517-4eb1-aa4a-77d6f9a5804f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.348181 Aug 06 20:58:37.669303 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 774/1588] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:58:37.681839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:37.682860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:37.690894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:37.693622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:37.694266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:37.700147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:37.700849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:37.701484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:37.813898 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15e495d0-4faa-49aa-99e5-7d3186512455 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.133178 Aug 06 20:58:37.815207 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 815/1589] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:37 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:37.820198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:37.832302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:37.864102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:37.883558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:37.887417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:37.893507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:37.894152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:37.903280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.171631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:38.208663 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eae8fe4a-8534-4217-9555-d0f6267a96e3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1477 microversion: 2.1 time: 0.538014 Aug 06 20:58:38.211436 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 775/1590] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:37 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1477 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:38.225464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0cbc3ab5-2b71-4eea-82aa-966642339b7b req-219d1c79-d79e-438b-ae70-cf4ddf40912b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f1e6bd-79f0-4d0a-88db-fbcc77835370", "name": "network-vif-deleted", "tag": "e9b8c1ec-2928-4f49-b70e-b639f643a169"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:38.247712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:38.252070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0cbc3ab5-2b71-4eea-82aa-966642339b7b req-219d1c79-d79e-438b-ae70-cf4ddf40912b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:38.252857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0cbc3ab5-2b71-4eea-82aa-966642339b7b req-219d1c79-d79e-438b-ae70-cf4ddf40912b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:38.253704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0cbc3ab5-2b71-4eea-82aa-966642339b7b req-219d1c79-d79e-438b-ae70-cf4ddf40912b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.266448 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b8aa0a57-7711-4ca5-a614-fd7e8a8eb613 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1470 microversion: 2.1 time: 0.449733 Aug 06 20:58:38.267686 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 816/1591] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:37 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:38.274388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:38.275807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:38.284567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:38.285712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:38.286675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.288196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:38.288894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:38.289914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.314189 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0cbc3ab5-2b71-4eea-82aa-966642339b7b req-219d1c79-d79e-438b-ae70-cf4ddf40912b service nova] Creating event network-vif-deleted:e9b8c1ec-2928-4f49-b70e-b639f643a169 for instance f2f1e6bd-79f0-4d0a-88db-fbcc77835370 on nch2-master-1 Aug 06 20:58:38.326277 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0cbc3ab5-2b71-4eea-82aa-966642339b7b req-219d1c79-d79e-438b-ae70-cf4ddf40912b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112550 Aug 06 20:58:38.328474 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 776/1592] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:38.342949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:38.344017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:38.365410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:38.366992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:38.370344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.371179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:38.372515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lazy-loading 'fault' on Instance uuid f2f1e6bd-79f0-4d0a-88db-fbcc77835370 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:58:38.373972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:38.374693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.379327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:38.381319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:38.384716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.457080 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 HTTP/1.1 Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:38.462242 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.464029 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '8c18108b-a584-4fe0-a1a1-e7f7eb300922'} Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:38.465714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.467515 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.469072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:38.469918 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a4fbd347-3802-46f7-96c3-2fe7c97915ee tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 404 len: 111 microversion: 2.1 time: 0.140208 Aug 06 20:58:38.471410 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 777/1593] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:58:38 2022] DELETE /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:38.498622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d830d83-0c27-4733-b4d6-01f2642cf9fd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:38.501249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7d830d83-0c27-4733-b4d6-01f2642cf9fd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:38.531668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad26fc0c618f4a548c64863f640dcf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9129b06bfc47457c954b8c5af61bdb7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:38.556908 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d07b5a09-ad87-465b-b0fd-f0ae4d733a23 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 200 len: 1304 microversion: 2.1 time: 0.286561 Aug 06 20:58:38.560428 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 817/1594] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:38 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 1304 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:38.595619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e0d9d028-e408-4f1f-a04b-7f3bd8337728 req-4d6624a6-d63c-4c88-8142-e185e7d22f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0a6060-3d45-4cc6-bd81-528b40dbb976", "tag": "c8556477-5b67-40f9-bd2e-4a17626d6a2f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:38.630872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e0d9d028-e408-4f1f-a04b-7f3bd8337728 req-4d6624a6-d63c-4c88-8142-e185e7d22f05 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:38.631181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e0d9d028-e408-4f1f-a04b-7f3bd8337728 req-4d6624a6-d63c-4c88-8142-e185e7d22f05 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:38.631624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e0d9d028-e408-4f1f-a04b-7f3bd8337728 req-4d6624a6-d63c-4c88-8142-e185e7d22f05 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.682627 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e0d9d028-e408-4f1f-a04b-7f3bd8337728 req-4d6624a6-d63c-4c88-8142-e185e7d22f05 service nova] Creating event network-changed:c8556477-5b67-40f9-bd2e-4a17626d6a2f for instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 on nch2-master-1 Aug 06 20:58:38.699385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-e0d9d028-e408-4f1f-a04b-7f3bd8337728 req-4d6624a6-d63c-4c88-8142-e185e7d22f05 service nova] Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 20:58:38.734973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e0d9d028-e408-4f1f-a04b-7f3bd8337728 req-4d6624a6-d63c-4c88-8142-e185e7d22f05 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170866 Aug 06 20:58:38.747002 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 818/1595] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:38.769566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:38.771810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 8c18108b-a584-4fe0-a1a1-e7f7eb300922] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:38.804115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7d830d83-0c27-4733-b4d6-01f2642cf9fd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:38.817052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:38.819286 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d830d83-0c27-4733-b4d6-01f2642cf9fd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1212 microversion: 2.1 time: 0.336635 Aug 06 20:58:38.820241 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 778/1596] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:38 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1212 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:38.821207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:38.828120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.839245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:38.848998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:38.850645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:38.863810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30a97582-28c6-4156-ae96-689113d6a0aa tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d776670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:38.927780 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 HTTP/1.1 Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:58:38.937871 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.939565 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '8c18108b-a584-4fe0-a1a1-e7f7eb300922'} Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:38.940457 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. Aug 06 20:58:38.941980 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:38.943238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Instance 8c18108b-a584-4fe0-a1a1-e7f7eb300922 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:38.945213 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-508134f8-d6f6-43b6-bb8f-6f63e5e33f3e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922" status: 404 len: 111 microversion: 2.1 time: 0.193905 Aug 06 20:58:38.951010 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 819/1597] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:38 2022] GET /compute/v2.1/servers/8c18108b-a584-4fe0-a1a1-e7f7eb300922 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:38.974233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-05f4fe4d-a297-4a60-b363-5d34d90c2e95 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d9b4f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:39.006024 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-30a97582-28c6-4156-ae96-689113d6a0aa tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.163445 Aug 06 20:58:39.008876 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 779/1598] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:38 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:39.172095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-05f4fe4d-a297-4a60-b363-5d34d90c2e95 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f865725e-3a8d-4e44-b8a0-945ff17e8845 does not exist", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:58:39.172720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.security_group_api [None req-05f4fe4d-a297-4a60-b363-5d34d90c2e95 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group f865725e-3a8d-4e44-b8a0-945ff17e8845 not found {{(pid=142462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:58:39.173264 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-05f4fe4d-a297-4a60-b363-5d34d90c2e95 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group f865725e-3a8d-4e44-b8a0-945ff17e8845 does not exist Aug 06 20:58:39.173264 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-2c6369ae-a3bd-4ba1-89ed-6dd03278ea9b'] Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-05f4fe4d-a297-4a60-b363-5d34d90c2e95 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-security-groups/f865725e-3a8d-4e44-b8a0-945ff17e8845 HTTP/1.1 Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:58:39.175157 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: exception: Security group f865725e-3a8d-4e44-b8a0-945ff17e8845 does not exist Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-2c6369ae-a3bd-4ba1-89ed-6dd03278ea9b'] Aug 06 20:58:39.177294 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'f865725e-3a8d-4e44-b8a0-945ff17e8845'} Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.178384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f865725e-3a8d-4e44-b8a0-945ff17e8845 does not exist Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c6369ae-a3bd-4ba1-89ed-6dd03278ea9b'] Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:58:39.180364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f865725e-3a8d-4e44-b8a0-945ff17e8845 does not exist Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c6369ae-a3bd-4ba1-89ed-6dd03278ea9b'] Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f865725e-3a8d-4e44-b8a0-945ff17e8845 does not exist Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c6369ae-a3bd-4ba1-89ed-6dd03278ea9b'] Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.181913 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f865725e-3a8d-4e44-b8a0-945ff17e8845 does not exist Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c6369ae-a3bd-4ba1-89ed-6dd03278ea9b'] Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-05f4fe4d-a297-4a60-b363-5d34d90c2e95 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group f865725e-3a8d-4e44-b8a0-945ff17e8845 does not exist Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-2c6369ae-a3bd-4ba1-89ed-6dd03278ea9b'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:39.184164 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-05f4fe4d-a297-4a60-b363-5d34d90c2e95 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f865725e-3a8d-4e44-b8a0-945ff17e8845" status: 404 len: 194 microversion: 2.1 time: 0.221561 Aug 06 20:58:39.186920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e92e17c0-2d18-4b75-bd60-680079e1fe07 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d6f03a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:39.191958 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 820/1599] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:38 2022] DELETE /compute/v2.1/os-security-groups/f865725e-3a8d-4e44-b8a0-945ff17e8845 => generated 194 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:39.235333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:39.236157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:39.257459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:39.257965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:39.258414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:39.259176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:39.259646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:39.260081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:39.316807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-e92e17c0-2d18-4b75-bd60-680079e1fe07 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 does not exist", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:58:39.318100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.security_group_api [None req-e92e17c0-2d18-4b75-bd60-680079e1fe07 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 not found {{(pid=142461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:58:39.318681 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-e92e17c0-2d18-4b75-bd60-680079e1fe07 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 does not exist Aug 06 20:58:39.318681 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-dc85fd95-5fe4-4074-8d64-0d30d77879a6'] Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e92e17c0-2d18-4b75-bd60-680079e1fe07 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-security-groups/9b710b39-c9c8-4e79-95de-59492c6e46e2 HTTP/1.1 Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:39.321189 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: exception: Security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 does not exist Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-dc85fd95-5fe4-4074-8d64-0d30d77879a6'] Aug 06 20:58:39.322757 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '9b710b39-c9c8-4e79-95de-59492c6e46e2'} Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.323773 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 does not exist Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc85fd95-5fe4-4074-8d64-0d30d77879a6'] Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:58:39.325151 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 does not exist Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc85fd95-5fe4-4074-8d64-0d30d77879a6'] Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 does not exist Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc85fd95-5fe4-4074-8d64-0d30d77879a6'] Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.326419 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 does not exist Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc85fd95-5fe4-4074-8d64-0d30d77879a6'] Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e92e17c0-2d18-4b75-bd60-680079e1fe07 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group 9b710b39-c9c8-4e79-95de-59492c6e46e2 does not exist Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-dc85fd95-5fe4-4074-8d64-0d30d77879a6'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e92e17c0-2d18-4b75-bd60-680079e1fe07 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9b710b39-c9c8-4e79-95de-59492c6e46e2" status: 404 len: 194 microversion: 2.1 time: 0.140747 Aug 06 20:58:39.327945 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 780/1600] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:39 2022] DELETE /compute/v2.1/os-security-groups/9b710b39-c9c8-4e79-95de-59492c6e46e2 => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:39.341837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:39.342468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:39.387386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:39.388034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:39.388485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:39.407468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:39.407883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:39.415386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:39.825008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:39.835000 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-81118cff-c1fc-435b-8676-d48d8e02bac4 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1463 microversion: 2.1 time: 0.506947 Aug 06 20:58:39.835590 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 781/1601] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:39 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1463 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:39.858356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-acd181ba-f502-45e9-a9b6-9ecaf877b699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d776af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:39.924892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-acd181ba-f502-45e9-a9b6-9ecaf877b699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:58:39.925506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.security_group_api [None req-acd181ba-f502-45e9-a9b6-9ecaf877b699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group 16e881c9-fd13-4f3a-848d-de6899b051e4 not found {{(pid=142461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:58:39.926036 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-acd181ba-f502-45e9-a9b6-9ecaf877b699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:58:39.926036 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-fc5b3ebd-bdf7-42c6-a345-4d272833602b'] Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-acd181ba-f502-45e9-a9b6-9ecaf877b699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-security-groups/16e881c9-fd13-4f3a-848d-de6899b051e4 HTTP/1.1 Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:39.935885 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: exception: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-fc5b3ebd-bdf7-42c6-a345-4d272833602b'] Aug 06 20:58:39.937337 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '16e881c9-fd13-4f3a-848d-de6899b051e4'} Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.938258 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc5b3ebd-bdf7-42c6-a345-4d272833602b'] Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:58:39.940241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc5b3ebd-bdf7-42c6-a345-4d272833602b'] Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc5b3ebd-bdf7-42c6-a345-4d272833602b'] Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.944089 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc5b3ebd-bdf7-42c6-a345-4d272833602b'] Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-acd181ba-f502-45e9-a9b6-9ecaf877b699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group 16e881c9-fd13-4f3a-848d-de6899b051e4 does not exist Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-fc5b3ebd-bdf7-42c6-a345-4d272833602b'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-acd181ba-f502-45e9-a9b6-9ecaf877b699 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/16e881c9-fd13-4f3a-848d-de6899b051e4" status: 404 len: 194 microversion: 2.1 time: 0.100912 Aug 06 20:58:39.948260 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 782/1602] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:39 2022] DELETE /compute/v2.1/os-security-groups/16e881c9-fd13-4f3a-848d-de6899b051e4 => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:39.965041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:39.968246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] [instance: f2f1e6bd-79f0-4d0a-88db-fbcc77835370] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:40.003264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:40.004306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:40.006210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:40.008224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:40.009755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:40.012133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:40.062951 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] HTTP exception thrown: Instance f2f1e6bd-79f0-4d0a-88db-fbcc77835370 could not be found. Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Request method failure captured: Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 HTTP/1.1 Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tXaTE0QBLKrktEtNi9FmKs6-V7RiwEVEmFbNk5ORze9YTp40Nm34MS7lazLyLRlsSdMMoBCnZHJz0LUGUQOWzfjxGIIDMsY_avn2ThXdaK861emqplaabc8GQVJoDhnAygxVT73wL-bDtLcbagBWnJllEpkoiR3Gy-nXSwOCQPRv2I Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 9129b06bfc47457c954b8c5af61bdb7e Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TenantUsagesTestJSON-47358237 Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:40.065682 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9129b06bfc47457c954b8c5af61bdb7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9129b06bfc47457c954b8c5af61bdb7e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9129b06bfc47457c954b8c5af61bdb7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9129b06bfc47457c954b8c5af61bdb7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TenantUsagesTestJSON-47358237 Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 9129b06bfc47457c954b8c5af61bdb7e Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TenantUsagesTestJSON-47358237 Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TenantUsagesTestJSON-47358237-project Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: ad26fc0c618f4a548c64863f640dcf95 Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TenantUsagesTestJSON-47358237-project Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance f2f1e6bd-79f0-4d0a-88db-fbcc77835370 could not be found. Aug 06 20:58:40.067295 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'f2f1e6bd-79f0-4d0a-88db-fbcc77835370'} Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f1e6bd-79f0-4d0a-88db-fbcc77835370 could not be found. Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:40.068422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f1e6bd-79f0-4d0a-88db-fbcc77835370 could not be found. Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f1e6bd-79f0-4d0a-88db-fbcc77835370 could not be found. Aug 06 20:58:40.070612 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.082404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] Returning 404 to user: Instance f2f1e6bd-79f0-4d0a-88db-fbcc77835370 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:40.083384 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92f603ba-f92c-4f3b-8bb4-f2a1f62b7632 tempest-TenantUsagesTestJSON-47358237 tempest-TenantUsagesTestJSON-47358237-project] 10.222.0.33 "GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370" status: 404 len: 111 microversion: 2.1 time: 0.135172 Aug 06 20:58:40.094058 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 783/1603] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:39 2022] GET /compute/v2.1/servers/f2f1e6bd-79f0-4d0a-88db-fbcc77835370 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:40.127465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:40.128240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:40.163711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:40.164222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:40.164943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:40.165672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:40.180826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:40.183745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:40.389335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:40.393134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:40.406835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:40.425381 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-73086028-40ce-428a-ab22-835009420766 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1272 microversion: 2.1 time: 0.324662 Aug 06 20:58:40.426727 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 784/1604] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:40 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1272 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:40.428759 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4816a6f4-077b-40eb-8060-572c8d4e93b8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1477 microversion: 2.1 time: 1.197947 Aug 06 20:58:40.429358 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 821/1605] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:39 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1477 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:40.437962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-390a9462-491c-4e90-ab4e-4b54f1f91f8a tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:40.444345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-390a9462-491c-4e90-ab4e-4b54f1f91f8a tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:40.446080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-507e86e3-0862-4b22-9453-39d525cb39b6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d8c4550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:40.468624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390a9462-491c-4e90-ab4e-4b54f1f91f8a tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:40.470802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390a9462-491c-4e90-ab4e-4b54f1f91f8a tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:40.473031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390a9462-491c-4e90-ab4e-4b54f1f91f8a tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:40.477333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390a9462-491c-4e90-ab4e-4b54f1f91f8a tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:40.482716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390a9462-491c-4e90-ab4e-4b54f1f91f8a tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:40.485142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390a9462-491c-4e90-ab4e-4b54f1f91f8a tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:40.885960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:40.930133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-507e86e3-0862-4b22-9453-39d525cb39b6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:58:40.931096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.security_group_api [None req-507e86e3-0862-4b22-9453-39d525cb39b6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group 4228a6b7-2f0d-4aac-847f-6a54991745ef not found {{(pid=142462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:58:40.931877 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-507e86e3-0862-4b22-9453-39d525cb39b6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:58:40.931877 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-e9f06c35-60a7-44c7-b024-9eb6db53bb04'] Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-507e86e3-0862-4b22-9453-39d525cb39b6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-security-groups/4228a6b7-2f0d-4aac-847f-6a54991745ef HTTP/1.1 Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:58:40.934358 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: exception: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-e9f06c35-60a7-44c7-b024-9eb6db53bb04'] Aug 06 20:58:40.935775 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4228a6b7-2f0d-4aac-847f-6a54991745ef'} Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:40.936618 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9f06c35-60a7-44c7-b024-9eb6db53bb04'] Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:58:40.937808 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9f06c35-60a7-44c7-b024-9eb6db53bb04'] Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9f06c35-60a7-44c7-b024-9eb6db53bb04'] Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.939431 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:40.940762 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:40.940762 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:40.940762 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:40.940762 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:40.940762 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:58:40.940762 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9f06c35-60a7-44c7-b024-9eb6db53bb04'] Aug 06 20:58:40.940762 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:40.942369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-507e86e3-0862-4b22-9453-39d525cb39b6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group 4228a6b7-2f0d-4aac-847f-6a54991745ef does not exist Aug 06 20:58:40.942369 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-e9f06c35-60a7-44c7-b024-9eb6db53bb04'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:40.943587 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-507e86e3-0862-4b22-9453-39d525cb39b6 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4228a6b7-2f0d-4aac-847f-6a54991745ef" status: 404 len: 194 microversion: 2.1 time: 0.509709 Aug 06 20:58:40.944843 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 822/1606] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:40 2022] DELETE /compute/v2.1/os-security-groups/4228a6b7-2f0d-4aac-847f-6a54991745ef => generated 194 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:40.955766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f56d0445-f5d0-4104-b94b-5729f8623d5b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d8cc280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:41.060188 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f56d0445-f5d0-4104-b94b-5729f8623d5b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.113948 Aug 06 20:58:41.062000 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 823/1607] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:40 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:41.069938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3f640e3-a4f3-42d7-9c26-cc747e6d06df tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d8c4790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:41.218364 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-390a9462-491c-4e90-ab4e-4b54f1f91f8a tempest-MigrationsAdminTest-438348689 tempest-MigrationsAdminTest-438348689-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1614 microversion: 2.1 time: 0.788554 Aug 06 20:58:41.223009 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 785/1608] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:40 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1614 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:41.252564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:41.254181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:41.278735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:41.281443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:41.282007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:41.287175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:41.288974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:41.293674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:41.408351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:58:41.441229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-b3f640e3-a4f3-42d7-9c26-cc747e6d06df tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:58:41.443095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.security_group_api [None req-b3f640e3-a4f3-42d7-9c26-cc747e6d06df tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b not found {{(pid=142462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:58:41.444186 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b3f640e3-a4f3-42d7-9c26-cc747e6d06df tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:58:41.444186 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-731fb12d-77f7-4644-bfa7-4938b7aa948e'] Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3f640e3-a4f3-42d7-9c26-cc747e6d06df tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-security-groups/5ffcc428-a1f2-42cb-8792-7d0595852b5b HTTP/1.1 Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:58:41.447417 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: exception: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-731fb12d-77f7-4644-bfa7-4938b7aa948e'] Aug 06 20:58:41.449651 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '5ffcc428-a1f2-42cb-8792-7d0595852b5b'} Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.450654 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731fb12d-77f7-4644-bfa7-4938b7aa948e'] Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:58:41.451950 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731fb12d-77f7-4644-bfa7-4938b7aa948e'] Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731fb12d-77f7-4644-bfa7-4938b7aa948e'] Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.453303 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:41.454845 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:41.454845 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:41.454845 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:41.454845 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:41.454845 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:58:41.454845 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-731fb12d-77f7-4644-bfa7-4938b7aa948e'] Aug 06 20:58:41.454845 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.456631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3f640e3-a4f3-42d7-9c26-cc747e6d06df tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group 5ffcc428-a1f2-42cb-8792-7d0595852b5b does not exist Aug 06 20:58:41.456631 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-731fb12d-77f7-4644-bfa7-4938b7aa948e'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:41.457869 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b3f640e3-a4f3-42d7-9c26-cc747e6d06df tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5ffcc428-a1f2-42cb-8792-7d0595852b5b" status: 404 len: 194 microversion: 2.1 time: 0.394742 Aug 06 20:58:41.458681 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 824/1609] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:41 2022] DELETE /compute/v2.1/os-security-groups/5ffcc428-a1f2-42cb-8792-7d0595852b5b => generated 194 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:41.472249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:41.473465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:41.496379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:41.508155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:41.512054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:41.513068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:41.516726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:41.517386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:41.735164 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7ca34903-5747-44ad-b7ed-71503e2c8e48 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 204 len: 0 microversion: 2.1 time: 0.486163 Aug 06 20:58:41.740005 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 786/1610] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:58:41 2022] DELETE /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:41.759274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:41.760363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:41.785247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:41.789021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:41.793400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:41.794469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:41.796786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:41.799258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:41.800291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:41.804637 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dd4fce88-a461-4f7d-b843-3ea20cd0bf04 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1270 microversion: 2.1 time: 0.341439 Aug 06 20:58:41.807606 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 825/1611] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:41 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1270 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:41.818653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-774a40d4-3b24-4fa4-900f-e9c21433fa82 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d8c4550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:41.958735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-774a40d4-3b24-4fa4-900f-e9c21433fa82 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 20:58:41.965006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.security_group_api [None req-774a40d4-3b24-4fa4-900f-e9c21433fa82 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Neutron security group 7def743e-bd9e-4e67-86d9-888aa57d4929 not found {{(pid=142462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 20:58:41.965785 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-774a40d4-3b24-4fa4-900f-e9c21433fa82 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:58:41.965785 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-7567b611-fdba-41dd-87a6-2b334ed695c2'] Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-774a40d4-3b24-4fa4-900f-e9c21433fa82 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929 HTTP/1.1 Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:58:41.969939 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: exception: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-7567b611-fdba-41dd-87a6-2b334ed695c2'] Aug 06 20:58:41.971638 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7def743e-bd9e-4e67-86d9-888aa57d4929'} Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.972614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7567b611-fdba-41dd-87a6-2b334ed695c2'] Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 20:58:41.973993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7567b611-fdba-41dd-87a6-2b334ed695c2'] Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7567b611-fdba-41dd-87a6-2b334ed695c2'] Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.975335 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7567b611-fdba-41dd-87a6-2b334ed695c2'] Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-774a40d4-3b24-4fa4-900f-e9c21433fa82 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Security group 7def743e-bd9e-4e67-86d9-888aa57d4929 does not exist Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-7567b611-fdba-41dd-87a6-2b334ed695c2'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:41.976863 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-774a40d4-3b24-4fa4-900f-e9c21433fa82 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929" status: 404 len: 194 microversion: 2.1 time: 0.163145 Aug 06 20:58:41.980452 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 826/1612] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:41 2022] DELETE /compute/v2.1/os-security-groups/7def743e-bd9e-4e67-86d9-888aa57d4929 => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:42.000821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:42.001477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:42.029099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:42.032126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:42.034633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:42.038421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:42.040979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:42.041463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:42.165420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:42.181367 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-77930ee7-7519-4314-a6bf-8159827b79be tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1477 microversion: 2.1 time: 0.442885 Aug 06 20:58:42.187795 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 787/1613] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:41 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1477 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:42.200594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:42.204316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:42.218114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:42.219149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:42.220344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:42.221487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:42.222108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:42.222733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:42.288234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:58:42.467765 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-95d7eedc-52a5-4692-b1ad-7b0085215cc5 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 204 len: 0 microversion: 2.1 time: 0.278397 Aug 06 20:58:42.468430 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 788/1614] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:58:42 2022] DELETE /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:42.490990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c13d0a2-b202-4c84-bd93-808ab69632a5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d76d040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:42.610671 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3c13d0a2-b202-4c84-bd93-808ab69632a5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.138429 Aug 06 20:58:42.629213 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 789/1615] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:42 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:42.641061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e2229654-f7f9-4336-aa31-28da96d16ab2 req-ffcc43a4-97c7-4963-96cd-13140f2a258f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d99126-c9b5-4b1e-8bb6-92dc1dd048da", "name": "network-vif-unplugged", "status": "completed", "tag": "7aebd8b0-07de-4d6e-88bc-b0ebb90332e3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:42.700671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e2229654-f7f9-4336-aa31-28da96d16ab2 req-ffcc43a4-97c7-4963-96cd-13140f2a258f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:42.701892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e2229654-f7f9-4336-aa31-28da96d16ab2 req-ffcc43a4-97c7-4963-96cd-13140f2a258f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:42.701892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e2229654-f7f9-4336-aa31-28da96d16ab2 req-ffcc43a4-97c7-4963-96cd-13140f2a258f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:42.745456 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e2229654-f7f9-4336-aa31-28da96d16ab2 req-ffcc43a4-97c7-4963-96cd-13140f2a258f service nova] Creating event network-vif-unplugged:7aebd8b0-07de-4d6e-88bc-b0ebb90332e3 for instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da on nch1-master-1 Aug 06 20:58:42.755414 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e2229654-f7f9-4336-aa31-28da96d16ab2 req-ffcc43a4-97c7-4963-96cd-13140f2a258f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124094 Aug 06 20:58:42.762182 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 790/1616] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:42.787381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:42.788321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:42.815670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:42.821733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:42.822299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:42.830895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:42.831415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:42.831943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:42.849284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:42.863283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:42.880865 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bb530847-d09d-42a3-8cf8-301823d5b66f tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1469 microversion: 2.1 time: 0.899319 Aug 06 20:58:42.881463 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 827/1617] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:41 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1469 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:42.900383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:42.901028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:42.927643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:42.928125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:42.928570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:42.940171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:42.940171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:42.940171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:43.130676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:43.144157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3b3001b1-9034-498d-9e20-da9430c7d26e tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1647 microversion: 2.1 time: 0.380425 Aug 06 20:58:43.148115 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 791/1618] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:42 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1647 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:43.211229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:43.212177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:43.221999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:43.223568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:43.224179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:43.225623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:43.226395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:43.227129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:43.338033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:43.349648 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f0431fbd-82e2-48b2-b320-6e54e99babc4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1312 microversion: 2.1 time: 0.460494 Aug 06 20:58:43.356685 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 828/1619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:42 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1312 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:43.593993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:43.606982 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02cfb60f-c0ee-43d3-875c-6ce773845491 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1477 microversion: 2.1 time: 0.402064 Aug 06 20:58:43.609030 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 792/1620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:43 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1477 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:43.631646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99d65fc7-3405-4163-b616-9ada84d8ff89 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729ef86c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:43.708462 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99d65fc7-3405-4163-b616-9ada84d8ff89 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.083343 Aug 06 20:58:43.709119 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 829/1621] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:43 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:43.906311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:43.906993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:43.917191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:43.917699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:43.918143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:43.918916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:43.919382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:43.919820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:44.178909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:44.179538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:44.196844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:44.197341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:44.197778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:44.198594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:44.199028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:44.199458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:44.370249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:44.385122 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-248ac483-c02d-4a76-b3ca-74be25824cd1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1469 microversion: 2.1 time: 0.483123 Aug 06 20:58:44.387601 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 793/1622] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:43 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1469 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:44.407622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:44.410199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:44.435196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:44.438865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:44.440178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:44.442698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:44.445894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:44.449809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:44.603220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:44.614175 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cdc62749-d953-4876-832d-8b41326b3f5a tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1647 microversion: 2.1 time: 0.444730 Aug 06 20:58:44.615330 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 830/1623] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:44 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1647 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:58:44.636502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:44.637395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:44.647647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:44.652786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:44.654293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:44.657411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:44.660245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:44.660860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:45.218645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:45.227463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:45.244180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f84e56b-a6aa-4557-82b9-ada89d99b898 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1312 microversion: 2.1 time: 0.850999 Aug 06 20:58:45.245066 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 794/1624] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:44 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1312 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:45.249835 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-18774283-d1ad-4d85-96ae-405576f76bbb tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1477 microversion: 2.1 time: 0.618195 Aug 06 20:58:45.250985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-93002503-701c-4a81-8d23-d52d1ac3babd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d7419d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:45.266621 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 831/1625] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:44 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1477 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:45.283221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-86ce2087-d010-4bfa-bcbf-6868cf6e7868 req-dcf544d5-da54-474e-ac19-adbadcd96bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0a6060-3d45-4cc6-bd81-528b40dbb976", "name": "network-vif-plugged", "status": "completed", "tag": "c8556477-5b67-40f9-bd2e-4a17626d6a2f"}, {"server_uuid": "a4d99126-c9b5-4b1e-8bb6-92dc1dd048da", "name": "network-vif-plugged", "status": "completed", "tag": "7aebd8b0-07de-4d6e-88bc-b0ebb90332e3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:45.308815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-86ce2087-d010-4bfa-bcbf-6868cf6e7868 req-dcf544d5-da54-474e-ac19-adbadcd96bab service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:45.310806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-86ce2087-d010-4bfa-bcbf-6868cf6e7868 req-dcf544d5-da54-474e-ac19-adbadcd96bab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:45.311430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-86ce2087-d010-4bfa-bcbf-6868cf6e7868 req-dcf544d5-da54-474e-ac19-adbadcd96bab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:45.354230 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-86ce2087-d010-4bfa-bcbf-6868cf6e7868 req-dcf544d5-da54-474e-ac19-adbadcd96bab service nova] Creating event network-vif-plugged:c8556477-5b67-40f9-bd2e-4a17626d6a2f for instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 on nch2-master-1 Aug 06 20:58:45.355115 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-86ce2087-d010-4bfa-bcbf-6868cf6e7868 req-dcf544d5-da54-474e-ac19-adbadcd96bab service nova] Creating event network-vif-plugged:7aebd8b0-07de-4d6e-88bc-b0ebb90332e3 for instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da on nch1-master-1 Aug 06 20:58:45.368477 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-93002503-701c-4a81-8d23-d52d1ac3babd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.121632 Aug 06 20:58:45.376164 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 795/1626] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:45 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:45.398715 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-86ce2087-d010-4bfa-bcbf-6868cf6e7868 req-dcf544d5-da54-474e-ac19-adbadcd96bab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.141390 Aug 06 20:58:45.400272 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 832/1627] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:45.414604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:45.415246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:45.437055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:45.437602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:45.438300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:45.439070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:45.439824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:45.439937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:45.638000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:45.639067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:45.673342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:45.674126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:45.674760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:45.675719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:45.676358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:45.676943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:45.857904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:45.871789 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-462f293f-7d86-459e-99ee-10e23fe9db42 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 200 len: 1427 microversion: 2.1 time: 0.460967 Aug 06 20:58:45.873049 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 796/1628] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:45 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 1427 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:46.269450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:46.270214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:46.293013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:46.293618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:46.296155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:46.299651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:46.301631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:46.302285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:46.439797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df9834cd3164d72a4bbd4d71d35df96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690e571b106a4305977f2d9166a4433e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:46.463144 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e5524c38-d51b-4e9d-90b6-e9a56da430ed tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 200 len: 1467 microversion: 2.1 time: 0.830931 Aug 06 20:58:46.477206 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 833/1629] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:45 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 1467 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:46.501475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:46.502101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:46.552202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:46.552712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:46.553166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:46.570052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:46.570599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:46.571062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:47.334779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:47.347257 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7fd65ea2-31eb-4056-83a1-2cef331247d3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1333 microversion: 2.1 time: 1.083028 Aug 06 20:58:47.348412 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 797/1630] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:46 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1333 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:47.355273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98a9e58c-d912-4f15-92db-63056fe43bad tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729dc2e1f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:47.486467 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-98a9e58c-d912-4f15-92db-63056fe43bad tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.136726 Aug 06 20:58:47.497220 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 798/1631] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:47 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:47.504623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-57220572-7705-4ad2-9c78-35af2ceb7ad0 req-fa349f0c-5913-49da-a3df-26e34adca7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fe03fb-ab4b-4c3c-b371-87fd08dc84ca", "name": "network-vif-deleted", "tag": "219bd8a1-4249-40ae-a148-22d89dd3953d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:47.529563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:47.536296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-57220572-7705-4ad2-9c78-35af2ceb7ad0 req-fa349f0c-5913-49da-a3df-26e34adca7be service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:47.540570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-57220572-7705-4ad2-9c78-35af2ceb7ad0 req-fa349f0c-5913-49da-a3df-26e34adca7be service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:47.541344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-57220572-7705-4ad2-9c78-35af2ceb7ad0 req-fa349f0c-5913-49da-a3df-26e34adca7be service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:47.560196 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-57220572-7705-4ad2-9c78-35af2ceb7ad0 req-fa349f0c-5913-49da-a3df-26e34adca7be service nova] Creating event network-vif-deleted:219bd8a1-4249-40ae-a148-22d89dd3953d for instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca on nch2-master-1 Aug 06 20:58:47.565626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-57220572-7705-4ad2-9c78-35af2ceb7ad0 req-fa349f0c-5913-49da-a3df-26e34adca7be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066888 Aug 06 20:58:47.566502 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 799/1632] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:47.572771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:47.574284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 0f0a6060-3d45-4cc6-bd81-528b40dbb976] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:47.581438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:47.582484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:47.583141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:47.584099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:47.584717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:47.585303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:47.618402 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] HTTP exception thrown: Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 could not be found. Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Request method failure captured: Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 HTTP/1.1 Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTuIKuDu4Lv3e5B0jAuqwjRbURLfKzm90zbl_YtKLbtQa1o7Ba_rdnuDGRsxkornjlyY01Qx53W5Ws0naESVIzGV7snJVOLeKYHYK19pQzlOh1mFhlnoY_Mslt6fbIBSPD3MAAjUk02IsGWnJr_vIZ_bZGmjpMwMBegpLuQEYkpx80 Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: aa51632a6bbf4d26b3db87902d6a17d2 Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MigrationsAdminTest-1631972194 Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:47.620478 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa51632a6bbf4d26b3db87902d6a17d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MigrationsAdminTest-1631972194 Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: aa51632a6bbf4d26b3db87902d6a17d2 Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MigrationsAdminTest-1631972194 Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MigrationsAdminTest-1631972194-project Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 0701f31766dd4eeab9a63f6411c26d6e Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MigrationsAdminTest-1631972194-project Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 could not be found. Aug 06 20:58:47.622163 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '0f0a6060-3d45-4cc6-bd81-528b40dbb976'} Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 could not be found. Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:47.623211 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 could not be found. Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 could not be found. Aug 06 20:58:47.624712 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.628977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Returning 404 to user: Instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:47.630034 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-778d2f59-c35b-4562-86e4-b234a0866415 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976" status: 404 len: 111 microversion: 2.1 time: 0.062250 Aug 06 20:58:47.631975 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 800/1633] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:47 2022] GET /compute/v2.1/servers/0f0a6060-3d45-4cc6-bd81-528b40dbb976 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:47.644984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:47.645895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] [instance: 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:47.661536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:47.665060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:47.665737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:47.668929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:47.671853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:47.674699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:47.730271 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] HTTP exception thrown: Instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca could not be found. Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Request method failure captured: Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca HTTP/1.1 Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWtXdRXIRDkzOBDSrGX5hBEWlkcE8R2OxIzBjpAgyigFAdsPi8sAR--D_R0VEtq-otqWDrHQJFP_Ja5J8TOQdPjxjOX4otFo1-2OJxvym7uo7iGch-OaDY0khuO-6-ZH1s89J56GiKmv_HGavM2NPshMlCQZnzI4ek8rAE3NVm9Zas Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:47.734962 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/690e571b106a4305977f2d9166a4433e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_690e571b106a4305977f2d9166a4433e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/690e571b106a4305977f2d9166a4433e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 690e571b106a4305977f2d9166a4433e Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1985739016 Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3df9834cd3164d72a4bbd4d71d35df96 Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsTestJSON-1985739016-project Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca could not be found. Aug 06 20:58:47.736723 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '83fe03fb-ab4b-4c3c-b371-87fd08dc84ca'} Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca could not be found. Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:47.737630 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca could not be found. Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca could not be found. Aug 06 20:58:47.739835 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:47.741902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Returning 404 to user: Instance 83fe03fb-ab4b-4c3c-b371-87fd08dc84ca could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:47.741902 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b75e87b8-79c2-47bf-8969-18f00e7832ad tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca" status: 404 len: 111 microversion: 2.1 time: 0.103339 Aug 06 20:58:47.741902 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 801/1634] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:47 2022] GET /compute/v2.1/servers/83fe03fb-ab4b-4c3c-b371-87fd08dc84ca => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:47.757947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:47.765559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:47.787689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:47.795366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:47.796156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:47.797123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:47.799170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:47.799872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:47.915365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:58:48.186047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:48.199740 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75ee6881-8d39-489e-8d5a-ab326eb19923 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 204 len: 0 microversion: 2.1 time: 0.452977 Aug 06 20:58:48.203713 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 802/1635] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:58:47 2022] DELETE /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:48.223475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-df90cb8e-365d-4dda-aa23-f9d6facc5c26 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d7a5280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:48.637016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:48.706781 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-807c5acf-ffae-416b-9f62-5d5616d82327 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1477 microversion: 2.1 time: 2.226372 Aug 06 20:58:48.707667 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 834/1636] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:46 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1477 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:48.770349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:48.771404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:48.789433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:48.790301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:48.793318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:48.794674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:48.795314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:48.795922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:48.812693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:49.213612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:49.227216 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b3d2eff9-b077-4731-a732-b443dbd93b36 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1534 microversion: 2.1 time: 0.514228 Aug 06 20:58:49.230859 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 835/1637] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:48 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1534 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:49.237781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:49.238845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:49.255952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:49.258385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:49.259936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:49.262266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:49.263038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:49.270442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:49.681590 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-df90cb8e-365d-4dda-aa23-f9d6facc5c26 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/564bb03a-a55a-43ba-8fd0-ae9db6245a21" status: 202 len: 0 microversion: 2.1 time: 1.476167 Aug 06 20:58:49.682186 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 803/1638] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:48 2022] DELETE /compute/v2.1/os-security-groups/564bb03a-a55a-43ba-8fd0-ae9db6245a21 => generated 0 bytes in 1478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:49.690956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7577f1c5-aa2d-4bbf-b52c-229624c0dde2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d6c4a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:49.830351 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7577f1c5-aa2d-4bbf-b52c-229624c0dde2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1412 microversion: 2.1 time: 0.146493 Aug 06 20:58:49.831411 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 804/1639] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:49 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1412 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:49.848895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-013ef116-baa0-44be-85b8-595d10b70b58 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] Calling method '.version_select at 0x7f729d6ce940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:50.055403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:50.083134 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-efd19011-6335-4b57-a2e9-3fcf068bd8f3 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 0.850675 Aug 06 20:58:50.097613 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 836/1640] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:49 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:50.103158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:50.104014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:50.122251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:50.123058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:50.123717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:50.124671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:50.125326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:50.125921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:50.454509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:50.465683 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aa897412-d822-44a8-b821-bc136cc3dda8 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1462 microversion: 2.1 time: 0.366154 Aug 06 20:58:50.468377 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 837/1641] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:50 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1462 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:50.483294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:50.484771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:50.502907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:50.504948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:50.506095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:50.507361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:50.512304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:50.513084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:51.147803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:51.172082 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36099208-ae63-4bc7-af53-04b19e370aca tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1534 microversion: 2.1 time: 0.702255 Aug 06 20:58:51.174009 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 838/1642] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:50 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1534 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:51.193967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f6858c07-12d6-42f5-b4e3-1d99665f99f4 req-61decad6-e8b6-48a7-8799-ae66ec0bc694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0a6060-3d45-4cc6-bd81-528b40dbb976", "name": "network-vif-deleted", "tag": "c8556477-5b67-40f9-bd2e-4a17626d6a2f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:51.232469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f6858c07-12d6-42f5-b4e3-1d99665f99f4 req-61decad6-e8b6-48a7-8799-ae66ec0bc694 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:51.237677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f6858c07-12d6-42f5-b4e3-1d99665f99f4 req-61decad6-e8b6-48a7-8799-ae66ec0bc694 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:51.240537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f6858c07-12d6-42f5-b4e3-1d99665f99f4 req-61decad6-e8b6-48a7-8799-ae66ec0bc694 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:51.276174 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f6858c07-12d6-42f5-b4e3-1d99665f99f4 req-61decad6-e8b6-48a7-8799-ae66ec0bc694 service nova] Creating event network-vif-deleted:c8556477-5b67-40f9-bd2e-4a17626d6a2f for instance 0f0a6060-3d45-4cc6-bd81-528b40dbb976 on nch2-master-1 Aug 06 20:58:51.287861 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f6858c07-12d6-42f5-b4e3-1d99665f99f4 req-61decad6-e8b6-48a7-8799-ae66ec0bc694 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111773 Aug 06 20:58:51.291473 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 839/1643] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:51.303336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cbe9cd65-2eb6-4c7d-887b-7ebd5b4ee68b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:51.311456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cbe9cd65-2eb6-4c7d-887b-7ebd5b4ee68b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:51.326835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbe9cd65-2eb6-4c7d-887b-7ebd5b4ee68b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:51.330322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbe9cd65-2eb6-4c7d-887b-7ebd5b4ee68b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:51.331179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbe9cd65-2eb6-4c7d-887b-7ebd5b4ee68b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:51.332364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbe9cd65-2eb6-4c7d-887b-7ebd5b4ee68b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:51.334377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbe9cd65-2eb6-4c7d-887b-7ebd5b4ee68b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:51.336354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbe9cd65-2eb6-4c7d-887b-7ebd5b4ee68b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:51.534918 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cbe9cd65-2eb6-4c7d-887b-7ebd5b4ee68b tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action" status: 202 len: 0 microversion: 2.1 time: 0.240427 Aug 06 20:58:51.535903 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 840/1644] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:58:51 2022] POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:51.543209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4e6799c5-2ce0-4608-8fab-31e7b53432f7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729da1f430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:51.644186 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4e6799c5-2ce0-4608-8fab-31e7b53432f7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1421 microversion: 2.1 time: 0.106908 Aug 06 20:58:51.644716 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 841/1645] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:51 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:51.658622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:51.670168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:51.687923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:51.693262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:51.694040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:51.694791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:51.695774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:51.696596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:51.865124 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-013ef116-baa0-44be-85b8-595d10b70b58 tempest-SecurityGroupsTestJSON-1985739016 tempest-SecurityGroupsTestJSON-1985739016-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/40e04532-23c2-4bf6-b215-f7328a78a10b" status: 202 len: 0 microversion: 2.1 time: 2.031404 Aug 06 20:58:51.868420 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 805/1646] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 20:58:49 2022] DELETE /compute/v2.1/os-security-groups/40e04532-23c2-4bf6-b215-f7328a78a10b => generated 0 bytes in 2036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:51.880919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:51.884004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:51.895505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:51.896591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:51.897212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:51.898108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:51.898982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:51.899581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:51.976659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:51.977659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:51.978327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:51.979921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lazy-loading 'fault' on Instance uuid a4d99126-c9b5-4b1e-8bb6-92dc1dd048da {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:58:52.423277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:52.434050 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3819b6a9-aff2-4d4d-a373-f8b80f0b71aa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 0.785969 Aug 06 20:58:52.463030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 842/1647] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:51 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:52.475377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-490d217e-84d0-4de5-b101-3a244f1aa20e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d869af0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:52.627547 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-490d217e-84d0-4de5-b101-3a244f1aa20e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 200 len: 1421 microversion: 2.1 time: 0.160759 Aug 06 20:58:52.631355 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 843/1648] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:58:52 2022] GET /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 1421 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:52.645955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:52.662978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:52.716369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:52.718634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:52.720221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:52.721454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:52.721995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:52.722730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:52.780349 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-544ac6be-fed2-4293-988c-f3c9cfe9b646 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1596 microversion: 2.1 time: 0.909760 Aug 06 20:58:52.780963 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 806/1649] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:51 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1596 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:52.803789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-045f20b6-7613-47e7-9738-b05fd8c41af6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d6cec10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:52.852597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:52.853806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:52.856440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:52.857302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lazy-loading 'fault' on Instance uuid 73a7adc6-d32c-4d2b-84be-536c9aebe878 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:58:53.066703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:53.077685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:53.110206 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ead7a3d4-9a8e-48a3-b6a5-a50d507f56c0 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 200 len: 1368 microversion: 2.1 time: 0.476370 Aug 06 20:58:53.130083 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 844/1650] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:52 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 1368 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:53.173308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac4a67df-a2b5-4e6c-8371-a204702172a7 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:53.191717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ac4a67df-a2b5-4e6c-8371-a204702172a7 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:53.239302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac4a67df-a2b5-4e6c-8371-a204702172a7 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:53.239989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac4a67df-a2b5-4e6c-8371-a204702172a7 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:53.240839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac4a67df-a2b5-4e6c-8371-a204702172a7 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:53.241893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac4a67df-a2b5-4e6c-8371-a204702172a7 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:53.242554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac4a67df-a2b5-4e6c-8371-a204702172a7 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:53.243173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac4a67df-a2b5-4e6c-8371-a204702172a7 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:53.514978 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac4a67df-a2b5-4e6c-8371-a204702172a7 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action" status: 202 len: 0 microversion: 2.1 time: 0.387148 Aug 06 20:58:53.517251 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 845/1651] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:58:53 2022] POST /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:53.540603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e43f7c10-1a22-4920-8752-8ec9a6eb957d req-e707b248-1039-482a-babc-2b63b3f73ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a7adc6-d32c-4d2b-84be-536c9aebe878", "name": "network-vif-deleted", "tag": "397efc42-e695-4b22-a223-76833b924b55"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:53.565749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e43f7c10-1a22-4920-8752-8ec9a6eb957d req-e707b248-1039-482a-babc-2b63b3f73ede service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:53.566764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e43f7c10-1a22-4920-8752-8ec9a6eb957d req-e707b248-1039-482a-babc-2b63b3f73ede service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:53.568339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e43f7c10-1a22-4920-8752-8ec9a6eb957d req-e707b248-1039-482a-babc-2b63b3f73ede service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:53.595149 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e43f7c10-1a22-4920-8752-8ec9a6eb957d req-e707b248-1039-482a-babc-2b63b3f73ede service nova] Creating event network-vif-deleted:397efc42-e695-4b22-a223-76833b924b55 for instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 on nch1-master-1 Aug 06 20:58:53.612582 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e43f7c10-1a22-4920-8752-8ec9a6eb957d req-e707b248-1039-482a-babc-2b63b3f73ede service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086468 Aug 06 20:58:53.614693 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 846/1652] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:53.628543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:53.633208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:53.647709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:53.650478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:53.651507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:53.659283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:53.659805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:53.660255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:54.239929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:54.251270 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c50063ea-6963-49ea-94f3-d2653567a009 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 0.633676 Aug 06 20:58:54.269564 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 847/1653] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:53 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:54.284738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-532a418d-5650-475b-a7dc-d4c28757e975 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:54.285423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-532a418d-5650-475b-a7dc-d4c28757e975 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:54.293509 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-045f20b6-7613-47e7-9738-b05fd8c41af6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 204 len: 0 microversion: 2.1 time: 1.496942 Aug 06 20:58:54.294685 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 807/1654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:52 2022] DELETE /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 0 bytes in 1499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:54.294978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-532a418d-5650-475b-a7dc-d4c28757e975 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:54.295429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-532a418d-5650-475b-a7dc-d4c28757e975 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:54.302658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:54.304410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-532a418d-5650-475b-a7dc-d4c28757e975 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:54.305464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-532a418d-5650-475b-a7dc-d4c28757e975 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:54.307411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: 73a7adc6-d32c-4d2b-84be-536c9aebe878] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:54.307955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-532a418d-5650-475b-a7dc-d4c28757e975 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:54.314584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-532a418d-5650-475b-a7dc-d4c28757e975 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:54.315438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:54.316188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:54.316916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:54.320020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:54.320987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:54.325860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:54.373577 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] HTTP exception thrown: Instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 could not be found. Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Request method failure captured: Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 HTTP/1.1 Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTuIKuDu4Lv3e5B0jAuqwjRbURLfKzm90zbl_YtKLbtQa1o7Ba_rdnuDGRsxkornjlyY01Qx53W5Ws0naESVIzGV7snJVOLeKYHYK19pQzlOh1mFhlnoY_Mslt6fbIBSPD3MAAjUk02IsGWnJr_vIZ_bZGmjpMwMBegpLuQEYkpx80 Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: aa51632a6bbf4d26b3db87902d6a17d2 Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MigrationsAdminTest-1631972194 Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:58:54.378029 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa51632a6bbf4d26b3db87902d6a17d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MigrationsAdminTest-1631972194 Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: aa51632a6bbf4d26b3db87902d6a17d2 Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MigrationsAdminTest-1631972194 Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MigrationsAdminTest-1631972194-project Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 0701f31766dd4eeab9a63f6411c26d6e Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MigrationsAdminTest-1631972194-project Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 could not be found. Aug 06 20:58:54.380031 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '73a7adc6-d32c-4d2b-84be-536c9aebe878'} Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 could not be found. Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:58:54.380845 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 could not be found. Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 could not be found. Aug 06 20:58:54.384330 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:58:54.387559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Returning 404 to user: Instance 73a7adc6-d32c-4d2b-84be-536c9aebe878 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:58:54.387559 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47c736a2-86af-44f8-86ac-dad51509d665 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878" status: 404 len: 111 microversion: 2.1 time: 0.083194 Aug 06 20:58:54.406434 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 808/1655] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:54 2022] GET /compute/v2.1/servers/73a7adc6-d32c-4d2b-84be-536c9aebe878 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:58:54.422764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-06647aa0-f4fb-491e-b950-78d5f6923e8d req-5e078b99-a766-4ccc-8247-8f6d87e22d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "tag": "8dc21a95-70aa-4653-a645-e1a636a38b15"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:54.447650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-06647aa0-f4fb-491e-b950-78d5f6923e8d req-5e078b99-a766-4ccc-8247-8f6d87e22d27 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:54.449110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-06647aa0-f4fb-491e-b950-78d5f6923e8d req-5e078b99-a766-4ccc-8247-8f6d87e22d27 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:54.449938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-06647aa0-f4fb-491e-b950-78d5f6923e8d req-5e078b99-a766-4ccc-8247-8f6d87e22d27 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:54.468060 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-06647aa0-f4fb-491e-b950-78d5f6923e8d req-5e078b99-a766-4ccc-8247-8f6d87e22d27 service nova] Creating event network-changed:8dc21a95-70aa-4653-a645-e1a636a38b15 for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:58:54.475897 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-06647aa0-f4fb-491e-b950-78d5f6923e8d req-5e078b99-a766-4ccc-8247-8f6d87e22d27 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067282 Aug 06 20:58:54.477541 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 809/1656] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:54.488556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:54.489846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:54.521361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:54.545934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:54.546811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:54.551468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:54.552244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:54.557090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:54.695461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:58:54.873582 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d5d7cee-1e50-419f-9dec-85f2031ea06b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 204 len: 0 microversion: 2.1 time: 0.392838 Aug 06 20:58:54.879108 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 810/1657] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:58:54 2022] DELETE /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:54.934385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53717a5d-9a63-4bf1-8d6f-6d4c35328564 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '.version_select at 0x7f729d78d670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:54.980951 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53717a5d-9a63-4bf1-8d6f-6d4c35328564 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417093008" status: 202 len: 0 microversion: 2.1 time: 0.099612 Aug 06 20:58:54.984910 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 811/1658] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 20:58:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417093008 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:58:55.046340 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-532a418d-5650-475b-a7dc-d4c28757e975 tempest-ServersAdminTestJSON-263644775 tempest-ServersAdminTestJSON-263644775-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1613 microversion: 2.1 time: 0.775255 Aug 06 20:58:55.047670 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 848/1659] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:54 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1613 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:55.074107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:55.074986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:55.092622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:55.106025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1979808085", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "a17c0b0a-6719-44f2-8dc6-4a0cb498bc1f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:55.107159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:55.107836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:55.108854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:55.109452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:55.111032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:55.183887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:58:55.239380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] validate_networks() for [('a17c0b0a-6719-44f2-8dc6-4a0cb498bc1f', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:58:55.347651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:55.400875 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-af4ad9ef-cc5c-44cc-834d-0a46c4561bbe tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "DELETE /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 204 len: 0 microversion: 2.1 time: 0.330899 Aug 06 20:58:55.406866 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 812/1660] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:58:55 2022] DELETE /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:58:55.414622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:55.415882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:55.424773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:55.425621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:55.426312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:55.427304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:55.429065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:55.429788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:56.344489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:56.357886 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aa0ebc38-a7fc-4a2c-94eb-947c4f86413a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 0.949320 Aug 06 20:58:56.359418 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 813/1661] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:55 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:56.377815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:56.378805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:56.386834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:56.395020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:56.395947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:56.396918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:56.397589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:56.398208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:57.461916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:57.490297 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e484db1a-4680-4c35-a6f8-85dbaf54b0dc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1468 microversion: 2.1 time: 1.115683 Aug 06 20:58:57.494046 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 814/1662] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:56 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1468 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:57.511936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-07164c11-1d46-45a6-b5f0-b2a082292090 req-8c3ca97c-b8d2-46b0-86dd-6643502e5b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27865ac3-9a8a-4568-ba57-3f022b07ba93", "name": "network-vif-unplugged", "status": "completed", "tag": "7fe99f75-e61b-480d-9d57-8f00ee43c6ca"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:57.541072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-07164c11-1d46-45a6-b5f0-b2a082292090 req-8c3ca97c-b8d2-46b0-86dd-6643502e5b44 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:57.545119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-07164c11-1d46-45a6-b5f0-b2a082292090 req-8c3ca97c-b8d2-46b0-86dd-6643502e5b44 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:57.546437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-07164c11-1d46-45a6-b5f0-b2a082292090 req-8c3ca97c-b8d2-46b0-86dd-6643502e5b44 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:57.599157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-07164c11-1d46-45a6-b5f0-b2a082292090 req-8c3ca97c-b8d2-46b0-86dd-6643502e5b44 service nova] Creating event network-vif-unplugged:7fe99f75-e61b-480d-9d57-8f00ee43c6ca for instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 on nch2-master-1 Aug 06 20:58:57.613362 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-07164c11-1d46-45a6-b5f0-b2a082292090 req-8c3ca97c-b8d2-46b0-86dd-6643502e5b44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112000 Aug 06 20:58:57.615420 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 815/1663] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:57.629907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:57.630984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:57.638975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:57.639819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:57.640432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:57.641359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:57.641988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:57.642616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:58.270345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:58:58.270903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:58:58.271372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:58:58.271798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:58:58.272230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:58:58.289580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:58.290408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:58.291079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:58.292056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:58.292871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:58.295180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:58.344255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Getting quotas for project 764e8bbcc05b47e5a647cf2a0fe82a20. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:58:58.351322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Getting quotas for user d43d0d15118242b7a60cc34c512fbe5e and project 764e8bbcc05b47e5a647cf2a0fe82a20. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:58:58.371732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:58:58.376133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:58:58.434256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:58.452398 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-45e27e17-7009-4de9-a7ec-541d1ea64bcd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 0.830996 Aug 06 20:58:58.466673 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 816/1664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:57 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:58.480791 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f5fcb13-a7d7-41e2-bc61-ec6bb0c55ccd tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.379703 Aug 06 20:58:58.482219 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 849/1665] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:58:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 20:58:58.496924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75531209-20c7-4fa5-a28f-f34e91b87e9e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:58.499091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-75531209-20c7-4fa5-a28f-f34e91b87e9e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:58.597025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f4d246eb-6817-441d-8b76-47a03b15b430 req-7850be86-ee54-4acc-a446-47c589d9b18e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "tag": "32523e6a-29b1-45e5-97ce-3f076b91af03"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:58.621020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f4d246eb-6817-441d-8b76-47a03b15b430 req-7850be86-ee54-4acc-a446-47c589d9b18e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:58.622969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f4d246eb-6817-441d-8b76-47a03b15b430 req-7850be86-ee54-4acc-a446-47c589d9b18e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:58.624070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f4d246eb-6817-441d-8b76-47a03b15b430 req-7850be86-ee54-4acc-a446-47c589d9b18e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:58.671829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-75531209-20c7-4fa5-a28f-f34e91b87e9e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:58.683498 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-75531209-20c7-4fa5-a28f-f34e91b87e9e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1208 microversion: 2.1 time: 0.193684 Aug 06 20:58:58.685878 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 850/1666] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:58 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1208 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:58:58.697681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:58.698910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:58.704578 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f4d246eb-6817-441d-8b76-47a03b15b430 req-7850be86-ee54-4acc-a446-47c589d9b18e service nova] Creating event network-changed:32523e6a-29b1-45e5-97ce-3f076b91af03 for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:58:58.717729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:58.720041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:58.720530 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f4d246eb-6817-441d-8b76-47a03b15b430 req-7850be86-ee54-4acc-a446-47c589d9b18e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251848 Aug 06 20:58:58.721862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:58.723963 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 817/1667] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:58.724170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:58.724567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:58.725010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:59.474356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:59.475320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:59.488428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:59.491319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:59.493075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:59.494699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:59.497174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:59.498775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:59.866032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:59.882222 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f4e77bfd-9cdd-4cf5-a074-066e914514bc tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1468 microversion: 2.1 time: 1.194916 Aug 06 20:58:59.882862 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 851/1668] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:58 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1468 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:00.069985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a079365f-66b4-4c26-b8b5-9b77a7e9f7e1 req-7c28fbb1-8773-4169-b662-208228c588dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27865ac3-9a8a-4568-ba57-3f022b07ba93", "name": "network-vif-deleted", "tag": "7fe99f75-e61b-480d-9d57-8f00ee43c6ca"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:00.080895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a079365f-66b4-4c26-b8b5-9b77a7e9f7e1 req-7c28fbb1-8773-4169-b662-208228c588dc service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:00.081383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a079365f-66b4-4c26-b8b5-9b77a7e9f7e1 req-7c28fbb1-8773-4169-b662-208228c588dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:00.081814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a079365f-66b4-4c26-b8b5-9b77a7e9f7e1 req-7c28fbb1-8773-4169-b662-208228c588dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:00.126787 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a079365f-66b4-4c26-b8b5-9b77a7e9f7e1 req-7c28fbb1-8773-4169-b662-208228c588dc service nova] Creating event network-vif-deleted:7fe99f75-e61b-480d-9d57-8f00ee43c6ca for instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 on nch2-master-1 Aug 06 20:59:00.183854 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a079365f-66b4-4c26-b8b5-9b77a7e9f7e1 req-7c28fbb1-8773-4169-b662-208228c588dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283195 Aug 06 20:59:00.189547 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 852/1669] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:00.221803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:00.230036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:00.269188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:00.272076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:00.274071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:00.275547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:00.277671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:00.278385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:00.574005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:00.595215 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a9e8fed7-fdb3-4d17-90f2-bd6b40c4ebf1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1260 microversion: 2.1 time: 0.402872 Aug 06 20:59:00.599128 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 853/1670] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:00 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1260 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:00.609234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:00.631919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:00.650401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:00.650970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:00.654565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:00.659041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:00.660818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:00.662511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:00.743432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:59:01.000835 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-79bc42cc-317b-4ebe-855b-8db365c859ad tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 204 len: 0 microversion: 2.1 time: 0.395184 Aug 06 20:59:01.004398 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 854/1671] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:59:00 2022] DELETE /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:59:01.012081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:01.014638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:01.029143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:01.034409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:01.034860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:01.035624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:01.036103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:01.036536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:01.138013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:01.151714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:01.156706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:01.164377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:01.165418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lazy-loading 'fault' on Instance uuid 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:59:01.285269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:01.314837 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b81b25f-a8d4-4875-8451-f7333d2c0f8f tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 200 len: 1303 microversion: 2.1 time: 0.310364 Aug 06 20:59:01.316474 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 855/1672] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:01 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 1303 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:01.337394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:01.338482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:01.353478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:01.354884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:01.356612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:01.357430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:01.358162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:01.358798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:01.783773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:01.795871 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1050bf13-b9ee-40a0-a989-e6dd04ba2e74 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 2.326141 Aug 06 20:59:01.797579 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 818/1673] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:59 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:01.806415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1270041069", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "0b16c9c9-35af-4398-8cf2-00695211de1f"}], "block_device_mapping_v2": [{"uuid": "f7a7d268-fe92-4462-a9fe-5327fe7ad7f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:01.913157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] validate_networks() for [('0b16c9c9-35af-4398-8cf2-00695211de1f', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:59:02.401883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:02.427032 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f960df12-2431-4adf-a281-f0f3c6a1bfc9 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1467 microversion: 2.1 time: 1.099417 Aug 06 20:59:02.429640 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 856/1674] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:01 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1467 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:02.440116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:02.443917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:02.470504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:02.472314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:02.474135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:02.475979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:02.477599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:02.478186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:02.906472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:02.925179 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-74845572-968f-4493-8649-b7fe4a55fda4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1266 microversion: 2.1 time: 0.494116 Aug 06 20:59:02.926508 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 857/1675] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:02 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1266 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:02.935261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-3b46c796-d22f-4e27-a12f-f92487ac25a0 req-d5898949-9fac-4a92-a955-4ca20d6e2494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "tag": "2419fafb-b718-48a6-ba44-0b7cd79a34cc"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:02.958386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3b46c796-d22f-4e27-a12f-f92487ac25a0 req-d5898949-9fac-4a92-a955-4ca20d6e2494 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:02.958949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3b46c796-d22f-4e27-a12f-f92487ac25a0 req-d5898949-9fac-4a92-a955-4ca20d6e2494 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:02.959397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3b46c796-d22f-4e27-a12f-f92487ac25a0 req-d5898949-9fac-4a92-a955-4ca20d6e2494 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:03.001679 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-3b46c796-d22f-4e27-a12f-f92487ac25a0 req-d5898949-9fac-4a92-a955-4ca20d6e2494 service nova] Creating event network-changed:2419fafb-b718-48a6-ba44-0b7cd79a34cc for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:59:03.007557 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-3b46c796-d22f-4e27-a12f-f92487ac25a0 req-d5898949-9fac-4a92-a955-4ca20d6e2494 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079587 Aug 06 20:59:03.008720 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 858/1676] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:03.014392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:03.014973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:03.031849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:03.032311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:03.032697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:03.033415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:03.047204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:03.047676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:03.080700 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] HTTP exception thrown: Instance 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 could not be found. Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Request method failure captured: Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 HTTP/1.1 Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWRvYT2XWviNz1SSvytQh75kpCwgyWuDUscgZS5z_6pdxgRz0jN-d3m5gmF4cITHl1970XUMQbXk4VlaUIJdCQdrHzoTKLIWk1hKKvsjgkhKpwYynmgW2ePsfCiC42rshL8lfM4qf3yU0qCCgO48tIsGz0gyLdnz9_m4R1p_J3GzdQ Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1558d5dbaa704f40a3b6436b4b6c0e51 Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersAdminTestJSON-1381403206 Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:59:03.083243 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1558d5dbaa704f40a3b6436b4b6c0e51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1558d5dbaa704f40a3b6436b4b6c0e51", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1558d5dbaa704f40a3b6436b4b6c0e51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1558d5dbaa704f40a3b6436b4b6c0e51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersAdminTestJSON-1381403206 Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1558d5dbaa704f40a3b6436b4b6c0e51 Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersAdminTestJSON-1381403206 Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersAdminTestJSON-1381403206-project Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: ea7293bc4816483dbcd0f96536814d2c Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersAdminTestJSON-1381403206-project Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 could not be found. Aug 06 20:59:03.084774 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '038bd6a9-9d4a-48b8-a1e8-6757e799e4e9'} Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 could not be found. Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:03.085603 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 could not be found. Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 could not be found. Aug 06 20:59:03.090435 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:03.093695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Returning 404 to user: Instance 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:03.109527 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7792dbe4-abc1-47f9-9466-10a1502aa429 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9" status: 404 len: 111 microversion: 2.1 time: 0.099125 Aug 06 20:59:03.118358 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 859/1677] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:03 2022] GET /compute/v2.1/servers/038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:03.125624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-4e8229ea-ffc8-496b-a3f0-1d93fdcd2768 req-1c7ed64f-0ef0-4774-b723-e6155c90c39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038bd6a9-9d4a-48b8-a1e8-6757e799e4e9", "name": "network-vif-deleted", "tag": "f469f0b5-acdf-45dd-9a45-a89f75261c3c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:03.138090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4e8229ea-ffc8-496b-a3f0-1d93fdcd2768 req-1c7ed64f-0ef0-4774-b723-e6155c90c39a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:03.139062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4e8229ea-ffc8-496b-a3f0-1d93fdcd2768 req-1c7ed64f-0ef0-4774-b723-e6155c90c39a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:03.139668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4e8229ea-ffc8-496b-a3f0-1d93fdcd2768 req-1c7ed64f-0ef0-4774-b723-e6155c90c39a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:03.154468 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-4e8229ea-ffc8-496b-a3f0-1d93fdcd2768 req-1c7ed64f-0ef0-4774-b723-e6155c90c39a service nova] Creating event network-vif-deleted:f469f0b5-acdf-45dd-9a45-a89f75261c3c for instance 038bd6a9-9d4a-48b8-a1e8-6757e799e4e9 on nch1-master-1 Aug 06 20:59:03.160791 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-4e8229ea-ffc8-496b-a3f0-1d93fdcd2768 req-1c7ed64f-0ef0-4774-b723-e6155c90c39a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042330 Aug 06 20:59:03.161898 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 860/1678] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:03.179011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:03.180140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:03.195125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:03.196320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:03.196956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:03.199070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:03.199856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:03.200493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:03.719740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:59:03.720224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:59:03.720647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:59:03.721073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:59:03.721499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:59:03.736163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:03.736930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:03.737584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:03.738513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:03.739231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:03.739849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:03.782632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:59:03.790112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Getting quotas for user 343f309c07e343b4b15268472d19f10c and project 5c99a4e2a24548ba906dd57b88cc0aba. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:59:03.876807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:59:03.880984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7a7d268-fe92-4462-a9fe-5327fe7ad7f5',volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:59:04.209896 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-377ac09d-ff0c-4776-9958-e037f944c6e4 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.383379 Aug 06 20:59:04.211889 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 819/1679] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 20:59:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 20:59:04.236321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:04.236840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:04.260323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:04.261596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:04.263503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:04.264480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:04.267372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:04.268290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:04.341971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:59:04.527142 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-58538f0a-563f-41c5-8ed1-d51cc401629c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "DELETE /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 204 len: 0 microversion: 2.1 time: 0.312314 Aug 06 20:59:04.529015 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 820/1680] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:59:04 2022] DELETE /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:59:04.537610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:04.544662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:04.546362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:04.551832 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-98463959-fadc-4572-8a9c-a3b873c73313 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 1.387776 Aug 06 20:59:04.553949 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 861/1681] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:03 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:04.556930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:04.557888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:04.559184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:04.560073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:04.560820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:04.561510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:04.562420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:04.563088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:04.593227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:04.593735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:04.594187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:04.594945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:04.595415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:04.595859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:05.027241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:05.045305 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-72898d99-ff7f-4d97-a8fb-a9a1afc405d1 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1467 microversion: 2.1 time: 0.514137 Aug 06 20:59:05.049360 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 821/1682] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:04 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1467 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:05.062248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-10bd170e-e065-45f1-a359-9dbdbb6939ed tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:05.062819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-10bd170e-e065-45f1-a359-9dbdbb6939ed tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:05.097903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:05.109495 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-82ef30f4-895c-483e-b42a-8f137939ffd7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1308 microversion: 2.1 time: 0.553427 Aug 06 20:59:05.112846 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 862/1683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:04 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:05.119342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:05.121273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:05.134735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:05.136311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:05.137034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:05.138206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:05.140741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:05.143254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:05.157512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:05.186847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10bd170e-e065-45f1-a359-9dbdbb6939ed tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:05.196338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10bd170e-e065-45f1-a359-9dbdbb6939ed tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:05.206736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10bd170e-e065-45f1-a359-9dbdbb6939ed tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:05.211446 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-10bd170e-e065-45f1-a359-9dbdbb6939ed tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1104 microversion: 2.25 time: 0.157515 Aug 06 20:59:05.218238 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 822/1684] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:05 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1104 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:05.579176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:05.579805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:05.616844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:05.617512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:05.617984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:05.618778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:05.619243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:05.619670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:05.841569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:05.849919 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-84dbaf6e-5f78-4357-8acb-61dd5268f206 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1468 microversion: 2.1 time: 0.735339 Aug 06 20:59:05.861341 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 863/1685] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:05 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1468 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:05.873453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:05.886555 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8c3d5747-fd99-4837-98aa-7a974cb2c224 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 0.312209 Aug 06 20:59:05.892159 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 823/1686] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:05 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:06.065446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:06.066304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:06.075738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:06.079651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:06.080110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:06.080857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:06.081321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:06.081754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:06.149319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:06.151174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:06.161847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:06.163331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:06.163998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:06.165188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:06.165834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:06.168325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:06.446154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:06.471294 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-805a53c1-052c-46bc-8c00-5a95e74e0864 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1308 microversion: 2.1 time: 0.336277 Aug 06 20:59:06.484886 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 824/1687] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:06 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:06.496373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-fd15acff-a0c3-4a57-a7ff-92cebba9283a req-78ed09f4-4aa9-453a-8807-7963a3d5b71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d053068c-becf-4353-b775-0bf47d7283ff", "name": "network-vif-deleted", "tag": "77bb4236-0e88-4203-bc54-27a09c725653"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:06.528331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fd15acff-a0c3-4a57-a7ff-92cebba9283a req-78ed09f4-4aa9-453a-8807-7963a3d5b71f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:06.529710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fd15acff-a0c3-4a57-a7ff-92cebba9283a req-78ed09f4-4aa9-453a-8807-7963a3d5b71f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:06.530490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fd15acff-a0c3-4a57-a7ff-92cebba9283a req-78ed09f4-4aa9-453a-8807-7963a3d5b71f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:06.542514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:06.555227 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4cfda57c-832b-4be2-bebf-664c8fdc9266 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 200 len: 1425 microversion: 2.1 time: 0.489779 Aug 06 20:59:06.555878 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-fd15acff-a0c3-4a57-a7ff-92cebba9283a req-78ed09f4-4aa9-453a-8807-7963a3d5b71f service nova] Creating event network-vif-deleted:77bb4236-0e88-4203-bc54-27a09c725653 for instance d053068c-becf-4353-b775-0bf47d7283ff on nch1-master-1 Aug 06 20:59:06.564415 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 864/1688] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:06 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 1425 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:06.564547 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-fd15acff-a0c3-4a57-a7ff-92cebba9283a req-78ed09f4-4aa9-453a-8807-7963a3d5b71f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073223 Aug 06 20:59:06.564547 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 825/1689] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:06.568659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:06.569200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:06.577072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:06.577584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:06.578115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:06.578917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:06.579567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:06.579917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:06.883556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:06.885098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:06.896073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:06.896756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:06.897342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:06.898378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:06.899141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:06.899882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:07.029367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:07.038534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:07.040345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:07.041523 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ae9bd34a-607b-4830-8559-54f734baf50d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1241 microversion: 2.25 time: 0.482451 Aug 06 20:59:07.042871 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 865/1690] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:06 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1241 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:07.075904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:07.076656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:07.095647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:07.096152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:07.096587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:07.097502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:07.098121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:07.098744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:07.244933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:07.264076 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f6f9570-a699-4806-b03e-c0a34a73148d tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1468 microversion: 2.1 time: 0.387447 Aug 06 20:59:07.266072 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 826/1691] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:06 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1468 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:59:07.507226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:07.507869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:07.524720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:07.525470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:07.526070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:07.527523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:07.543279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:07.544065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:07.769095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:07.780554 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-604fc315-2fd0-4c3d-9083-15dad5fd9d7b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1308 microversion: 2.1 time: 0.288113 Aug 06 20:59:07.781888 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 827/1692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:07 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:07.791722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:07.794241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: d053068c-becf-4353-b775-0bf47d7283ff] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:07.801108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:07.801858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:07.802455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:07.803370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:07.804023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:07.804616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:07.829165 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] HTTP exception thrown: Instance d053068c-becf-4353-b775-0bf47d7283ff could not be found. Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Request method failure captured: Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff HTTP/1.1 Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTuIKuDu4Lv3e5B0jAuqwjRbURLfKzm90zbl_YtKLbtQa1o7Ba_rdnuDGRsxkornjlyY01Qx53W5Ws0naESVIzGV7snJVOLeKYHYK19pQzlOh1mFhlnoY_Mslt6fbIBSPD3MAAjUk02IsGWnJr_vIZ_bZGmjpMwMBegpLuQEYkpx80 Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: aa51632a6bbf4d26b3db87902d6a17d2 Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MigrationsAdminTest-1631972194 Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:07.831258 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa51632a6bbf4d26b3db87902d6a17d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MigrationsAdminTest-1631972194 Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: aa51632a6bbf4d26b3db87902d6a17d2 Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MigrationsAdminTest-1631972194 Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MigrationsAdminTest-1631972194-project Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 0701f31766dd4eeab9a63f6411c26d6e Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MigrationsAdminTest-1631972194-project Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance d053068c-becf-4353-b775-0bf47d7283ff could not be found. Aug 06 20:59:07.832954 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'd053068c-becf-4353-b775-0bf47d7283ff'} Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d053068c-becf-4353-b775-0bf47d7283ff could not be found. Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:07.833901 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d053068c-becf-4353-b775-0bf47d7283ff could not be found. Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d053068c-becf-4353-b775-0bf47d7283ff could not be found. Aug 06 20:59:07.835547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:07.837959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Returning 404 to user: Instance d053068c-becf-4353-b775-0bf47d7283ff could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:07.839087 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-699ec476-99f9-45bd-bf2a-9ff44a2b0c47 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff" status: 404 len: 111 microversion: 2.1 time: 0.051585 Aug 06 20:59:07.843507 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 828/1693] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:07 2022] GET /compute/v2.1/servers/d053068c-becf-4353-b775-0bf47d7283ff => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:07.848832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:07.851978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:07.864564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:07.865343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:07.865991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:07.866966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:07.867605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:07.868192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:07.928663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:59:08.103221 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b8d692e-7f65-4f5d-9e75-5d9ca0f45ccb tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 204 len: 0 microversion: 2.1 time: 0.257529 Aug 06 20:59:08.103788 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 829/1694] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:59:07 2022] DELETE /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:59:08.113488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:08.114204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:08.140321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:08.140824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:08.141262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:08.141979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:08.145206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:08.145766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:08.220647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:08.304399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:08.316779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:08.321169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:08.322218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:08.322694 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67ea1f4b-5d53-4d49-ba38-122f15e1e72d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1251 microversion: 2.25 time: 0.214058 Aug 06 20:59:08.322989 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 830/1695] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:08 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1251 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:08.480122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:08.495503 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3ee6464a-766f-46e6-8e1e-80007c8958ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 1.423630 Aug 06 20:59:08.496829 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 866/1696] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:07 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:08.503270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:08.504320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:08.515385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:08.516584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:08.517256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:08.518416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:08.519132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:08.519777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:08.679184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:08.766435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:08.767271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:08.773477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:08.774079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:08.774589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:08.775399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:08.775872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:08.776366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:09.361769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:09.377543 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d54165ef-5e26-46e4-ac8b-69c7296fac20 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 200 len: 1468 microversion: 2.1 time: 0.879390 Aug 06 20:59:09.379952 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 867/1697] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:08 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 1468 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:09.387151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:09.388071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:09.398275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:09.399199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:09.401131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:09.416779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:09.418802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:09.421188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:09.514082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:09.531077 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e298943-41b9-4cb5-b7ca-e5ad5dd82154 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1469 microversion: 2.1 time: 1.206939 Aug 06 20:59:09.540224 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 831/1698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:08 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1469 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:09.562498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:09.567893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:09.579993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:09.589438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:09.590081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:09.591091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:09.591789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:09.592394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:09.716564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:09.732960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:09.735824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:09.738762 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-143b818b-93bf-4b95-83e6-254350998f86 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1239 microversion: 2.25 time: 0.187348 Aug 06 20:59:09.742649 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 832/1699] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:09 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:09.749133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3fa64913-e6e5-483f-83d9-fa7e64beb2ed req-d11a4333-4fb8-4f3c-ae02-eb3dac08f5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a", "name": "network-vif-deleted", "tag": "bdd3d1a4-abad-49cb-b7ea-1c1d4d3bba83"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:09.761381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3fa64913-e6e5-483f-83d9-fa7e64beb2ed req-d11a4333-4fb8-4f3c-ae02-eb3dac08f5ab service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:09.761873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3fa64913-e6e5-483f-83d9-fa7e64beb2ed req-d11a4333-4fb8-4f3c-ae02-eb3dac08f5ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:09.762340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3fa64913-e6e5-483f-83d9-fa7e64beb2ed req-d11a4333-4fb8-4f3c-ae02-eb3dac08f5ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:09.781199 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3fa64913-e6e5-483f-83d9-fa7e64beb2ed req-d11a4333-4fb8-4f3c-ae02-eb3dac08f5ab service nova] Creating event network-vif-deleted:bdd3d1a4-abad-49cb-b7ea-1c1d4d3bba83 for instance 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a on nch1-master-1 Aug 06 20:59:09.786918 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3fa64913-e6e5-483f-83d9-fa7e64beb2ed req-d11a4333-4fb8-4f3c-ae02-eb3dac08f5ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042646 Aug 06 20:59:09.788216 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 833/1700] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:09.795187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:09.796151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:09.802186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:09.804207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:09.804959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:09.805613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:09.806771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:09.807409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:09.808041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:10.266148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:10.280966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f6e749db-a95a-4dfc-9dfc-16cec27e68ef tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1308 microversion: 2.1 time: 0.899127 Aug 06 20:59:10.297164 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 868/1701] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:09 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1308 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:10.400683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:10.402279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:10.415772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:10.428945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:10.430811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:10.431169 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-403934e4-2715-426a-9656-a3a2190276d5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 0.641522 Aug 06 20:59:10.431780 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 834/1702] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:09 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:10.434628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:10.441850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:10.446179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:10.446682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:10.470022 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] HTTP exception thrown: Instance 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a could not be found. Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Request method failure captured: Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a HTTP/1.1 Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tWRvYT2XWviNz1SSvytQh75kpCwgyWuDUscgZS5z_6pdxgRz0jN-d3m5gmF4cITHl1970XUMQbXk4VlaUIJdCQdrHzoTKLIWk1hKKvsjgkhKpwYynmgW2ePsfCiC42rshL8lfM4qf3yU0qCCgO48tIsGz0gyLdnz9_m4R1p_J3GzdQ Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1558d5dbaa704f40a3b6436b4b6c0e51 Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersAdminTestJSON-1381403206 Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:59:10.473061 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1558d5dbaa704f40a3b6436b4b6c0e51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1558d5dbaa704f40a3b6436b4b6c0e51", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1558d5dbaa704f40a3b6436b4b6c0e51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1558d5dbaa704f40a3b6436b4b6c0e51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersAdminTestJSON-1381403206 Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1558d5dbaa704f40a3b6436b4b6c0e51 Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersAdminTestJSON-1381403206 Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersAdminTestJSON-1381403206-project Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: ea7293bc4816483dbcd0f96536814d2c Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersAdminTestJSON-1381403206-project Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a could not be found. Aug 06 20:59:10.474506 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a'} Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a could not be found. Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:10.475450 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a could not be found. Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a could not be found. Aug 06 20:59:10.476718 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:10.477884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Returning 404 to user: Instance 97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:10.477884 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f8fe6ff-4d51-453d-8567-8fccea3f1e45 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a" status: 404 len: 111 microversion: 2.1 time: 0.079256 Aug 06 20:59:10.488464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:10.488976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:10.494661 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 869/1703] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:10 2022] GET /compute/v2.1/servers/97f8b754-5c2e-49f1-a7f8-4aec11ea3b7a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:10.497782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:10.498292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:10.498986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:10.499712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:10.500228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:10.500830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:10.539468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:59:10.562967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:10.563601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:10.577158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:10.577662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:10.578113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:10.578869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:10.579326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:10.579760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:10.771625 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7304431a-f7af-4a80-b394-33f2c2a6e94c tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 204 len: 0 microversion: 2.1 time: 0.288308 Aug 06 20:59:10.774772 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 835/1704] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:59:10 2022] DELETE /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:59:10.780304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:10.781409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:10.789044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:10.789853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:10.790858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:10.791823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:10.793695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:10.794449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:11.209433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:11.222915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:11.227132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:11.231808 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c5b23b75-abac-4d29-8adc-4a2d5c382c4b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 0.455767 Aug 06 20:59:11.243020 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 836/1705] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:10 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:11.255388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:11.256371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:11.263771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:11.264792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:11.265336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:11.266469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:11.267041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:11.267647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:11.553674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0701f31766dd4eeab9a63f6411c26d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa51632a6bbf4d26b3db87902d6a17d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:11.572514 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5274d5e6-aa12-459b-8015-8f94a137bf71 tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 200 len: 1469 microversion: 2.1 time: 1.013725 Aug 06 20:59:11.581020 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 870/1706] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:10 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 1469 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:11.682532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:11.697111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1437928798", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "f08baf7e-869c-4eae-8bfa-a0fe291e548d"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:11.699985 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-83fbdb16-e792-4a02-94c2-8deaf6415cc2 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1468 microversion: 2.1 time: 0.452664 Aug 06 20:59:11.714011 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 837/1707] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:11 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1468 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:11.732955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-06aae6ae-1830-48ec-9789-e3640799d414 req-e4cf223a-db0d-48c5-9a9a-0ff329729b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebe66499-78a6-4cfe-bb3b-dd0daced441e", "name": "network-vif-deleted", "tag": "002e51bc-8957-435b-bb91-05c80cbea7e1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:11.761433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-06aae6ae-1830-48ec-9789-e3640799d414 req-e4cf223a-db0d-48c5-9a9a-0ff329729b9c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:11.762396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-06aae6ae-1830-48ec-9789-e3640799d414 req-e4cf223a-db0d-48c5-9a9a-0ff329729b9c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:11.763422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-06aae6ae-1830-48ec-9789-e3640799d414 req-e4cf223a-db0d-48c5-9a9a-0ff329729b9c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:11.797965 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-06aae6ae-1830-48ec-9789-e3640799d414 req-e4cf223a-db0d-48c5-9a9a-0ff329729b9c service nova] Creating event network-vif-deleted:002e51bc-8957-435b-bb91-05c80cbea7e1 for instance ebe66499-78a6-4cfe-bb3b-dd0daced441e on nch2-master-1 Aug 06 20:59:11.809017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] validate_networks() for [('f08baf7e-869c-4eae-8bfa-a0fe291e548d', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:59:11.813753 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-06aae6ae-1830-48ec-9789-e3640799d414 req-e4cf223a-db0d-48c5-9a9a-0ff329729b9c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096031 Aug 06 20:59:11.815667 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 838/1708] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:11.840293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:11.841018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:11.855919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:11.857671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:11.858308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:11.860704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:11.862810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:11.863416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:12.302111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:12.315351 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-79c59eba-6d53-48da-af4b-1f1022288158 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1308 microversion: 2.1 time: 0.492814 Aug 06 20:59:12.318325 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 839/1709] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:11 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:12.337779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:12.338403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:12.345638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:12.346124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:12.346584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:12.347311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:12.347945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:12.348533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:12.605626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:12.624867 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0bfd4db3-6ab1-47aa-96c7-385857808bda tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 0.302403 Aug 06 20:59:12.626427 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 840/1710] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:12 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:12.631768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-fd30b439-a93b-49f2-b4e2-aec0d0984dcc req-7d1c1b7f-7b08-453a-8794-e8c31ded9374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75bcfa59-4102-4577-b6de-82c9c5d59911", "tag": "7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:12.642446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fd30b439-a93b-49f2-b4e2-aec0d0984dcc req-7d1c1b7f-7b08-453a-8794-e8c31ded9374 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:12.643230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fd30b439-a93b-49f2-b4e2-aec0d0984dcc req-7d1c1b7f-7b08-453a-8794-e8c31ded9374 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:12.643914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fd30b439-a93b-49f2-b4e2-aec0d0984dcc req-7d1c1b7f-7b08-453a-8794-e8c31ded9374 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:12.657376 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-fd30b439-a93b-49f2-b4e2-aec0d0984dcc req-7d1c1b7f-7b08-453a-8794-e8c31ded9374 service nova] Creating event network-changed:7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9 for instance 75bcfa59-4102-4577-b6de-82c9c5d59911 on nch2-master-1 Aug 06 20:59:12.663257 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-fd30b439-a93b-49f2-b4e2-aec0d0984dcc req-7d1c1b7f-7b08-453a-8794-e8c31ded9374 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035086 Aug 06 20:59:12.664121 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 841/1711] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:12.677840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:12.680408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:12.690116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:12.691353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:12.692023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:12.692928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:12.693537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:12.695031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:12.891253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:12.903127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:12.906686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:12.908770 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6aee3997-bc74-423a-8df4-0c5608def8c6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 0.238269 Aug 06 20:59:12.911584 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 842/1712] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:12 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:13.271647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-294c0a69-3a22-421d-882e-3b98596301d8 req-e5f81f53-9a22-4cb1-9b09-4df9ff393498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "name": "network-vif-plugged", "status": "completed", "tag": "8dc21a95-70aa-4653-a645-e1a636a38b15"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:13.297426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-294c0a69-3a22-421d-882e-3b98596301d8 req-e5f81f53-9a22-4cb1-9b09-4df9ff393498 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:13.297911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-294c0a69-3a22-421d-882e-3b98596301d8 req-e5f81f53-9a22-4cb1-9b09-4df9ff393498 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:13.298429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-294c0a69-3a22-421d-882e-3b98596301d8 req-e5f81f53-9a22-4cb1-9b09-4df9ff393498 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:13.312584 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-294c0a69-3a22-421d-882e-3b98596301d8 req-e5f81f53-9a22-4cb1-9b09-4df9ff393498 service nova] Creating event network-vif-plugged:8dc21a95-70aa-4653-a645-e1a636a38b15 for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:59:13.318835 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-294c0a69-3a22-421d-882e-3b98596301d8 req-e5f81f53-9a22-4cb1-9b09-4df9ff393498 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.405870 Aug 06 20:59:13.320785 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 843/1713] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:13.329713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:13.330733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] [instance: ebe66499-78a6-4cfe-bb3b-dd0daced441e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:13.338163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:13.339725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:13.340369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:13.341305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:13.341922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:13.342504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:13.360749 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] HTTP exception thrown: Instance ebe66499-78a6-4cfe-bb3b-dd0daced441e could not be found. Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Request method failure captured: Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e HTTP/1.1 Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tTuIKuDu4Lv3e5B0jAuqwjRbURLfKzm90zbl_YtKLbtQa1o7Ba_rdnuDGRsxkornjlyY01Qx53W5Ws0naESVIzGV7snJVOLeKYHYK19pQzlOh1mFhlnoY_Mslt6fbIBSPD3MAAjUk02IsGWnJr_vIZ_bZGmjpMwMBegpLuQEYkpx80 Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: aa51632a6bbf4d26b3db87902d6a17d2 Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MigrationsAdminTest-1631972194 Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:13.362890 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa51632a6bbf4d26b3db87902d6a17d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa51632a6bbf4d26b3db87902d6a17d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MigrationsAdminTest-1631972194 Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: aa51632a6bbf4d26b3db87902d6a17d2 Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MigrationsAdminTest-1631972194 Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MigrationsAdminTest-1631972194-project Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 0701f31766dd4eeab9a63f6411c26d6e Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MigrationsAdminTest-1631972194-project Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ebe66499-78a6-4cfe-bb3b-dd0daced441e could not be found. Aug 06 20:59:13.364572 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ebe66499-78a6-4cfe-bb3b-dd0daced441e'} Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebe66499-78a6-4cfe-bb3b-dd0daced441e could not be found. Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:13.365498 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebe66499-78a6-4cfe-bb3b-dd0daced441e could not be found. Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebe66499-78a6-4cfe-bb3b-dd0daced441e could not be found. Aug 06 20:59:13.367022 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:13.369107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] Returning 404 to user: Instance ebe66499-78a6-4cfe-bb3b-dd0daced441e could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:13.370749 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c3e43b00-0d9a-4929-b1f2-4d09ee805eba tempest-MigrationsAdminTest-1631972194 tempest-MigrationsAdminTest-1631972194-project] 10.222.0.33 "GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e" status: 404 len: 111 microversion: 2.1 time: 0.048161 Aug 06 20:59:13.371522 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 844/1714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:13 2022] GET /compute/v2.1/servers/ebe66499-78a6-4cfe-bb3b-dd0daced441e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:13.382626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:13.383260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:13.397403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:13.398865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:13.400661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:13.402244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:13.405595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:13.406117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:13.741889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:13.756555 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5120a6cb-1f5e-43d3-b03e-cc97d41974a3 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1468 microversion: 2.1 time: 0.383182 Aug 06 20:59:13.757457 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 845/1715] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:13 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1468 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:13.771061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:13.778309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:13.782187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:13.788343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:13.789092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:13.789759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:13.791557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:13.792795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:13.793439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:14.057820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:14.073421 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2a538de-a73a-463e-91b2-8d5569ea366e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1308 microversion: 2.1 time: 0.314538 Aug 06 20:59:14.075745 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 846/1716] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:13 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:14.098091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:14.102937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:14.130284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:14.130908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:14.135558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:14.140891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:14.142072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:14.145212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:14.233124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:59:14.234911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:59:14.235787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:59:14.236453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:59:14.237086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:59:14.258831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:14.259579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:14.260251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:14.261626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:14.262372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:14.263069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:14.301445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Getting quotas for project ce68966451244078835766f1dfd16258. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:59:14.307387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Getting quotas for user e3a18bfb46b54712a4b6e1f6bec790a4 and project ce68966451244078835766f1dfd16258. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:59:14.321946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:59:14.325138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:59:14.384650 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8dba3e2-2809-4056-bc25-b7fe440ca40c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.802275 Aug 06 20:59:14.389380 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 871/1717] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:59:14.397515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:14.398598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:14.413811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:14.414713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:14.415675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:14.416810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:14.419854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:14.421068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:14.607902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:14.621982 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bdea6996-9fe0-4a45-9b17-9f5b9b62c764 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 0.544585 Aug 06 20:59:14.622619 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 847/1718] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:14 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:14.642145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-89752f6c-d243-4e55-96eb-ce7e75da5417 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:14.648657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-89752f6c-d243-4e55-96eb-ce7e75da5417 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:14.797438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-89752f6c-d243-4e55-96eb-ce7e75da5417 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:14.807961 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-89752f6c-d243-4e55-96eb-ce7e75da5417 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1216 microversion: 2.1 time: 0.182946 Aug 06 20:59:14.811039 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 848/1719] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:14 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1216 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:14.818036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:14.830960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:14.838852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:14.840238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:14.842026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:14.846644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:14.847995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:14.848647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:15.053661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea7293bc4816483dbcd0f96536814d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1558d5dbaa704f40a3b6436b4b6c0e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:15.056330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:15.080968 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c60837c6-2e5a-43b2-99bc-d4669a6c274e tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 200 len: 1426 microversion: 2.1 time: 0.265344 Aug 06 20:59:15.097955 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 849/1720] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:14 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 1426 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:15.123055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:15.124152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:15.144083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:15.148517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:15.149350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:15.152451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:15.153130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:15.155938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:15.692562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:15.705003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:15.709915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:15.715165 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c2743e58-a5ec-49d5-8181-ff93e25eee22 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 1.324255 Aug 06 20:59:15.718848 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 872/1721] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:14 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:15.735782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9b2f2dad-b038-44a4-9cd9-4f7e5600c3cb req-64cc0809-50d1-49ac-97b1-61ec88b73b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d99126-c9b5-4b1e-8bb6-92dc1dd048da", "name": "network-vif-deleted", "tag": "7aebd8b0-07de-4d6e-88bc-b0ebb90332e3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:15.769666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9b2f2dad-b038-44a4-9cd9-4f7e5600c3cb req-64cc0809-50d1-49ac-97b1-61ec88b73b2c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:15.770201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9b2f2dad-b038-44a4-9cd9-4f7e5600c3cb req-64cc0809-50d1-49ac-97b1-61ec88b73b2c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:15.772767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9b2f2dad-b038-44a4-9cd9-4f7e5600c3cb req-64cc0809-50d1-49ac-97b1-61ec88b73b2c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:15.834754 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9b2f2dad-b038-44a4-9cd9-4f7e5600c3cb req-64cc0809-50d1-49ac-97b1-61ec88b73b2c service nova] Creating event network-vif-deleted:7aebd8b0-07de-4d6e-88bc-b0ebb90332e3 for instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da on nch1-master-1 Aug 06 20:59:15.854100 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9b2f2dad-b038-44a4-9cd9-4f7e5600c3cb req-64cc0809-50d1-49ac-97b1-61ec88b73b2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133243 Aug 06 20:59:15.854807 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 873/1722] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:15.879204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-30fef6f0-7d01-4e2b-9b2b-c9c1273c227e req-6f233013-081a-47bf-adde-937fdd5a673f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "name": "network-vif-plugged", "status": "completed", "tag": "32523e6a-29b1-45e5-97ce-3f076b91af03"}, {"server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "name": "network-vif-plugged", "status": "completed", "tag": "2419fafb-b718-48a6-ba44-0b7cd79a34cc"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:15.901216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-30fef6f0-7d01-4e2b-9b2b-c9c1273c227e req-6f233013-081a-47bf-adde-937fdd5a673f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:15.901999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-30fef6f0-7d01-4e2b-9b2b-c9c1273c227e req-6f233013-081a-47bf-adde-937fdd5a673f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:15.902596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-30fef6f0-7d01-4e2b-9b2b-c9c1273c227e req-6f233013-081a-47bf-adde-937fdd5a673f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:15.917279 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-30fef6f0-7d01-4e2b-9b2b-c9c1273c227e req-6f233013-081a-47bf-adde-937fdd5a673f service nova] Creating event network-vif-plugged:32523e6a-29b1-45e5-97ce-3f076b91af03 for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:59:15.917830 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-30fef6f0-7d01-4e2b-9b2b-c9c1273c227e req-6f233013-081a-47bf-adde-937fdd5a673f service nova] Creating event network-vif-plugged:2419fafb-b718-48a6-ba44-0b7cd79a34cc for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:59:15.924313 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-30fef6f0-7d01-4e2b-9b2b-c9c1273c227e req-6f233013-081a-47bf-adde-937fdd5a673f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064322 Aug 06 20:59:15.932124 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 874/1723] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:15.947913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:15.949553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:15.967165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:15.967935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:15.968561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:15.969464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:15.970115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:15.973908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:16.099176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:16.127638 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-31132af4-90da-4c1a-8d82-17e7b2d333c8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1308 microversion: 2.1 time: 1.028251 Aug 06 20:59:16.128185 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 850/1724] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:15 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1308 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:16.132794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:16.133405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:16.161420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:16.162128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:16.162626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:16.163435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:16.163894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:16.164306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:16.453965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:16.463380 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6f59bb0f-7262-4445-b670-871a417373a6 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1268 microversion: 2.1 time: 0.333723 Aug 06 20:59:16.465620 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 851/1725] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:16 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1268 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:16.473571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:16.474651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] [instance: a4d99126-c9b5-4b1e-8bb6-92dc1dd048da] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:16.482240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:16.483100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:16.485045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:16.485978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:16.486674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:16.487285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:16.507512 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] HTTP exception thrown: Instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da could not be found. Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Request method failure captured: Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da HTTP/1.1 Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tWRvYT2XWviNz1SSvytQh75kpCwgyWuDUscgZS5z_6pdxgRz0jN-d3m5gmF4cITHl1970XUMQbXk4VlaUIJdCQdrHzoTKLIWk1hKKvsjgkhKpwYynmgW2ePsfCiC42rshL8lfM4qf3yU0qCCgO48tIsGz0gyLdnz9_m4R1p_J3GzdQ Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 1558d5dbaa704f40a3b6436b4b6c0e51 Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersAdminTestJSON-1381403206 Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:16.509702 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1558d5dbaa704f40a3b6436b4b6c0e51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1558d5dbaa704f40a3b6436b4b6c0e51", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1558d5dbaa704f40a3b6436b4b6c0e51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1558d5dbaa704f40a3b6436b4b6c0e51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersAdminTestJSON-1381403206 Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 1558d5dbaa704f40a3b6436b4b6c0e51 Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersAdminTestJSON-1381403206 Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersAdminTestJSON-1381403206-project Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: ea7293bc4816483dbcd0f96536814d2c Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersAdminTestJSON-1381403206-project Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da could not be found. Aug 06 20:59:16.512222 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'a4d99126-c9b5-4b1e-8bb6-92dc1dd048da'} Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da could not be found. Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:16.513102 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da could not be found. Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da could not be found. Aug 06 20:59:16.514586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:16.516045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] Returning 404 to user: Instance a4d99126-c9b5-4b1e-8bb6-92dc1dd048da could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:16.516506 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f5ccf8c6-284f-4378-8789-6565ccb14ce6 tempest-ServersAdminTestJSON-1381403206 tempest-ServersAdminTestJSON-1381403206-project] 10.222.0.33 "GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da" status: 404 len: 111 microversion: 2.1 time: 0.048621 Aug 06 20:59:16.517326 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 852/1726] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:16 2022] GET /compute/v2.1/servers/a4d99126-c9b5-4b1e-8bb6-92dc1dd048da => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:16.744838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:16.746194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:16.753469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:16.754192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:16.754827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:16.755742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:16.756538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:16.757644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:17.699372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:17.722024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:17.727882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:17.732095 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d1db9d6-e411-41cb-a134-c98931630c89 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 0.992721 Aug 06 20:59:17.733252 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 853/1727] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:16 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:59:17.764495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:17.766449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:17.776307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:17.778727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:17.779378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:17.780917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:17.781637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:17.782393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:17.976616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:18.010200 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72cbf3e2-8ef3-4f24-b5d1-f5435c148ace tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1354 microversion: 2.1 time: 2.072767 Aug 06 20:59:18.011566 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 875/1728] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:15 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1354 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:18.031669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:18.036075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:18.072405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:18.073972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:18.076924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:18.080958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:18.082340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:18.084376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:18.261654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:18.266867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:18.274619 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0064b1bd-826e-4b2b-8037-e92f94fbf580 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1274 microversion: 2.1 time: 0.259601 Aug 06 20:59:18.278146 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 876/1729] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:18 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1274 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:18.282902 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dfe04c40-ec77-4488-a6e8-7faeff108766 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1308 microversion: 2.1 time: 0.547249 Aug 06 20:59:18.284189 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 854/1730] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:17 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:18.292337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7a4d3267-8e17-4685-8268-7ebe3b7202c4 req-5c6d367d-d6f1-4136-98fc-fb99d48d4829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bcfa59-4102-4577-b6de-82c9c5d59911", "name": "network-vif-plugged", "status": "completed", "tag": "7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:18.295240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-25969030-d240-4212-8445-5df41136ac17 req-deabb738-af50-4ddf-85aa-bd27d0e2e143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6bbf929-686e-4283-a462-91a5f7eb10b5", "tag": "6c6abbab-02de-448b-bdb2-4a4805a66285"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:18.323190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7a4d3267-8e17-4685-8268-7ebe3b7202c4 req-5c6d367d-d6f1-4136-98fc-fb99d48d4829 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:18.323331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7a4d3267-8e17-4685-8268-7ebe3b7202c4 req-5c6d367d-d6f1-4136-98fc-fb99d48d4829 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:18.324292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7a4d3267-8e17-4685-8268-7ebe3b7202c4 req-5c6d367d-d6f1-4136-98fc-fb99d48d4829 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:18.329811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-25969030-d240-4212-8445-5df41136ac17 req-deabb738-af50-4ddf-85aa-bd27d0e2e143 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:18.330705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-25969030-d240-4212-8445-5df41136ac17 req-deabb738-af50-4ddf-85aa-bd27d0e2e143 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:18.331542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-25969030-d240-4212-8445-5df41136ac17 req-deabb738-af50-4ddf-85aa-bd27d0e2e143 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:18.348906 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-25969030-d240-4212-8445-5df41136ac17 req-deabb738-af50-4ddf-85aa-bd27d0e2e143 service nova] Creating event network-changed:6c6abbab-02de-448b-bdb2-4a4805a66285 for instance c6bbf929-686e-4283-a462-91a5f7eb10b5 on nch1-master-1 Aug 06 20:59:18.355882 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-25969030-d240-4212-8445-5df41136ac17 req-deabb738-af50-4ddf-85aa-bd27d0e2e143 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075422 Aug 06 20:59:18.357040 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 877/1731] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:18.363968 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7a4d3267-8e17-4685-8268-7ebe3b7202c4 req-5c6d367d-d6f1-4136-98fc-fb99d48d4829 service nova] Creating event network-vif-plugged:7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9 for instance 75bcfa59-4102-4577-b6de-82c9c5d59911 on nch2-master-1 Aug 06 20:59:18.377055 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7a4d3267-8e17-4685-8268-7ebe3b7202c4 req-5c6d367d-d6f1-4136-98fc-fb99d48d4829 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089208 Aug 06 20:59:18.383354 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 855/1732] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:18.761059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:18.761059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:18.779615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:18.780744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:18.781547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:18.784854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:18.785707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:18.790893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:19.036016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:19.036834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:19.052485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:19.053472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:19.054917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:19.056151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:19.060638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:19.061407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:19.169885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:19.186089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:19.191530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:19.200190 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1a436f00-3fca-4641-8be6-91cf3e1e530c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 0.444942 Aug 06 20:59:19.202861 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 878/1733] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:18 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:19.299958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:19.300773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:19.329810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:19.330567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:19.331281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:19.332266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:19.333263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:19.334703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:19.508674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:19.526424 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-39f244f7-ef26-4beb-9fbf-2a28cae2cc76 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1274 microversion: 2.1 time: 0.229342 Aug 06 20:59:19.530082 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 879/1734] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:19 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:19.535894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:19.536789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:19.545255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:19.546432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:19.547760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:19.548592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:19.549168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:19.549992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:19.794332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:19.816125 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1a291dab-11fb-4863-a572-1c7faf095312 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1802 microversion: 2.1 time: 0.784161 Aug 06 20:59:19.819204 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 856/1735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:19 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1802 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:59:19.842677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-986e3293-0d93-479c-a337-465bad3a8e81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:19.843242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-986e3293-0d93-479c-a337-465bad3a8e81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:19.864762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-986e3293-0d93-479c-a337-465bad3a8e81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:19.865309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-986e3293-0d93-479c-a337-465bad3a8e81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:19.865766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-986e3293-0d93-479c-a337-465bad3a8e81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:19.866766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-986e3293-0d93-479c-a337-465bad3a8e81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:19.869172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-986e3293-0d93-479c-a337-465bad3a8e81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:19.870626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-986e3293-0d93-479c-a337-465bad3a8e81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:19.918345 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-986e3293-0d93-479c-a337-465bad3a8e81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995/ips" status: 200 len: 216 microversion: 2.1 time: 0.083812 Aug 06 20:59:19.919644 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 857/1736] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 20:59:19 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995/ips => generated 216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:20.101892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-14dc4e83-29cd-42f5-90b0-8bfda547af2f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Calling method '.version_select at 0x7f729d759940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:20.150038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:20.161492 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99b01770-5670-4844-9afc-fb6855eac03b tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1308 microversion: 2.1 time: 0.629970 Aug 06 20:59:20.166362 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 880/1737] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:19 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1308 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:20.179062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:20.183325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:20.192030 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-14dc4e83-29cd-42f5-90b0-8bfda547af2f tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/69951ce724f64b5e995611e8bde7477a" status: 200 len: 371 microversion: 2.1 time: 0.271006 Aug 06 20:59:20.193055 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 858/1738] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 20:59:19 2022] GET /compute/v2.1/os-quota-sets/69951ce724f64b5e995611e8bde7477a => generated 371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:20.195477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:20.196318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:20.200347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:20.201191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:20.201607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:20.202131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:20.208442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ce617dc-6d18-4dda-b42f-373a2bb88552 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Action: 'update', calling method: .version_select at 0x7f729d6d7ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:20.262031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:59:20.302478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ce617dc-6d18-4dda-b42f-373a2bb88552 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:20.303238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ce617dc-6d18-4dda-b42f-373a2bb88552 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:20.304190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ce617dc-6d18-4dda-b42f-373a2bb88552 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:20.305130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ce617dc-6d18-4dda-b42f-373a2bb88552 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:20.305772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ce617dc-6d18-4dda-b42f-373a2bb88552 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:20.306589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ce617dc-6d18-4dda-b42f-373a2bb88552 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:20.386983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:20.409354 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ce617dc-6d18-4dda-b42f-373a2bb88552 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/69951ce724f64b5e995611e8bde7477a" status: 200 len: 328 microversion: 2.1 time: 0.206079 Aug 06 20:59:20.413231 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 859/1739] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 20:59:20 2022] PUT /compute/v2.1/os-quota-sets/69951ce724f64b5e995611e8bde7477a => generated 328 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:20.444103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:20.447541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:20.467434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:20.468266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:20.468948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:20.469996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:20.470967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:20.471634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:20.516606 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d1c5309-7a1a-4ed7-9e35-d42e27074481 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 204 len: 0 microversion: 2.1 time: 0.345826 Aug 06 20:59:20.517230 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 881/1740] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:59:20 2022] DELETE /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:59:20.541278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55d08ca5-80cb-4381-a1c7-dc4ebfe18851 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:20.563083 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55d08ca5-80cb-4381-a1c7-dc4ebfe18851 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-quota-sets/69951ce724f64b5e995611e8bde7477a" status: 202 len: 0 microversion: 2.1 time: 0.038019 Aug 06 20:59:20.564486 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 882/1741] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 20:59:20 2022] DELETE /compute/v2.1/os-quota-sets/69951ce724f64b5e995611e8bde7477a => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:59:20.570760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:20.572098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:20.580824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:20.581702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:20.582500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:20.583493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:20.584189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:20.584897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:20.941224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:20.968941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:20.975097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:20.983411 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3914116-ad84-4cef-8d6d-e623ac726a7d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 0.564817 Aug 06 20:59:20.998875 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 860/1742] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:20 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:20.999337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:21.007744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:21.030660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:21.034101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:21.034601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:21.035371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:21.035844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:21.043127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:21.413416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:21.427011 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-07188e91-04bb-435b-a48d-1d42710e24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1316 microversion: 2.1 time: 0.434735 Aug 06 20:59:21.428288 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 861/1743] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:20 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:21.437765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4765ac2c-6f4d-47c2-b029-3ffb421eefe3 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Calling method '.version_select at 0x7f729d7599d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:21.720447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:21.733002 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-682ae36c-2d66-4c57-8db3-5ad162f0dd95 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1808 microversion: 2.1 time: 1.164073 Aug 06 20:59:21.736554 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 883/1744] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:20 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1808 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:21.748563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:21.752210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:21.780298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:21.782277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:21.784168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:21.785120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:21.786238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:21.788388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:22.005267 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4765ac2c-6f4d-47c2-b029-3ffb421eefe3 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/69951ce724f64b5e995611e8bde7477a" status: 200 len: 371 microversion: 2.1 time: 0.575429 Aug 06 20:59:22.006802 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 862/1745] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 20:59:21 2022] GET /compute/v2.1/os-quota-sets/69951ce724f64b5e995611e8bde7477a => generated 371 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:22.024448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:22.031187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:22.061127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:22.065114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:22.067005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:22.068382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:22.072962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:22.075980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:22.582980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:22.596168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:22.599565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:22.603987 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-692ab2a0-d52a-4623-8e7e-e2ae2774d55b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 0.593760 Aug 06 20:59:22.606968 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 863/1746] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:22 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:22.633648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b15a47f1-59da-4a58-b801-2fd822753545 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Calling method '.version_select at 0x7f729d6da8b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:22.972372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:22.984716 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-82a8f54f-8e29-4b5b-bd07-38599ea2b5a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1488 microversion: 2.1 time: 1.246894 Aug 06 20:59:22.987342 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 884/1747] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:21 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1488 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:23.000019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:23.000918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:23.015139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:23.020498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:23.021387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:23.022426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:23.023001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:23.023520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:23.240958 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b15a47f1-59da-4a58-b801-2fd822753545 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/5a9a056b01e74eee84124c184505bcb2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.632258 Aug 06 20:59:23.242222 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 864/1748] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 20:59:22 2022] GET /compute/v2.1/os-quota-sets/5a9a056b01e74eee84124c184505bcb2/defaults => generated 371 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:23.268999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:23.269909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:23.281161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:23.283628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:23.284127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:23.284870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:23.285346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:23.288845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:23.857437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:23.868458 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f6b58d06-3486-447d-ba4e-a2abefb5869b tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1808 microversion: 2.1 time: 0.624908 Aug 06 20:59:23.874736 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 865/1749] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:23 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1808 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:23.890885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5c9fd57c-6fa7-4e79-9aef-2670f9336466 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:23.897622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5c9fd57c-6fa7-4e79-9aef-2670f9336466 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:23.903521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5c9fd57c-6fa7-4e79-9aef-2670f9336466 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:23.904206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5c9fd57c-6fa7-4e79-9aef-2670f9336466 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:23.980508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:24.021726 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfac7c05-283e-46c5-9469-dfe7e72eaa79 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1316 microversion: 2.1 time: 1.032516 Aug 06 20:59:24.025352 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 885/1750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:22 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1316 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:24.048207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5c9fd57c-6fa7-4e79-9aef-2670f9336466 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Going to try to stop instance {{(pid=142461) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 20:59:24.054772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:24.056280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:24.076653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:24.092554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:24.093321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:24.095636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:24.098786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:24.100547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:24.149635 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5c9fd57c-6fa7-4e79-9aef-2670f9336466 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911/action" status: 202 len: 0 microversion: 2.1 time: 0.273287 Aug 06 20:59:24.150674 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 866/1751] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:59:23 2022] POST /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:59:24.282842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:24.315732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:24.563205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d841d4fa-e305-46e4-a951-ed7a412b541c tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:24.565865 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:59:24.565865 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:59:24.567685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d841d4fa-e305-46e4-a951-ed7a412b541c tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:24.568878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d841d4fa-e305-46e4-a951-ed7a412b541c tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:24.569366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d841d4fa-e305-46e4-a951-ed7a412b541c tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:24.570108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d841d4fa-e305-46e4-a951-ed7a412b541c tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:24.570591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d841d4fa-e305-46e4-a951-ed7a412b541c tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:24.571225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d841d4fa-e305-46e4-a951-ed7a412b541c tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:24.601160 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d841d4fa-e305-46e4-a951-ed7a412b541c tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.447710 Aug 06 20:59:24.602322 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 867/1752] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:59:24 2022] GET /compute/v2.1/os-services => generated 947 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:24.607910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e4d66e07-0918-484b-8a53-f3cd4e0f28fd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Action: 'update', calling method: .version_select at 0x7f729d68c700>, body: {"quota_set": {"ram": "5120"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:24.718335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4d66e07-0918-484b-8a53-f3cd4e0f28fd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:24.718853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4d66e07-0918-484b-8a53-f3cd4e0f28fd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:24.724046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4d66e07-0918-484b-8a53-f3cd4e0f28fd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:24.724909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4d66e07-0918-484b-8a53-f3cd4e0f28fd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:24.725402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4d66e07-0918-484b-8a53-f3cd4e0f28fd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:24.732063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4d66e07-0918-484b-8a53-f3cd4e0f28fd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:24.788635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:24.852792 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e4d66e07-0918-484b-8a53-f3cd4e0f28fd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0f38a9f6a69d4aa9b3d3997e572a01ef" status: 200 len: 328 microversion: 2.1 time: 0.249030 Aug 06 20:59:24.858937 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 868/1753] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 20:59:24 2022] PUT /compute/v2.1/os-quota-sets/0f38a9f6a69d4aa9b3d3997e572a01ef => generated 328 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:24.863993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:24.867209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:24.884087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:24.884879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:24.885484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:24.886411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:24.887470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:24.888072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.142808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:25.161171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:25.166575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:25.168318 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c11b44b-462b-44c1-929f-a71f4babcf8c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 1.140934 Aug 06 20:59:25.168922 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 886/1754] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:24 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:25.180722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-880b574d-50a1-4173-af06-d98087d39d25 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:25.193350 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:59:25.193350 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:59:25.195576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-880b574d-50a1-4173-af06-d98087d39d25 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.196253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-880b574d-50a1-4173-af06-d98087d39d25 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.196890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-880b574d-50a1-4173-af06-d98087d39d25 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.201052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-880b574d-50a1-4173-af06-d98087d39d25 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.205126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-880b574d-50a1-4173-af06-d98087d39d25 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.205832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-880b574d-50a1-4173-af06-d98087d39d25 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.268653 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-880b574d-50a1-4173-af06-d98087d39d25 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.098653 Aug 06 20:59:25.276102 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 887/1755] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Aug 6 20:59:25 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:25.281388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c3655ebe-8773-46ef-840a-6c1320021a3d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Calling method '.version_select at 0x7f729d88ec10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:25.287200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:25.299255 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a1536960-b0e6-45e0-8752-3ff1dd3dfabb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.439167 Aug 06 20:59:25.300279 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 869/1756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:24 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:25.311203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:25.314521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:25.333226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.336257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.337536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.340946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.343057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.344908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.491278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3655ebe-8773-46ef-840a-6c1320021a3d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.491766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3655ebe-8773-46ef-840a-6c1320021a3d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.492202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3655ebe-8773-46ef-840a-6c1320021a3d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.492936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3655ebe-8773-46ef-840a-6c1320021a3d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.493499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3655ebe-8773-46ef-840a-6c1320021a3d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.493926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3655ebe-8773-46ef-840a-6c1320021a3d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.523756 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c3655ebe-8773-46ef-840a-6c1320021a3d tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0f38a9f6a69d4aa9b3d3997e572a01ef/detail" status: 200 len: 916 microversion: 2.1 time: 0.246532 Aug 06 20:59:25.536031 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 888/1757] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 20:59:25 2022] GET /compute/v2.1/os-quota-sets/0f38a9f6a69d4aa9b3d3997e572a01ef/detail => generated 916 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:25.536031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:25.536031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:25.537793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.538487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.546526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.547721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.548360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.550305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.612828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:25.628774 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-569dba4b-9c02-40e5-961a-70edbac65c06 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1787 microversion: 2.1 time: 0.326035 Aug 06 20:59:25.630032 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 870/1758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:25 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1787 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:25.640272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2256252f-8112-4118-b59a-2deb0dfa8efd tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:25.645572 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:59:25.645572 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:59:25.647560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2256252f-8112-4118-b59a-2deb0dfa8efd tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.648723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2256252f-8112-4118-b59a-2deb0dfa8efd tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.649647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2256252f-8112-4118-b59a-2deb0dfa8efd tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.651283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2256252f-8112-4118-b59a-2deb0dfa8efd tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.652252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2256252f-8112-4118-b59a-2deb0dfa8efd tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.655019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2256252f-8112-4118-b59a-2deb0dfa8efd tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.701754 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2256252f-8112-4118-b59a-2deb0dfa8efd tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.068901 Aug 06 20:59:25.702844 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 871/1759] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:59:25 2022] GET /compute/v2.1/os-services => generated 947 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:25.710384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-819b2df1-9dde-4533-b88b-a3fd5f1252f9 req-21e8c5de-75de-4f5d-9b8a-d6220262f5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "name": "network-vif-deleted", "tag": "32523e6a-29b1-45e5-97ce-3f076b91af03"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:25.727882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-819b2df1-9dde-4533-b88b-a3fd5f1252f9 req-21e8c5de-75de-4f5d-9b8a-d6220262f5da service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.731498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-819b2df1-9dde-4533-b88b-a3fd5f1252f9 req-21e8c5de-75de-4f5d-9b8a-d6220262f5da service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.732818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-819b2df1-9dde-4533-b88b-a3fd5f1252f9 req-21e8c5de-75de-4f5d-9b8a-d6220262f5da service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.754617 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-819b2df1-9dde-4533-b88b-a3fd5f1252f9 req-21e8c5de-75de-4f5d-9b8a-d6220262f5da service nova] Creating event network-vif-deleted:32523e6a-29b1-45e5-97ce-3f076b91af03 for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:59:25.769263 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-819b2df1-9dde-4533-b88b-a3fd5f1252f9 req-21e8c5de-75de-4f5d-9b8a-d6220262f5da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063948 Aug 06 20:59:25.771287 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 872/1760] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:25.804899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-64f4c0a3-c27a-4f61-9613-52f1ea30b4e0 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:25.817504 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:59:25.817504 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:59:25.823743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64f4c0a3-c27a-4f61-9613-52f1ea30b4e0 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.828052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64f4c0a3-c27a-4f61-9613-52f1ea30b4e0 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.828843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64f4c0a3-c27a-4f61-9613-52f1ea30b4e0 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.829768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64f4c0a3-c27a-4f61-9613-52f1ea30b4e0 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.831489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64f4c0a3-c27a-4f61-9613-52f1ea30b4e0 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.834022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64f4c0a3-c27a-4f61-9613-52f1ea30b4e0 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.921523 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-64f4c0a3-c27a-4f61-9613-52f1ea30b4e0 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.148494 Aug 06 20:59:25.922398 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 873/1761] 10.222.0.33 () {58 vars in 1196 bytes} [Sat Aug 6 20:59:25 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:59:25.932264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-49040e31-cd40-409e-b234-f3100051e9d1 req-1316b193-1619-4902-8aea-934de4a36ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "name": "network-vif-unplugged", "status": "completed", "tag": "8dc21a95-70aa-4653-a645-e1a636a38b15"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:25.948852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49040e31-cd40-409e-b234-f3100051e9d1 req-1316b193-1619-4902-8aea-934de4a36ec6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:25.949714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49040e31-cd40-409e-b234-f3100051e9d1 req-1316b193-1619-4902-8aea-934de4a36ec6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:25.951230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49040e31-cd40-409e-b234-f3100051e9d1 req-1316b193-1619-4902-8aea-934de4a36ec6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:25.963782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:25.967903 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-49040e31-cd40-409e-b234-f3100051e9d1 req-1316b193-1619-4902-8aea-934de4a36ec6 service nova] Creating event network-vif-unplugged:8dc21a95-70aa-4653-a645-e1a636a38b15 for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:59:25.977903 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-49040e31-cd40-409e-b234-f3100051e9d1 req-1316b193-1619-4902-8aea-934de4a36ec6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053685 Aug 06 20:59:25.978522 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 874/1762] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:25.985003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Action: 'update', calling method: .version_select at 0x7f729d5f5a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:26.373125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.373670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.374227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:26.379056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.380686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.380686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:26.421739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:26.435517 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-32382553-230f-4ee2-9f46-d41f1d79b910 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1316 microversion: 2.1 time: 0.908607 Aug 06 20:59:26.437484 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 889/1763] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:25 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1316 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:26.453788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.454238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2717a814-d4ba-449f-b617-e6cb1afe61d1 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:26.455885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.457789 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:59:26.457789 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:59:26.459092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:26.463534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2717a814-d4ba-449f-b617-e6cb1afe61d1 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.465494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2717a814-d4ba-449f-b617-e6cb1afe61d1 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.466188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2717a814-d4ba-449f-b617-e6cb1afe61d1 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:26.469657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2717a814-d4ba-449f-b617-e6cb1afe61d1 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.470173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.470669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2717a814-d4ba-449f-b617-e6cb1afe61d1 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.470824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.471248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:26.471639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2717a814-d4ba-449f-b617-e6cb1afe61d1 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:26.548589 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2717a814-d4ba-449f-b617-e6cb1afe61d1 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.107683 Aug 06 20:59:26.550799 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 890/1764] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:59:26 2022] GET /compute/v2.1/os-services => generated 947 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:26.562849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:26.563879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:26.579729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:26.584912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.586347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.588430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:26.590677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.591783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.592885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:26.659095 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b38a91bd-7a43-4916-8bbc-18cd476e5980 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0f38a9f6a69d4aa9b3d3997e572a01ef?user_id=78bba8e1bcca4892ac76807ced3d6d8a" status: 200 len: 328 microversion: 2.1 time: 0.677986 Aug 06 20:59:26.661334 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 875/1765] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 20:59:25 2022] PUT /compute/v2.1/os-quota-sets/0f38a9f6a69d4aa9b3d3997e572a01ef?user_id=78bba8e1bcca4892ac76807ced3d6d8a => generated 328 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:26.679119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:26.681812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:26.699335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.703297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.704989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:26.705823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:26.706982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:26.707501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:27.097269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:27.106500 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bda8a797-15c4-4a62-8909-f10091bb303f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.442213 Aug 06 20:59:27.107359 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 876/1766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:26 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:27.128511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a60e0e9f-fbec-4255-8d6c-b25b077fff80 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:27.132078 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:59:27.132078 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:59:27.134621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60e0e9f-fbec-4255-8d6c-b25b077fff80 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:27.135338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60e0e9f-fbec-4255-8d6c-b25b077fff80 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:27.137164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60e0e9f-fbec-4255-8d6c-b25b077fff80 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:27.138351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60e0e9f-fbec-4255-8d6c-b25b077fff80 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:27.139501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60e0e9f-fbec-4255-8d6c-b25b077fff80 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:27.140381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60e0e9f-fbec-4255-8d6c-b25b077fff80 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:27.147160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:27.159475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:27.162216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:27.166539 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4188dd39-5f6d-4f08-90bf-64b67e67cb9d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 0.613761 Aug 06 20:59:27.179892 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 891/1767] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:26 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:27.192378 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a60e0e9f-fbec-4255-8d6c-b25b077fff80 tempest-ServicesAdminNegativeTestJSON-1474097553 tempest-ServicesAdminNegativeTestJSON-1474097553-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.071307 Aug 06 20:59:27.194988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:27.195663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:27.208596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 877/1768] 10.222.0.33 () {58 vars in 1198 bytes} [Sat Aug 6 20:59:27 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:59:27.209950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:27.210690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:27.212334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:27.213689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:27.216027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c3c1031f-d700-4f99-84e3-ec796406decd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Calling method '.version_select at 0x7f729d741af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:27.216386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:27.216963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:27.469490 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c3c1031f-d700-4f99-84e3-ec796406decd tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0f38a9f6a69d4aa9b3d3997e572a01ef?user_id=78bba8e1bcca4892ac76807ced3d6d8a" status: 200 len: 370 microversion: 2.1 time: 0.259351 Aug 06 20:59:27.477325 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 878/1769] 10.222.0.33 () {58 vars in 1323 bytes} [Sat Aug 6 20:59:27 2022] GET /compute/v2.1/os-quota-sets/0f38a9f6a69d4aa9b3d3997e572a01ef?user_id=78bba8e1bcca4892ac76807ced3d6d8a => generated 370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:27.712285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:27.727620 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7bb9270-3525-49f6-acf6-c70496b3fe51 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1630 microversion: 2.1 time: 0.543979 Aug 06 20:59:27.730539 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 892/1770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:27 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1630 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:27.738192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0cf5a4b-81a3-45c1-bd4e-e930cbb96605 tempest-ServicesAdminNegativeTestJSON-1386416480 tempest-ServicesAdminNegativeTestJSON-1386416480-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:27.740921 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:59:27.740921 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 20:59:27.743185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b0cf5a4b-81a3-45c1-bd4e-e930cbb96605 tempest-ServicesAdminNegativeTestJSON-1386416480 tempest-ServicesAdminNegativeTestJSON-1386416480-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '675a845a87f648cc88ef25b584d99908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d03c5ff6ed945d49d82c794fc3e43c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:27.744698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:27.746971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:27.756183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0cf5a4b-81a3-45c1-bd4e-e930cbb96605 tempest-ServicesAdminNegativeTestJSON-1386416480 tempest-ServicesAdminNegativeTestJSON-1386416480-project] Request method failure captured: Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYp5yiinNFfFCAWrZ4lRsGKWcyoAeGDJ1cQGxF2TM9hlvSwTzyAymfCB0Tt0vhAQMaR28dNRGrAI42y-yzAm3hv3m_SCICl4eZ_LgOTTx-2tG7dAYLhmR_wn3z9F5kJsGd-5xiV_HWJoJT9xsla5YxM31kXFXKUZ9gQdn9DZR2EHGM Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 5d03c5ff6ed945d49d82c794fc3e43c2 Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1386416480 Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:27.756792 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d03c5ff6ed945d49d82c794fc3e43c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d03c5ff6ed945d49d82c794fc3e43c2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d03c5ff6ed945d49d82c794fc3e43c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d03c5ff6ed945d49d82c794fc3e43c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1386416480 Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 5d03c5ff6ed945d49d82c794fc3e43c2 Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1386416480 Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServicesAdminNegativeTestJSON-1386416480-project Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 675a845a87f648cc88ef25b584d99908 Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1386416480-project Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 06 20:59:27.758713 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:59:27.759720 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 06 20:59:27.761814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:27.764603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0cf5a4b-81a3-45c1-bd4e-e930cbb96605 tempest-ServicesAdminNegativeTestJSON-1386416480 tempest-ServicesAdminNegativeTestJSON-1386416480-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:27.764603 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b0cf5a4b-81a3-45c1-bd4e-e930cbb96605 tempest-ServicesAdminNegativeTestJSON-1386416480 tempest-ServicesAdminNegativeTestJSON-1386416480-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.288375 Aug 06 20:59:27.766126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:27.767236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:27.768880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:27.769778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:27.770500 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 879/1771] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 20:59:27 2022] GET /compute/v2.1/os-services => generated 112 bytes in 296 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:27.771077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:28.096838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5698a1a3-a334-422a-b7c4-43d86a5d6a09 req-6ef7fb2d-929b-41aa-af6e-a46139cbd4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "name": "network-vif-unplugged", "status": "completed", "tag": "2419fafb-b718-48a6-ba44-0b7cd79a34cc"}, {"server_uuid": "c6bbf929-686e-4283-a462-91a5f7eb10b5", "name": "network-vif-plugged", "status": "completed", "tag": "6c6abbab-02de-448b-bdb2-4a4805a66285"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:28.125136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5698a1a3-a334-422a-b7c4-43d86a5d6a09 req-6ef7fb2d-929b-41aa-af6e-a46139cbd4f5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:28.139952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5698a1a3-a334-422a-b7c4-43d86a5d6a09 req-6ef7fb2d-929b-41aa-af6e-a46139cbd4f5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:28.143240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5698a1a3-a334-422a-b7c4-43d86a5d6a09 req-6ef7fb2d-929b-41aa-af6e-a46139cbd4f5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:28.185034 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5698a1a3-a334-422a-b7c4-43d86a5d6a09 req-6ef7fb2d-929b-41aa-af6e-a46139cbd4f5 service nova] Creating event network-vif-unplugged:2419fafb-b718-48a6-ba44-0b7cd79a34cc for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:59:28.185945 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5698a1a3-a334-422a-b7c4-43d86a5d6a09 req-6ef7fb2d-929b-41aa-af6e-a46139cbd4f5 service nova] Creating event network-vif-plugged:6c6abbab-02de-448b-bdb2-4a4805a66285 for instance c6bbf929-686e-4283-a462-91a5f7eb10b5 on nch1-master-1 Aug 06 20:59:28.236519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5698a1a3-a334-422a-b7c4-43d86a5d6a09 req-6ef7fb2d-929b-41aa-af6e-a46139cbd4f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.138422 Aug 06 20:59:28.239933 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 880/1772] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:28.250364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:28.252756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:28.262448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:28.265134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:28.265672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:28.267351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:28.269592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:28.270116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:28.670187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:28.688604 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2d8193bb-1fa1-4f50-821f-2b3a13e8eeb3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.445572 Aug 06 20:59:28.702900 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 881/1773] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:28 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:28.707826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:28.708604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:28.716859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:28.717390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:28.718023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:28.719135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:28.719820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:28.720254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:28.842462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:28.859466 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23bbcf46-74f3-43ed-af78-739848446dcb tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1316 microversion: 2.1 time: 1.125501 Aug 06 20:59:28.861536 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 893/1774] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:27 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1316 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:28.878747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-78d371cb-7b00-4e27-89b7-0949fb566b86 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Calling method '.version_select at 0x7f729d88ee50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:29.259013 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-78d371cb-7b00-4e27-89b7-0949fb566b86 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/5a9a056b01e74eee84124c184505bcb2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.392859 Aug 06 20:59:29.260260 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 894/1775] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 20:59:28 2022] GET /compute/v2.1/os-quota-sets/5a9a056b01e74eee84124c184505bcb2/defaults => generated 371 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:29.294511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-cbe532fb-e49b-4451-8902-330d5fb4d3d3 req-d7d9f063-7c83-4061-b308-acf9cc34685c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0f39e3-0003-425a-8343-bf46e92b4395", "tag": "af13ee38-125f-44c4-aaba-362213c40f92"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:29.310970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cbe532fb-e49b-4451-8902-330d5fb4d3d3 req-d7d9f063-7c83-4061-b308-acf9cc34685c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:29.311550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cbe532fb-e49b-4451-8902-330d5fb4d3d3 req-d7d9f063-7c83-4061-b308-acf9cc34685c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:29.311995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cbe532fb-e49b-4451-8902-330d5fb4d3d3 req-d7d9f063-7c83-4061-b308-acf9cc34685c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:29.335578 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-cbe532fb-e49b-4451-8902-330d5fb4d3d3 req-d7d9f063-7c83-4061-b308-acf9cc34685c service nova] Creating event network-changed:af13ee38-125f-44c4-aaba-362213c40f92 for instance 4b0f39e3-0003-425a-8343-bf46e92b4395 on nch2-master-1 Aug 06 20:59:29.343012 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-cbe532fb-e49b-4451-8902-330d5fb4d3d3 req-d7d9f063-7c83-4061-b308-acf9cc34685c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081303 Aug 06 20:59:29.346355 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 895/1776] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:29.362960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:29.363701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:29.380737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:29.381661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:29.382338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:29.383287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:29.383943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:29.384613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:29.744413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:29.756174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:29.758328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:29.760131 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5cc8b0a2-5330-477c-bbee-5c78ce0c13fd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1281 microversion: 2.25 time: 1.055875 Aug 06 20:59:29.761253 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 882/1777] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:28 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1281 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:29.767707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-19b70c7e-de54-4cfc-a8cc-ff9b377ece31 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Action: 'update', calling method: .version_select at 0x7f729d609ca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:29.889523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=47 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:29.895665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:29.906276 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-35f9b9b9-d79c-4605-8ea6-a55a1792703e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1609 microversion: 2.1 time: 0.558376 Aug 06 20:59:29.911459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19b70c7e-de54-4cfc-a8cc-ff9b377ece31 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:29.911961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19b70c7e-de54-4cfc-a8cc-ff9b377ece31 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:29.912408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19b70c7e-de54-4cfc-a8cc-ff9b377ece31 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:29.918841 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 896/1778] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:29 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1609 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:29.922280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19b70c7e-de54-4cfc-a8cc-ff9b377ece31 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:29.927698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19b70c7e-de54-4cfc-a8cc-ff9b377ece31 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:29.930019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19b70c7e-de54-4cfc-a8cc-ff9b377ece31 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:29.935008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:29.946532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:29.963685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:29.965317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:29.968461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:29.971053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:29.972219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:29.974338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:30.344745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:30.405888 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-19b70c7e-de54-4cfc-a8cc-ff9b377ece31 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/5a9a056b01e74eee84124c184505bcb2" status: 200 len: 329 microversion: 2.1 time: 0.642498 Aug 06 20:59:30.408642 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 883/1779] 10.222.0.33 () {60 vars in 1263 bytes} [Sat Aug 6 20:59:29 2022] PUT /compute/v2.1/os-quota-sets/5a9a056b01e74eee84124c184505bcb2 => generated 329 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:30.421606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:30.423702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:30.446401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:30.447277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:30.452852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:30.454000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:30.457788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:30.460609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:31.162571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:31.185721 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-87505ddc-2cde-48c3-8eae-3956ee0ddbf1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1316 microversion: 2.1 time: 0.775987 Aug 06 20:59:31.186960 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 884/1780] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:30 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:31.199264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2511f4a2-340e-4033-8f82-8cd0f4f96297 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Action: 'update', calling method: .version_select at 0x7f729d6bb790>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:31.321174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:31.371563 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f417ed9a-ad4c-4da5-8b73-544b181cf302 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 1.450473 Aug 06 20:59:31.373531 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 897/1781] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:29 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:31.382844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:31.384416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:31.396093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:31.396905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:31.397576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:31.398700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:31.399338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:31.401032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:31.427873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2511f4a2-340e-4033-8f82-8cd0f4f96297 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:31.429372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2511f4a2-340e-4033-8f82-8cd0f4f96297 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:31.429817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2511f4a2-340e-4033-8f82-8cd0f4f96297 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:31.433050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2511f4a2-340e-4033-8f82-8cd0f4f96297 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:31.434280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2511f4a2-340e-4033-8f82-8cd0f4f96297 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:31.435599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2511f4a2-340e-4033-8f82-8cd0f4f96297 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:32.212631 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2511f4a2-340e-4033-8f82-8cd0f4f96297 tempest-QuotasAdminTestJSON-1411971599 tempest-QuotasAdminTestJSON-1411971599-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/5a9a056b01e74eee84124c184505bcb2" status: 200 len: 329 microversion: 2.1 time: 1.024028 Aug 06 20:59:32.232951 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 885/1782] 10.222.0.33 () {60 vars in 1263 bytes} [Sat Aug 6 20:59:31 2022] PUT /compute/v2.1/os-quota-sets/5a9a056b01e74eee84124c184505bcb2 => generated 329 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:32.254993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:32.255620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:32.270473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:32.270473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:32.271335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:32.272095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:32.272569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:32.273007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:32.370162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:32.371217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:32.372202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:32.372928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lazy-loading 'fault' on Instance uuid 0c361fdc-3fca-4dd3-b2fe-78662ec18995 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:59:32.500011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:32.540790 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1d5da29b-115d-433d-96ee-acf69bedb153 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 200 len: 1302 microversion: 2.1 time: 0.291931 Aug 06 20:59:32.541884 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 886/1783] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:32 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 1302 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:32.580800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-a79a7ebf-a234-45d7-bc19-6e14da44ae91 req-c7e69c5d-8ea1-4c41-a8e0-f182e5834119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "name": "network-vif-deleted", "tag": "2419fafb-b718-48a6-ba44-0b7cd79a34cc"}, {"server_uuid": "0c361fdc-3fca-4dd3-b2fe-78662ec18995", "name": "network-vif-deleted", "tag": "8dc21a95-70aa-4653-a645-e1a636a38b15"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:32.632798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a79a7ebf-a234-45d7-bc19-6e14da44ae91 req-c7e69c5d-8ea1-4c41-a8e0-f182e5834119 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:32.644195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a79a7ebf-a234-45d7-bc19-6e14da44ae91 req-c7e69c5d-8ea1-4c41-a8e0-f182e5834119 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:32.645029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a79a7ebf-a234-45d7-bc19-6e14da44ae91 req-c7e69c5d-8ea1-4c41-a8e0-f182e5834119 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:32.698657 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a79a7ebf-a234-45d7-bc19-6e14da44ae91 req-c7e69c5d-8ea1-4c41-a8e0-f182e5834119 service nova] Creating event network-vif-deleted:2419fafb-b718-48a6-ba44-0b7cd79a34cc for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:59:32.699739 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a79a7ebf-a234-45d7-bc19-6e14da44ae91 req-c7e69c5d-8ea1-4c41-a8e0-f182e5834119 service nova] Creating event network-vif-deleted:8dc21a95-70aa-4653-a645-e1a636a38b15 for instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 on nch2-master-1 Aug 06 20:59:32.712583 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-a79a7ebf-a234-45d7-bc19-6e14da44ae91 req-c7e69c5d-8ea1-4c41-a8e0-f182e5834119 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.160688 Aug 06 20:59:32.717395 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 887/1784] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:32.724295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:32.733077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:32.749188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:32.750048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:32.750806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:32.751965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:32.752652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:32.754475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:32.755194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:32.774752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:32.776663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:32.781177 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b0cbd82-9496-462d-94ae-0717c629110f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1477 microversion: 2.25 time: 1.403648 Aug 06 20:59:32.798958 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 898/1785] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:31 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1477 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:32.817006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:32.818293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:32.843250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:32.843760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:32.848021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:32.850814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:32.852892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:32.853605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:33.278949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:33.287582 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb4f34e3-2fe6-4058-89bc-14498e9607a7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.486662 Aug 06 20:59:33.295056 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 899/1786] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:32 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:33.301691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:33.302648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:33.320157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:33.320894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:33.327104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:33.328457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:33.329029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:33.329790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:33.461635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:33.474702 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66af2bea-e003-4987-b661-e4fac794d32a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1316 microversion: 2.1 time: 0.755229 Aug 06 20:59:33.475309 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 888/1787] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:32 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:33.687979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid c6bbf929-686e-4283-a462-91a5f7eb10b5 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:59:33.703999 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fdfff679-d71d-4c3a-90dd-4e5fd57bc75e tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1970 microversion: 2.25 time: 0.407590 Aug 06 20:59:33.724797 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 900/1788] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:33 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1970 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:33.732031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:33.733032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:33.742180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:33.743145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:33.744153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:33.745395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:33.746200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:33.747138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:33.765897 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] HTTP exception thrown: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Request method failure captured: Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 HTTP/1.1 Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tX0VYnnuLKseD-5RXfDpol9jgsHvAHmmpI58KtVVp5g4f3K70MtG-5YmJkIobMFoQP37bejaM48zjwaVdDVth67ao4ih8pmx-VdqyHHCOnYxwX4OjCTkFCnbsjg8-88ryvqcTQbq1QrZtIXzr77SpSnn4COnY0DGqyYlMlAyedeHfI Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:59:33.768537 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_710cf2b1bc504e8090132ca97890a791", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestMultiNic-1769901458 Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestMultiNic-1769901458-project Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 91d180c9584c49b296a1db51fbe50694 Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestMultiNic-1769901458-project Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 20:59:33.770289 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '0c361fdc-3fca-4dd3-b2fe-78662ec18995'} Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:33.771213 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 20:59:33.772656 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:33.773981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1757734816", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5fee4f47-5ab3-4921-b8aa-c6b0a41eb20e"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:33.776468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Returning 404 to user: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:33.778315 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-677f21dd-8b0e-4978-87ab-22a8b92828d9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 404 len: 111 microversion: 2.1 time: 0.052034 Aug 06 20:59:33.779480 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 901/1789] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:33 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:33.786268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:33.787266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:33.798653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:33.799523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:33.800622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:33.803045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:33.805059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:33.809176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:33.848159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] validate_networks() for [('5fee4f47-5ab3-4921-b8aa-c6b0a41eb20e', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:59:34.331315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid c6bbf929-686e-4283-a462-91a5f7eb10b5 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:59:34.346537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:34.383791 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d3f4e770-be23-43c8-89f2-412a7733a6b1 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1970 microversion: 2.25 time: 0.602662 Aug 06 20:59:34.387079 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 902/1790] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:33 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1970 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:34.397056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:34.402856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:34.418238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:34.421453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:34.422363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:34.423375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:34.426882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:34.427572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:34.653066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:34.683106 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e921d961-d6b1-437e-9084-be58f887dd49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.294909 Aug 06 20:59:34.698091 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 903/1791] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:34 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:34.703505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71b6a251-1447-4ad5-b818-639922c97a02 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:34.706700 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:59:34.706700 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 20:59:34.708564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6a251-1447-4ad5-b818-639922c97a02 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:34.709560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6a251-1447-4ad5-b818-639922c97a02 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:34.710241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6a251-1447-4ad5-b818-639922c97a02 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:34.711714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6a251-1447-4ad5-b818-639922c97a02 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:34.712478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6a251-1447-4ad5-b818-639922c97a02 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:34.713144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6a251-1447-4ad5-b818-639922c97a02 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:34.783585 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71b6a251-1447-4ad5-b818-639922c97a02 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.081535 Aug 06 20:59:34.785431 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 904/1792] 10.222.0.33 () {60 vars in 1217 bytes} [Sat Aug 6 20:59:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:59:34.797163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:34.803063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:34.814933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:34.815496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:34.815951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:34.816783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:34.818040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:34.818579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:35.095373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:59:35.095908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:59:35.096473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:59:35.097030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:59:35.097581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:59:35.122948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:35.124400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:35.127131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:35.128425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:35.130538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:35.132779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:35.220611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for project e47f439135a6445fa29c8be6d69c1759. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:59:35.239650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for user ad1a96004778407584d1805b07ad1c5f and project e47f439135a6445fa29c8be6d69c1759. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:59:35.300534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:59:35.312576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:59:35.442272 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-af45b51f-df7a-4754-ba9d-3eb7fd860cec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.965849 Aug 06 20:59:35.459596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 889/1793] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:59:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:59:35.468432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:35.472831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:35.488408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:35.512115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=17,nova_api:UPDATE=14 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:35.514759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:35.515325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:35.515977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:35.517542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:35.518222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:35.537436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:35.608027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'flavor' on Instance uuid c6bbf929-686e-4283-a462-91a5f7eb10b5 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:59:35.634870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Going to try to live migrate instance to nch2-master-1 {{(pid=142461) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 20:59:35.850628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:35.859296 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-97d33289-629b-4952-8470-9c6fdc64796c tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1316 microversion: 2.1 time: 1.070554 Aug 06 20:59:35.859900 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 905/1794] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:34 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1316 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:35.891965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6fe484bb-8605-47c0-b305-493db5449541 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:35.892591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6fe484bb-8605-47c0-b305-493db5449541 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:36.104894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6fe484bb-8605-47c0-b305-493db5449541 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:36.115851 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6fe484bb-8605-47c0-b305-493db5449541 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1211 microversion: 2.1 time: 0.234738 Aug 06 20:59:36.116480 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 906/1795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:35 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1211 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:36.135690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:36.138638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:36.153275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:36.153784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:36.162064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:36.171853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:36.172364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:36.176507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:37.201552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:37.214244 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7e57442-971f-4bdf-baba-14eb2ae153a0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 1.094605 Aug 06 20:59:37.216648 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 907/1796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:36 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:37.224890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:37.227097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:37.244105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:37.245750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:37.246419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:37.247650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:37.248830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:37.249583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:37.957782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:37.976506 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-afda264f-620f-4f36-a68b-b38643ee24e4 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1316 microversion: 2.1 time: 0.757408 Aug 06 20:59:37.977456 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 908/1797] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:37 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1316 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:37.995838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:37.997398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:38.008141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:38.010812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:38.013680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:38.015609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:38.017216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:38.018532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:38.389461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:38.412363 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7eae769-094e-4bdb-b374-760778f11499 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1269 microversion: 2.1 time: 0.420281 Aug 06 20:59:38.432081 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 909/1798] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:37 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1269 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:38.447535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8c0280dd-ef72-4696-bcf3-d444fd2c388d req-30ce94a7-69fc-4e80-acc9-58a6747177d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0f39e3-0003-425a-8343-bf46e92b4395", "name": "network-vif-plugged", "status": "completed", "tag": "af13ee38-125f-44c4-aaba-362213c40f92"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:38.471225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8c0280dd-ef72-4696-bcf3-d444fd2c388d req-30ce94a7-69fc-4e80-acc9-58a6747177d0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:38.474902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8c0280dd-ef72-4696-bcf3-d444fd2c388d req-30ce94a7-69fc-4e80-acc9-58a6747177d0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:38.489127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8c0280dd-ef72-4696-bcf3-d444fd2c388d req-30ce94a7-69fc-4e80-acc9-58a6747177d0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:38.508975 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8c0280dd-ef72-4696-bcf3-d444fd2c388d req-30ce94a7-69fc-4e80-acc9-58a6747177d0 service nova] Creating event network-vif-plugged:af13ee38-125f-44c4-aaba-362213c40f92 for instance 4b0f39e3-0003-425a-8343-bf46e92b4395 on nch2-master-1 Aug 06 20:59:38.519645 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8c0280dd-ef72-4696-bcf3-d444fd2c388d req-30ce94a7-69fc-4e80-acc9-58a6747177d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086111 Aug 06 20:59:38.520634 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 910/1799] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:38.540434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:38.545304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:38.561658 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74d4d518-1341-468b-a400-f2664e4aeb29 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5/action" status: 202 len: 0 microversion: 2.25 time: 3.100648 Aug 06 20:59:38.562283 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 890/1800] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 20:59:35 2022] POST /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5/action => generated 0 bytes in 3102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:59:38.570923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:38.571852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:38.572243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:38.573065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:38.573432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:38.576293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:38.580333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:38.581540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:38.617011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:38.624934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:38.625541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:38.626324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:38.626834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:38.633781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:38.934768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:38.947699 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3fbda3a8-527e-4bcb-8b98-a5df43302ab2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.422822 Aug 06 20:59:38.981695 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 911/1801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:38 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:38.999635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:39.003651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:39.018390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:39.019084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:39.019641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:39.020490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:39.021249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:39.027717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:39.108381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:39.125001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:39.128379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:39.130369 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0276d87b-86bb-4627-aca9-1f3ea5e1d6bd tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 0.563364 Aug 06 20:59:39.130986 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 891/1802] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:38 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:39.443225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:39.443847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:39.459321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:39.459840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:39.473821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:39.475097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:39.485359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:39.485831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:39.733614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:39.745927 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc728d96-50cf-4ae5-8e2d-1f226dc2f576 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1269 microversion: 2.1 time: 0.306864 Aug 06 20:59:39.769259 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 892/1803] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:39 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1269 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:39.985157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:39.986233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:39.999924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:40.000703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:40.001913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:40.003821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:40.007016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:40.009006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:40.059657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:40.068489 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-017f0ea3-8a0e-470d-b75d-db5251bc6b98 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1316 microversion: 2.1 time: 1.074330 Aug 06 20:59:40.072756 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 912/1804] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:38 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1316 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:40.476042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:40.515993 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f5ec235-760b-4661-9bff-c757479d2723 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.533778 Aug 06 20:59:40.537391 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 893/1805] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:39 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:40.782088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:40.782918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:40.808678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:40.810027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:40.811749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:40.813975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:40.815938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:40.817819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:40.911773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:40.912336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:40.940706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:40.948585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:40.951264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:40.955652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:40.957808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:40.959192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:40.959824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:40.969273 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-513e679a-e809-4006-8ba8-801dd573e410 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1269 microversion: 2.1 time: 0.192221 Aug 06 20:59:40.970540 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 894/1806] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:40 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:59:41.210235 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-badb9806-0ac4-448f-9314-d1bb7d3d7a47 tempest-TenantUsagesNegativeTestJSON-173992532 tempest-TenantUsagesNegativeTestJSON-173992532-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-05T20%3A59%3A41.010975&end=2022-08-07T20%3A59%3A41.010975" status: 404 len: 112 microversion: - time: 0.194531 Aug 06 20:59:41.216645 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 895/1807] 10.222.0.33 () {58 vars in 1316 bytes} [Sat Aug 6 20:59:41 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-05T20%3A59%3A41.010975&end=2022-08-07T20%3A59%3A41.010975 => generated 112 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 20:59:41.222993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:41.223913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:41.231653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:41.232341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:41.232878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:41.233748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:41.234405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:41.234953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:41.240618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:41.418965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:41.427613 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fd1e98dc-0933-4f26-9ac2-71d49d7666cc tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1504 microversion: 2.1 time: 0.214208 Aug 06 20:59:41.443486 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 896/1808] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:41 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:41.451733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e39cb2bb-599c-47b4-9dc7-e46503d586e9 tempest-TenantUsagesNegativeTestJSON-173992532 tempest-TenantUsagesNegativeTestJSON-173992532-project-admin] Calling method '.version_select at 0x7f729d741d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:41.460860 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-e39cb2bb-599c-47b4-9dc7-e46503d586e9 tempest-TenantUsagesNegativeTestJSON-173992532 tempest-TenantUsagesNegativeTestJSON-173992532-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e39cb2bb-599c-47b4-9dc7-e46503d586e9 tempest-TenantUsagesNegativeTestJSON-173992532 tempest-TenantUsagesNegativeTestJSON-173992532-project-admin] Request method failure captured: Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-simple-tenant-usage/bed4a73b5c7341089301eac35984057a?start=2022-08-07T20%3A59%3A41.010975&end=2022-08-05T20%3A59%3A41.010975 HTTP/1.1 Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tY8k0lVjb2DX9MV5NVxoe22jbguTlZm8gB8WBKpZ9yKDKpCN9sVIg7jopq7SZ4il6Y6EhvnYPkGmFxX6IDIkUteuGNBNdDHF_a2EamUJCJMPvYsac1oLVduRJe-3oVA6P5MorBaGeHUm4HuVDPdCwGdCAERY-JEGRf3Mhz71s2WKQE Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 282f57f59dbd43978417807e8a6e1f5b Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-173992532 Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 20:59:41.464966 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/282f57f59dbd43978417807e8a6e1f5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_282f57f59dbd43978417807e8a6e1f5b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/282f57f59dbd43978417807e8a6e1f5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/282f57f59dbd43978417807e8a6e1f5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-173992532 Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 282f57f59dbd43978417807e8a6e1f5b Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-173992532 Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TenantUsagesNegativeTestJSON-173992532-project-admin Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: eabc5f5d5d3a432785021324bb9c190d Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-173992532-project-admin Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid start time. The start time cannot occur after the end time. Aug 06 20:59:41.466729 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'bed4a73b5c7341089301eac35984057a'} Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 06 20:59:41.467620 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 06 20:59:41.468957 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:41.471091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e39cb2bb-599c-47b4-9dc7-e46503d586e9 tempest-TenantUsagesNegativeTestJSON-173992532 tempest-TenantUsagesNegativeTestJSON-173992532-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:41.472249 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e39cb2bb-599c-47b4-9dc7-e46503d586e9 tempest-TenantUsagesNegativeTestJSON-173992532 tempest-TenantUsagesNegativeTestJSON-173992532-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/bed4a73b5c7341089301eac35984057a?start=2022-08-07T20%3A59%3A41.010975&end=2022-08-05T20%3A59%3A41.010975" status: 400 len: 111 microversion: 2.1 time: 0.024895 Aug 06 20:59:41.472927 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 897/1809] 10.222.0.33 () {58 vars in 1412 bytes} [Sat Aug 6 20:59:41 2022] GET /compute/v2.1/os-simple-tenant-usage/bed4a73b5c7341089301eac35984057a?start=2022-08-07T20%3A59%3A41.010975&end=2022-08-05T20%3A59%3A41.010975 => generated 111 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:59:41.487372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:41.489922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:41.500642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:41.501460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:41.502262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:41.503273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:41.504057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:41.505331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:41.557275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:59:41.666748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:41.674494 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7bf78257-b201-470c-8082-912b2485d3a5 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 204 len: 0 microversion: 2.1 time: 0.198085 Aug 06 20:59:41.679722 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 898/1810] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:59:41 2022] DELETE /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:59:41.690501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:41.697523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:41.699467 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-876c96b8-1e88-411f-8a47-6d1ef6e12a1e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 1.545622 Aug 06 20:59:41.701528 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 913/1811] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:40 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:59:41.722010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:41.723112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:41.732345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:41.733319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:41.734046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:41.735071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:41.735711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:41.736368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:41.913864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48abda40-f5c1-4cbe-a76b-5bb9df01dd22 tempest-TenantUsagesNegativeTestJSON-1069764088 tempest-TenantUsagesNegativeTestJSON-1069764088-project] Calling method '.version_select at 0x7f729d69b940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:41.931004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-48abda40-f5c1-4cbe-a76b-5bb9df01dd22 tempest-TenantUsagesNegativeTestJSON-1069764088 tempest-TenantUsagesNegativeTestJSON-1069764088-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '031a0c2bf880491a9ad1c1ed53783722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4a73b5c7341089301eac35984057a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48abda40-f5c1-4cbe-a76b-5bb9df01dd22 tempest-TenantUsagesNegativeTestJSON-1069764088 tempest-TenantUsagesNegativeTestJSON-1069764088-project] Request method failure captured: Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-05T20%3A59%3A41.010975&end=2022-08-07T20%3A59%3A41.010975&detailed=1 HTTP/1.1 Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tY7bS1iUAXDH9LNcFyxlkqCK0Lnq3yX487YstB2HSlzhLsDb1t4Q88Q2ZwqBxdmaEO3JPZhaX_C8QgWfcgnJvSMAteODkqcihbanIvrnfKubHe8OEH0l-rBxgjiTttdTwBs2vsmPdGl3XM1D29sK6POou0PaFNuo_nk1RTlUtkZd0w Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: bed4a73b5c7341089301eac35984057a Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1069764088 Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:41.939389 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bed4a73b5c7341089301eac35984057a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bed4a73b5c7341089301eac35984057a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bed4a73b5c7341089301eac35984057a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bed4a73b5c7341089301eac35984057a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1069764088 Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: bed4a73b5c7341089301eac35984057a Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1069764088 Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TenantUsagesNegativeTestJSON-1069764088-project Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 031a0c2bf880491a9ad1c1ed53783722 Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1069764088-project Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 20:59:41.942156 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 20:59:41.943688 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 20:59:41.945077 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 20:59:41.946413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 06 20:59:41.946413 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:41.950902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48abda40-f5c1-4cbe-a76b-5bb9df01dd22 tempest-TenantUsagesNegativeTestJSON-1069764088 tempest-TenantUsagesNegativeTestJSON-1069764088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:41.955337 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-48abda40-f5c1-4cbe-a76b-5bb9df01dd22 tempest-TenantUsagesNegativeTestJSON-1069764088 tempest-TenantUsagesNegativeTestJSON-1069764088-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-05T20%3A59%3A41.010975&end=2022-08-07T20%3A59%3A41.010975&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.271185 Aug 06 20:59:41.960107 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 899/1812] 10.222.0.33 () {58 vars in 1335 bytes} [Sat Aug 6 20:59:41 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-05T20%3A59%3A41.010975&end=2022-08-07T20%3A59%3A41.010975&detailed=1 => generated 123 bytes in 279 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:41.987345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:41.988127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:42.008457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:42.011788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:42.013499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:42.014819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:42.015823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:42.016662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:42.426671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:42.435913 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-af69bfb5-de73-4c92-b5ee-927917ebdd20 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.732883 Aug 06 20:59:42.441644 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 914/1813] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:41 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:42.456411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:42.457270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:42.470166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:42.475147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:42.475973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:42.476994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:42.478236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:42.478949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:42.521527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:42.539978 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-88620bdd-7d6a-4824-97bf-118142f2907a tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1510 microversion: 2.1 time: 0.573866 Aug 06 20:59:42.545312 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 900/1814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:41 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1510 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:42.725908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:42.726924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:42.739926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:42.742985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:42.743590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:42.744780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:42.745420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:42.746908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:43.086125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:43.112821 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e516f630-5dde-4ff9-ab1d-690a1bd8995d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1311 microversion: 2.1 time: 0.669144 Aug 06 20:59:43.126585 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 915/1815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:42 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1311 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:43.234453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:43.250638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:43.254956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:43.263957 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b2e0022-6686-421b-ad14-b60fd8926192 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 0.542399 Aug 06 20:59:43.266699 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 901/1816] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:42 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:43.468361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:43.469156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:43.487241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:43.487790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:43.489321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:43.492313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:43.498080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:43.499895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:43.575102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:43.575913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:43.593091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:43.594002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:43.594926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:43.595859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:43.597933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:43.600395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:44.061131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:44.077175 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa3a2461-0f39-43d5-9561-c24a20632e45 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1510 microversion: 2.1 time: 0.507185 Aug 06 20:59:44.078098 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 902/1817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:43 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1510 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:59:44.145603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:44.146272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:44.177286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:44.177796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:44.178830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:44.179583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:44.180050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:44.180486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:44.722630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:44.816364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:44.832530 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e574ee6b-e95e-4d6e-b8ab-ebd66f591b19 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1311 microversion: 2.1 time: 0.695097 Aug 06 20:59:44.835276 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 903/1818] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:44 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1311 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:44.852359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:44.853385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:44.867696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:44.869572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:44.871865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:44.875645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:44.876380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:44.877061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:45.131435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:45.144661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:45.146244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:45.147476 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e93bb1f-f87c-4442-a2f8-249484b369fb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 0.310242 Aug 06 20:59:45.148046 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 904/1819] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:44 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:45.158742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d0e8c434-f83d-4f8d-b179-8b0328d70dd7 req-17704135-161e-4e50-8516-fa5efc565f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0f39e3-0003-425a-8343-bf46e92b4395", "name": "network-vif-deleted", "tag": "af13ee38-125f-44c4-aaba-362213c40f92"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:45.169558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d0e8c434-f83d-4f8d-b179-8b0328d70dd7 req-17704135-161e-4e50-8516-fa5efc565f55 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:45.170049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d0e8c434-f83d-4f8d-b179-8b0328d70dd7 req-17704135-161e-4e50-8516-fa5efc565f55 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:45.170487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d0e8c434-f83d-4f8d-b179-8b0328d70dd7 req-17704135-161e-4e50-8516-fa5efc565f55 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:45.181094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=23 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:45.184775 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d0e8c434-f83d-4f8d-b179-8b0328d70dd7 req-17704135-161e-4e50-8516-fa5efc565f55 service nova] Creating event network-vif-deleted:af13ee38-125f-44c4-aaba-362213c40f92 for instance 4b0f39e3-0003-425a-8343-bf46e92b4395 on nch2-master-1 Aug 06 20:59:45.190237 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d0e8c434-f83d-4f8d-b179-8b0328d70dd7 req-17704135-161e-4e50-8516-fa5efc565f55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035145 Aug 06 20:59:45.191187 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 905/1820] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:45.196264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:45.196589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:45.196977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:45.205060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:45.205555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:45.206384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:45.207332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:45.207799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:45.208404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:45.215187 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-38a6fbf7-71f6-4b9a-bc8d-96b07ee5aa87 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 1.754500 Aug 06 20:59:45.216689 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 916/1821] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:43 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:45.246462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:45.247206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:45.248037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:45.248512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lazy-loading 'fault' on Instance uuid 4b0f39e3-0003-425a-8343-bf46e92b4395 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:59:45.274528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=73 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:45.300648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a18bfb46b54712a4b6e1f6bec790a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce68966451244078835766f1dfd16258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:45.311087 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bfe29f1f-9b93-47f7-842b-9a05da614e8e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 200 len: 1306 microversion: 2.1 time: 0.118558 Aug 06 20:59:45.312035 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 906/1822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:45 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 1306 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:45.870089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:45.870645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:45.882362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:45.883439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:45.884046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:45.885944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:45.892036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:45.892187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.110341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:46.171686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:46.172301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:46.188166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:46.188572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:46.189012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.195402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:46.195987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:46.196412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.471832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:46.482252 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f57beacd-6ede-4005-bae0-4209877a6c14 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1311 microversion: 2.1 time: 0.632449 Aug 06 20:59:46.499507 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 917/1823] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:45 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1311 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:46.505481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-20807e07-f448-4dd8-9f4f-78fba3395e76 req-fed0214a-63c0-404b-b6b6-9d8d79225359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32283b96-8517-4916-a1a1-8984fc7e664d", "tag": "e53b42f6-ab95-43a2-8401-88deeffa1d8d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:46.522014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-20807e07-f448-4dd8-9f4f-78fba3395e76 req-fed0214a-63c0-404b-b6b6-9d8d79225359 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:46.522749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-20807e07-f448-4dd8-9f4f-78fba3395e76 req-fed0214a-63c0-404b-b6b6-9d8d79225359 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:46.523608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-20807e07-f448-4dd8-9f4f-78fba3395e76 req-fed0214a-63c0-404b-b6b6-9d8d79225359 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.539288 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-20807e07-f448-4dd8-9f4f-78fba3395e76 req-fed0214a-63c0-404b-b6b6-9d8d79225359 service nova] Creating event network-changed:e53b42f6-ab95-43a2-8401-88deeffa1d8d for instance 32283b96-8517-4916-a1a1-8984fc7e664d on nch2-master-1 Aug 06 20:59:46.546315 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-20807e07-f448-4dd8-9f4f-78fba3395e76 req-fed0214a-63c0-404b-b6b6-9d8d79225359 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044529 Aug 06 20:59:46.548437 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 918/1824] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:46.562813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:46.563903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:46.587545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:46.588970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:46.591029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.592064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:46.595137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:46.595879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.771427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:46.799193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:46.801517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:46.803771 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1493f6f3-1d50-42d9-ad1d-7b326ff95ee7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 0.637271 Aug 06 20:59:46.805225 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 907/1825] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:46 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:59:46.816818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:46.818122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:46.831575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:46.832298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:46.833265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.834997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:46.836566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:46.837346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.860856 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] HTTP exception thrown: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Request method failure captured: Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 HTTP/1.1 Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYeccrPgmy5NROhnbO5S0q4gTehLTmVWjbcy5hI7Aqa5OiYeL4ZHlo7ZtMVy_SsvonaG1Uys-bhNI8pGIHFiHzQYUTnShpdF0jdR0674xeJlnh7b2rXCxRKqKoIIbQVKj_lEQ9vsyJ3ZsNHjB9F-ZryIC4UBZNacw7Ic7nSkJ74Y3c Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:46.863752 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce68966451244078835766f1dfd16258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce68966451244078835766f1dfd16258", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e3a18bfb46b54712a4b6e1f6bec790a4 Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.865343 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4b0f39e3-0003-425a-8343-bf46e92b4395'} Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:46.866292 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.867730 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.880444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Returning 404 to user: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:46.882142 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6880d83e-3b84-47f5-8e48-cc39d7112950 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 404 len: 111 microversion: 2.1 time: 0.075656 Aug 06 20:59:46.883267 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 908/1826] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:46 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:46.892109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2032217132", "metadata": {"image_type": "test"}}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:46.896460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:46.907012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:46.908295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:46.909544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.910644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:46.911326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:46.911970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:46.952607 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] HTTP exception thrown: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Request method failure captured: Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395/action HTTP/1.1 Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 112 Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYeccrPgmy5NROhnbO5S0q4gTehLTmVWjbcy5hI7Aqa5OiYeL4ZHlo7ZtMVy_SsvonaG1Uys-bhNI8pGIHFiHzQYUTnShpdF0jdR0674xeJlnh7b2rXCxRKqKoIIbQVKj_lEQ9vsyJ3ZsNHjB9F-ZryIC4UBZNacw7Ic7nSkJ74Y3c Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:46.954267 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce68966451244078835766f1dfd16258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce68966451244078835766f1dfd16258", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e3a18bfb46b54712a4b6e1f6bec790a4 Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2032217132", "metadata": {"image_type": "test"}}} Aug 06 20:59:46.956077 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4b0f39e3-0003-425a-8343-bf46e92b4395', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2032217132', 'metadata': {'image_type': 'test'}}}} Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:46.956943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:46.958234 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:46.960384 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:46.960384 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:46.960384 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:46.960384 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:46.960384 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.960384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Returning 404 to user: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:46.960384 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3ae0b216-ca07-4320-9eeb-15ab770569d1 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "POST /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395/action" status: 404 len: 111 microversion: 2.1 time: 0.067854 Aug 06 20:59:46.960384 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 909/1827] 10.222.0.33 () {60 vars in 1279 bytes} [Sat Aug 6 20:59:46 2022] POST /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:46.977900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-849aea37-c027-4ddc-9113-4b1d928d324e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1039392821", "metadata": {"image_type": "test"}}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:46.980808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-849aea37-c027-4ddc-9113-4b1d928d324e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Failed to fetch instance by id tempest-invalid-769716432 {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 06 20:59:46.981441 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-849aea37-c027-4ddc-9113-4b1d928d324e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] HTTP exception thrown: Instance tempest-invalid-769716432 could not be found. Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-849aea37-c027-4ddc-9113-4b1d928d324e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Request method failure captured: Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/tempest-invalid-769716432/action HTTP/1.1 Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 112 Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYeccrPgmy5NROhnbO5S0q4gTehLTmVWjbcy5hI7Aqa5OiYeL4ZHlo7ZtMVy_SsvonaG1Uys-bhNI8pGIHFiHzQYUTnShpdF0jdR0674xeJlnh7b2rXCxRKqKoIIbQVKj_lEQ9vsyJ3ZsNHjB9F-ZryIC4UBZNacw7Ic7nSkJ74Y3c Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:46.983024 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce68966451244078835766f1dfd16258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce68966451244078835766f1dfd16258", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e3a18bfb46b54712a4b6e1f6bec790a4 Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1039392821", "metadata": {"image_type": "test"}}} Aug 06 20:59:46.984795 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance tempest-invalid-769716432 could not be found. Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'tempest-invalid-769716432', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1039392821', 'metadata': {'image_type': 'test'}}}} Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-769716432 could not be found. Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:46.991618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-769716432 could not be found. Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-769716432 could not be found. Aug 06 20:59:46.993440 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:46.995190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-849aea37-c027-4ddc-9113-4b1d928d324e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Returning 404 to user: Instance tempest-invalid-769716432 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:46.995190 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-849aea37-c027-4ddc-9113-4b1d928d324e tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "POST /compute/v2.1/servers/tempest-invalid-769716432/action" status: 404 len: 100 microversion: 2.1 time: 0.010812 Aug 06 20:59:46.995190 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 910/1828] 10.222.0.33 () {60 vars in 1246 bytes} [Sat Aug 6 20:59:46 2022] POST /compute/v2.1/servers/tempest-invalid-769716432/action => generated 100 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:59:46.998637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ae8a089-2dc2-4a81-8a1f-43d61a94d4c8 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2053317551"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:46.998637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5ae8a089-2dc2-4a81-8a1f-43d61a94d4c8 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 06 20:59:47.010975 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5ae8a089-2dc2-4a81-8a1f-43d61a94d4c8 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ae8a089-2dc2-4a81-8a1f-43d61a94d4c8 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Request method failure captured: Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 57 Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYeccrPgmy5NROhnbO5S0q4gTehLTmVWjbcy5hI7Aqa5OiYeL4ZHlo7ZtMVy_SsvonaG1Uys-bhNI8pGIHFiHzQYUTnShpdF0jdR0674xeJlnh7b2rXCxRKqKoIIbQVKj_lEQ9vsyJ3ZsNHjB9F-ZryIC4UBZNacw7Ic7nSkJ74Y3c Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:47.013566 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce68966451244078835766f1dfd16258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce68966451244078835766f1dfd16258", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e3a18bfb46b54712a4b6e1f6bec790a4 Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: {"createImage": {"name": "tempest-test-snap-2053317551"}} Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:47.015413 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2053317551'}}} Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:59:47.022302 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.023733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.026466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ae8a089-2dc2-4a81-8a1f-43d61a94d4c8 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:47.026466 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ae8a089-2dc2-4a81-8a1f-43d61a94d4c8 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.023133 Aug 06 20:59:47.026466 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 911/1829] 10.222.0.33 () {60 vars in 1275 bytes} [Sat Aug 6 20:59:46 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:47.028846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6cf2619-1cb4-4b2f-8327-14846be8b419 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-885542334"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:47.035016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c6cf2619-1cb4-4b2f-8327-14846be8b419 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 06 20:59:47.035250 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-c6cf2619-1cb4-4b2f-8327-14846be8b419 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6cf2619-1cb4-4b2f-8327-14846be8b419 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Request method failure captured: Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 56 Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYeccrPgmy5NROhnbO5S0q4gTehLTmVWjbcy5hI7Aqa5OiYeL4ZHlo7ZtMVy_SsvonaG1Uys-bhNI8pGIHFiHzQYUTnShpdF0jdR0674xeJlnh7b2rXCxRKqKoIIbQVKj_lEQ9vsyJ3ZsNHjB9F-ZryIC4UBZNacw7Ic7nSkJ74Y3c Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:47.039763 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce68966451244078835766f1dfd16258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce68966451244078835766f1dfd16258", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e3a18bfb46b54712a4b6e1f6bec790a4 Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: {"createImage": {"name": "tempest-test-snap-885542334"}} Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:47.041396 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-885542334'}}} Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:59:47.048507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 06 20:59:47.050363 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.052011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6cf2619-1cb4-4b2f-8327-14846be8b419 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:47.052011 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c6cf2619-1cb4-4b2f-8327-14846be8b419 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.017397 Aug 06 20:59:47.052011 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 912/1830] 10.222.0.33 () {60 vars in 1281 bytes} [Sat Aug 6 20:59:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:59:47.053442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:47.053442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:47.069291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:47.070230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:47.072069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:47.075444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:47.077506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:47.078010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:47.078808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:47.091977 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-336814af-38ba-4f28-8ce7-851c573b0016 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.536284 Aug 06 20:59:47.092815 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 919/1831] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:46 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:47.128109 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] HTTP exception thrown: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Request method failure captured: Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 HTTP/1.1 Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYeccrPgmy5NROhnbO5S0q4gTehLTmVWjbcy5hI7Aqa5OiYeL4ZHlo7ZtMVy_SsvonaG1Uys-bhNI8pGIHFiHzQYUTnShpdF0jdR0674xeJlnh7b2rXCxRKqKoIIbQVKj_lEQ9vsyJ3ZsNHjB9F-ZryIC4UBZNacw7Ic7nSkJ74Y3c Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 20:59:47.132016 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce68966451244078835766f1dfd16258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce68966451244078835766f1dfd16258", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e3a18bfb46b54712a4b6e1f6bec790a4 Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.133587 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4b0f39e3-0003-425a-8343-bf46e92b4395'} Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:47.134477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.135940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.138709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Returning 404 to user: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:47.142368 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f2a1e45d-493b-49b7-8345-55c3e43afa23 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 404 len: 111 microversion: 2.1 time: 0.089119 Aug 06 20:59:47.144205 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 913/1832] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 20:59:47 2022] DELETE /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:59:47.154691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:47.155473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] [instance: 4b0f39e3-0003-425a-8343-bf46e92b4395] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:47.164487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:47.168361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:47.168922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:47.169773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:47.172014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:47.172637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:47.210486 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] HTTP exception thrown: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Request method failure captured: Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 HTTP/1.1 Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tYeccrPgmy5NROhnbO5S0q4gTehLTmVWjbcy5hI7Aqa5OiYeL4ZHlo7ZtMVy_SsvonaG1Uys-bhNI8pGIHFiHzQYUTnShpdF0jdR0674xeJlnh7b2rXCxRKqKoIIbQVKj_lEQ9vsyJ3ZsNHjB9F-ZryIC4UBZNacw7Ic7nSkJ74Y3c Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 20:59:47.212739 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce68966451244078835766f1dfd16258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce68966451244078835766f1dfd16258", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce68966451244078835766f1dfd16258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: ce68966451244078835766f1dfd16258 Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1375620206 Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e3a18bfb46b54712a4b6e1f6bec790a4 Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesNegativeTestJSON-1375620206-project Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.214490 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4b0f39e3-0003-425a-8343-bf46e92b4395'} Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:59:47.215565 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. Aug 06 20:59:47.217214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 20:59:47.218844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] Returning 404 to user: Instance 4b0f39e3-0003-425a-8343-bf46e92b4395 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:59:47.218844 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f95ace0-c7d6-4f29-90e1-183fa8f45948 tempest-ImagesNegativeTestJSON-1375620206 tempest-ImagesNegativeTestJSON-1375620206-project] 10.222.0.33 "GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395" status: 404 len: 111 microversion: 2.1 time: 0.066912 Aug 06 20:59:47.220552 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 920/1833] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:47 2022] GET /compute/v2.1/servers/4b0f39e3-0003-425a-8343-bf46e92b4395 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:59:47.506410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:47.507084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:47.520223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:47.520720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:47.522042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:47.522042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:47.522276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:47.526894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:47.833101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:47.834016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:47.849360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:47.852642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:47.853399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:47.857460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:47.864313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:47.866442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:48.346006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:48.371076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:48.376775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:48.384645 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-56d5187a-b28a-4167-9ae1-8cf5a31fa7cc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 0.555365 Aug 06 20:59:48.386298 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 921/1834] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:47 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:48.408271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:48.411214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:48.459747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:48.460562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:48.461370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:48.462478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:48.463301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:48.467492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:49.274007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:49.285474 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99199af9-d181-4e53-84e7-a3005b6abed5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1498 microversion: 2.1 time: 0.893283 Aug 06 20:59:49.286094 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 922/1835] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:48 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1498 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:49.419523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:49.420794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:49.437513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:49.448950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:49.450532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:49.452829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:49.454758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:49.455443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:49.555580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:49.592600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:49.605689 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40a05cc0-ae7c-4bf4-9839-dd239ae230d2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1311 microversion: 2.1 time: 2.101291 Aug 06 20:59:49.610020 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 914/1836] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:47 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1311 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:49.938835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:49.954970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:49.959960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:49.965289 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fc45c584-a66d-4afe-9fa4-5a7df43cbafa tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 0.548961 Aug 06 20:59:49.967174 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 923/1837] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:49 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:59:50.190665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1388093324", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "2ffd27a8-2baf-4c3a-9119-c39e84b806e1"}, {"uuid": "3100aad6-9beb-4ba7-acc9-98f2d6687a14"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:50.309600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] validate_networks() for [('2ffd27a8-2baf-4c3a-9119-c39e84b806e1', None, None, None, None, None), ('3100aad6-9beb-4ba7-acc9-98f2d6687a14', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:59:50.318631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:50.319368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:50.327603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:50.329012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:50.329582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:50.330590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:50.331160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:50.331688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:51.810642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:51.822484 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-19ca86ce-0b07-4528-9cc2-e68e088f0925 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 200 len: 1475 microversion: 2.1 time: 1.510892 Aug 06 20:59:51.834637 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 924/1838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:50 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 1475 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:51.852819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-54469b27-8844-461f-9643-e020ea6cbe20 req-f25493a1-d4c0-43db-8a08-357aeae628fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bbf929-686e-4283-a462-91a5f7eb10b5", "name": "network-vif-unplugged", "status": "completed", "tag": "6c6abbab-02de-448b-bdb2-4a4805a66285"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:51.934514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-54469b27-8844-461f-9643-e020ea6cbe20 req-f25493a1-d4c0-43db-8a08-357aeae628fc service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:51.936069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-54469b27-8844-461f-9643-e020ea6cbe20 req-f25493a1-d4c0-43db-8a08-357aeae628fc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:51.937496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-54469b27-8844-461f-9643-e020ea6cbe20 req-f25493a1-d4c0-43db-8a08-357aeae628fc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:51.966109 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-54469b27-8844-461f-9643-e020ea6cbe20 req-f25493a1-d4c0-43db-8a08-357aeae628fc service nova] Creating event network-vif-unplugged:6c6abbab-02de-448b-bdb2-4a4805a66285 for instance c6bbf929-686e-4283-a462-91a5f7eb10b5 on nch1-master-1 Aug 06 20:59:51.993791 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-54469b27-8844-461f-9643-e020ea6cbe20 req-f25493a1-d4c0-43db-8a08-357aeae628fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164331 Aug 06 20:59:51.995043 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 925/1839] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:52.008639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:52.013549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:52.027582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:52.033483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:52.034228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:52.035210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:52.035843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:52.036478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:52.757192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:59:52.759847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:59:52.763602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:59:52.764398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:59:52.768090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:59:52.800167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:52.801020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:52.801704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:52.803925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:52.806044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:52.807086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:52.847634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:52.857488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Getting quotas for project 710cf2b1bc504e8090132ca97890a791. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:59:52.861620 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b27fcd0e-258f-4582-83a7-b278273aae25 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1311 microversion: 2.1 time: 0.861180 Aug 06 20:59:52.868224 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 926/1840] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:51 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1311 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:52.881283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Getting quotas for user 91d180c9584c49b296a1db51fbe50694 and project 710cf2b1bc504e8090132ca97890a791. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:59:52.887949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:52.890346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:52.899872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:52.902159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:52.903589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:52.904673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:52.905411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:52.906078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:52.951651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:59:52.954194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:59:53.073567 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c09b0ef5-fc62-4849-a816-c0ff569c6eac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.886417 Aug 06 20:59:53.075023 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 915/1841] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 20:59:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:59:53.089947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5ded21f-3525-4137-afa8-1cb86469e582 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2089653163"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:53.095553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5ded21f-3525-4137-afa8-1cb86469e582 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:53.108486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ded21f-3525-4137-afa8-1cb86469e582 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:53.110200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ded21f-3525-4137-afa8-1cb86469e582 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:53.110890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ded21f-3525-4137-afa8-1cb86469e582 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:53.112318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ded21f-3525-4137-afa8-1cb86469e582 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:53.113150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ded21f-3525-4137-afa8-1cb86469e582 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:53.113760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ded21f-3525-4137-afa8-1cb86469e582 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:53.594536 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5ded21f-3525-4137-afa8-1cb86469e582 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911/action" status: 202 len: 0 microversion: 2.1 time: 0.511020 Aug 06 20:59:53.595611 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 916/1842] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 20:59:53 2022] POST /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 20:59:53.614908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d484630f-a596-414f-9d40-189f34c07d4f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:53.615643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d484630f-a596-414f-9d40-189f34c07d4f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:53.771922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:53.788907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:53.794921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:53.800289 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2a65cbea-5861-4a6e-b1db-e87a44ed41f2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 0.927542 Aug 06 20:59:53.801923 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 927/1843] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:52 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:53.822946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52d5b1ac-f4ab-4e02-9dd3-c89c2f51487a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d877700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:53.932889 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-52d5b1ac-f4ab-4e02-9dd3-c89c2f51487a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.128888 Aug 06 20:59:53.936964 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 928/1844] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:53 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:53.953676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:53.956956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:53.980090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:53.982701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:53.984160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:53.986537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:53.987592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:53.989007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:54.385797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d484630f-a596-414f-9d40-189f34c07d4f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:54.408639 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d484630f-a596-414f-9d40-189f34c07d4f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1213 microversion: 2.1 time: 0.806890 Aug 06 20:59:54.411946 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 917/1845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:53 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1213 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:54.431610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-4aa8118d-09b0-469f-a788-cc564f20d81e req-5faa7537-edba-48e8-badc-2199881dd3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6bbf929-686e-4283-a462-91a5f7eb10b5", "tag": "6c6abbab-02de-448b-bdb2-4a4805a66285"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:54.444909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4aa8118d-09b0-469f-a788-cc564f20d81e req-5faa7537-edba-48e8-badc-2199881dd3dd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:54.445733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4aa8118d-09b0-469f-a788-cc564f20d81e req-5faa7537-edba-48e8-badc-2199881dd3dd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:54.446374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4aa8118d-09b0-469f-a788-cc564f20d81e req-5faa7537-edba-48e8-badc-2199881dd3dd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:54.460647 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-4aa8118d-09b0-469f-a788-cc564f20d81e req-5faa7537-edba-48e8-badc-2199881dd3dd service nova] Creating event network-changed:6c6abbab-02de-448b-bdb2-4a4805a66285 for instance c6bbf929-686e-4283-a462-91a5f7eb10b5 on nch1-master-1 Aug 06 20:59:54.468625 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-4aa8118d-09b0-469f-a788-cc564f20d81e req-5faa7537-edba-48e8-badc-2199881dd3dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044205 Aug 06 20:59:54.469517 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 918/1846] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:54.713699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:54.723297 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a088ec4e-daf0-4e70-ae14-dbe4259d879e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1311 microversion: 2.1 time: 0.781165 Aug 06 20:59:54.730607 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 929/1847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:53 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1311 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:54.833037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:54.833996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:54.860407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:54.860912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:54.861374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:54.862235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:54.868115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:54.868567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:54.953929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22ea28bc-9689-40aa-8b8f-3f6fc1aec838 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d88e430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:54.979838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:55.060939 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-22ea28bc-9689-40aa-8b8f-3f6fc1aec838 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.113196 Aug 06 20:59:55.068788 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 930/1848] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:54 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:59:55.273978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-0d7b528b-0f6a-499e-9c69-949dcd64cedd req-b09f3666-ede7-4510-a244-d741d61a4086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32283b96-8517-4916-a1a1-8984fc7e664d", "name": "network-vif-plugged", "status": "completed", "tag": "e53b42f6-ab95-43a2-8401-88deeffa1d8d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:55.300771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0d7b528b-0f6a-499e-9c69-949dcd64cedd req-b09f3666-ede7-4510-a244-d741d61a4086 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:55.300982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0d7b528b-0f6a-499e-9c69-949dcd64cedd req-b09f3666-ede7-4510-a244-d741d61a4086 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:55.301372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0d7b528b-0f6a-499e-9c69-949dcd64cedd req-b09f3666-ede7-4510-a244-d741d61a4086 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:55.337173 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-0d7b528b-0f6a-499e-9c69-949dcd64cedd req-b09f3666-ede7-4510-a244-d741d61a4086 service nova] Creating event network-vif-plugged:e53b42f6-ab95-43a2-8401-88deeffa1d8d for instance 32283b96-8517-4916-a1a1-8984fc7e664d on nch2-master-1 Aug 06 20:59:55.351739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-0d7b528b-0f6a-499e-9c69-949dcd64cedd req-b09f3666-ede7-4510-a244-d741d61a4086 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082372 Aug 06 20:59:55.352905 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 931/1849] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:55.438406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:55.439564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:55.457651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:55.458410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:55.469242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:55.470271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:55.470985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:55.471733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:55.477467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:55.498745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:55.502105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:55.505992 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c4185eb2-f86c-4db3-aaf8-c3fcc9635ab0 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 0.678183 Aug 06 20:59:55.507521 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 919/1850] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:54 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:55.669557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:55.688223 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce74cc6d-7208-4938-9ef0-3a51bc0a277d tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1271 microversion: 2.1 time: 0.257679 Aug 06 20:59:55.703276 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 932/1851] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:55 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:59:55.766254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:55.768052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:55.792538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:55.800487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:55.802251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:55.804258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:55.805007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:55.805908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:56.077784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d6729f5e-6941-4d5d-ad67-f3a166053e33 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d877790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:56.148096 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d6729f5e-6941-4d5d-ad67-f3a166053e33 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.075723 Aug 06 20:59:56.156429 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 933/1852] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:56 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:59:56.507178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:56.525420 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ba6b0a2-0b7b-4dcf-9a3c-1cc1b22f1703 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1311 microversion: 2.1 time: 0.767451 Aug 06 20:59:56.528029 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 920/1853] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:55 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1311 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:56.546641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:56.547549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:56.568631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:56.569492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:56.570166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:56.571162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:56.571837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:56.572469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:56.712307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:56.713507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:56.734231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:56.737737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:56.739339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:56.741457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:56.743067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:56.744394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:56.975593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:56.988422 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d060d0d1-f0f6-46a3-ac05-93648e87d66f tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1271 microversion: 2.1 time: 0.279338 Aug 06 20:59:56.990332 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 921/1854] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:56 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:57.164203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d278cecd-6323-4ecb-8613-f07a2dbbe5fe tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d5a4b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:57.250974 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d278cecd-6323-4ecb-8613-f07a2dbbe5fe tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.090651 Aug 06 20:59:57.267533 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 922/1855] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:57 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:59:57.548894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:57.549655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:57.558850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:57.569395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:57.570153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:57.575142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:57.576622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:57.578639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:57.579929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:57.585021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:57.592535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:57.594250 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23b63e7d-f86b-46ec-8a0f-a790a53462db tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 1.066382 Aug 06 20:59:57.596912 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 934/1856] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:56 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:59:58.019066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:58.019706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:58.032266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=86 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:58.034997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:58.035745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:58.040073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:58.040779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:58.041245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:58.047709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:58.264432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:58.275310 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f6e5335f-0141-4bc1-83ee-86736fe0ced5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1494 microversion: 2.1 time: 0.730445 Aug 06 20:59:58.283919 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 923/1857] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:57 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1494 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:58.304302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a5782c9-5249-4b32-8d94-7242f7513f15 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d5818b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:58.391669 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a5782c9-5249-4b32-8d94-7242f7513f15 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.101177 Aug 06 20:59:58.392546 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 924/1858] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:58 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:58.932319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc029c2d-4371-47c1-92e1-10d7de51dd8f tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:58.934522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bc029c2d-4371-47c1-92e1-10d7de51dd8f tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:58.943885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc029c2d-4371-47c1-92e1-10d7de51dd8f tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:58.947010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc029c2d-4371-47c1-92e1-10d7de51dd8f tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:58.950415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc029c2d-4371-47c1-92e1-10d7de51dd8f tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:58.951200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc029c2d-4371-47c1-92e1-10d7de51dd8f tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:58.951590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc029c2d-4371-47c1-92e1-10d7de51dd8f tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:58.957423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc029c2d-4371-47c1-92e1-10d7de51dd8f tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:59.048854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:59.057242 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-35039b8c-1e13-4b8a-8967-bed73e3a5a49 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1313 microversion: 2.1 time: 1.041943 Aug 06 20:59:59.071360 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 935/1859] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:58 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1313 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:59.080251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:59.081287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:59.087850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:59.088704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:59.089515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:59.103499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:59.105025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:59.107084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:59.831142 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc029c2d-4371-47c1-92e1-10d7de51dd8f tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1645 microversion: 2.1 time: 1.429672 Aug 06 20:59:59.834369 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 925/1860] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:58 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1645 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:59.875355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a0d402a8-3963-45d4-85bf-14f2d27117d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d5a4700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:59.983083 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a0d402a8-3963-45d4-85bf-14f2d27117d5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.137518 Aug 06 20:59:59.985364 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 926/1861] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 20:59:59 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:59:59.996631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53912513-d5a1-4691-a814-54de8c01056d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:59.997816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-53912513-d5a1-4691-a814-54de8c01056d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:00.019260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53912513-d5a1-4691-a814-54de8c01056d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:00.019969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53912513-d5a1-4691-a814-54de8c01056d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:00.020518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53912513-d5a1-4691-a814-54de8c01056d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:00.025724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53912513-d5a1-4691-a814-54de8c01056d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:00.026351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53912513-d5a1-4691-a814-54de8c01056d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:00.026827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53912513-d5a1-4691-a814-54de8c01056d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:00.254897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:00.272888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:00.275721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:00.277280 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b5044b62-9bcb-4bd4-8362-423d046f9a17 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 1.202323 Aug 06 21:00:00.278808 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 936/1862] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 20:59:59 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:00.296693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:00.298202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:00.315438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:00.315953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:00.316399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:00.317136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:00.335576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:00.349083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:01.621362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:01.637193 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3581d272-f95b-4f5b-a3b6-aa5c0aff057c tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1313 microversion: 2.1 time: 1.356990 Aug 06 21:00:01.656254 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 937/1863] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:00 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1313 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:01.678940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1238abd7-c28f-40d7-a06d-d504f8441701 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d8779d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:01.795097 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1238abd7-c28f-40d7-a06d-d504f8441701 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.127696 Aug 06 21:00:01.802635 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 938/1864] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:01 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:01.825774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:01.826765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:01.854124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:01.855799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:01.858009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:01.860271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:01.862463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:01.864314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:02.156718 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53912513-d5a1-4691-a814-54de8c01056d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1645 microversion: 2.1 time: 2.169580 Aug 06 21:00:02.177799 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 927/1865] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:59 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1645 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:02.186654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8fdfb681-a228-4ee0-9b0a-4c84c18455bd tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:02.190794 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:00:02.190794 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:00:02.192876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8fdfb681-a228-4ee0-9b0a-4c84c18455bd tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:02.195621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8fdfb681-a228-4ee0-9b0a-4c84c18455bd tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:02.196299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8fdfb681-a228-4ee0-9b0a-4c84c18455bd tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:02.198516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8fdfb681-a228-4ee0-9b0a-4c84c18455bd tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:02.200003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8fdfb681-a228-4ee0-9b0a-4c84c18455bd tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:02.201727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8fdfb681-a228-4ee0-9b0a-4c84c18455bd tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:02.289037 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8fdfb681-a228-4ee0-9b0a-4c84c18455bd tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.109646 Aug 06 21:00:02.293471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 928/1866] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Aug 6 21:00:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:02.319197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:02.321949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:02.359826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:02.360594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:02.361396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:02.362329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:02.363031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:02.363624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:02.436225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lazy-loading 'flavor' on Instance uuid 32283b96-8517-4916-a1a1-8984fc7e664d {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:00:02.483525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Going to try to live migrate instance to nch1-master-1 {{(pid=142461) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 21:00:03.020721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:03.036518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:03.042505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:03.046516 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b51d7eba-e857-42dc-8539-55e991873b6c tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 1.241800 Aug 06 21:00:03.047469 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 939/1867] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:01 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:03.060382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:03.066581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:03.087676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:03.091049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:03.091755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:03.092780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:03.096378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:03.097303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:04.373331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:04.384739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df518550-973e-4df8-83b7-cb23bd6da673 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1313 microversion: 2.1 time: 1.333193 Aug 06 21:00:04.396259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:04.404074 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 940/1868] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:03 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1313 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:04.432586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab4fd05a-85f7-4ace-a8e2-c72ff81a478d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a36a8670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:04.601487 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab4fd05a-85f7-4ace-a8e2-c72ff81a478d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.189975 Aug 06 21:00:04.601901 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 941/1869] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:04 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:04.636301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:04.639050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:04.657926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:04.660508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:04.687626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:04.688963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:04.689625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:04.690242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:05.863321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:05.878118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:05.883009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:05.886478 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-035cf87b-9763-4dbe-b118-1f22e00f8991 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 1.276026 Aug 06 21:00:05.905209 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 942/1870] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:04 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:05.921477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:05.922158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:05.938346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:05.940637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:05.941194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:05.942323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:05.955919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:05.956527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:06.810243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:06.839824 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-44477104-ab4d-4988-8ecb-4ff095e46ddd tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.933117 Aug 06 21:00:06.840703 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 943/1871] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:05 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:06.873779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d4d14fd5-6d8b-43ba-9379-2c23a3be8e57 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d96cb80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:06.974276 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d4d14fd5-6d8b-43ba-9379-2c23a3be8e57 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.122089 Aug 06 21:00:06.975045 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 944/1872] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:06 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:07.052575 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3ceb7496-9f62-4cb3-a971-df464202d280 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d/action" status: 202 len: 0 microversion: 2.1 time: 4.737326 Aug 06 21:00:07.052575 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 929/1873] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:00:02 2022] POST /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d/action => generated 0 bytes in 4739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:00:07.057509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:07.059756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:07.079141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:07.124532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:07.127271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:07.129536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:07.135526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:07.137373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:07.145944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:07.492555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-20d977e2-8359-4a39-ab64-9c11dfd40d28 tempest-AbsoluteLimitsTestJSON-278282728 tempest-AbsoluteLimitsTestJSON-278282728-project] Calling method '.version_select at 0x7f72a36a8ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:07.526085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20d977e2-8359-4a39-ab64-9c11dfd40d28 tempest-AbsoluteLimitsTestJSON-278282728 tempest-AbsoluteLimitsTestJSON-278282728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:07.529060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20d977e2-8359-4a39-ab64-9c11dfd40d28 tempest-AbsoluteLimitsTestJSON-278282728 tempest-AbsoluteLimitsTestJSON-278282728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:07.531337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20d977e2-8359-4a39-ab64-9c11dfd40d28 tempest-AbsoluteLimitsTestJSON-278282728 tempest-AbsoluteLimitsTestJSON-278282728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:07.534978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20d977e2-8359-4a39-ab64-9c11dfd40d28 tempest-AbsoluteLimitsTestJSON-278282728 tempest-AbsoluteLimitsTestJSON-278282728-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:07.535997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20d977e2-8359-4a39-ab64-9c11dfd40d28 tempest-AbsoluteLimitsTestJSON-278282728 tempest-AbsoluteLimitsTestJSON-278282728-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:07.538279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20d977e2-8359-4a39-ab64-9c11dfd40d28 tempest-AbsoluteLimitsTestJSON-278282728 tempest-AbsoluteLimitsTestJSON-278282728-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:07.581271 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-20d977e2-8359-4a39-ab64-9c11dfd40d28 tempest-AbsoluteLimitsTestJSON-278282728 tempest-AbsoluteLimitsTestJSON-278282728-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.598809 Aug 06 21:00:07.582450 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 945/1874] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:00:06 2022] GET /compute/v2.1/limits => generated 511 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:07.599596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-82de77e5-609d-4ba8-964d-ab2d48046415 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Action: 'create', calling method: .version_select at 0x7f729d96cb80>, body: {"keypair": {"name": "tempest-keypair-1430971903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFo/17Njq5tmqe+3XtlZC7b04EDL4PRwuHamFC3Bgbs7+gr3U/qRn09jCqvhu+4ENDFoswEn9AMIyBBx+pm1WJzcMKfLxBckrZ1jKxSE+Ni9OCfGpYceB7Hu70zEpgpWw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:07.687898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-82de77e5-609d-4ba8-964d-ab2d48046415 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Getting quotas for project 26d35f36722e4fc8ac7d222cf93883e9. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:00:07.716929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-82de77e5-609d-4ba8-964d-ab2d48046415 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Getting quotas for user dd9a63d793aa4a55822bfe108df664a3 and project 26d35f36722e4fc8ac7d222cf93883e9. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:00:07.753697 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-82de77e5-609d-4ba8-964d-ab2d48046415 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.169746 Aug 06 21:00:07.755898 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 946/1875] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Aug 6 21:00:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 21:00:07.766764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:07.768462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:07.784088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:07.785026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:07.785761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:07.787220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:07.787859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:07.789006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:08.599539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:08.617474 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-24ef12b9-706c-47c0-861e-b271f6824b0f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 0.858328 Aug 06 21:00:08.622491 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 947/1876] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:07 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:08.640326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-bf5c7408-06da-4009-b562-d72f6f496bba req-558f687a-2de3-4562-9de2-f5008fadb319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bcfa59-4102-4577-b6de-82c9c5d59911", "name": "network-vif-plugged", "status": "completed", "tag": "7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:08.674938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bf5c7408-06da-4009-b562-d72f6f496bba req-558f687a-2de3-4562-9de2-f5008fadb319 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:08.678352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bf5c7408-06da-4009-b562-d72f6f496bba req-558f687a-2de3-4562-9de2-f5008fadb319 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:08.679081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bf5c7408-06da-4009-b562-d72f6f496bba req-558f687a-2de3-4562-9de2-f5008fadb319 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:08.736211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-bf5c7408-06da-4009-b562-d72f6f496bba req-558f687a-2de3-4562-9de2-f5008fadb319 service nova] Creating event network-vif-plugged:7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9 for instance 75bcfa59-4102-4577-b6de-82c9c5d59911 on nch2-master-1 Aug 06 21:00:08.744254 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-bf5c7408-06da-4009-b562-d72f6f496bba req-558f687a-2de3-4562-9de2-f5008fadb319 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119535 Aug 06 21:00:08.745667 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 948/1877] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:08.753520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:08.754659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:08.764113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:08.765475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:08.766115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:08.767456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:08.768103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:08.768711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:08.816719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:08.977590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:09.006440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:09.008209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:09.009552 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02bd9a88-81f6-4de5-8fb8-646b0ca861b2 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1487 microversion: 2.25 time: 1.958964 Aug 06 21:00:09.049493 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 930/1878] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:07 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1487 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:09.066462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-15f89edd-2466-4fb9-bebd-51fb32bb9dce tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d550160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:09.174959 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-15f89edd-2466-4fb9-bebd-51fb32bb9dce tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.124038 Aug 06 21:00:09.176402 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 931/1879] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:09 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:09.197110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-073fd735-814b-4299-a984-5a5a05e110b0 req-9eb12826-c597-4676-ba02-1c0b90357c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef35ec0-f619-4ed6-9fbd-687eb753f51e", "tag": "4a77ce44-2fe1-42c5-bd05-d6fb0ddcab89"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:09.219793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-073fd735-814b-4299-a984-5a5a05e110b0 req-9eb12826-c597-4676-ba02-1c0b90357c57 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:09.220765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-073fd735-814b-4299-a984-5a5a05e110b0 req-9eb12826-c597-4676-ba02-1c0b90357c57 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:09.221460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-073fd735-814b-4299-a984-5a5a05e110b0 req-9eb12826-c597-4676-ba02-1c0b90357c57 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:09.237973 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-073fd735-814b-4299-a984-5a5a05e110b0 req-9eb12826-c597-4676-ba02-1c0b90357c57 service nova] Creating event network-changed:4a77ce44-2fe1-42c5-bd05-d6fb0ddcab89 for instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e on nch2-master-1 Aug 06 21:00:09.244055 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-073fd735-814b-4299-a984-5a5a05e110b0 req-9eb12826-c597-4676-ba02-1c0b90357c57 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055415 Aug 06 21:00:09.245234 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 932/1880] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:09.653467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:09.654369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:09.689865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:09.699559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:09.708805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:09.710077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:09.726515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:09.728709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:10.312709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:10.334772 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9e281013-4f3b-41cb-9a58-241f09734c81 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 1.585817 Aug 06 21:00:10.360649 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 949/1881] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:08 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:10.375704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:10.378406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:10.396921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:10.398880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:10.400442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:10.404072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:10.404689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:10.405985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:10.429195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:10.449284 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c51bd2aa-40aa-4691-a1f0-f61d3eb2b9a3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 0.799166 Aug 06 21:00:10.486398 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 933/1882] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:09 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:10.544456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c97eb3a7-7599-4d64-a6cc-3952b619b35d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d5565e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:10.706781 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c97eb3a7-7599-4d64-a6cc-3952b619b35d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.218961 Aug 06 21:00:10.712632 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 934/1883] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:10 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:11.358404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:11.359131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:11.373977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:11.376753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:11.377387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:11.378069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:11.382312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:11.383924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:12.056472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:12.073119 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc1e4c96-61ff-4f56-9318-3c9d0520e2f2 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.718162 Aug 06 21:00:12.088765 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 935/1884] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:11 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:00:12.099278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:12.100388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:12.114134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:12.114908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:12.115520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:12.116639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:12.117344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:12.118519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:12.238264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:12.744292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:12.776151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:12.788846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:12.803973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-95991dac-0601-44e2-9834-528349872c63 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1477 microversion: 2.25 time: 2.433725 Aug 06 21:00:12.809553 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 950/1885] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:10 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1477 bytes in 2448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:12.819770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22700cd8-f423-4e4f-bf22-67b8206411c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a36ac550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:12.986205 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-22700cd8-f423-4e4f-bf22-67b8206411c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.171568 Aug 06 21:00:12.995178 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 951/1886] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:12 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:13.023525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0742cf71-2c7f-4d50-85ca-04136359bb07 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '.version_select at 0x7f729d8773a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:13.037928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0742cf71-2c7f-4d50-85ca-04136359bb07 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:13.044180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0742cf71-2c7f-4d50-85ca-04136359bb07 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:13.044803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0742cf71-2c7f-4d50-85ca-04136359bb07 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:13.076703 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0742cf71-2c7f-4d50-85ca-04136359bb07 tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.25 time: 0.077985 Aug 06 21:00:13.080803 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 952/1887] 10.222.0.33 () {60 vars in 1184 bytes} [Sat Aug 6 21:00:12 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:13.108040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:13.109123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:13.127387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:13.129585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:13.131026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:13.132797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:13.134628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:13.136214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:13.224690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:13.247124 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4b65edf9-3107-41b5-a171-ea7f4d60f94b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 1.156302 Aug 06 21:00:13.257877 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 936/1888] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:12 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:13.297895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:13.301327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:13.333396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:13.341376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:13.346885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:13.347712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:13.373636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:13.375317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:14.654342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] Lazy-loading 'services' on Instance uuid c6bbf929-686e-4283-a462-91a5f7eb10b5 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:00:14.741750 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-462c86db-65b7-4d5b-9404-0ae1a71350fa tempest-LiveAutoBlockMigrationV225Test-554212102 tempest-LiveAutoBlockMigrationV225Test-554212102-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1970 microversion: 2.25 time: 1.647511 Aug 06 21:00:14.764006 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 953/1889] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:13 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1970 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:14.779680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7706bbe2-fa83-46c7-8b86-a020b1a6040b req-d1148adc-eebe-4262-879f-d634c9bbb3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef35ec0-f619-4ed6-9fbd-687eb753f51e", "tag": "8029828f-6dbc-4719-b4d4-04cf73c5308c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:14.794749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7706bbe2-fa83-46c7-8b86-a020b1a6040b req-d1148adc-eebe-4262-879f-d634c9bbb3e8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:14.797092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7706bbe2-fa83-46c7-8b86-a020b1a6040b req-d1148adc-eebe-4262-879f-d634c9bbb3e8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:14.797761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7706bbe2-fa83-46c7-8b86-a020b1a6040b req-d1148adc-eebe-4262-879f-d634c9bbb3e8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:14.817120 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7706bbe2-fa83-46c7-8b86-a020b1a6040b req-d1148adc-eebe-4262-879f-d634c9bbb3e8 service nova] Creating event network-changed:8029828f-6dbc-4719-b4d4-04cf73c5308c for instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e on nch2-master-1 Aug 06 21:00:14.823757 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7706bbe2-fa83-46c7-8b86-a020b1a6040b req-d1148adc-eebe-4262-879f-d634c9bbb3e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059195 Aug 06 21:00:14.825334 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 954/1890] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:14.836586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a1796a3f-42a8-4f82-ad3d-97e03dd61dd4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a36ac820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:14.857590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:14.874832 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f7f6d0ad-66aa-4230-af5c-d0d19d4dfb60 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 1.611341 Aug 06 21:00:14.879980 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 937/1891] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:13 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:14.894885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:14.903272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:14.937286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:14.938317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:14.950962 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a1796a3f-42a8-4f82-ad3d-97e03dd61dd4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.123911 Aug 06 21:00:14.952324 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 955/1892] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:14 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:14.955231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:14.958472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:14.964381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:14.968575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:14.976626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:14.977521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:15.007308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:15.007728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:15.008169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:15.008900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:15.013552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:15.014260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:15.094566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:00:15.296853 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 204 len: 0 microversion: 2.25 time: 0.335252 Aug 06 21:00:15.299870 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 956/1893] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:00:14 2022] DELETE /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:00:15.315569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:15.316949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:15.335233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:15.336384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:15.337452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:15.341120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:15.342706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:15.346484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:15.517897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:15.534459 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2a752c0f-43aa-4266-bd72-c1790ea6a8a0 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 0.646611 Aug 06 21:00:15.535747 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 938/1894] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:14 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:15.903239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:15.903943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:15.925411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:15.932707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:15.933331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:15.937671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:15.938238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:15.938987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:16.516318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:16.528654 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ff093ea9-8e33-4384-8679-7c2ce5ad0b72 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.629325 Aug 06 21:00:16.529506 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 939/1895] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:15 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:00:16.538015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d66a5cec-c58a-4c70-be59-2ce050d5f848 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d609ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:16.628775 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d66a5cec-c58a-4c70-be59-2ce050d5f848 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.098036 Aug 06 21:00:16.629938 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 940/1896] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:16 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:16.635068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:16.636922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:16.653170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:16.655203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:16.655841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:16.659476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:16.660172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:16.660780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:16.714673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:17.174827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:17.193163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:17.199403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:17.204304 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-05337e25-9107-40c0-a38f-3f0e7c650c54 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1483 microversion: 2.25 time: 1.896886 Aug 06 21:00:17.218587 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 957/1897] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:15 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1483 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:17.218587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-358f2097-5806-4012-b859-45a5b747adb2 req-076a22d9-765d-4dc9-976e-a60d49acc99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32283b96-8517-4916-a1a1-8984fc7e664d", "name": "network-vif-unplugged", "status": "completed", "tag": "e53b42f6-ab95-43a2-8401-88deeffa1d8d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:17.243311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-358f2097-5806-4012-b859-45a5b747adb2 req-076a22d9-765d-4dc9-976e-a60d49acc99d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:17.245851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-358f2097-5806-4012-b859-45a5b747adb2 req-076a22d9-765d-4dc9-976e-a60d49acc99d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:17.252729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-358f2097-5806-4012-b859-45a5b747adb2 req-076a22d9-765d-4dc9-976e-a60d49acc99d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:17.286132 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-358f2097-5806-4012-b859-45a5b747adb2 req-076a22d9-765d-4dc9-976e-a60d49acc99d service nova] Creating event network-vif-unplugged:e53b42f6-ab95-43a2-8401-88deeffa1d8d for instance 32283b96-8517-4916-a1a1-8984fc7e664d on nch2-master-1 Aug 06 21:00:17.300395 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-358f2097-5806-4012-b859-45a5b747adb2 req-076a22d9-765d-4dc9-976e-a60d49acc99d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089077 Aug 06 21:00:17.303940 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 958/1898] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:17.552123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:17.553010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:17.560708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:17.566047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:17.576131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:17.577119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:17.577757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:17.578523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:17.579392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:17.726949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:17.819564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:17.838817 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e6a07b29-9f14-432c-9966-d65063e1afab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 1.196737 Aug 06 21:00:17.852715 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 941/1899] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:16 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:17.858758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-282143d8-f047-45d4-8a52-37e273f6b9c4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d68c3a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:17.924137 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-282143d8-f047-45d4-8a52-37e273f6b9c4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.069939 Aug 06 21:00:17.925276 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 942/1900] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:17 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:18.235084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:18.236677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:18.246597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:18.273356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:18.279468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:18.280805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:18.281996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:18.284281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:18.901199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:18.915965 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3f7d0e29-c7a6-40fb-bf68-c00fefa0b0ab tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 1.366590 Aug 06 21:00:18.923536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:18.928278 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 959/1901] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:17 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:00:18.942519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-225723371", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1bbcfd23-a8bd-4ae1-a599-816807adae72"}, {"port": "631ad28d-478e-497c-84f9-cb93dd852c28", "tag": "port-1"}, {"port": "858d1607-0948-4184-9b0c-ac1a999047cf", "tag": "port-2"}, {"uuid": "2505645a-5394-42ba-a065-6d80f4150187", "tag": "net-1"}, {"uuid": "2505645a-5394-42ba-a065-6d80f4150187"}, {"uuid": "3552075e-6c34-432f-80ec-c7341fa0736d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3552075e-6c34-432f-80ec-c7341fa0736d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2381464f-8d79-4e5e-8926-b919fcd72240", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4297f47d-31a4-4957-9809-e323b1575be7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a2a66353-40fa-4672-99aa-9f8e137e1126", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1863490485"}], "key_name": "tempest-keypair-1430971903", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:18.946921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:18.956890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:18.967663 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e3a4a201-ccf6-431c-a401-4670bbc016cb tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 200 len: 1483 microversion: 2.25 time: 0.738809 Aug 06 21:00:18.978569 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 943/1902] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:18 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 1483 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:00:18.989596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:18.990235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:19.016386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:19.016893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:19.017646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:19.018372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:19.024319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:19.025036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:19.437933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] validate_networks() for [('1bbcfd23-a8bd-4ae1-a599-816807adae72', None, None, None, None, None), (None, None, '631ad28d-478e-497c-84f9-cb93dd852c28', None, None, None), (None, None, '858d1607-0948-4184-9b0c-ac1a999047cf', None, None, None), ('2505645a-5394-42ba-a065-6d80f4150187', None, None, None, None, None), ('2505645a-5394-42ba-a065-6d80f4150187', None, None, None, None, None), ('3552075e-6c34-432f-80ec-c7341fa0736d', '10.2.2.100', None, None, None, None), ('3552075e-6c34-432f-80ec-c7341fa0736d', '10.2.2.200', None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:00:19.451584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:19.472157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12d4937c-a192-48b7-89a1-d01c4f99fb54 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 0.492265 Aug 06 21:00:19.472826 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 944/1903] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:18 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:19.491630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-147b4511-be51-4a5a-9fe5-aef2dedeec88 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d561c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:20.079255 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-147b4511-be51-4a5a-9fe5-aef2dedeec88 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.601916 Aug 06 21:00:20.080804 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 945/1904] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:19 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:20.108766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2886eabc-7979-4557-88d5-ed8661aaa4c0 req-81b6da70-7982-4eb0-a11b-178595e19963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32283b96-8517-4916-a1a1-8984fc7e664d", "tag": "e53b42f6-ab95-43a2-8401-88deeffa1d8d"}, {"server_uuid": "c6bbf929-686e-4283-a462-91a5f7eb10b5", "name": "network-vif-deleted", "tag": "6c6abbab-02de-448b-bdb2-4a4805a66285"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:20.888266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2886eabc-7979-4557-88d5-ed8661aaa4c0 req-81b6da70-7982-4eb0-a11b-178595e19963 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:20.888953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2886eabc-7979-4557-88d5-ed8661aaa4c0 req-81b6da70-7982-4eb0-a11b-178595e19963 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:20.889569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2886eabc-7979-4557-88d5-ed8661aaa4c0 req-81b6da70-7982-4eb0-a11b-178595e19963 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:20.929796 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2886eabc-7979-4557-88d5-ed8661aaa4c0 req-81b6da70-7982-4eb0-a11b-178595e19963 service nova] Creating event network-changed:e53b42f6-ab95-43a2-8401-88deeffa1d8d for instance 32283b96-8517-4916-a1a1-8984fc7e664d on nch2-master-1 Aug 06 21:00:20.931323 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2886eabc-7979-4557-88d5-ed8661aaa4c0 req-81b6da70-7982-4eb0-a11b-178595e19963 service nova] Creating event network-vif-deleted:6c6abbab-02de-448b-bdb2-4a4805a66285 for instance c6bbf929-686e-4283-a462-91a5f7eb10b5 on nch2-master-1 Aug 06 21:00:20.944696 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2886eabc-7979-4557-88d5-ed8661aaa4c0 req-81b6da70-7982-4eb0-a11b-178595e19963 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.860179 Aug 06 21:00:20.946069 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 946/1905] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:20.955312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:20.960344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:20.995013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:20.998247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:21.000461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:21.005054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:21.009682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:21.013622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:21.687362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:21.705041 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37596f1d-4773-47bf-987e-9b72318a62f1 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.754574 Aug 06 21:00:21.722933 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 947/1906] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:20 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:21.745824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:21.749068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: c6bbf929-686e-4283-a462-91a5f7eb10b5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:21.776391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:21.777576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:21.779848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:21.782473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:21.784952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:21.786270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:21.833337 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] HTTP exception thrown: Instance c6bbf929-686e-4283-a462-91a5f7eb10b5 could not be found. Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Request method failure captured: Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 HTTP/1.1 Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tT_Lzg3VoctJ61__nynqdPlVtZ9ncnIVU-kCGmeg4AEuOgA3eIMtu5U_sODQdPPyZjDh6NwDuV8L3t3k8PGi__V7I-HjQb-4RRtsqM9xYaEkYwFi3Wba_4EjHGojxflUyfWAXYf1_YdcW-FBj8ew2eiMgpPNBA5KOn1JNQhbbKDQW4 Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.25 Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 5c99a4e2a24548ba906dd57b88cc0aba Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:00:21.848113 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5c99a4e2a24548ba906dd57b88cc0aba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 5c99a4e2a24548ba906dd57b88cc0aba Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-LiveAutoBlockMigrationV225Test-1556093481-project Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 343f309c07e343b4b15268472d19f10c Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481-project Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance c6bbf929-686e-4283-a462-91a5f7eb10b5 could not be found. Aug 06 21:00:21.849997 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'c6bbf929-686e-4283-a462-91a5f7eb10b5'} Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6bbf929-686e-4283-a462-91a5f7eb10b5 could not be found. Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:00:21.851006 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6bbf929-686e-4283-a462-91a5f7eb10b5 could not be found. Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6bbf929-686e-4283-a462-91a5f7eb10b5 could not be found. Aug 06 21:00:21.852562 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:21.861339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Returning 404 to user: Instance c6bbf929-686e-4283-a462-91a5f7eb10b5 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:00:21.862526 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-def45ad8-7cab-48ca-8ef6-cc5c5836267f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5" status: 404 len: 111 microversion: 2.25 time: 0.137654 Aug 06 21:00:21.871708 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 948/1907] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:21 2022] GET /compute/v2.1/servers/c6bbf929-686e-4283-a462-91a5f7eb10b5 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:00:21.889639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:21.896667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:21.932537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:21.941659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:21.942508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:21.943662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:21.944370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:21.945055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:22.221784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:22.241629 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-be9b6651-00d3-4116-89af-6c4d2a0965e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 0.368195 Aug 06 21:00:22.242885 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 949/1908] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:21 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:22.256142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-554c143d-ea35-413a-bc62-7d324a196fb0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d556550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:25.073862 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-554c143d-ea35-413a-bc62-7d324a196fb0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 2.827353 Aug 06 21:00:25.075543 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 950/1909] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:22 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:25.087514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:25.090720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:25.106929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:25.107448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:25.107896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:25.110611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:25.111412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:25.112056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:25.776830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:25.788886 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-669e8fd7-dc35-421d-a707-084adb661b7a tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.710949 Aug 06 21:00:25.789469 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 951/1910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:25 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:25.812807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:25.816427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:25.827754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:25.833208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:25.833945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:25.834949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:25.835645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:25.836324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:26.105592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:26.117184 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a26716dc-a69c-46b7-b3c4-c5ce1135a3d7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 0.317196 Aug 06 21:00:26.127012 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 952/1911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:25 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:26.145688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:26.146773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:26.159782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:26.161807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:26.162933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:26.167023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:26.169503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:26.171028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:26.240008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:00:26.527720 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b0ab321-5da8-4899-9d2b-f721a43910dc tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 204 len: 0 microversion: 2.25 time: 0.379266 Aug 06 21:00:26.535857 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 953/1912] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:00:26 2022] DELETE /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:00:26.557053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d9bcd699-b118-44a9-b78c-c03cb7b2cd4c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d63a790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:26.691967 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d9bcd699-b118-44a9-b78c-c03cb7b2cd4c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.150537 Aug 06 21:00:26.692903 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 954/1913] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:26 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:26.698402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:26.721005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:26.753837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:26.757750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:26.761006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:26.761807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:26.762327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:26.762793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:27.351123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:27.365198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:27.367982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:27.372081 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9db3b6e4-7c22-4474-ad8f-d810a731da13 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1731 microversion: 2.25 time: 0.677290 Aug 06 21:00:27.377403 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 955/1914] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:26 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1731 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:27.392350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:27.394959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:27.413397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:27.414309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:27.415169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:27.416204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:27.416897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:27.417599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:27.886133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:27.907566 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2fd84a9b-7c85-40cd-8274-c1b773541530 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.528579 Aug 06 21:00:27.908345 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 956/1915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:27 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:27.913165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:27.917249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:27.940287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:27.952955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:27.953700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:27.954659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:27.960914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:27.961518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:28.373333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:28.394043 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2414c82e-89c3-4c11-a680-9a445eec4231 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 0.483779 Aug 06 21:00:28.405720 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 957/1916] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:27 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:28.427760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-381f618d-133d-44c2-9f5f-81692dbcd72a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d561af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:28.512478 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-381f618d-133d-44c2-9f5f-81692dbcd72a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.105366 Aug 06 21:00:28.513493 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 958/1917] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:28 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:28.518376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:28.532163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:28.564130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:28.566296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:28.566962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:28.567803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:28.572139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:28.572725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:28.947023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:29.473519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:29.483492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:29.491085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:29.501168 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-60bfb51a-b061-4e37-9b96-6876d6c6271b tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1731 microversion: 2.25 time: 0.986342 Aug 06 21:00:29.505413 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 959/1918] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:28 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1731 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:29.514366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:29.519696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:29.534861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:29.539003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:29.539787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:29.540781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:29.541635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:29.546395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:30.048429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:30.057449 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b7d025fa-6e57-4693-b461-9ee890908c17 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.550635 Aug 06 21:00:30.066040 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 960/1919] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:29 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:30.103045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:30.107844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:30.128398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:30.128927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:30.129388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:30.130145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:30.130655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:30.131108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:30.938423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:30.954384 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d315a49-182d-47f5-b2b4-5accbc9e8eb9 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 0.883885 Aug 06 21:00:30.969812 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 961/1920] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:30 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:30.997467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1150341f-e223-49a5-877f-04743ffee8d4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729de1dc10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:31.115435 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1150341f-e223-49a5-877f-04743ffee8d4 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1412 microversion: 2.1 time: 0.139971 Aug 06 21:00:31.116345 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 962/1921] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:30 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:31.138577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:31.138577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:31.185240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:31.185745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:31.186270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:31.186969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:31.187436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:31.187871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:31.390123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:31.394947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:31.413265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:31.423730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:31.428412 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b7f064c1-f4e7-4861-9974-b4b7218a36e6 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1663 microversion: 2.25 time: 0.304373 Aug 06 21:00:31.431208 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 963/1922] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:31 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1663 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:31.471927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:31.475812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:31.524136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:31.527371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:31.530505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:31.531451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:31.533642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:31.534213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:32.393633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:32.408693 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5a5b39a-6065-47ef-9574-657400a04805 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.964205 Aug 06 21:00:32.410805 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 964/1923] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:31 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:32.418581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:32.418581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:32.453648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:32.454173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:32.454658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:32.455389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:32.455859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:32.457880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:33.317093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:33.332505 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-492ce797-aa6f-4092-aab7-b6b4379a9ef5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 0.918509 Aug 06 21:00:33.339614 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 965/1924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:32 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:33.362988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42272a48-c784-46b5-9950-27320cf38031 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d7a1ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:33.450365 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42272a48-c784-46b5-9950-27320cf38031 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1421 microversion: 2.1 time: 0.100411 Aug 06 21:00:33.452741 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 966/1925] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:33 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:33.459286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:33.460240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:33.461337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:33.471225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:33.472085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:33.472710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:33.473690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:33.474327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:33.475313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:33.599430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:33.617524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:33.619040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:33.626471 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32ff5f99-6191-48a3-bfe4-ccabd149b0ba tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 200 len: 1663 microversion: 2.25 time: 0.171429 Aug 06 21:00:33.629239 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 967/1926] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:33 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 1663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:33.642867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-49344237-d04d-4e2f-be38-494dcb0c1f61 req-e5b1fbf5-c363-4ebb-9424-96b9be8fdbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef35ec0-f619-4ed6-9fbd-687eb753f51e", "name": "network-vif-plugged", "status": "completed", "tag": "8029828f-6dbc-4719-b4d4-04cf73c5308c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:33.664283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49344237-d04d-4e2f-be38-494dcb0c1f61 req-e5b1fbf5-c363-4ebb-9424-96b9be8fdbd4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:33.664781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49344237-d04d-4e2f-be38-494dcb0c1f61 req-e5b1fbf5-c363-4ebb-9424-96b9be8fdbd4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:33.672564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49344237-d04d-4e2f-be38-494dcb0c1f61 req-e5b1fbf5-c363-4ebb-9424-96b9be8fdbd4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:33.708917 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-49344237-d04d-4e2f-be38-494dcb0c1f61 req-e5b1fbf5-c363-4ebb-9424-96b9be8fdbd4 service nova] Creating event network-vif-plugged:8029828f-6dbc-4719-b4d4-04cf73c5308c for instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e on nch2-master-1 Aug 06 21:00:33.723560 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-49344237-d04d-4e2f-be38-494dcb0c1f61 req-e5b1fbf5-c363-4ebb-9424-96b9be8fdbd4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092657 Aug 06 21:00:33.724595 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 968/1927] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:33.730212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:33.730867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:33.751024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:33.751857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:33.752956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:33.755663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:33.756357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:33.758049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:34.287915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:34.300507 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d06fa67-f70a-4aea-8908-be56c0ce3d1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.574608 Aug 06 21:00:34.302804 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 969/1928] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:33 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:34.316778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22d13a5b-2e22-4b9e-b572-13e273c7d23a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d5a4a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:34.431763 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22d13a5b-2e22-4b9e-b572-13e273c7d23a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 200 len: 1421 microversion: 2.1 time: 0.127677 Aug 06 21:00:34.433795 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 970/1929] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:34 2022] GET /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 1421 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:34.442487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:34.443552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:34.452268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:34.453605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:34.454466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:34.455511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:34.456240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:34.457065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:35.589039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:35.623177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5fa44162-f2b0-456f-bbeb-39d3afc7f0b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1504 microversion: 2.1 time: 1.187807 Aug 06 21:00:35.629716 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 971/1930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:34 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1504 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:35.646470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-45b701e6-62f9-4dbe-a006-72b21a36b524 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d7591f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:37.210411 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-45b701e6-62f9-4dbe-a006-72b21a36b524 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 204 len: 0 microversion: 2.1 time: 1.575945 Aug 06 21:00:37.211723 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 972/1931] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:35 2022] DELETE /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 0 bytes in 1581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:00:37.217011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:37.218311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: a87d6735-5d42-4f96-aac5-55b50a1a804f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:37.250437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:37.258994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:37.259711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:37.260698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:37.263872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:37.265626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:37.301180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] HTTP exception thrown: Instance a87d6735-5d42-4f96-aac5-55b50a1a804f could not be found. Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Request method failure captured: Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f HTTP/1.1 Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tT_Lzg3VoctJ61__nynqdPlVtZ9ncnIVU-kCGmeg4AEuOgA3eIMtu5U_sODQdPPyZjDh6NwDuV8L3t3k8PGi__V7I-HjQb-4RRtsqM9xYaEkYwFi3Wba_4EjHGojxflUyfWAXYf1_YdcW-FBj8ew2eiMgpPNBA5KOn1JNQhbbKDQW4 Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.25 Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 5c99a4e2a24548ba906dd57b88cc0aba Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:00:37.312710 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5c99a4e2a24548ba906dd57b88cc0aba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 5c99a4e2a24548ba906dd57b88cc0aba Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-LiveAutoBlockMigrationV225Test-1556093481-project Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 343f309c07e343b4b15268472d19f10c Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481-project Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance a87d6735-5d42-4f96-aac5-55b50a1a804f could not be found. Aug 06 21:00:37.314958 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'a87d6735-5d42-4f96-aac5-55b50a1a804f'} Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87d6735-5d42-4f96-aac5-55b50a1a804f could not be found. Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:00:37.316146 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87d6735-5d42-4f96-aac5-55b50a1a804f could not be found. Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87d6735-5d42-4f96-aac5-55b50a1a804f could not be found. Aug 06 21:00:37.317954 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:37.320456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Returning 404 to user: Instance a87d6735-5d42-4f96-aac5-55b50a1a804f could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:00:37.321611 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08ca8a4c-696a-44c8-88dc-04a79b177fee tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f" status: 404 len: 111 microversion: 2.25 time: 0.108770 Aug 06 21:00:37.322369 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 973/1932] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:37 2022] GET /compute/v2.1/servers/a87d6735-5d42-4f96-aac5-55b50a1a804f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:00:37.339063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-96a0f56d-9512-4411-8241-8f1656512c81 req-6074f9f4-ef3b-4b37-9da0-cdcc52676905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87d6735-5d42-4f96-aac5-55b50a1a804f", "name": "network-vif-deleted", "tag": "270cefb5-0f7a-43e8-8015-bdf5afc1c875"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:37.367145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:37.369200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-96a0f56d-9512-4411-8241-8f1656512c81 req-6074f9f4-ef3b-4b37-9da0-cdcc52676905 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:37.369944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-96a0f56d-9512-4411-8241-8f1656512c81 req-6074f9f4-ef3b-4b37-9da0-cdcc52676905 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:37.374998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-96a0f56d-9512-4411-8241-8f1656512c81 req-6074f9f4-ef3b-4b37-9da0-cdcc52676905 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:37.396180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-96a0f56d-9512-4411-8241-8f1656512c81 req-6074f9f4-ef3b-4b37-9da0-cdcc52676905 service nova] Creating event network-vif-deleted:270cefb5-0f7a-43e8-8015-bdf5afc1c875 for instance a87d6735-5d42-4f96-aac5-55b50a1a804f on nch1-master-1 Aug 06 21:00:37.414603 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-96a0f56d-9512-4411-8241-8f1656512c81 req-6074f9f4-ef3b-4b37-9da0-cdcc52676905 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090736 Aug 06 21:00:37.415214 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 974/1933] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:37.430127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:37.431188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:37.449346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:37.451935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:37.452567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:37.453635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:37.455093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:37.455701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:37.865951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:00:37.866505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:00:37.867235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:00:37.867669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:00:37.868066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:00:37.893229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:37.893721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:37.894163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:37.894945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:37.902071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:37.902687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:37.964147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Getting quotas for project 26d35f36722e4fc8ac7d222cf93883e9. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:00:37.976918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Getting quotas for user dd9a63d793aa4a55822bfe108df664a3 and project 26d35f36722e4fc8ac7d222cf93883e9. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:00:38.159809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:38.175663 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e457457-f0e9-477e-a85a-6bfc32cf24f7 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 0.746162 Aug 06 21:00:38.176340 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 975/1934] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:37 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:38.200742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c1e62965-fd57-49b9-bf0d-7c1b33dff545 req-9a685e25-5177-4436-b100-960db7c2d489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef35ec0-f619-4ed6-9fbd-687eb753f51e", "name": "network-vif-plugged", "status": "completed", "tag": "4a77ce44-2fe1-42c5-bd05-d6fb0ddcab89"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:38.235232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1e62965-fd57-49b9-bf0d-7c1b33dff545 req-9a685e25-5177-4436-b100-960db7c2d489 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:38.241849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1e62965-fd57-49b9-bf0d-7c1b33dff545 req-9a685e25-5177-4436-b100-960db7c2d489 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:38.245067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1e62965-fd57-49b9-bf0d-7c1b33dff545 req-9a685e25-5177-4436-b100-960db7c2d489 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:38.316731 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c1e62965-fd57-49b9-bf0d-7c1b33dff545 req-9a685e25-5177-4436-b100-960db7c2d489 service nova] Creating event network-vif-plugged:4a77ce44-2fe1-42c5-bd05-d6fb0ddcab89 for instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e on nch2-master-1 Aug 06 21:00:38.338333 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c1e62965-fd57-49b9-bf0d-7c1b33dff545 req-9a685e25-5177-4436-b100-960db7c2d489 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155356 Aug 06 21:00:38.346637 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 976/1935] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:38.367219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:38.372520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:38.391686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:38.395834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:38.396674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:38.402412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:00:38.406162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2381464f-8d79-4e5e-8926-b919fcd72240',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4297f47d-31a4-4957-9809-e323b1575be7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2a66353-40fa-4672-99aa-9f8e137e1126',volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:00:38.421315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:38.433359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:38.446877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:39.086639 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 20.151727 Aug 06 21:00:39.094998 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 960/1936] 10.222.0.33 () {62 vars in 1189 bytes} [Sat Aug 6 21:00:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 20161 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:00:39.102523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:39.103366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:39.113005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:39.114023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:39.115024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:39.116373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:39.118179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:39.119105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:39.172849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:00:39.288125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:39.295231 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e1e9f101-7756-41f8-90aa-7144b2141b7e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 204 len: 0 microversion: 2.1 time: 0.195505 Aug 06 21:00:39.297449 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 961/1937] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:00:39 2022] DELETE /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:00:39.318768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df29cabf-7c47-4b6c-ba33-f24097fe82b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '.version_select at 0x7f72a36aca60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:39.319203 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a85fd754-1fab-4dab-9706-b9af5c6ac4a4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1494 microversion: 2.1 time: 0.962060 Aug 06 21:00:39.330372 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 977/1938] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:38 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1494 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:39.336698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75ca358f-01d7-4234-80c9-be6af361d5df tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:39.348573 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df29cabf-7c47-4b6c-ba33-f24097fe82b5 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062076998" status: 204 len: 0 microversion: 2.25 time: 0.044614 Aug 06 21:00:39.355882 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 962/1939] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062076998 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:00:39.364168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75ca358f-01d7-4234-80c9-be6af361d5df tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:39.402729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:39.409077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:39.457884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:39.458389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:39.458862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:39.473692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:39.474225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:39.474718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:39.675399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-75ca358f-01d7-4234-80c9-be6af361d5df tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:39.686151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-75ca358f-01d7-4234-80c9-be6af361d5df tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:39.694137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-75ca358f-01d7-4234-80c9-be6af361d5df tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:39.701174 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75ca358f-01d7-4234-80c9-be6af361d5df tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1285 microversion: 2.42 time: 0.369066 Aug 06 21:00:39.717550 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 978/1940] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:39 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1285 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:39.735149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6ebf127b-983c-4c1d-bb32-e7d5f41a4164 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '.version_select at 0x7f729d561ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:39.748202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ebf127b-983c-4c1d-bb32-e7d5f41a4164 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:39.750009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ebf127b-983c-4c1d-bb32-e7d5f41a4164 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:39.754508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ebf127b-983c-4c1d-bb32-e7d5f41a4164 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:39.775474 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6ebf127b-983c-4c1d-bb32-e7d5f41a4164 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.053466 Aug 06 21:00:39.776046 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 979/1941] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 21:00:39 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:39.802803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-793133770", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "a17c0b0a-6719-44f2-8dc6-4a0cb498bc1f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:39.895752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] validate_networks() for [('a17c0b0a-6719-44f2-8dc6-4a0cb498bc1f', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:00:40.349861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:40.361101 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e49e1fed-eb56-4fc6-98d5-9c9a5bbcbeb5 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1334 microversion: 2.1 time: 1.002086 Aug 06 21:00:40.361920 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 963/1942] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:39 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1334 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:40.374610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2b70ae55-c7ba-4fe7-9aee-b3b057273747 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:40.376099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2b70ae55-c7ba-4fe7-9aee-b3b057273747 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:40.399963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b70ae55-c7ba-4fe7-9aee-b3b057273747 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:40.400688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b70ae55-c7ba-4fe7-9aee-b3b057273747 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:40.402197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b70ae55-c7ba-4fe7-9aee-b3b057273747 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:40.403672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b70ae55-c7ba-4fe7-9aee-b3b057273747 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:40.404401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b70ae55-c7ba-4fe7-9aee-b3b057273747 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:40.405017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b70ae55-c7ba-4fe7-9aee-b3b057273747 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:40.777632 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2b70ae55-c7ba-4fe7-9aee-b3b057273747 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1645 microversion: 2.1 time: 0.413520 Aug 06 21:00:40.781172 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 964/1943] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:40 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1645 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:41.180316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f8433674-63f7-4850-9d7d-ecb8e5aa9bd6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Action: 'create', calling method: .version_select at 0x7f729d88e700>, body: {"keypair": {"name": "tempest-keypair-1073919174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCR8kIkbyvqsnf4gMIK5u5dr89Uj5M4ZwgTlWNg7savEUQH2bMBOfSP3PMAtduMZ+V2IoxDhu1NU6fPa91rHe0sG01Q9SBEMjTZz/UgXb6TrWSmVKPDe0MqZAtSIHVKn1g=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:41.214803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f8433674-63f7-4850-9d7d-ecb8e5aa9bd6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Getting quotas for project afc36f344d274f89b5139ba88bef375b. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:00:41.240721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f8433674-63f7-4850-9d7d-ecb8e5aa9bd6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Getting quotas for user 145439e0e0d549f89b17e81cbd46c580 and project afc36f344d274f89b5139ba88bef375b. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:00:41.314060 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f8433674-63f7-4850-9d7d-ecb8e5aa9bd6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.531486 Aug 06 21:00:41.326415 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 965/1944] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:00:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:41.338671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-28fae2bc-8d67-465e-a397-a6b18209f00d req-b7e488e2-3244-4909-99b0-44f978746897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bcfa59-4102-4577-b6de-82c9c5d59911", "name": "network-vif-unplugged", "status": "completed", "tag": "7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:41.368293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-28fae2bc-8d67-465e-a397-a6b18209f00d req-b7e488e2-3244-4909-99b0-44f978746897 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:41.371737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-28fae2bc-8d67-465e-a397-a6b18209f00d req-b7e488e2-3244-4909-99b0-44f978746897 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:41.372548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-28fae2bc-8d67-465e-a397-a6b18209f00d req-b7e488e2-3244-4909-99b0-44f978746897 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:41.422839 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-28fae2bc-8d67-465e-a397-a6b18209f00d req-b7e488e2-3244-4909-99b0-44f978746897 service nova] Creating event network-vif-unplugged:7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9 for instance 75bcfa59-4102-4577-b6de-82c9c5d59911 on nch2-master-1 Aug 06 21:00:41.437355 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-28fae2bc-8d67-465e-a397-a6b18209f00d req-b7e488e2-3244-4909-99b0-44f978746897 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107663 Aug 06 21:00:41.439202 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 966/1945] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:41.453193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:41.456093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:41.472807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:41.489407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:41.509467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:41.512267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:41.517991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:41.518733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:42.244520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:42.269029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:42.275656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:42.292638 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c1f0ace1-1881-4231-b9e7-9c04a5654c0d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1519 microversion: 2.42 time: 0.839922 Aug 06 21:00:42.294335 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 967/1946] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:41 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1519 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:42.335349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-801820570", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5fee4f47-5ab3-4921-b8aa-c6b0a41eb20e"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:42.542785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] validate_networks() for [('5fee4f47-5ab3-4921-b8aa-c6b0a41eb20e', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:00:42.777852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:00:42.779974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:00:42.780931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:00:42.781997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:00:42.782814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:00:42.803490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:42.807069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:42.808198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:42.810534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:42.812163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:42.812626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:42.904645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Getting quotas for project 764e8bbcc05b47e5a647cf2a0fe82a20. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:00:42.922744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Getting quotas for user d43d0d15118242b7a60cc34c512fbe5e and project 764e8bbcc05b47e5a647cf2a0fe82a20. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:00:42.949322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:00:42.955598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:00:43.069691 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0ef1e250-2b5a-4713-abc0-a0264eb4f54c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.285855 Aug 06 21:00:43.071740 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 980/1947] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:00:43.084729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:43.085549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:43.103390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:43.107401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:43.108749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:43.109873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:43.112460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:43.113218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:43.993073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:44.011325 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6b794d6-66c1-4139-a983-2530961978c4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1669 microversion: 2.1 time: 0.937792 Aug 06 21:00:44.025335 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 981/1948] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:43 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1669 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:44.038178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c0624e6-87e6-487e-9f5c-f9cc54dca43e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:44.042158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2c0624e6-87e6-487e-9f5c-f9cc54dca43e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:44.220804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2c0624e6-87e6-487e-9f5c-f9cc54dca43e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:44.233893 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2c0624e6-87e6-487e-9f5c-f9cc54dca43e tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1207 microversion: 2.1 time: 0.204351 Aug 06 21:00:44.235669 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 982/1949] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:44 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1207 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:44.260222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:44.264254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:44.294583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:44.302349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:44.307752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:44.315371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:44.316484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:44.319319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:44.693333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:44.709941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:44.715908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:44.720402 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01975222-0178-4b15-b9c8-b0d4ec3ef711 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1593 microversion: 2.42 time: 0.481082 Aug 06 21:00:44.735677 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 983/1950] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:44 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1593 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:44.745226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f4ff28f7-a14c-45e0-af42-8a79f9a81a7b req-907d337f-f796-4fd5-be93-2a5c2b4477ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75bcfa59-4102-4577-b6de-82c9c5d59911", "name": "network-vif-deleted", "tag": "7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:44.767007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f4ff28f7-a14c-45e0-af42-8a79f9a81a7b req-907d337f-f796-4fd5-be93-2a5c2b4477ec service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:44.768627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f4ff28f7-a14c-45e0-af42-8a79f9a81a7b req-907d337f-f796-4fd5-be93-2a5c2b4477ec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:44.769317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f4ff28f7-a14c-45e0-af42-8a79f9a81a7b req-907d337f-f796-4fd5-be93-2a5c2b4477ec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:44.784585 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f4ff28f7-a14c-45e0-af42-8a79f9a81a7b req-907d337f-f796-4fd5-be93-2a5c2b4477ec service nova] Creating event network-vif-deleted:7eeae1b8-3706-4b1a-b6dc-cfe3b76043f9 for instance 75bcfa59-4102-4577-b6de-82c9c5d59911 on nch2-master-1 Aug 06 21:00:44.815908 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f4ff28f7-a14c-45e0-af42-8a79f9a81a7b req-907d337f-f796-4fd5-be93-2a5c2b4477ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076964 Aug 06 21:00:44.816847 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 984/1951] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:44.823965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:44.825474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:44.833808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:44.834744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:44.835458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:44.836315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:44.837032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:44.837701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:44.869081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:00:45.059943 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aaae136c-a8a9-4d09-b0d4-2af2eeabb80e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 204 len: 0 microversion: 2.25 time: 0.239467 Aug 06 21:00:45.061170 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 985/1952] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:00:44 2022] DELETE /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:00:45.092245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0f7c3e32-883b-46f2-b232-45d3188bf8ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:45.096890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0f7c3e32-883b-46f2-b232-45d3188bf8ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:45.130110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f7c3e32-883b-46f2-b232-45d3188bf8ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:45.132807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f7c3e32-883b-46f2-b232-45d3188bf8ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:45.135830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f7c3e32-883b-46f2-b232-45d3188bf8ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:45.140322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f7c3e32-883b-46f2-b232-45d3188bf8ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:45.143404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f7c3e32-883b-46f2-b232-45d3188bf8ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:45.145721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f7c3e32-883b-46f2-b232-45d3188bf8ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:45.242719 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0f7c3e32-883b-46f2-b232-45d3188bf8ca tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e/ips" status: 200 len: 179 microversion: 2.1 time: 0.173370 Aug 06 21:00:45.249195 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 986/1953] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:00:45 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e/ips => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:45.275802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:45.277151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:45.304003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:45.313519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:45.315980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:45.317158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:45.320264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:45.323639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:45.892616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:45.905581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:45.909895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:45.912080 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8176a0de-ed8d-4bea-9d4e-9d5e16bc8a8d tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1548 microversion: 2.25 time: 0.659178 Aug 06 21:00:45.916988 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 987/1954] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:45 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1548 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:45.932153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:45.932526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:45.958461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:45.960552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:45.962216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:45.965354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:45.966115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:45.966873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:46.047304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:00:46.055430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:46.269099 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a9daa5d-4ee7-4d03-b5c1-88c005c271ac tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 204 len: 0 microversion: 2.1 time: 0.350352 Aug 06 21:00:46.270306 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 988/1955] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:00:45 2022] DELETE /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:00:46.277064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:46.278175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:46.286498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:46.287176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:46.287725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:46.288582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:46.289115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:46.291732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:46.421117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:00:46.421560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:00:46.422921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:00:46.423862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:00:46.424359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:00:46.447066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:46.456500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:46.461176 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0e95135d-d2fe-4d41-8029-096145217618 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1265 microversion: 2.1 time: 0.188440 Aug 06 21:00:46.461771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:46.463026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:46.467752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:46.468127 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 989/1956] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:46 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:46.468857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:46.475076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:46.533130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for project e47f439135a6445fa29c8be6d69c1759. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:00:46.551745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for user ad1a96004778407584d1805b07ad1c5f and project e47f439135a6445fa29c8be6d69c1759. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:00:46.588514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:00:46.593681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:00:46.614200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8de3d68-e32f-4568-bd99-0124660e5bb4 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Action: 'create', calling method: .version_select at 0x7f72a367dc10>, body: {"keypair": {"name": "tempest-keypair-1159788295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbsuw2KJlM+Dc41/qmkoM8nlXNEWKYKd8AKB8LuZAU9TITzSwLW+Z38/e7pbfL8T86MzQQ+Rz9SRTX6nHwdXq2am/NLXS6ETIh3g2tEfz06CHMjIVWFWRtaydqjkhwbPA=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:46.667225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d8de3d68-e32f-4568-bd99-0124660e5bb4 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Getting quotas for project e9acff8060d543c3b8422b25fdc1119b. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:00:46.686200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d8de3d68-e32f-4568-bd99-0124660e5bb4 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Getting quotas for user 62e7c88630854feb8e5f74c105f70825 and project e9acff8060d543c3b8422b25fdc1119b. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:00:46.707906 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab7e38ef-9c47-4869-9405-effce936023d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.378723 Aug 06 21:00:46.709885 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 968/1957] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:00:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:00:46.724769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:46.727511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:46.750591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:46.755889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:46.756632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:46.757581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:46.758230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:46.759381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:46.784642 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d8de3d68-e32f-4568-bd99-0124660e5bb4 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314530 Aug 06 21:00:46.785442 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 990/1958] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:00:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:46.803853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:46.804508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:46.853874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:46.854381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:46.854860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:46.855598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:46.856053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:46.857700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:47.166637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:47.189193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:47.194671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:47.195892 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b6226e9b-4038-4ccc-9bdb-8a54e1efa019 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1593 microversion: 2.42 time: 0.484260 Aug 06 21:00:47.196451 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 969/1959] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:46 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1593 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:47.221963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aed2a185-1be9-40de-933b-a5f55c98940d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:47.222780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aed2a185-1be9-40de-933b-a5f55c98940d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:47.917405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:47.934207 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f37fd43b-01df-460e-ae61-c886c8341bf0 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1675 microversion: 2.1 time: 1.146879 Aug 06 21:00:47.936468 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 991/1960] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:46 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1675 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:47.954128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:47.957864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:47.973376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:47.974426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:47.976440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:47.979030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:47.979816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:47.981287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:48.029710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aed2a185-1be9-40de-933b-a5f55c98940d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:48.040421 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aed2a185-1be9-40de-933b-a5f55c98940d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1210 microversion: 2.1 time: 0.830890 Aug 06 21:00:48.044523 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 970/1961] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:47 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1210 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:48.056880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:48.063586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:48.081145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:48.086764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:48.089684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:48.094623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:48.097773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:48.099961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:48.793402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:48.802851 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b9514c94-2074-44ea-a697-f62c6417592f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1307 microversion: 2.1 time: 0.757057 Aug 06 21:00:48.831888 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 971/1962] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:48 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1307 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:48.864277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:48.871714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:48.905413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:48.908676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:48.911990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:48.915644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:48.918571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:48.919960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:49.000133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:49.025874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:49.030470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:49.035023 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37de1f6c-6b1e-4675-b752-31057802d21f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1548 microversion: 2.25 time: 1.095958 Aug 06 21:00:49.037449 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 992/1963] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:47 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1548 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:49.052193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:49.052193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:49.072710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:49.073160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:49.073617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:49.074472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:49.075400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:49.076017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:49.436933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:49.470377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:49.472179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:49.478618 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e832aaf2-4d96-4032-aeac-6f989e3932e2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1593 microversion: 2.42 time: 0.645371 Aug 06 21:00:49.479544 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 972/1964] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:48 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1593 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:49.496508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:49.497619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:49.524985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:49.525805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:49.526530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:49.527581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:49.534848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:49.535740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:50.374005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:50.392623 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e33542a6-bbf3-4b1f-a92b-65451723bfb9 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1675 microversion: 2.1 time: 1.352622 Aug 06 21:00:50.418575 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 993/1965] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:49 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1675 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:50.468857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:50.482932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:50.485133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:50.492856 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-48de62ad-0375-42cf-b9f8-1d655be4b41e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1268 microversion: 2.1 time: 1.010509 Aug 06 21:00:50.505109 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 973/1966] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:49 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1268 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:50.520535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:50.521158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:50.523878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:50.524725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:50.526315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:50.528811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:50.531993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:50.533416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:50.536539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:50.538734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:50.539271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:50.543105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:50.543933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:50.544388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:51.100022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:51.120444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:51.126245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:51.131162 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f0a919e1-9c94-4f36-aa4d-8c55bed829e7 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 200 len: 1506 microversion: 2.25 time: 0.623400 Aug 06 21:00:51.132444 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 974/1967] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:50 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:51.144869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-673202924", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "3187ba96-af9c-4655-aa30-5b4cd76c6eb6"}], "security_groups": [{"name": "tempest-securitygroup--1645310242"}], "key_name": "tempest-keypair-1073919174", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:51.340156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:51.353239 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e3800390-f167-463e-b0c8-d90a28b7065d tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1307 microversion: 2.1 time: 0.921647 Aug 06 21:00:51.355598 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 994/1968] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:50 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1307 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:51.368843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:51.370011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:51.385049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:51.387957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:51.390824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:51.391799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:51.394064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:51.394755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:51.614940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] validate_networks() for [('3187ba96-af9c-4655-aa30-5b4cd76c6eb6', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:00:51.808035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:51.824746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:51.842894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:51.844263 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-51fb9b7e-c4ae-4ad7-a763-7198ec4e42ca tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1661 microversion: 2.42 time: 0.486829 Aug 06 21:00:51.844856 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 995/1969] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:51 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1661 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:51.895442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-a3e13bb1-d1ff-4ce1-b4a1-b4a549952f2d req-0e76612e-8b32-41e2-80d0-641e64d7d707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7468a9b2-902c-4b29-bdc2-230d3f558c4b", "name": "network-vif-deleted", "tag": "0f582021-42a5-4a6d-ab3f-f6de4b82347d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:51.936502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a3e13bb1-d1ff-4ce1-b4a1-b4a549952f2d req-0e76612e-8b32-41e2-80d0-641e64d7d707 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:51.937297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a3e13bb1-d1ff-4ce1-b4a1-b4a549952f2d req-0e76612e-8b32-41e2-80d0-641e64d7d707 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:51.937938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a3e13bb1-d1ff-4ce1-b4a1-b4a549952f2d req-0e76612e-8b32-41e2-80d0-641e64d7d707 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:51.973141 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a3e13bb1-d1ff-4ce1-b4a1-b4a549952f2d req-0e76612e-8b32-41e2-80d0-641e64d7d707 service nova] Creating event network-vif-deleted:0f582021-42a5-4a6d-ab3f-f6de4b82347d for instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b on nch1-master-1 Aug 06 21:00:51.980710 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-a3e13bb1-d1ff-4ce1-b4a1-b4a549952f2d req-0e76612e-8b32-41e2-80d0-641e64d7d707 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117690 Aug 06 21:00:51.986911 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 996/1970] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:52.000845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:52.002246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:52.020986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:52.021907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:52.022819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:52.023817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:52.030850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:52.031678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:52.368076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:52.377026 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7657bd0f-f7e8-455b-944f-02e5bcadbec8 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1675 microversion: 2.1 time: 0.388424 Aug 06 21:00:52.377621 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 997/1971] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:51 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1675 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:52.400067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:52.412155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:52.418715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:52.422028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:52.422780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:52.423771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:52.424437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:52.431270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:52.541166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:52.550183 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16030e4f-ebd6-403b-a8ae-d67371ada783 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1268 microversion: 2.1 time: 0.153958 Aug 06 21:00:52.563028 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 998/1972] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:52 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:52.568113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:52.568941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: 7468a9b2-902c-4b29-bdc2-230d3f558c4b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:52.578038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:52.579789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:52.582566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:52.583597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:52.585805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:52.586462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:52.615185 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] HTTP exception thrown: Instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b could not be found. Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Request method failure captured: Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b HTTP/1.1 Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tT_Lzg3VoctJ61__nynqdPlVtZ9ncnIVU-kCGmeg4AEuOgA3eIMtu5U_sODQdPPyZjDh6NwDuV8L3t3k8PGi__V7I-HjQb-4RRtsqM9xYaEkYwFi3Wba_4EjHGojxflUyfWAXYf1_YdcW-FBj8ew2eiMgpPNBA5KOn1JNQhbbKDQW4 Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.25 Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 5c99a4e2a24548ba906dd57b88cc0aba Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:00:52.617922 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5c99a4e2a24548ba906dd57b88cc0aba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 5c99a4e2a24548ba906dd57b88cc0aba Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-LiveAutoBlockMigrationV225Test-1556093481-project Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 343f309c07e343b4b15268472d19f10c Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481-project Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b could not be found. Aug 06 21:00:52.620142 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7468a9b2-902c-4b29-bdc2-230d3f558c4b'} Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b could not be found. Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:00:52.620996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b could not be found. Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b could not be found. Aug 06 21:00:52.622993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:00:52.625695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Returning 404 to user: Instance 7468a9b2-902c-4b29-bdc2-230d3f558c4b could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:00:52.626926 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6461246-26a3-477f-b286-638c5826460e tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b" status: 404 len: 111 microversion: 2.25 time: 0.062567 Aug 06 21:00:52.631532 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 999/1973] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:52 2022] GET /compute/v2.1/servers/7468a9b2-902c-4b29-bdc2-230d3f558c4b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:00:52.639212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:52.640101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:52.648680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:52.649553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:52.650228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:52.651240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:52.651934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:52.659180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:52.880582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:53.159993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:53.172636 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5e6a35e9-2948-4f62-95f5-285f620c9f94 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1307 microversion: 2.1 time: 0.539311 Aug 06 21:00:53.173656 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1000/1974] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:52 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1307 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:53.180952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d2d01b82-dbea-427b-a150-c2db19e42e2f req-39efb86f-67ea-4255-916a-0f2d0ef24aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef35ec0-f619-4ed6-9fbd-687eb753f51e", "name": "network-vif-unplugged", "status": "completed", "tag": "8029828f-6dbc-4719-b4d4-04cf73c5308c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:53.225115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d2d01b82-dbea-427b-a150-c2db19e42e2f req-39efb86f-67ea-4255-916a-0f2d0ef24aaa service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:53.227614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d2d01b82-dbea-427b-a150-c2db19e42e2f req-39efb86f-67ea-4255-916a-0f2d0ef24aaa service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:53.228159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d2d01b82-dbea-427b-a150-c2db19e42e2f req-39efb86f-67ea-4255-916a-0f2d0ef24aaa service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:53.252530 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d2d01b82-dbea-427b-a150-c2db19e42e2f req-39efb86f-67ea-4255-916a-0f2d0ef24aaa service nova] Creating event network-vif-unplugged:8029828f-6dbc-4719-b4d4-04cf73c5308c for instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e on nch2-master-1 Aug 06 21:00:53.274015 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d2d01b82-dbea-427b-a150-c2db19e42e2f req-39efb86f-67ea-4255-916a-0f2d0ef24aaa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096677 Aug 06 21:00:53.276675 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1001/1975] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:53.288923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:53.295362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:53.314473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:53.315369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:53.316067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:53.317059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:53.317773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:53.318487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:53.365254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:00:53.563927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:53.581434 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-60f05897-24b7-4859-85f4-f8b97269339f tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 204 len: 0 microversion: 2.25 time: 0.300987 Aug 06 21:00:53.583816 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1002/1976] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:00:53 2022] DELETE /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:00:53.616999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:53.620004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:53.659027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:53.659914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:53.660614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:53.661631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:53.681136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:53.681880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:54.082625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:00:54.083137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:00:54.083766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:00:54.084374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:00:54.084797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:00:54.101649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:54.102477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:54.103129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:54.104138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:54.104674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:54.105335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:54.131871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Getting quotas for project afc36f344d274f89b5139ba88bef375b. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:00:54.140360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Getting quotas for user 145439e0e0d549f89b17e81cbd46c580 and project afc36f344d274f89b5139ba88bef375b. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:00:54.166209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:00:54.169806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:00:54.265459 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c26da2d-ae2f-4e80-b998-ae20c23b9f10 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.129918 Aug 06 21:00:54.275245 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 975/1977] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:00:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 3141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:00:54.280491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:54.281125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:54.308568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:54.309080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:54.310200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:54.310854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:54.311910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:54.312518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:54.344708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:54.370584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:54.375457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:54.376824 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53eee367-5a47-40fa-81b3-cf97798624b9 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1649 microversion: 2.42 time: 0.789094 Aug 06 21:00:54.377395 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1003/1978] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:53 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1649 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:54.395993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:54.401176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:54.413883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:54.414395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:54.414873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:54.423842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:54.424386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:54.424840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:54.896464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:54.906309 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6aa7add1-4b01-453f-ad5e-6c5f82fc2565 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1310 microversion: 2.1 time: 0.527857 Aug 06 21:00:54.909961 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1004/1979] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:54 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1310 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:54.920306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:54.921910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:54.954946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:54.960749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:54.964980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:54.969472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:54.972784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:54.993163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:55.034002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:55.076955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:55.094747 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-711ab8ad-96bf-4cfb-b621-33e11f6cfce4 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1654 microversion: 2.1 time: 0.818075 Aug 06 21:00:55.095464 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 976/1980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:54 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1654 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:55.100471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:55.101226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:55.124941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:55.125569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:55.126093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:55.127019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:55.127557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:55.128074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:55.809050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:55.833303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:55.835170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:55.838426 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-84d38cae-8ac3-4626-ad17-89d3913f5ac9 tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1564 microversion: 2.25 time: 0.923482 Aug 06 21:00:55.839992 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1005/1981] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:54 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1564 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:55.861086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:55.865680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:55.885424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:55.885939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:55.886403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:55.887167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:55.888392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:55.889008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:55.907924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:55.921499 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2812f897-3331-43fb-9802-76de724f7230 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1307 microversion: 2.1 time: 0.824780 Aug 06 21:00:55.935221 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 977/1982] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:55 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1307 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:55.940809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c1cd018f-c2f3-4910-bcb0-97b5194c92af req-68a8257b-5eb4-44ed-a2a3-5240988a933b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef35ec0-f619-4ed6-9fbd-687eb753f51e", "name": "network-vif-deleted", "tag": "4a77ce44-2fe1-42c5-bd05-d6fb0ddcab89"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:55.949684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:55.952621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c1cd018f-c2f3-4910-bcb0-97b5194c92af req-68a8257b-5eb4-44ed-a2a3-5240988a933b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:55.953326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c1cd018f-c2f3-4910-bcb0-97b5194c92af req-68a8257b-5eb4-44ed-a2a3-5240988a933b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:55.953951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c1cd018f-c2f3-4910-bcb0-97b5194c92af req-68a8257b-5eb4-44ed-a2a3-5240988a933b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:55.968870 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c1cd018f-c2f3-4910-bcb0-97b5194c92af req-68a8257b-5eb4-44ed-a2a3-5240988a933b service nova] Creating event network-vif-deleted:4a77ce44-2fe1-42c5-bd05-d6fb0ddcab89 for instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e on nch2-master-1 Aug 06 21:00:55.978369 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c1cd018f-c2f3-4910-bcb0-97b5194c92af req-68a8257b-5eb4-44ed-a2a3-5240988a933b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041625 Aug 06 21:00:55.984565 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 978/1983] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:55.995918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-368885110", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f88545f3-74e5-46db-99b1-0f2b9a5b0414"}], "security_groups": [{"name": "tempest-securitygroup--414135655"}], "key_name": "tempest-keypair-1159788295", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:56.115070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:56.136103 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fc0310f7-4ccd-4382-b4ad-74fc76103877 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1301 microversion: 2.1 time: 0.294611 Aug 06 21:00:56.137077 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1006/1984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:55 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1301 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:56.149055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d86547eb-ac95-46a6-9e44-cc38577e5c5e req-89dee775-82bd-4a45-892e-5962df3dc54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484ddada-2ad7-4bd8-a298-196086372bc8", "tag": "797fb5d8-810c-48f1-9f40-b8f36d0eba22"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:56.169954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d86547eb-ac95-46a6-9e44-cc38577e5c5e req-89dee775-82bd-4a45-892e-5962df3dc54f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:56.171129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d86547eb-ac95-46a6-9e44-cc38577e5c5e req-89dee775-82bd-4a45-892e-5962df3dc54f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:56.171782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d86547eb-ac95-46a6-9e44-cc38577e5c5e req-89dee775-82bd-4a45-892e-5962df3dc54f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:56.187762 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d86547eb-ac95-46a6-9e44-cc38577e5c5e req-89dee775-82bd-4a45-892e-5962df3dc54f service nova] Creating event network-changed:797fb5d8-810c-48f1-9f40-b8f36d0eba22 for instance 484ddada-2ad7-4bd8-a298-196086372bc8 on nch1-master-1 Aug 06 21:00:56.193373 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d86547eb-ac95-46a6-9e44-cc38577e5c5e req-89dee775-82bd-4a45-892e-5962df3dc54f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053756 Aug 06 21:00:56.194815 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1007/1985] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:56.202090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-61b77f0a-024d-4b03-89f6-49385ae67be8 req-08e2a37b-b87b-461f-add5-cfb0c1b2baad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef35ec0-f619-4ed6-9fbd-687eb753f51e", "name": "network-vif-unplugged", "status": "completed", "tag": "4a77ce44-2fe1-42c5-bd05-d6fb0ddcab89"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:56.214860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-61b77f0a-024d-4b03-89f6-49385ae67be8 req-08e2a37b-b87b-461f-add5-cfb0c1b2baad service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:56.215671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-61b77f0a-024d-4b03-89f6-49385ae67be8 req-08e2a37b-b87b-461f-add5-cfb0c1b2baad service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:56.216652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-61b77f0a-024d-4b03-89f6-49385ae67be8 req-08e2a37b-b87b-461f-add5-cfb0c1b2baad service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:56.232289 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-61b77f0a-024d-4b03-89f6-49385ae67be8 req-08e2a37b-b87b-461f-add5-cfb0c1b2baad service nova] Creating event network-vif-unplugged:4a77ce44-2fe1-42c5-bd05-d6fb0ddcab89 for instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e on nch2-master-1 Aug 06 21:00:56.239248 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-61b77f0a-024d-4b03-89f6-49385ae67be8 req-08e2a37b-b87b-461f-add5-cfb0c1b2baad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042278 Aug 06 21:00:56.240478 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1008/1986] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:56.247739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:56.248469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:56.258949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:56.259578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:56.259947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:56.261374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:56.262091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:56.263766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:56.462439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] validate_networks() for [('f88545f3-74e5-46db-99b1-0f2b9a5b0414', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:00:56.727977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=14 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:56.815210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:56.828262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:56.834236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:56.838091 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c220669-e7b5-4de9-9027-651caf81668d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1696 microversion: 2.42 time: 0.595839 Aug 06 21:00:56.843645 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1009/1987] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:56 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1696 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:56.860685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:56.863584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:56.884583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:56.885096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:56.885543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:56.886275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:56.886792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:56.887232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:57.183008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:57.199155 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd6115fa-53a4-4e24-be82-da9644a8df98 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1310 microversion: 2.1 time: 0.351195 Aug 06 21:00:57.199902 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1010/1988] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:56 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:57.213694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:57.214780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:57.232510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:57.234976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:57.235629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:57.236908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:57.238267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:57.239957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:57.356796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91d180c9584c49b296a1db51fbe50694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '710cf2b1bc504e8090132ca97890a791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:57.370817 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6942d55c-d8ef-4a8a-91f8-afd9f9340ffa tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 200 len: 1298 microversion: 2.1 time: 0.164586 Aug 06 21:00:57.384818 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1011/1989] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:57 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:57.390660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:57.391286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:57.409101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:57.410262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:57.411155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:57.412210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:57.412908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:57.413620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:57.461464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:57.463549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:57.464562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:57.465637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lazy-loading 'fault' on Instance uuid cf528ca4-80d5-47b1-8e89-0241a0132074 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:00:57.576795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:57.603003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:57.604936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '343f309c07e343b4b15268472d19f10c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99a4e2a24548ba906dd57b88cc0aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:57.606167 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e5054cab-114d-4d6f-9205-9320d15aa99a tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 200 len: 1352 microversion: 2.25 time: 0.225586 Aug 06 21:00:57.607714 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1012/1990] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:57 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 1352 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:57.612054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:57.612677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:57.639195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:57.639691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:57.640129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:57.640843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:57.641309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:57.641731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:57.968030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Getting quotas for project e9acff8060d543c3b8422b25fdc1119b. Resources: dict_keys(['metadata_items']) {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:00:57.974674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Getting quotas for user 62e7c88630854feb8e5f74c105f70825 and project e9acff8060d543c3b8422b25fdc1119b. Resources: dict_keys(['metadata_items']) {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:00:58.000701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:00:58.001378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:00:58.002044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:00:58.003628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:00:58.004396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:00:58.027359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:58.028199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:58.029910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:58.030871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:58.044006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:58.047242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:58.092558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Getting quotas for project e9acff8060d543c3b8422b25fdc1119b. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:00:58.107643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Getting quotas for user 62e7c88630854feb8e5f74c105f70825 and project e9acff8060d543c3b8422b25fdc1119b. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:00:58.138745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:00:58.143802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:00:58.189499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:58.201154 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5ea55ce-287c-4bf8-8d5f-a270c6b5f2f9 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1307 microversion: 2.1 time: 0.592571 Aug 06 21:00:58.208117 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1013/1991] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:57 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1307 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:58.226134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:58.235486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:58.255016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:58.255641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:58.256753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:58.257529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:58.258000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:58.258436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:58.263206 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-042117ab-65ee-4232-ad9a-6a0bdcd03f3f tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.270348 Aug 06 21:00:58.270767 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 979/1992] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:00:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:00:58.311665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:58.312382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:58.340251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:58.341342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:58.341810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:58.342758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:58.343234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:58.350818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:58.757230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:58.779392 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6a0133c3-33d7-48c0-9f55-e8025011162e tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1367 microversion: 2.1 time: 0.552383 Aug 06 21:00:58.780481 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1014/1993] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:58 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:58.795618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-a75d3da7-a990-442c-a052-8287baedb2f1 req-45237de1-b25f-44eb-bddc-d5b3048c2771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd1e10d-f1cf-4c07-aa50-3ec0620b133b", "tag": "ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2"}, {"server_uuid": "cf528ca4-80d5-47b1-8e89-0241a0132074", "name": "network-vif-deleted", "tag": "060516c4-8983-4018-8d4a-a96568a9617f"}, {"server_uuid": "7ef35ec0-f619-4ed6-9fbd-687eb753f51e", "name": "network-vif-deleted", "tag": "8029828f-6dbc-4719-b4d4-04cf73c5308c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:58.855261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a75d3da7-a990-442c-a052-8287baedb2f1 req-45237de1-b25f-44eb-bddc-d5b3048c2771 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:58.866344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a75d3da7-a990-442c-a052-8287baedb2f1 req-45237de1-b25f-44eb-bddc-d5b3048c2771 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:58.869607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a75d3da7-a990-442c-a052-8287baedb2f1 req-45237de1-b25f-44eb-bddc-d5b3048c2771 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:58.924858 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a75d3da7-a990-442c-a052-8287baedb2f1 req-45237de1-b25f-44eb-bddc-d5b3048c2771 service nova] Creating event network-changed:ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2 for instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b on nch2-master-1 Aug 06 21:00:58.927238 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a75d3da7-a990-442c-a052-8287baedb2f1 req-45237de1-b25f-44eb-bddc-d5b3048c2771 service nova] Creating event network-vif-deleted:060516c4-8983-4018-8d4a-a96568a9617f for instance cf528ca4-80d5-47b1-8e89-0241a0132074 on nch1-master-1 Aug 06 21:00:58.928683 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a75d3da7-a990-442c-a052-8287baedb2f1 req-45237de1-b25f-44eb-bddc-d5b3048c2771 service nova] Creating event network-vif-deleted:8029828f-6dbc-4719-b4d4-04cf73c5308c for instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e on nch2-master-1 Aug 06 21:00:58.946850 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-a75d3da7-a990-442c-a052-8287baedb2f1 req-45237de1-b25f-44eb-bddc-d5b3048c2771 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.162951 Aug 06 21:00:58.948141 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1015/1994] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:58.972869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:58.973902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:58.983708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:58.984488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:58.985129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:58.986035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:58.986735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:58.987363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:59.100580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:59.123750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:59.129143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:59.133325 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bbe0c85b-4e2c-4ed8-86d9-f6a141f8fefd tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1696 microversion: 2.42 time: 0.858209 Aug 06 21:00:59.135628 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 980/1995] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:58 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1696 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:00:59.146036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43994693-d6a3-4940-a87e-2ec0add1914c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:59.147477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-43994693-d6a3-4940-a87e-2ec0add1914c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:59.293687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-43994693-d6a3-4940-a87e-2ec0add1914c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:59.305801 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-43994693-d6a3-4940-a87e-2ec0add1914c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1277 microversion: 2.1 time: 0.166839 Aug 06 21:00:59.306427 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 981/1996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:59 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:59.347935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:59.351839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:59.374220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:59.379080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:59.379881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:59.380943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:59.381645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:59.385777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:59.395649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:59.424534 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] HTTP exception thrown: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Request method failure captured: Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e HTTP/1.1 Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tX0VYnnuLKseD-5RXfDpol9jgsHvAHmmpI58KtVVp5g4f3K70MtG-5YmJkIobMFoQP37bejaM48zjwaVdDVth67ao4ih8pmx-VdqyHHCOnYxwX4OjCTkFCnbsjg8-88ryvqcTQbq1QrZtIXzr77SpSnn4COnY0DGqyYlMlAyedeHfI Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:00:59.427189 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_710cf2b1bc504e8090132ca97890a791", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestMultiNic-1769901458 Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 91d180c9584c49b296a1db51fbe50694 Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:00:59.428795 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7ef35ec0-f619-4ed6-9fbd-687eb753f51e'} Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:00:59.429684 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:00:59.431185 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.439151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Returning 404 to user: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:00:59.443938 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0546e166-3d68-4168-a8e1-f7cdc95e4361 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 404 len: 111 microversion: 2.1 time: 0.111334 Aug 06 21:00:59.446238 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 982/1997] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:59 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:00:59.459984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:59.466999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] [instance: cf528ca4-80d5-47b1-8e89-0241a0132074] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:59.482497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:59.487086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:59.488870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:59.495377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:59.496206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:59.497653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:59.537218 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] HTTP exception thrown: Instance cf528ca4-80d5-47b1-8e89-0241a0132074 could not be found. Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Request method failure captured: Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 HTTP/1.1 Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tT_Lzg3VoctJ61__nynqdPlVtZ9ncnIVU-kCGmeg4AEuOgA3eIMtu5U_sODQdPPyZjDh6NwDuV8L3t3k8PGi__V7I-HjQb-4RRtsqM9xYaEkYwFi3Wba_4EjHGojxflUyfWAXYf1_YdcW-FBj8ew2eiMgpPNBA5KOn1JNQhbbKDQW4 Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.25 Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 5c99a4e2a24548ba906dd57b88cc0aba Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:00:59.539397 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5c99a4e2a24548ba906dd57b88cc0aba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5c99a4e2a24548ba906dd57b88cc0aba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 5c99a4e2a24548ba906dd57b88cc0aba Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481 Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-LiveAutoBlockMigrationV225Test-1556093481-project Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 343f309c07e343b4b15268472d19f10c Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1556093481-project Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance cf528ca4-80d5-47b1-8e89-0241a0132074 could not be found. Aug 06 21:00:59.541293 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'cf528ca4-80d5-47b1-8e89-0241a0132074'} Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf528ca4-80d5-47b1-8e89-0241a0132074 could not be found. Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:00:59.542295 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf528ca4-80d5-47b1-8e89-0241a0132074 could not be found. Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf528ca4-80d5-47b1-8e89-0241a0132074 could not be found. Aug 06 21:00:59.544570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:00:59.551437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] Returning 404 to user: Instance cf528ca4-80d5-47b1-8e89-0241a0132074 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:00:59.552650 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-de0043bc-a95a-4b7a-b3c4-efcc69778ede tempest-LiveAutoBlockMigrationV225Test-1556093481 tempest-LiveAutoBlockMigrationV225Test-1556093481-project] 10.222.0.33 "GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074" status: 404 len: 111 microversion: 2.25 time: 0.105022 Aug 06 21:00:59.553402 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 983/1998] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:00:59 2022] GET /compute/v2.1/servers/cf528ca4-80d5-47b1-8e89-0241a0132074 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:00:59.566007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:59.566750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:59.573269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:59.573780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:59.574203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:59.574948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:59.575681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:59.576706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:59.696416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:59.710144 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-38ba97be-ca1b-42ed-a39e-8bdd2ab5be5d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1310 microversion: 2.1 time: 0.745575 Aug 06 21:00:59.713481 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1016/1999] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:58 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1310 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:59.803477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:59.804410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:59.830132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:59.831955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:59.838413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:59.839726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:59.841937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:59.843967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:00.028767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:00.041658 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a895475f-cd76-4596-838f-b401632b0a08 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1307 microversion: 2.1 time: 0.480584 Aug 06 21:01:00.060853 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 984/2000] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:59 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1307 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:00.163209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:00.164905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:00.174002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:00.174791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:00.175459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:00.176537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:00.177240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:00.177906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:00.473698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:00.483687 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8aeb01c5-2e21-4034-b6e3-2c80eb4a9adb tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1367 microversion: 2.1 time: 0.683838 Aug 06 21:01:00.485830 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1017/2001] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:59 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1367 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:00.495997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:00.499446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:00.510627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:00.515681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:00.516426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:00.517413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:00.519494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:00.520125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:00.710698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:00.718267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:00.721424 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-24323a72-d366-42b3-95e6-ee8524e0c50b tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1337 microversion: 2.1 time: 0.234003 Aug 06 21:01:00.733270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:00.740281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:00.741850 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dc14f90c-2866-41b8-a5cb-4194589808fb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1743 microversion: 2.42 time: 0.584444 Aug 06 21:01:00.743178 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1018/2002] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:00 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1337 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:00.743459 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 985/2003] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:00 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1743 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:00.754126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:00.757444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:00.772867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:00.774845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:00.776464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:00.778271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:00.779150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:00.780355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:01.078660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:01.079614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:01.098325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:01.099067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:01.099629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:01.100483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:01.101063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:01.101613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:01.468176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:01.484437 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c5dfdd67-da0d-472c-b997-8e680242cfeb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1307 microversion: 2.1 time: 0.410317 Aug 06 21:01:01.489369 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 986/2004] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:01 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1307 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:01.497092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e3ccad9a-31f4-452c-af8c-95ae8bf12347 req-3529ac2e-7fff-4401-8673-dc3b766ee66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484ddada-2ad7-4bd8-a298-196086372bc8", "name": "network-vif-plugged", "status": "completed", "tag": "797fb5d8-810c-48f1-9f40-b8f36d0eba22"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:01.515381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e3ccad9a-31f4-452c-af8c-95ae8bf12347 req-3529ac2e-7fff-4401-8673-dc3b766ee66d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:01.522032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e3ccad9a-31f4-452c-af8c-95ae8bf12347 req-3529ac2e-7fff-4401-8673-dc3b766ee66d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:01.527151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e3ccad9a-31f4-452c-af8c-95ae8bf12347 req-3529ac2e-7fff-4401-8673-dc3b766ee66d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:01.563590 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e3ccad9a-31f4-452c-af8c-95ae8bf12347 req-3529ac2e-7fff-4401-8673-dc3b766ee66d service nova] Creating event network-vif-plugged:797fb5d8-810c-48f1-9f40-b8f36d0eba22 for instance 484ddada-2ad7-4bd8-a298-196086372bc8 on nch1-master-1 Aug 06 21:01:01.568739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e3ccad9a-31f4-452c-af8c-95ae8bf12347 req-3529ac2e-7fff-4401-8673-dc3b766ee66d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077378 Aug 06 21:01:01.569373 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 987/2005] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:01.749129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-38838ff0-36e3-49ab-8c2e-3eff996adde8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Action: 'create', calling method: .version_select at 0x7f729d929e50>, body: {"keypair": {"name": "tempest-keypair-1374206544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmWQh9jB3zNnhEMe39XYE0QH1IXwa+2Hc7VL9WKgvGgAheX7qkOzbAjXfpxnITkclG5PW/KlIn/JXhK4MkRRVOCnncdNNFt8tRQAzLH2Hv4nu3WwwSGBgX9JwYTrqJpyQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:01.766536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-38838ff0-36e3-49ab-8c2e-3eff996adde8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Getting quotas for project 155b2c35804a4799a75a327703a5e26e. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:01:01.776595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:01.786526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-38838ff0-36e3-49ab-8c2e-3eff996adde8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Getting quotas for user d5754e7eed1b48f8805b6dffefb37b59 and project 155b2c35804a4799a75a327703a5e26e. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:01:01.793212 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e58e0cf4-390f-4fde-93dc-2e999df54d90 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1310 microversion: 2.1 time: 1.046401 Aug 06 21:01:01.795490 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1019/2006] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:00 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1310 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:01.808226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:01.809133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:01.827443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:01.828534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:01.829208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:01.832128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:01.832843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:01.835248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:01.846429 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-38838ff0-36e3-49ab-8c2e-3eff996adde8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.273483 Aug 06 21:01:01.856625 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 988/2007] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:01:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:01.868875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:01.872021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:01.890117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:01.891179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:01.891908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:01.892927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:01.893659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:01.894344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:02.079668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:02.104297 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bf564812-a939-43b2-872f-a095ef70398e tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1335 microversion: 2.1 time: 0.245759 Aug 06 21:01:02.105069 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 989/2008] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:01 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1335 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:02.114397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:02.116153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:02.138817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:02.139636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:02.140261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:02.148546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:02.149051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:02.149694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:02.480653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:02.505555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:02.511976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:02.524803 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8bd8b3cf-4969-4a10-8dca-799e5f39944e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1790 microversion: 2.42 time: 0.417659 Aug 06 21:01:02.525740 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 990/2009] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:02 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1790 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:02.545355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9c8ae874-42b1-4cc9-8d00-df3eb70c3466 req-1a4b4161-3862-4647-b35a-46f90bb4dadd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa20eef6-07e5-4267-b6b8-cb709a0f5920", "tag": "a9c12b17-7937-408d-9e53-9a50f2743b91"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:02.561931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9c8ae874-42b1-4cc9-8d00-df3eb70c3466 req-1a4b4161-3862-4647-b35a-46f90bb4dadd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:02.562688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9c8ae874-42b1-4cc9-8d00-df3eb70c3466 req-1a4b4161-3862-4647-b35a-46f90bb4dadd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:02.567397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9c8ae874-42b1-4cc9-8d00-df3eb70c3466 req-1a4b4161-3862-4647-b35a-46f90bb4dadd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:02.589803 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9c8ae874-42b1-4cc9-8d00-df3eb70c3466 req-1a4b4161-3862-4647-b35a-46f90bb4dadd service nova] Creating event network-changed:a9c12b17-7937-408d-9e53-9a50f2743b91 for instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 on nch2-master-1 Aug 06 21:01:02.600208 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9c8ae874-42b1-4cc9-8d00-df3eb70c3466 req-1a4b4161-3862-4647-b35a-46f90bb4dadd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073126 Aug 06 21:01:02.601385 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 991/2010] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:02.609752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:02.610878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:02.620513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:02.621004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:02.621589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:02.652747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:02.653297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:02.653899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:02.658847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:02.670013 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd356d4b-8cd9-421c-a867-45481b0a01f3 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1367 microversion: 2.1 time: 0.872869 Aug 06 21:01:02.685185 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1020/2011] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:01 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1367 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:02.819840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:02.820643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:02.827841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:02.828436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:02.828943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:02.829774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:02.830304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:02.830828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:03.328032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:03.338360 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-efeb0f3b-3a50-4319-9731-71103e3a5aee tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1310 microversion: 2.1 time: 0.523028 Aug 06 21:01:03.353136 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1021/2012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:02 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1310 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:03.356056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:03.358990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:03.368476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:03.368981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:03.369438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:03.370189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:03.370701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:03.371142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:03.489171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:03.505068 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-91862533-4c5e-4601-a5f7-07e67bf3d0e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1307 microversion: 2.1 time: 0.901152 Aug 06 21:01:03.519207 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 992/2013] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:02 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1307 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:03.553871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:03.554954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:03.564635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:03.565457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:03.566221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:03.567162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:03.567830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:03.568357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:03.788668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:03.800618 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a0a1abb-6ebe-4dfe-a6fb-f54f744843b0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1402 microversion: 2.1 time: 0.448385 Aug 06 21:01:03.816183 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1022/2014] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:03 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1402 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:03.823910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-8030f23a-079a-43c6-b165-be193241de80 req-bfe04dbd-d0ae-42da-9b5f-54f4dc2e5b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd1e10d-f1cf-4c07-aa50-3ec0620b133b", "name": "network-vif-plugged", "status": "completed", "tag": "ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:03.836293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8030f23a-079a-43c6-b165-be193241de80 req-bfe04dbd-d0ae-42da-9b5f-54f4dc2e5b5b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:03.837191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8030f23a-079a-43c6-b165-be193241de80 req-bfe04dbd-d0ae-42da-9b5f-54f4dc2e5b5b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:03.837814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8030f23a-079a-43c6-b165-be193241de80 req-bfe04dbd-d0ae-42da-9b5f-54f4dc2e5b5b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:03.857177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-8030f23a-079a-43c6-b165-be193241de80 req-bfe04dbd-d0ae-42da-9b5f-54f4dc2e5b5b service nova] Creating event network-vif-plugged:ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2 for instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b on nch2-master-1 Aug 06 21:01:03.868711 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-8030f23a-079a-43c6-b165-be193241de80 req-bfe04dbd-d0ae-42da-9b5f-54f4dc2e5b5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049354 Aug 06 21:01:03.870408 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1023/2015] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:03.879771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:03.881030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:03.889213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:03.889954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:03.890564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:03.891906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:03.892632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:03.893335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:03.930496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:04.055220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:04.087245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:04.091169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:04.092450 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3705e2dd-4ad6-4759-813a-3da3faf4042f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1790 microversion: 2.42 time: 0.544988 Aug 06 21:01:04.093459 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 993/2016] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:03 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1790 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:04.307288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:04.320773 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce3fe003-fc53-499f-adf0-6cefca0c02d4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1367 microversion: 2.1 time: 0.448103 Aug 06 21:01:04.323609 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1024/2017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:03 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:04.363919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:04.364539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:04.372983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:04.373889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:04.374505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:04.375451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:04.376221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:04.377060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:04.530974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:04.532064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:04.556336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:04.557363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:04.558834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:04.567360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:04.576415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:04.579628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:05.016393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:05.028070 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5e027903-019f-4054-963b-13e910bc6a00 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1493 microversion: 2.1 time: 0.668349 Aug 06 21:01:05.029246 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 994/2018] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:04 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1493 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:05.035141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:05.036248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:05.044320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:05.044825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:05.045444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:05.046428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:05.046912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:05.047343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:05.354327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:05.373203 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-842b848b-1946-41c3-b4a2-82d43e907587 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1307 microversion: 2.1 time: 0.846689 Aug 06 21:01:05.374486 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1025/2019] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:04 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1307 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:05.381781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a7512fb4-3099-4167-b9cf-51b6fc926237 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:05.382687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a7512fb4-3099-4167-b9cf-51b6fc926237 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:05.390028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7512fb4-3099-4167-b9cf-51b6fc926237 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:05.390788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7512fb4-3099-4167-b9cf-51b6fc926237 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:05.391234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7512fb4-3099-4167-b9cf-51b6fc926237 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:05.392136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7512fb4-3099-4167-b9cf-51b6fc926237 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:05.392785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7512fb4-3099-4167-b9cf-51b6fc926237 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:05.393222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7512fb4-3099-4167-b9cf-51b6fc926237 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:05.544125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:05.555569 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a98628e9-80f3-4bc7-81d0-118d71fa3d93 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1402 microversion: 2.1 time: 0.525032 Aug 06 21:01:05.556747 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 995/2020] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:05 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1402 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:05.564350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:05.565337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:05.578022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:05.578928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:05.580005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:05.581241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:05.581958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:05.582671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:05.727951 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a7512fb4-3099-4167-b9cf-51b6fc926237 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1644 microversion: 2.1 time: 0.351936 Aug 06 21:01:05.728572 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1026/2021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:05 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1644 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:05.734381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:05.735038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:05.759731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:05.760226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:05.760661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:05.761389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:05.780237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:05.780700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.123293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:06.154190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:06.156651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:06.158177 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-de11a936-7797-4785-9575-31a45457f174 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1837 microversion: 2.42 time: 0.600291 Aug 06 21:01:06.162768 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 996/2022] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:05 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1837 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:06.172131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-aae388c4-a11a-4c16-9ad4-aadb03c84b2b req-ef07f9a5-94eb-4b80-a10c-a9e13a951575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac44c669-09c1-4b2a-ab7e-2126661e2e87", "tag": "7a6f9161-2804-4d29-bb69-124d7ceb4a28"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:06.228524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-aae388c4-a11a-4c16-9ad4-aadb03c84b2b req-ef07f9a5-94eb-4b80-a10c-a9e13a951575 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.230188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-aae388c4-a11a-4c16-9ad4-aadb03c84b2b req-ef07f9a5-94eb-4b80-a10c-a9e13a951575 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.231214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-aae388c4-a11a-4c16-9ad4-aadb03c84b2b req-ef07f9a5-94eb-4b80-a10c-a9e13a951575 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.254342 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-aae388c4-a11a-4c16-9ad4-aadb03c84b2b req-ef07f9a5-94eb-4b80-a10c-a9e13a951575 service nova] Creating event network-changed:7a6f9161-2804-4d29-bb69-124d7ceb4a28 for instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 on nch2-master-1 Aug 06 21:01:06.272758 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-aae388c4-a11a-4c16-9ad4-aadb03c84b2b req-ef07f9a5-94eb-4b80-a10c-a9e13a951575 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107814 Aug 06 21:01:06.274436 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 997/2023] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:06.285915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:06.290850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9f25b7f8-9209-42b2-b5c3-7eedf54dfbf7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:06.292292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9f25b7f8-9209-42b2-b5c3-7eedf54dfbf7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:06.300249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f25b7f8-9209-42b2-b5c3-7eedf54dfbf7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.300760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f25b7f8-9209-42b2-b5c3-7eedf54dfbf7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.301206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f25b7f8-9209-42b2-b5c3-7eedf54dfbf7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.302176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f25b7f8-9209-42b2-b5c3-7eedf54dfbf7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.302729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f25b7f8-9209-42b2-b5c3-7eedf54dfbf7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.303170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f25b7f8-9209-42b2-b5c3-7eedf54dfbf7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.324492 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-69e687d7-d3cd-4efd-9c99-49ed869a2cc6 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1367 microversion: 2.1 time: 0.593584 Aug 06 21:01:06.346105 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1027/2024] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:05 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1367 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:06.374785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:06.376354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:06.385004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.386333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.388831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.390145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.393643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.395286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.424692 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] HTTP exception thrown: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Request method failure captured: Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e HTTP/1.1 Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tX0VYnnuLKseD-5RXfDpol9jgsHvAHmmpI58KtVVp5g4f3K70MtG-5YmJkIobMFoQP37bejaM48zjwaVdDVth67ao4ih8pmx-VdqyHHCOnYxwX4OjCTkFCnbsjg8-88ryvqcTQbq1QrZtIXzr77SpSnn4COnY0DGqyYlMlAyedeHfI Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:01:06.426348 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_710cf2b1bc504e8090132ca97890a791", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 91d180c9584c49b296a1db51fbe50694 Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.428322 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7ef35ec0-f619-4ed6-9fbd-687eb753f51e'} Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:01:06.429251 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.430853 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.432629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Returning 404 to user: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:01:06.432629 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7c9a65f2-c7ed-498c-bb04-6ce54d4c8536 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 404 len: 111 microversion: 2.1 time: 0.080336 Aug 06 21:01:06.432629 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1028/2025] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:01:06 2022] DELETE /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:01:06.437825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:06.438828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:06.446082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.446659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.447100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.447865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.448380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.448857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.754073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:06.765898 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32400957-8fd2-4d66-9c0c-458f4fb80608 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1486 microversion: 2.1 time: 0.336111 Aug 06 21:01:06.767439 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1029/2026] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:06 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1486 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:06.789606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:06.791863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 7ef35ec0-f619-4ed6-9fbd-687eb753f51e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:06.807717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.809777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.811063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.814041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.814840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.815538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.837394 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] HTTP exception thrown: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Request method failure captured: Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e HTTP/1.1 Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tX0VYnnuLKseD-5RXfDpol9jgsHvAHmmpI58KtVVp5g4f3K70MtG-5YmJkIobMFoQP37bejaM48zjwaVdDVth67ao4ih8pmx-VdqyHHCOnYxwX4OjCTkFCnbsjg8-88ryvqcTQbq1QrZtIXzr77SpSnn4COnY0DGqyYlMlAyedeHfI Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:01:06.840468 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_710cf2b1bc504e8090132ca97890a791", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 91d180c9584c49b296a1db51fbe50694 Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.842753 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7ef35ec0-f619-4ed6-9fbd-687eb753f51e'} Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:01:06.843650 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. Aug 06 21:01:06.845721 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:06.849165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Returning 404 to user: Instance 7ef35ec0-f619-4ed6-9fbd-687eb753f51e could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:01:06.851352 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1c64bd73-ede0-4186-b433-35436caa6c1e tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e" status: 404 len: 111 microversion: 2.1 time: 0.080622 Aug 06 21:01:06.852179 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1030/2027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:06 2022] GET /compute/v2.1/servers/7ef35ec0-f619-4ed6-9fbd-687eb753f51e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:01:06.859763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:06.862500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:06.873713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.874747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.876015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:06.877058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:06.878362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:06.879221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.119554 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9f25b7f8-9209-42b2-b5c3-7eedf54dfbf7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1644 microversion: 2.1 time: 0.843658 Aug 06 21:01:07.120529 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 998/2028] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:06 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1644 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:07.126121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:07.127452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:07.133803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.134525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.135163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.136759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.137383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.138006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.148259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:07.157154 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-929018e7-77c3-43c9-a290-92e264e7f594 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1402 microversion: 2.1 time: 0.303630 Aug 06 21:01:07.158483 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1031/2029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:06 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1402 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:07.163841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:07.164570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:07.172117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.173182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.173813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.174763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.175397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.176032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.185619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lazy-loading 'flavor' on Instance uuid 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:01:07.195722 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] HTTP exception thrown: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Request method failure captured: Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 HTTP/1.1 Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tX0VYnnuLKseD-5RXfDpol9jgsHvAHmmpI58KtVVp5g4f3K70MtG-5YmJkIobMFoQP37bejaM48zjwaVdDVth67ao4ih8pmx-VdqyHHCOnYxwX4OjCTkFCnbsjg8-88ryvqcTQbq1QrZtIXzr77SpSnn4COnY0DGqyYlMlAyedeHfI Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:01:07.197420 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_710cf2b1bc504e8090132ca97890a791", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 91d180c9584c49b296a1db51fbe50694 Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.199264 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '0c361fdc-3fca-4dd3-b2fe-78662ec18995'} Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:01:07.203450 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.205186 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.206880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Returning 404 to user: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:01:07.206880 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb9ac72e-20ba-4b44-bbba-3600ae568c65 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 404 len: 111 microversion: 2.1 time: 0.039128 Aug 06 21:01:07.206880 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1032/2030] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:01:07 2022] DELETE /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:01:07.209270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-55029868", "imageRef": "8fe01d39-35f2-478b-b8ec-54cfa5c2ada9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "63c1c467-02d8-4912-aa02-99ad2d1c8f8e"}], "security_groups": [{"name": "tempest-securitygroup--1270242439"}], "key_name": "tempest-keypair-1374206544", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:07.337954 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c663848-6310-4dee-a55d-b85b30af67c3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b/action" status: 202 len: 0 microversion: 2.1 time: 0.215926 Aug 06 21:01:07.339396 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 999/2031] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:01:07 2022] POST /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:01:07.348292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-19777d88-1c6d-4f7b-b63c-d7983288b8b0 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:07.353094 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:01:07.353094 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:01:07.355506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19777d88-1c6d-4f7b-b63c-d7983288b8b0 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.356186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19777d88-1c6d-4f7b-b63c-d7983288b8b0 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.357171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19777d88-1c6d-4f7b-b63c-d7983288b8b0 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.358256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19777d88-1c6d-4f7b-b63c-d7983288b8b0 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.359725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19777d88-1c6d-4f7b-b63c-d7983288b8b0 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.360472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19777d88-1c6d-4f7b-b63c-d7983288b8b0 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.384498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] validate_networks() for [('63c1c467-02d8-4912-aa02-99ad2d1c8f8e', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:01:07.400204 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-19777d88-1c6d-4f7b-b63c-d7983288b8b0 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059036 Aug 06 21:01:07.401187 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1000/2032] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Aug 6 21:01:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:07.415338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:07.416420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:07.426316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.426937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.427739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.429134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.429820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.430486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.789760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:07.800011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:07.801526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:07.802850 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab88fdf7-fd5f-4ccd-a500-89b9b067cd5c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1837 microversion: 2.42 time: 0.399976 Aug 06 21:01:07.803448 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1001/2033] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:07 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1837 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:07.808258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:07.809233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] [instance: 0c361fdc-3fca-4dd3-b2fe-78662ec18995] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:07.815801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.815801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.816267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.816984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.817438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.817928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.822829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:07.835024 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] HTTP exception thrown: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Request method failure captured: Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 HTTP/1.1 Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tX0VYnnuLKseD-5RXfDpol9jgsHvAHmmpI58KtVVp5g4f3K70MtG-5YmJkIobMFoQP37bejaM48zjwaVdDVth67ao4ih8pmx-VdqyHHCOnYxwX4OjCTkFCnbsjg8-88ryvqcTQbq1QrZtIXzr77SpSnn4COnY0DGqyYlMlAyedeHfI Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:01:07.836741 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_710cf2b1bc504e8090132ca97890a791", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/710cf2b1bc504e8090132ca97890a791"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 710cf2b1bc504e8090132ca97890a791 Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestMultiNic-1769901458 Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 91d180c9584c49b296a1db51fbe50694 Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestMultiNic-1769901458-project Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.838661 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '0c361fdc-3fca-4dd3-b2fe-78662ec18995'} Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:01:07.839910 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. Aug 06 21:01:07.842369 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:07.844030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] Returning 404 to user: Instance 0c361fdc-3fca-4dd3-b2fe-78662ec18995 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:01:07.844030 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e66e4278-9ded-4526-a097-2e4590cfc145 tempest-ServersTestMultiNic-1769901458 tempest-ServersTestMultiNic-1769901458-project] 10.222.0.33 "GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995" status: 404 len: 111 microversion: 2.1 time: 0.033458 Aug 06 21:01:07.844030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1002/2034] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:07 2022] GET /compute/v2.1/servers/0c361fdc-3fca-4dd3-b2fe-78662ec18995 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:01:07.844733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:07.845341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:07.852281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.852600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.853013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.853727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.854283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.854752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.920660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:01:07.921669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:01:07.922660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:01:07.923310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:01:07.923947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:01:07.945462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.946419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.946905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.947943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:07.948550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:07.948988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:07.972705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Getting quotas for project 155b2c35804a4799a75a327703a5e26e. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:01:07.979984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Getting quotas for user d5754e7eed1b48f8805b6dffefb37b59 and project 155b2c35804a4799a75a327703a5e26e. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:01:07.994523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:01:07.997256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8fe01d39-35f2-478b-b8ec-54cfa5c2ada9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:01:08.053669 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40ee8eae-ebed-48b0-8fb8-5cf406d38eeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.850818 Aug 06 21:01:08.054346 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1033/2035] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:01:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:01:08.059093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:08.060219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:08.068084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:08.068977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:08.069316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:08.070219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:08.070700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:08.071415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:08.229009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:08.238977 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6129fc69-3b25-47f9-aa8a-dc84f76eda68 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1494 microversion: 2.1 time: 0.398552 Aug 06 21:01:08.240604 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1003/2036] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:07 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1494 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:08.248001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f2fc6808-10d4-4c8b-99bf-f83ded0c29b8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:08.249247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f2fc6808-10d4-4c8b-99bf-f83ded0c29b8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:08.263846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2fc6808-10d4-4c8b-99bf-f83ded0c29b8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:08.266114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2fc6808-10d4-4c8b-99bf-f83ded0c29b8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:08.267565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2fc6808-10d4-4c8b-99bf-f83ded0c29b8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:08.268572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2fc6808-10d4-4c8b-99bf-f83ded0c29b8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:08.269264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2fc6808-10d4-4c8b-99bf-f83ded0c29b8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:08.269985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2fc6808-10d4-4c8b-99bf-f83ded0c29b8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:08.306509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:08.317571 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7c4bcbdd-80b3-42d5-9e6e-8410c2fd879f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1367 microversion: 2.1 time: 0.261873 Aug 06 21:01:08.335914 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1034/2037] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:08 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:08.356571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-489bf21f-fb8e-416a-8085-e62d98948289 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:08.358716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-489bf21f-fb8e-416a-8085-e62d98948289 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:08.378746 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f2fc6808-10d4-4c8b-99bf-f83ded0c29b8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8/action" status: 202 len: 0 microversion: 2.1 time: 0.135377 Aug 06 21:01:08.386250 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1004/2038] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:01:08 2022] POST /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:01:08.397058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:08.402817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:08.412633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:08.415237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:08.416078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:08.417079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:08.422687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:08.423298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:08.553817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-489bf21f-fb8e-416a-8085-e62d98948289 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:08.567276 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-489bf21f-fb8e-416a-8085-e62d98948289 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1244 microversion: 2.1 time: 0.229554 Aug 06 21:01:08.568576 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1035/2039] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:08 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1244 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:08.574292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-908f338a-31aa-464d-b83d-a83b92897f38 req-367ad971-5f78-4fbf-9ace-d6576f2fbaec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "tag": "6a277d3d-757e-4809-a72d-fac786fbec67"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:08.591600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-908f338a-31aa-464d-b83d-a83b92897f38 req-367ad971-5f78-4fbf-9ace-d6576f2fbaec service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:08.593210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-908f338a-31aa-464d-b83d-a83b92897f38 req-367ad971-5f78-4fbf-9ace-d6576f2fbaec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:08.593972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-908f338a-31aa-464d-b83d-a83b92897f38 req-367ad971-5f78-4fbf-9ace-d6576f2fbaec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:08.617469 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-908f338a-31aa-464d-b83d-a83b92897f38 req-367ad971-5f78-4fbf-9ace-d6576f2fbaec service nova] Creating event network-changed:6a277d3d-757e-4809-a72d-fac786fbec67 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:01:08.626507 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-908f338a-31aa-464d-b83d-a83b92897f38 req-367ad971-5f78-4fbf-9ace-d6576f2fbaec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055948 Aug 06 21:01:08.628531 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1036/2040] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:08.637165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3edc309c-da92-4e32-98b3-1a42220bd07e tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:08.638004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3edc309c-da92-4e32-98b3-1a42220bd07e tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:08.646609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3edc309c-da92-4e32-98b3-1a42220bd07e tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:08.647135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3edc309c-da92-4e32-98b3-1a42220bd07e tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:08.647584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3edc309c-da92-4e32-98b3-1a42220bd07e tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:08.648374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3edc309c-da92-4e32-98b3-1a42220bd07e tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:08.648890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3edc309c-da92-4e32-98b3-1a42220bd07e tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:08.649796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3edc309c-da92-4e32-98b3-1a42220bd07e tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:09.093413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:09.104937 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ba823dac-543e-40c7-a9f1-731f1b438ce0 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1402 microversion: 2.1 time: 0.719636 Aug 06 21:01:09.106979 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1005/2041] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:08 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1402 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:09.115037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-b20656bc-6f29-4f0d-9e98-e2e260764ded req-1c1a8bba-313d-4703-897e-99aa2967730b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa20eef6-07e5-4267-b6b8-cb709a0f5920", "name": "network-vif-plugged", "status": "completed", "tag": "a9c12b17-7937-408d-9e53-9a50f2743b91"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:09.127942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b20656bc-6f29-4f0d-9e98-e2e260764ded req-1c1a8bba-313d-4703-897e-99aa2967730b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:09.128428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b20656bc-6f29-4f0d-9e98-e2e260764ded req-1c1a8bba-313d-4703-897e-99aa2967730b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:09.129539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b20656bc-6f29-4f0d-9e98-e2e260764ded req-1c1a8bba-313d-4703-897e-99aa2967730b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:09.150606 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-b20656bc-6f29-4f0d-9e98-e2e260764ded req-1c1a8bba-313d-4703-897e-99aa2967730b service nova] Creating event network-vif-plugged:a9c12b17-7937-408d-9e53-9a50f2743b91 for instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 on nch2-master-1 Aug 06 21:01:09.158349 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-b20656bc-6f29-4f0d-9e98-e2e260764ded req-1c1a8bba-313d-4703-897e-99aa2967730b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049402 Aug 06 21:01:09.159130 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1006/2042] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:09.179129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:09.181023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:09.192681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:09.193665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:09.194360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:09.195624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:09.196591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:09.197572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:09.611878 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3edc309c-da92-4e32-98b3-1a42220bd07e tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1649 microversion: 2.1 time: 0.980916 Aug 06 21:01:09.626748 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1037/2043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:08 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1649 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:09.632100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:09.643570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:09.658214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:09.659043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:09.659647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:09.660560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:09.661186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:09.661779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:09.692538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:09.728181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:09.731164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:09.734005 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-64fdc48d-e47e-478a-9b1d-4d3e53fe546a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1858 microversion: 2.42 time: 0.573381 Aug 06 21:01:09.734900 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1007/2044] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:09 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1858 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:09.740148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:09.741318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:09.754267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:09.755210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:09.755880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:09.756841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:09.757531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:09.758183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:10.101809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:10.111182 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0e89fbfd-0edd-47f1-aa05-5cd8b7a86357 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 200 len: 1477 microversion: 2.1 time: 0.482933 Aug 06 21:01:10.121724 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1038/2045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:09 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 1477 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:10.128097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:10.129367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:10.137579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:10.139663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:10.140674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:10.141987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:10.142737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:10.143419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:10.706156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:10.716843 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd9eb2d0-570e-4f0b-984a-1a7820db775e tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1302 microversion: 2.1 time: 0.592592 Aug 06 21:01:10.719222 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1039/2046] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:10 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1302 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:10.738907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:10.740462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:10.758249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:10.759226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:10.759940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:10.763564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:10.764430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:10.765094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:10.811354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:10.820291 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1d736439-d636-435b-bd2d-6a7830efb123 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1367 microversion: 2.1 time: 1.084030 Aug 06 21:01:10.833570 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1008/2047] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:09 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1367 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:10.833570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d822d952-137f-4c08-a8b5-ba07239f4115 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2095733804"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:10.842120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d822d952-137f-4c08-a8b5-ba07239f4115 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:10.848761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:10.862670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d822d952-137f-4c08-a8b5-ba07239f4115 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:10.863906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d822d952-137f-4c08-a8b5-ba07239f4115 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:10.865817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d822d952-137f-4c08-a8b5-ba07239f4115 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:10.866614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d822d952-137f-4c08-a8b5-ba07239f4115 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:10.874647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d822d952-137f-4c08-a8b5-ba07239f4115 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:10.875288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d822d952-137f-4c08-a8b5-ba07239f4115 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:11.257935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:11.275086 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eb0ca78e-aaed-4be1-bcfe-599a2877e364 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1402 microversion: 2.1 time: 0.546634 Aug 06 21:01:11.292869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1040/2048] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:10 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1402 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:11.319113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-17cc382a-86c4-4367-9f9d-ddc3e5e2e867 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:11.320690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-17cc382a-86c4-4367-9f9d-ddc3e5e2e867 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:11.342832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17cc382a-86c4-4367-9f9d-ddc3e5e2e867 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:11.343340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17cc382a-86c4-4367-9f9d-ddc3e5e2e867 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:11.350898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17cc382a-86c4-4367-9f9d-ddc3e5e2e867 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:11.352227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17cc382a-86c4-4367-9f9d-ddc3e5e2e867 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:11.357170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17cc382a-86c4-4367-9f9d-ddc3e5e2e867 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:11.362234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17cc382a-86c4-4367-9f9d-ddc3e5e2e867 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:11.400594 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d822d952-137f-4c08-a8b5-ba07239f4115 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b/action" status: 202 len: 0 microversion: 2.1 time: 0.561877 Aug 06 21:01:11.409236 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1009/2049] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:01:10 2022] POST /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 21:01:11.417052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:11.418037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:11.426941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:11.427709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:11.428519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:11.429411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:11.430752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:11.431439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:11.801247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=40 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:11.844808 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-17cc382a-86c4-4367-9f9d-ddc3e5e2e867 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1629 microversion: 2.1 time: 0.550725 Aug 06 21:01:11.848784 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1041/2050] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:11 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1629 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:11.856337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c8654f8f-0120-4b9a-963d-3800c5ce3274 req-02d3bb84-458d-424e-b411-0e5bf1cef390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "tag": "631ad28d-478e-497c-84f9-cb93dd852c28"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:11.881312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:11.884327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c8654f8f-0120-4b9a-963d-3800c5ce3274 req-02d3bb84-458d-424e-b411-0e5bf1cef390 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:11.885107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c8654f8f-0120-4b9a-963d-3800c5ce3274 req-02d3bb84-458d-424e-b411-0e5bf1cef390 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:11.885805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c8654f8f-0120-4b9a-963d-3800c5ce3274 req-02d3bb84-458d-424e-b411-0e5bf1cef390 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:11.925331 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c8654f8f-0120-4b9a-963d-3800c5ce3274 req-02d3bb84-458d-424e-b411-0e5bf1cef390 service nova] Creating event network-changed:631ad28d-478e-497c-84f9-cb93dd852c28 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:01:11.942247 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c8654f8f-0120-4b9a-963d-3800c5ce3274 req-02d3bb84-458d-424e-b411-0e5bf1cef390 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088871 Aug 06 21:01:11.944570 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1042/2051] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:11.963344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4ceda0ef-7206-4600-9622-12a5641d5e40 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d778940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:12.104901 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4ceda0ef-7206-4600-9622-12a5641d5e40 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1438 microversion: 2.1 time: 0.157446 Aug 06 21:01:12.106015 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1043/2052] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:11 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1438 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:12.127885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:12.134360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:12.164254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:12.165375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:12.166020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:12.175072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:12.175857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:12.176688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:12.522920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:12.538948 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e8509a69-19f8-4e6f-b4ee-e054ff2b7a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1302 microversion: 2.1 time: 0.425124 Aug 06 21:01:12.564519 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1044/2053] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:12 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1302 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:12.579272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:12.580344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:12.593451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:12.594302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:12.595044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:12.596189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:12.597112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:12.597829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:12.651268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:12.697523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:12.704886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:12.706908 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-812d4e4f-7eaa-4bdc-b9e8-19ce2fdc3c9b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 1.300959 Aug 06 21:01:12.709020 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1010/2054] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:11 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:12.715592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:12.719453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:12.727923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:12.728569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:12.729241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:12.730581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:12.731566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:12.732974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:12.804968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lazy-loading 'flavor' on Instance uuid 484ddada-2ad7-4bd8-a298-196086372bc8 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:01:12.849855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Going to try to live migrate instance to nch2-master-1 {{(pid=142462) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 21:01:13.850859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:13.871278 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2da59f3d-c372-4ca3-9d73-dba970083ad5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1556 microversion: 2.1 time: 1.304961 Aug 06 21:01:13.872200 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1045/2055] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:12 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1556 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:13.878127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:13.879066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:13.895401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:13.896057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:13.896685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:13.897494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:13.898042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:13.898531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:14.377435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:14.410339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:14.424422 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d40af1c5-c0ec-410a-83bf-3e9132f2f0fc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1402 microversion: 2.1 time: 0.549876 Aug 06 21:01:14.432452 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1046/2056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:13 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1402 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:14.463833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e8491bf6-6851-4e35-bbc6-b26cc692de16 req-1e2fb012-c9a4-4316-b364-be2dc9db7f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac44c669-09c1-4b2a-ab7e-2126661e2e87", "name": "network-vif-plugged", "status": "completed", "tag": "7a6f9161-2804-4d29-bb69-124d7ceb4a28"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:14.542072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e8491bf6-6851-4e35-bbc6-b26cc692de16 req-1e2fb012-c9a4-4316-b364-be2dc9db7f02 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:14.544968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e8491bf6-6851-4e35-bbc6-b26cc692de16 req-1e2fb012-c9a4-4316-b364-be2dc9db7f02 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:14.552687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e8491bf6-6851-4e35-bbc6-b26cc692de16 req-1e2fb012-c9a4-4316-b364-be2dc9db7f02 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:14.601675 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e8491bf6-6851-4e35-bbc6-b26cc692de16 req-1e2fb012-c9a4-4316-b364-be2dc9db7f02 service nova] Creating event network-vif-plugged:7a6f9161-2804-4d29-bb69-124d7ceb4a28 for instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 on nch2-master-1 Aug 06 21:01:14.626140 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e8491bf6-6851-4e35-bbc6-b26cc692de16 req-1e2fb012-c9a4-4316-b364-be2dc9db7f02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188905 Aug 06 21:01:14.628773 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1047/2057] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:14.650979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0b504cd5-14b8-4120-bfb7-863db006d6d0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729db198b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:14.971736 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0b504cd5-14b8-4120-bfb7-863db006d6d0 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1438 microversion: 2.1 time: 0.340031 Aug 06 21:01:14.973449 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1048/2058] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:14 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1438 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:15.010597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:15.014512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:15.028997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:15.029501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:15.029948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:15.030855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:15.054456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:15.055192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:16.435599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:16.449047 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ac83e759-a31e-4550-afbf-fcd05aab46fb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1370 microversion: 2.1 time: 1.467635 Aug 06 21:01:16.450254 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1049/2059] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:14 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1370 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:16.462774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:16.463710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:16.480248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:16.485377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:16.487384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:16.490053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:16.491811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:16.493142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:17.204485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:17.219635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:17.221934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:17.224577 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee2d42de-fad0-4d58-b5eb-4f81bf066811 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.768137 Aug 06 21:01:17.227585 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1050/2060] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:16 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:17.263716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f4206eb5-dacc-4b9e-a034-11e1729ef251 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:17.267427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f4206eb5-dacc-4b9e-a034-11e1729ef251 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:17.290776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4206eb5-dacc-4b9e-a034-11e1729ef251 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:17.291378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4206eb5-dacc-4b9e-a034-11e1729ef251 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:17.291901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4206eb5-dacc-4b9e-a034-11e1729ef251 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:17.292637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4206eb5-dacc-4b9e-a034-11e1729ef251 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:17.293092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4206eb5-dacc-4b9e-a034-11e1729ef251 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:17.308515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4206eb5-dacc-4b9e-a034-11e1729ef251 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:17.380417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=10 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:17.516574 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f4206eb5-dacc-4b9e-a034-11e1729ef251 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.287570 Aug 06 21:01:17.518800 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1051/2061] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:01:17 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:17.524276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ae4f088f-c354-4a07-a853-33400c973b21 req-66d9057f-a87b-426b-97b0-28dac35178ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "tag": "858d1607-0948-4184-9b0c-ac1a999047cf"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:17.548368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ae4f088f-c354-4a07-a853-33400c973b21 req-66d9057f-a87b-426b-97b0-28dac35178ec service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:17.551202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ae4f088f-c354-4a07-a853-33400c973b21 req-66d9057f-a87b-426b-97b0-28dac35178ec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:17.555399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ae4f088f-c354-4a07-a853-33400c973b21 req-66d9057f-a87b-426b-97b0-28dac35178ec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:17.580332 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4cb47eb7-0b8e-419b-b04f-176e47e4460d tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8/action" status: 202 len: 0 microversion: 2.1 time: 4.869701 Aug 06 21:01:17.582968 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1011/2062] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:01:12 2022] POST /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8/action => generated 0 bytes in 4873 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:01:17.587328 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ae4f088f-c354-4a07-a853-33400c973b21 req-66d9057f-a87b-426b-97b0-28dac35178ec service nova] Creating event network-changed:858d1607-0948-4184-9b0c-ac1a999047cf for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:01:17.596046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:17.599193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:17.605347 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ae4f088f-c354-4a07-a853-33400c973b21 req-66d9057f-a87b-426b-97b0-28dac35178ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084961 Aug 06 21:01:17.609847 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1052/2063] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:17.631427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bec999b9-76a4-45cf-a068-9d0fe658ce01 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d76db80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:17.648968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:17.652016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:17.652831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:17.656855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:17.659499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:17.673504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:17.961583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:18.566445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:18.817978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:18.827939 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-77843792-3aa7-44b9-b64d-21a3fd2a7c90 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1588 microversion: 2.1 time: 1.243329 Aug 06 21:01:18.833910 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1012/2064] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:17 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1588 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:18.844565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e9d99f18-3864-44de-b18b-ce2c30857563 req-c4db974d-938f-4338-b46b-8147adab0e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd1e10d-f1cf-4c07-aa50-3ec0620b133b", "name": "network-vif-plugged", "status": "completed", "tag": "ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:18.874646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e9d99f18-3864-44de-b18b-ce2c30857563 req-c4db974d-938f-4338-b46b-8147adab0e77 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:18.875549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e9d99f18-3864-44de-b18b-ce2c30857563 req-c4db974d-938f-4338-b46b-8147adab0e77 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:18.876739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e9d99f18-3864-44de-b18b-ce2c30857563 req-c4db974d-938f-4338-b46b-8147adab0e77 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:18.906919 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e9d99f18-3864-44de-b18b-ce2c30857563 req-c4db974d-938f-4338-b46b-8147adab0e77 service nova] Creating event network-vif-plugged:ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2 for instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b on nch2-master-1 Aug 06 21:01:18.917398 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e9d99f18-3864-44de-b18b-ce2c30857563 req-c4db974d-938f-4338-b46b-8147adab0e77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081744 Aug 06 21:01:18.918598 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1013/2065] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:18.929923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:18.936263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:18.956753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:18.957671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:18.958433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:18.959573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:18.960322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:18.961080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:21.093922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:21.108921 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-01dea96a-239f-4023-be62-a9d1aaf6d667 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1370 microversion: 2.1 time: 2.188533 Aug 06 21:01:21.114105 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1014/2066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:18 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1370 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:21.123842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:21.126099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:21.152218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:21.154275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:21.157132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:21.158226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:21.159003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:21.161257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:22.246723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:22.264225 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dc00fda7-ffd6-45e6-8ae9-a23249f2e630 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1503 microversion: 2.1 time: 1.148421 Aug 06 21:01:22.279517 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1015/2067] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:21 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1503 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:22.292658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:22.293740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:22.309375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:22.310358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:22.311132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:22.314676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:22.315364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:22.316058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:22.375334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:23.662837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:23.697897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:23.726187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:23.736336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-218afc56-81a4-4a50-ab5e-d79aea2e5baa tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 1.449687 Aug 06 21:01:23.751938 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1016/2068] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:22 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:23.777662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e32f927-f871-4ea7-b8fd-a22a037b396c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:23.781265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3e32f927-f871-4ea7-b8fd-a22a037b396c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:23.804934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e32f927-f871-4ea7-b8fd-a22a037b396c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:23.805840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e32f927-f871-4ea7-b8fd-a22a037b396c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:23.806513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e32f927-f871-4ea7-b8fd-a22a037b396c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:23.807442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e32f927-f871-4ea7-b8fd-a22a037b396c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:23.808068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e32f927-f871-4ea7-b8fd-a22a037b396c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:23.808699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e32f927-f871-4ea7-b8fd-a22a037b396c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:24.116653 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e32f927-f871-4ea7-b8fd-a22a037b396c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.356650 Aug 06 21:01:24.117577 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1017/2069] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:01:23 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87/os-interface => generated 284 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:24.126047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a6ca4a6b-50c6-4af3-afa2-4b00dc336cdf req-df532661-b57b-4902-85cc-9396f0353b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "tag": "eb03162f-ec54-46ef-b2b4-b0acc1199e55"}, {"name": "network-changed", "server_uuid": "80940d4d-801b-4144-8d48-5e10a0f752a6", "tag": "20b98415-5b22-44b7-9d18-65751ef5aeaa"}, {"name": "network-changed", "server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "tag": "51739d7c-ad65-40a3-85bf-e2312dde6cb3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:24.178133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a6ca4a6b-50c6-4af3-afa2-4b00dc336cdf req-df532661-b57b-4902-85cc-9396f0353b96 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:24.179191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a6ca4a6b-50c6-4af3-afa2-4b00dc336cdf req-df532661-b57b-4902-85cc-9396f0353b96 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:24.181268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a6ca4a6b-50c6-4af3-afa2-4b00dc336cdf req-df532661-b57b-4902-85cc-9396f0353b96 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:24.226689 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a6ca4a6b-50c6-4af3-afa2-4b00dc336cdf req-df532661-b57b-4902-85cc-9396f0353b96 service nova] Creating event network-changed:eb03162f-ec54-46ef-b2b4-b0acc1199e55 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:01:24.227559 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a6ca4a6b-50c6-4af3-afa2-4b00dc336cdf req-df532661-b57b-4902-85cc-9396f0353b96 service nova] Creating event network-changed:20b98415-5b22-44b7-9d18-65751ef5aeaa for instance 80940d4d-801b-4144-8d48-5e10a0f752a6 on nch1-master-1 Aug 06 21:01:24.229135 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a6ca4a6b-50c6-4af3-afa2-4b00dc336cdf req-df532661-b57b-4902-85cc-9396f0353b96 service nova] Creating event network-changed:51739d7c-ad65-40a3-85bf-e2312dde6cb3 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:01:24.246764 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a6ca4a6b-50c6-4af3-afa2-4b00dc336cdf req-df532661-b57b-4902-85cc-9396f0353b96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.127645 Aug 06 21:01:24.251045 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1018/2070] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:24.266680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d58a148d-0b45-4a50-92e1-fab5399c3d49 req-714ee815-58a3-4a14-9482-092c596ffc80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa20eef6-07e5-4267-b6b8-cb709a0f5920", "tag": "a9c12b17-7937-408d-9e53-9a50f2743b91"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:24.313590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d58a148d-0b45-4a50-92e1-fab5399c3d49 req-714ee815-58a3-4a14-9482-092c596ffc80 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:24.316976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d58a148d-0b45-4a50-92e1-fab5399c3d49 req-714ee815-58a3-4a14-9482-092c596ffc80 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:24.319266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d58a148d-0b45-4a50-92e1-fab5399c3d49 req-714ee815-58a3-4a14-9482-092c596ffc80 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:24.359477 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d58a148d-0b45-4a50-92e1-fab5399c3d49 req-714ee815-58a3-4a14-9482-092c596ffc80 service nova] Creating event network-changed:a9c12b17-7937-408d-9e53-9a50f2743b91 for instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 on nch2-master-1 Aug 06 21:01:24.368325 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d58a148d-0b45-4a50-92e1-fab5399c3d49 req-714ee815-58a3-4a14-9482-092c596ffc80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114986 Aug 06 21:01:24.375074 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1019/2071] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:24.389704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:24.402784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:24.425704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:24.427862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:24.428533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:24.429482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:24.432797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:24.433469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:25.620879 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bec999b9-76a4-45cf-a068-9d0fe658ce01 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1438 microversion: 2.1 time: 8.009088 Aug 06 21:01:25.621366 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1053/2072] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:17 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1438 bytes in 8011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:25.630302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:25.635404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:25.670169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:25.680202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:25.682356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:25.685354 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f49a2e6-42d1-4141-a281-2f7e6822e268 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1370 microversion: 2.1 time: 1.308463 Aug 06 21:01:25.690378 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1020/2073] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:24 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1370 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:25.693421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:25.694218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:25.694788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:25.695229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:25.697935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:25.713536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:25.740907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:25.741371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:25.742623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:25.744496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:25.748129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:25.751271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:26.264968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:26.277750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:26.287521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:26.288961 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-37ebd37a-81d6-4a5a-b156-670afa75d4da tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.597396 Aug 06 21:01:26.302959 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1021/2074] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:25 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:26.311477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-661768f3-28c8-4a71-bcee-fcc46f3c3a8e req-621a8849-f331-4412-ab4e-f70a96be0dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "tag": "33e933e8-51c8-4eb2-8702-773e0049c053"}, {"server_uuid": "484ddada-2ad7-4bd8-a298-196086372bc8", "name": "network-vif-unplugged", "status": "completed", "tag": "797fb5d8-810c-48f1-9f40-b8f36d0eba22"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:26.331169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-661768f3-28c8-4a71-bcee-fcc46f3c3a8e req-621a8849-f331-4412-ab4e-f70a96be0dd6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:26.332094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-661768f3-28c8-4a71-bcee-fcc46f3c3a8e req-621a8849-f331-4412-ab4e-f70a96be0dd6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:26.332843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-661768f3-28c8-4a71-bcee-fcc46f3c3a8e req-621a8849-f331-4412-ab4e-f70a96be0dd6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:26.364374 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-661768f3-28c8-4a71-bcee-fcc46f3c3a8e req-621a8849-f331-4412-ab4e-f70a96be0dd6 service nova] Creating event network-changed:33e933e8-51c8-4eb2-8702-773e0049c053 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:01:26.366994 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-661768f3-28c8-4a71-bcee-fcc46f3c3a8e req-621a8849-f331-4412-ab4e-f70a96be0dd6 service nova] Creating event network-vif-unplugged:797fb5d8-810c-48f1-9f40-b8f36d0eba22 for instance 484ddada-2ad7-4bd8-a298-196086372bc8 on nch1-master-1 Aug 06 21:01:26.401744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-661768f3-28c8-4a71-bcee-fcc46f3c3a8e req-621a8849-f331-4412-ab4e-f70a96be0dd6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.094699 Aug 06 21:01:26.414309 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1022/2075] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:26.685677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a90cb0b-433b-4efc-81ce-32d7fc046dba tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a35b38b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:26.732892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:26.785073 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5381845-370c-42ff-8195-ed5fcd1a0992 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1503 microversion: 2.1 time: 1.162245 Aug 06 21:01:26.785348 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1054/2076] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:25 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1503 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:26.821475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:26.822129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:26.863090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:26.875179 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a90cb0b-433b-4efc-81ce-32d7fc046dba tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1438 microversion: 2.1 time: 0.229064 Aug 06 21:01:26.877412 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1023/2077] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:26 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1438 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:26.878288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:26.879759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:26.881595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:26.882390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:26.883311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:27.315174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:27.316318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:27.330095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:27.330903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:27.332565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:27.333481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:27.337208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:27.337894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:28.013612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:28.031641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:28.034627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:28.038244 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9b025faa-9ae9-4e54-877e-72c7cc19f0b1 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.728567 Aug 06 21:01:28.041393 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1024/2078] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:27 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:01:28.050703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:28.051611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:28.059667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:28.060571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:28.061628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:28.062684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:28.063390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:28.064062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:28.331534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:28.354162 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7a812d7-2a84-43b7-9c2a-712dace73b72 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1503 microversion: 2.1 time: 0.309895 Aug 06 21:01:28.367751 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1025/2079] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:28 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:28.389246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f99676f-74f7-45e0-85af-c509a72cc886 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a35a44c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:28.466928 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f99676f-74f7-45e0-85af-c509a72cc886 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1438 microversion: 2.1 time: 0.096300 Aug 06 21:01:28.472418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:28.477054 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1026/2080] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:28 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:28.485288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-48b12122-fe7d-4cff-bef3-b6ba1d13dde3 req-90d3f3f5-986c-4d40-a1a6-b96be29b3d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484ddada-2ad7-4bd8-a298-196086372bc8", "tag": "797fb5d8-810c-48f1-9f40-b8f36d0eba22"}, {"name": "network-changed", "server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "tag": "d5834d81-de6d-4143-950a-49b591985c1f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:28.497609 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40ff3eea-e6e8-4c5e-9989-55142282c0df tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1370 microversion: 2.1 time: 1.711221 Aug 06 21:01:28.498221 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1055/2081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:26 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1370 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:28.506422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-48b12122-fe7d-4cff-bef3-b6ba1d13dde3 req-90d3f3f5-986c-4d40-a1a6-b96be29b3d6f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:28.510939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-48b12122-fe7d-4cff-bef3-b6ba1d13dde3 req-90d3f3f5-986c-4d40-a1a6-b96be29b3d6f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:28.510939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-48b12122-fe7d-4cff-bef3-b6ba1d13dde3 req-90d3f3f5-986c-4d40-a1a6-b96be29b3d6f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:28.536009 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-48b12122-fe7d-4cff-bef3-b6ba1d13dde3 req-90d3f3f5-986c-4d40-a1a6-b96be29b3d6f service nova] Creating event network-changed:797fb5d8-810c-48f1-9f40-b8f36d0eba22 for instance 484ddada-2ad7-4bd8-a298-196086372bc8 on nch1-master-1 Aug 06 21:01:28.537800 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-48b12122-fe7d-4cff-bef3-b6ba1d13dde3 req-90d3f3f5-986c-4d40-a1a6-b96be29b3d6f service nova] Creating event network-changed:d5834d81-de6d-4143-950a-49b591985c1f for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:01:28.550115 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-48b12122-fe7d-4cff-bef3-b6ba1d13dde3 req-90d3f3f5-986c-4d40-a1a6-b96be29b3d6f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.069756 Aug 06 21:01:28.551488 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1027/2082] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:29.067262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:29.067964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:29.078868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:29.079441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:29.080597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:29.084497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:29.085099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:29.085617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:29.186436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-700728a1-c999-499d-b350-2552aaa54a7d req-abb2d5b4-dc8e-4da5-b81b-55953a229255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80940d4d-801b-4144-8d48-5e10a0f752a6", "name": "network-vif-plugged", "status": "completed", "tag": "20b98415-5b22-44b7-9d18-65751ef5aeaa"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:29.210647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-700728a1-c999-499d-b350-2552aaa54a7d req-abb2d5b4-dc8e-4da5-b81b-55953a229255 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:29.214012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-700728a1-c999-499d-b350-2552aaa54a7d req-abb2d5b4-dc8e-4da5-b81b-55953a229255 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:29.214512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-700728a1-c999-499d-b350-2552aaa54a7d req-abb2d5b4-dc8e-4da5-b81b-55953a229255 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:29.245234 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-700728a1-c999-499d-b350-2552aaa54a7d req-abb2d5b4-dc8e-4da5-b81b-55953a229255 service nova] Creating event network-vif-plugged:20b98415-5b22-44b7-9d18-65751ef5aeaa for instance 80940d4d-801b-4144-8d48-5e10a0f752a6 on nch1-master-1 Aug 06 21:01:29.262401 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-700728a1-c999-499d-b350-2552aaa54a7d req-abb2d5b4-dc8e-4da5-b81b-55953a229255 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080419 Aug 06 21:01:29.263422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1028/2083] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:29.381082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:29.382094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:29.397498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:29.398705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:29.402204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:29.406263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:29.406814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:29.407279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:29.882828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:29.895517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:29.908244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:29.909490 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0e48c495-cbbf-4f05-82ac-193d7200fbf4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.846107 Aug 06 21:01:29.910059 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1056/2084] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:29 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:29.941684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5c3a6d5a-757d-4acb-985d-b55b82db0fe3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729de229d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:30.021804 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5c3a6d5a-757d-4acb-985d-b55b82db0fe3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1438 microversion: 2.1 time: 0.083834 Aug 06 21:01:30.026172 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1057/2085] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:29 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:30.038789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:30.045850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:30.046488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:30.049847 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7553e25a-2442-42b9-8714-971109af030e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1503 microversion: 2.1 time: 0.675352 Aug 06 21:01:30.066404 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1029/2086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:29 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1503 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:30.075929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:30.079637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:30.080395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:30.081626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:30.082318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:30.083598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:30.519149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:30.527817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:30.538837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:30.548059 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4cad317f-fdd8-4454-a40b-3ee3619c8d78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1370 microversion: 2.1 time: 0.520753 Aug 06 21:01:30.553381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:30.570452 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1058/2087] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:30 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1370 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:30.576082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:30.577399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:30.578346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:30.579026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:30.579631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:30.584011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e70297ec-30cf-47b5-a974-765e1cc772eb req-4cbc20df-d316-4023-b542-8cd187587884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac44c669-09c1-4b2a-ab7e-2126661e2e87", "tag": "7a6f9161-2804-4d29-bb69-124d7ceb4a28"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:30.610734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e70297ec-30cf-47b5-a974-765e1cc772eb req-4cbc20df-d316-4023-b542-8cd187587884 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:30.611491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e70297ec-30cf-47b5-a974-765e1cc772eb req-4cbc20df-d316-4023-b542-8cd187587884 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:30.612177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e70297ec-30cf-47b5-a974-765e1cc772eb req-4cbc20df-d316-4023-b542-8cd187587884 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:30.654603 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e70297ec-30cf-47b5-a974-765e1cc772eb req-4cbc20df-d316-4023-b542-8cd187587884 service nova] Creating event network-changed:7a6f9161-2804-4d29-bb69-124d7ceb4a28 for instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 on nch2-master-1 Aug 06 21:01:30.686777 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e70297ec-30cf-47b5-a974-765e1cc772eb req-4cbc20df-d316-4023-b542-8cd187587884 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110910 Aug 06 21:01:30.688032 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1059/2088] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:30.936207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:30.937782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:30.952009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:30.968105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:30.968569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:30.969339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:30.969821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:30.970242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:31.632189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:31.645484 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46d3ed86-4362-48ba-85d4-117300c8e87d tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1588 microversion: 2.1 time: 1.130680 Aug 06 21:01:31.659124 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1030/2089] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:30 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1588 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:31.676262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d891dead-9c73-445f-95d3-7f359cde8c9f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729da1fb80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:31.760587 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d891dead-9c73-445f-95d3-7f359cde8c9f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1438 microversion: 2.1 time: 0.100048 Aug 06 21:01:31.762093 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1031/2090] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:31 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:31.786409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:31.790653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:31.801048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:31.802035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:31.803065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:31.804009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:31.804670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:31.805296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:32.142271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:32.160642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:32.162498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:32.165260 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4b60ed67-26b9-4ae2-84f5-64574cb48ed2 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 1.235208 Aug 06 21:01:32.175653 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1060/2091] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:30 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:32.193505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:32.194459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:32.201273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:32.201778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:32.206348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:32.207178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:32.207859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:32.210753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:32.651384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:32.662456 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dcbccdc6-b017-49fe-bf3d-1752f924e763 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1503 microversion: 2.1 time: 0.898203 Aug 06 21:01:32.680168 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1032/2092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:31 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1503 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:32.780479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2e9925b0-5597-4715-8819-d2a4812641ce tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a367e550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:32.885440 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2e9925b0-5597-4715-8819-d2a4812641ce tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1438 microversion: 2.1 time: 0.110790 Aug 06 21:01:32.886868 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1033/2093] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:32 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1438 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:33.201521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:33.202237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:33.213559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:33.214204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:33.215671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:33.219635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:33.220609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:33.227527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:33.675185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:33.685405 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee13a97c-ce5c-4934-a6df-62dce5f79fb2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1557 microversion: 2.1 time: 1.507706 Aug 06 21:01:33.690717 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1061/2094] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:32 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1557 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:33.704810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:33.709447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:33.730433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:33.731938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:33.733013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:33.734002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:33.735493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:33.736195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:34.000718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:34.018119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:34.019700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:34.020885 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-965b0ce7-bf33-46fc-8d2f-b1424a4bc6cf tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.823357 Aug 06 21:01:34.025523 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1034/2095] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:33 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:01:34.041047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c630646-87e6-4d5a-a86d-bea1578655d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:34.041557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3c630646-87e6-4d5a-a86d-bea1578655d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:34.052031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c630646-87e6-4d5a-a86d-bea1578655d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:34.052524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c630646-87e6-4d5a-a86d-bea1578655d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:34.053129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c630646-87e6-4d5a-a86d-bea1578655d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:34.053866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c630646-87e6-4d5a-a86d-bea1578655d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:34.054335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c630646-87e6-4d5a-a86d-bea1578655d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:34.054852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c630646-87e6-4d5a-a86d-bea1578655d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:34.385901 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3c630646-87e6-4d5a-a86d-bea1578655d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.358770 Aug 06 21:01:34.386864 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1035/2096] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:01:34 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-interface => generated 285 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:34.394023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-20bf56be-e08d-462f-b686-1c4515487e89 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a35cc700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:34.476901 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-20bf56be-e08d-462f-b686-1c4515487e89 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1447 microversion: 2.1 time: 0.088769 Aug 06 21:01:34.477299 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1036/2097] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:34 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1447 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:34.494615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf52d9b4-2fc7-45c0-897c-e35d7d13d255 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a35b3d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:34.589186 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf52d9b4-2fc7-45c0-897c-e35d7d13d255 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 200 len: 1447 microversion: 2.1 time: 0.101115 Aug 06 21:01:34.594098 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1037/2098] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:34 2022] GET /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:34.610901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1afd9ea3-28c7-41fa-83f0-1e4b7f9280e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a35cc8b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:34.671660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:34.685598 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba3462d2-4e84-456b-a3e2-0dd6d08054e4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1503 microversion: 2.1 time: 0.984569 Aug 06 21:01:34.686225 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1062/2099] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:33 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1503 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:35.048257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:35.049777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:35.058429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:35.059957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:35.060664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:35.061686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:35.062467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:35.063177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:35.576623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:35.598118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:35.602189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:35.604313 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-847aff1c-4faf-4e00-a5d6-5dbe67a21f2b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.562103 Aug 06 21:01:35.610187 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1063/2100] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:35 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:01:35.656150 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1afd9ea3-28c7-41fa-83f0-1e4b7f9280e3 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 204 len: 0 microversion: 2.1 time: 1.051343 Aug 06 21:01:35.656883 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1038/2101] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:34 2022] DELETE /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:01:35.666982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:35.668606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:35.677656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:35.678357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:35.679179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:35.680315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:35.681114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:35.681732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:35.707243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:35.708153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:35.721349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:35.722055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:35.722824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:35.725837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:35.726518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:35.727156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:35.740275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:01:35.941825 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c121cb38-28ee-48ec-b249-63a7a61b34a1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 204 len: 0 microversion: 2.1 time: 0.279903 Aug 06 21:01:35.943269 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1064/2102] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:01:35 2022] DELETE /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:01:36.206744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-789632436", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "a17c0b0a-6719-44f2-8dc6-4a0cb498bc1f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:36.306261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] validate_networks() for [('a17c0b0a-6719-44f2-8dc6-4a0cb498bc1f', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:01:36.395784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:36.410449 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-977cad08-1585-4e54-b804-d80a44f898bb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1503 microversion: 2.1 time: 0.707244 Aug 06 21:01:36.412003 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1039/2103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:35 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1503 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:36.639043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:36.640213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:36.650689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:36.651205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:36.651648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:36.652394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:36.652859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:36.653849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:36.999652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:37.010248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:37.012259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:37.014430 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eae88103-9be8-4dcd-a1ca-380ab7bfb2a4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.379710 Aug 06 21:01:37.015221 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1040/2104] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:36 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:37.020354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-12834567-1fe3-4b22-bb79-14ce119a680d req-c59a55af-c508-4cda-a6df-a18f1905afa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80940d4d-801b-4144-8d48-5e10a0f752a6", "tag": "20b98415-5b22-44b7-9d18-65751ef5aeaa"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:37.030675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-12834567-1fe3-4b22-bb79-14ce119a680d req-c59a55af-c508-4cda-a6df-a18f1905afa6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:37.031393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-12834567-1fe3-4b22-bb79-14ce119a680d req-c59a55af-c508-4cda-a6df-a18f1905afa6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:37.032117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-12834567-1fe3-4b22-bb79-14ce119a680d req-c59a55af-c508-4cda-a6df-a18f1905afa6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:37.047771 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-12834567-1fe3-4b22-bb79-14ce119a680d req-c59a55af-c508-4cda-a6df-a18f1905afa6 service nova] Creating event network-changed:20b98415-5b22-44b7-9d18-65751ef5aeaa for instance 80940d4d-801b-4144-8d48-5e10a0f752a6 on nch1-master-1 Aug 06 21:01:37.053556 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-12834567-1fe3-4b22-bb79-14ce119a680d req-c59a55af-c508-4cda-a6df-a18f1905afa6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036725 Aug 06 21:01:37.064507 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1041/2105] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:37.437655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:37.438503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:37.459745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:37.460631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:37.461123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:37.461890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:37.462721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:37.464256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:37.760757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:37.777877 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c9854cf6-dc1e-4730-aa3c-a523028f8c94 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1503 microversion: 2.1 time: 0.348656 Aug 06 21:01:37.799030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1042/2106] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:37 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1503 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:37.854888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:01:37.856023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:01:37.857290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:01:37.858087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:01:37.858714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:01:37.880099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:37.880903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:37.884118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:37.886067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:37.888010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:37.889276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:37.955073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Getting quotas for project 764e8bbcc05b47e5a647cf2a0fe82a20. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:01:37.974651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Getting quotas for user d43d0d15118242b7a60cc34c512fbe5e and project 764e8bbcc05b47e5a647cf2a0fe82a20. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:01:38.007481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:01:38.011929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:01:38.159726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15eaf8ba-3d9e-416f-9c29-bbaeb17fe63e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Action: 'update', calling method: .version_select at 0x7f72a367e430>, body: {"quota_set": {"ram": "5120"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:38.186028 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b1f22c4a-60f2-4d8d-ba2e-e31da52e04d7 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.974169 Aug 06 21:01:38.188479 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1065/2107] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:01:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:01:38.229956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:38.234931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:38.260726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:38.262752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:38.264406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:38.266266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:38.267508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:38.269335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:38.312750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15eaf8ba-3d9e-416f-9c29-bbaeb17fe63e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:38.314347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15eaf8ba-3d9e-416f-9c29-bbaeb17fe63e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:38.315011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15eaf8ba-3d9e-416f-9c29-bbaeb17fe63e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:38.317633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15eaf8ba-3d9e-416f-9c29-bbaeb17fe63e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:38.318385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15eaf8ba-3d9e-416f-9c29-bbaeb17fe63e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:38.321175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15eaf8ba-3d9e-416f-9c29-bbaeb17fe63e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:38.515470 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15eaf8ba-3d9e-416f-9c29-bbaeb17fe63e tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/914267b631964bb69eb459d6e58ed982" status: 200 len: 148 microversion: 2.57 time: 0.714693 Aug 06 21:01:38.516126 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1043/2108] 10.222.0.33 () {62 vars in 1303 bytes} [Sat Aug 6 21:01:37 2022] PUT /compute/v2.1/os-quota-sets/914267b631964bb69eb459d6e58ed982 => generated 148 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:01:38.527940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-81c51294-e26c-4b01-9c90-49719d3b0c07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:38.531615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-81c51294-e26c-4b01-9c90-49719d3b0c07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:38.647298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-81c51294-e26c-4b01-9c90-49719d3b0c07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:38.677837 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-81c51294-e26c-4b01-9c90-49719d3b0c07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1207 microversion: 2.1 time: 0.160471 Aug 06 21:01:38.680149 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1044/2109] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:38 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1207 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:38.685635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6aa5d282-1fdf-454f-90ef-fdaf5a6cf643 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Calling method '.version_select at 0x7f72a35a4ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:38.837932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6aa5d282-1fdf-454f-90ef-fdaf5a6cf643 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:38.838431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6aa5d282-1fdf-454f-90ef-fdaf5a6cf643 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:38.843692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6aa5d282-1fdf-454f-90ef-fdaf5a6cf643 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:38.844703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6aa5d282-1fdf-454f-90ef-fdaf5a6cf643 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:38.845202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6aa5d282-1fdf-454f-90ef-fdaf5a6cf643 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:38.845651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6aa5d282-1fdf-454f-90ef-fdaf5a6cf643 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:38.900110 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6aa5d282-1fdf-454f-90ef-fdaf5a6cf643 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/914267b631964bb69eb459d6e58ed982/detail" status: 200 len: 463 microversion: 2.57 time: 0.218657 Aug 06 21:01:38.906341 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1045/2110] 10.222.0.33 () {60 vars in 1304 bytes} [Sat Aug 6 21:01:38 2022] GET /compute/v2.1/os-quota-sets/914267b631964bb69eb459d6e58ed982/detail => generated 463 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:01:38.921865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:38.930512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:38.946017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:38.948372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:38.949125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:38.951910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:38.953374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:38.955449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.043997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:39.061104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:39.067962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:39.072753 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01752c86-922a-4274-bef0-07de2879ce30 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.880738 Aug 06 21:01:39.086579 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1066/2111] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:38 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:39.140252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ae1bd204-4d12-4a08-8a85-32973450e54b req-621389fd-d7ba-4769-a898-7e2f9247fa1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd1e10d-f1cf-4c07-aa50-3ec0620b133b", "name": "network-vif-unplugged", "status": "completed", "tag": "ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:39.165263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ae1bd204-4d12-4a08-8a85-32973450e54b req-621389fd-d7ba-4769-a898-7e2f9247fa1c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.165762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ae1bd204-4d12-4a08-8a85-32973450e54b req-621389fd-d7ba-4769-a898-7e2f9247fa1c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.166198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ae1bd204-4d12-4a08-8a85-32973450e54b req-621389fd-d7ba-4769-a898-7e2f9247fa1c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.191636 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ae1bd204-4d12-4a08-8a85-32973450e54b req-621389fd-d7ba-4769-a898-7e2f9247fa1c service nova] Creating event network-vif-unplugged:ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2 for instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b on nch2-master-1 Aug 06 21:01:39.215376 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ae1bd204-4d12-4a08-8a85-32973450e54b req-621389fd-d7ba-4769-a898-7e2f9247fa1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079702 Aug 06 21:01:39.217594 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1067/2112] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:39.229284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Action: 'update', calling method: .version_select at 0x7f729d8699d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:39.360462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:39.372112 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c360e110-e1ba-4371-8b42-e8ccd0bca738 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1478 microversion: 2.1 time: 0.464349 Aug 06 21:01:39.375549 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1046/2113] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:38 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1478 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:39.375742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.376139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.376582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.378271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.379036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.379639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.396143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3bd68dbe-70ec-487c-bab6-d2b612a93213 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '.version_select at 0x7f729ddc0790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:39.400002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd68dbe-70ec-487c-bab6-d2b612a93213 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.400546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd68dbe-70ec-487c-bab6-d2b612a93213 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.401001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bd68dbe-70ec-487c-bab6-d2b612a93213 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.403002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:39.421734 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3bd68dbe-70ec-487c-bab6-d2b612a93213 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.029804 Aug 06 21:01:39.426228 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1047/2114] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 21:01:39 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:01:39.440943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c72d33df-9be5-43c4-9a1f-a6f6e00abd83 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:39.442029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c72d33df-9be5-43c4-9a1f-a6f6e00abd83 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:39.452254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.453598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.455645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c72d33df-9be5-43c4-9a1f-a6f6e00abd83 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.458284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.458998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c72d33df-9be5-43c4-9a1f-a6f6e00abd83 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.459524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c72d33df-9be5-43c4-9a1f-a6f6e00abd83 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.459930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.460774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c72d33df-9be5-43c4-9a1f-a6f6e00abd83 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.461024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.461647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.462013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c72d33df-9be5-43c4-9a1f-a6f6e00abd83 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.462516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c72d33df-9be5-43c4-9a1f-a6f6e00abd83 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.473661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:39.554050 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a7e08469-c288-48dc-a922-b87024f23ba5 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/914267b631964bb69eb459d6e58ed982?user_id=1b4ad0ba40394a55b3f0ae198bace645" status: 200 len: 148 microversion: 2.57 time: 0.334938 Aug 06 21:01:39.555393 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1068/2115] 10.222.0.33 () {62 vars in 1384 bytes} [Sat Aug 6 21:01:39 2022] PUT /compute/v2.1/os-quota-sets/914267b631964bb69eb459d6e58ed982?user_id=1b4ad0ba40394a55b3f0ae198bace645 => generated 148 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:01:39.574977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0323c414-5df4-47b0-81f3-4f39876ba040 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] Calling method '.version_select at 0x7f729d871310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:39.754150 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0323c414-5df4-47b0-81f3-4f39876ba040 tempest-QuotasAdminTestV257-1777334465 tempest-QuotasAdminTestV257-1777334465-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/914267b631964bb69eb459d6e58ed982?user_id=1b4ad0ba40394a55b3f0ae198bace645" status: 200 len: 190 microversion: 2.57 time: 0.191885 Aug 06 21:01:39.755454 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1069/2116] 10.222.0.33 () {60 vars in 1364 bytes} [Sat Aug 6 21:01:39 2022] GET /compute/v2.1/os-quota-sets/914267b631964bb69eb459d6e58ed982?user_id=1b4ad0ba40394a55b3f0ae198bace645 => generated 190 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:01:39.765940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:39.767634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:39.776446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.777146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.777907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.779115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:39.779746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:39.780344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:39.953794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:39.994760 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78d13745-1735-4522-9ff8-bb7cd379355c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1259 microversion: 2.1 time: 0.237922 Aug 06 21:01:39.997774 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1070/2117] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:39 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:40.011603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2d78a61c-2b1e-422c-887a-82b99b3ae0cf req-eff6c789-ae22-4619-ae87-d8f10ffe8df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd1e10d-f1cf-4c07-aa50-3ec0620b133b", "name": "network-vif-deleted", "tag": "ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:40.035117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2d78a61c-2b1e-422c-887a-82b99b3ae0cf req-eff6c789-ae22-4619-ae87-d8f10ffe8df4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:40.035954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2d78a61c-2b1e-422c-887a-82b99b3ae0cf req-eff6c789-ae22-4619-ae87-d8f10ffe8df4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:40.036762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2d78a61c-2b1e-422c-887a-82b99b3ae0cf req-eff6c789-ae22-4619-ae87-d8f10ffe8df4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:40.076976 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2d78a61c-2b1e-422c-887a-82b99b3ae0cf req-eff6c789-ae22-4619-ae87-d8f10ffe8df4 service nova] Creating event network-vif-deleted:ca4b9ff2-81b4-4c8a-8acf-e289bbe627c2 for instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b on nch2-master-1 Aug 06 21:01:40.088173 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2d78a61c-2b1e-422c-887a-82b99b3ae0cf req-eff6c789-ae22-4619-ae87-d8f10ffe8df4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088517 Aug 06 21:01:40.094830 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1071/2118] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:40.100908 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c72d33df-9be5-43c4-9a1f-a6f6e00abd83 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1629 microversion: 2.1 time: 0.663710 Aug 06 21:01:40.111304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:40.113700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:40.118921 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1048/2119] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:39 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1629 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:40.133612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e285f177-782a-4e4b-8bdf-ce7fd3d7f512 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Action: 'create', calling method: .version_select at 0x7f72a35a3820>, body: {"keypair": {"name": "tempest-keypair-1045864944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI01B/GrkqN0piZbH3kr6LtiUotoatdy0qeJkgVtljHyPxRFJPqnJWU8hPdD7h+ZtGhd83hMbbASgSCJStOkDHTq2Gj1+zydMv3Wi0P/VNCy9bSMqaIKCsOUIDTBgBAa6g=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:40.135095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:40.135977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:40.137115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:40.139715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:40.140986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:40.141701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:40.172316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e285f177-782a-4e4b-8bdf-ce7fd3d7f512 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for project e47f439135a6445fa29c8be6d69c1759. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:01:40.180085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e285f177-782a-4e4b-8bdf-ce7fd3d7f512 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for user ad1a96004778407584d1805b07ad1c5f and project e47f439135a6445fa29c8be6d69c1759. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:01:40.228297 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e285f177-782a-4e4b-8bdf-ce7fd3d7f512 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086202 Aug 06 21:01:40.229034 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1049/2120] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:01:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:01:40.592790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:40.613958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:40.618049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:40.620911 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6373ea6-65a5-476f-9d82-cae677aa5d85 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.524932 Aug 06 21:01:40.623925 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1072/2121] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:40 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:41.022669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:41.026412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:41.036520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:41.044935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:41.045317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:41.045767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:41.046725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:41.047330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:41.048230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:41.238238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:41.246645 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-919804eb-089a-416f-ad97-888b2709b2bf tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1265 microversion: 2.1 time: 0.230423 Aug 06 21:01:41.249352 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1050/2122] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:41 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:41.654789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:41.656065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:41.660041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:41.664294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:41.665022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:41.665656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:41.666382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:41.666879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:41.667318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:42.163801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:42.174860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:42.176602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:42.178009 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b13878e2-71c7-4286-810d-42c955799e03 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.532450 Aug 06 21:01:42.181004 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1073/2123] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:41 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:42.269240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:42.270657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:42.279190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:42.280188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:42.280945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:42.281896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:42.282628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:42.283302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:42.933594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:42.973952 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a301a563-33f1-4945-bd4d-30494d2f5e05 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1307 microversion: 2.1 time: 0.707400 Aug 06 21:01:42.976145 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1051/2124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:42 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1307 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:43.204953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:43.205574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:43.213092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:43.213814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:43.214441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:43.215400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:43.216494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:43.217154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:43.430258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:43.443151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:43.444965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:43.446532 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bb17cc3f-d5c1-488d-ac54-ab6eb05d5fe7 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.245988 Aug 06 21:01:43.447405 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1074/2125] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:43 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:43.996952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:43.997633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:44.004595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:44.007206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:44.008248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:44.009454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:44.011106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:44.011578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:44.436753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:44.451425 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b56f530-0a6e-4320-921c-9ca17a5aa7f8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1307 microversion: 2.1 time: 0.457250 Aug 06 21:01:44.469415 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1052/2126] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:43 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1307 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:44.479102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:44.480756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:44.490410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:44.491595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:44.492267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:44.493153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:44.494466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:44.495417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:44.741329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1360900932", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "a325533c-4e08-4233-a872-04f98faab476"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:44.813549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] validate_networks() for [('a325533c-4e08-4233-a872-04f98faab476', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:01:45.011559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:45.034750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:45.042419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:45.044670 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bcfca61a-1064-450a-acbe-00bebba75331 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.572040 Aug 06 21:01:45.047478 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1075/2127] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:44 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:45.067023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3feb8834-a06d-4b37-a3c1-8507696f9663 req-cc672d83-ed63-449d-b3ec-1a310a207e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b5d414-5de4-408a-a806-7d3c112f9448", "tag": "1fae6113-7214-4070-979c-38530aa829e3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:45.080462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3feb8834-a06d-4b37-a3c1-8507696f9663 req-cc672d83-ed63-449d-b3ec-1a310a207e6c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:45.081031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3feb8834-a06d-4b37-a3c1-8507696f9663 req-cc672d83-ed63-449d-b3ec-1a310a207e6c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:45.082054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3feb8834-a06d-4b37-a3c1-8507696f9663 req-cc672d83-ed63-449d-b3ec-1a310a207e6c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:45.097985 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3feb8834-a06d-4b37-a3c1-8507696f9663 req-cc672d83-ed63-449d-b3ec-1a310a207e6c service nova] Creating event network-changed:1fae6113-7214-4070-979c-38530aa829e3 for instance 79b5d414-5de4-408a-a806-7d3c112f9448 on nch2-master-1 Aug 06 21:01:45.106610 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3feb8834-a06d-4b37-a3c1-8507696f9663 req-cc672d83-ed63-449d-b3ec-1a310a207e6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053453 Aug 06 21:01:45.107823 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1076/2128] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:45.235074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2012112137", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5fee4f47-5ab3-4921-b8aa-c6b0a41eb20e"}], "security_groups": [{"name": "tempest-securitygroup--397477934"}], "key_name": "tempest-keypair-1045864944", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:45.432875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] validate_networks() for [('5fee4f47-5ab3-4921-b8aa-c6b0a41eb20e', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:01:45.679267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:01:45.680107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:01:45.681152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:01:45.681826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:01:45.682326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:01:45.693273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:45.694613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:45.695310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:45.696226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:45.697626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:45.698252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:45.735373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Getting quotas for project 5a30ae4cede34e428cc6468b7a073497. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:01:45.742406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Getting quotas for user 398134b8b4234816ae43a9230eae3c16 and project 5a30ae4cede34e428cc6468b7a073497. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:01:45.757793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:01:45.760452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:01:45.811166 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8517c3a3-94d8-4491-bf9b-57975908bc6f tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245140 Aug 06 21:01:45.812547 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1053/2129] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:01:45.817485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:45.818415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:45.826170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:45.827042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:45.827740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:45.828714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:45.829403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:45.830094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:46.041630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:46.055296 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-35975b85-b342-435f-9f48-6aa43e48e822 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1307 microversion: 2.1 time: 0.241363 Aug 06 21:01:46.057308 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1054/2130] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:45 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:46.071208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-baad8926-eecc-4379-8f38-1c40f0cf7e90 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:46.071208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-baad8926-eecc-4379-8f38-1c40f0cf7e90 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:46.162196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-baad8926-eecc-4379-8f38-1c40f0cf7e90 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:46.171939 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-baad8926-eecc-4379-8f38-1c40f0cf7e90 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1217 microversion: 2.1 time: 0.109644 Aug 06 21:01:46.173673 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1055/2131] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:46 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:46.199485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:46.201493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:46.222423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:46.224663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:46.225155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:46.226434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:46.231839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:46.232382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:46.254337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:01:46.254956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:01:46.255628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:01:46.255775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:01:46.256155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:01:46.275191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:46.277395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:46.279242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:46.282161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:46.283268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:46.284732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:46.317484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for project e47f439135a6445fa29c8be6d69c1759. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:01:46.332835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for user ad1a96004778407584d1805b07ad1c5f and project e47f439135a6445fa29c8be6d69c1759. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:01:46.350804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:01:46.353633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:01:46.459058 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da02a01b-e7f5-4456-8a6a-c55fe3b3d8a8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.227719 Aug 06 21:01:46.466714 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1077/2132] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:01:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:01:46.476445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bee724c9-9009-493b-8de0-205676d8d954 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:46.481479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bee724c9-9009-493b-8de0-205676d8d954 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:46.660622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:46.675795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:46.677734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:46.679210 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f977bcc-89c3-407d-8f39-abf589bcd64a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.490010 Aug 06 21:01:46.679940 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1056/2133] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:46 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:46.734953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bee724c9-9009-493b-8de0-205676d8d954 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:46.742383 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bee724c9-9009-493b-8de0-205676d8d954 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1235 microversion: 2.1 time: 0.273708 Aug 06 21:01:46.746978 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1078/2134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:46 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1235 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:47.087406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:47.088428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:47.118056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:47.118917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:47.119374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:47.121297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:47.125150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:47.128136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:47.205295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:47.206287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:47.227078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:47.229137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:47.230035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:47.239266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:47.239944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:47.240398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:48.244745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:48.252613 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-983a97aa-91b7-4159-980b-a615eadd047d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1269 microversion: 2.1 time: 1.056505 Aug 06 21:01:48.258066 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1079/2135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:47 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1269 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:48.281240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:48.282402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:48.294426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:48.295278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:48.296669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:48.297594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:48.302887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:48.303738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:48.518385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:48.535157 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-300c4ea0-034f-4d04-82f7-439c652f5068 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1307 microversion: 2.1 time: 1.457058 Aug 06 21:01:48.537665 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1057/2136] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:47 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1307 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:48.549414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:48.550133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:48.566444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:48.569608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:48.570322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:48.572187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:48.573208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:48.573871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:48.734039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:48.745013 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-271259c8-9661-4938-92fa-c7cb963dbcc1 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1305 microversion: 2.1 time: 0.206164 Aug 06 21:01:48.746276 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1058/2137] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:48 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1305 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:49.127136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:49.132045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:49.136234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:49.140786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:49.141704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:49.143285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:49.145643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:49.147194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:49.148996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:49.154583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:49.156326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:49.172828 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3ef5fde8-0f68-4072-9482-0ca148fa693c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.913410 Aug 06 21:01:49.173593 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1080/2138] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:48 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:49.273625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:49.274259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:49.287456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:49.287958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:49.288492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:49.296900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:49.311007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:49.311906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:49.552245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:49.567667 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37f0b3d4-7fc2-4f37-94b7-abe808bae732 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1275 microversion: 2.1 time: 0.297875 Aug 06 21:01:49.569154 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1081/2139] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:49 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1275 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:49.576569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:49.577531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:49.588579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:49.589370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:49.590480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:49.591948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:49.593016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:49.594041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:49.653471 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "POST /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.534357 Aug 06 21:01:49.655133 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1059/2140] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:01:49 2022] POST /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:01:49.773008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:49.773825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:49.787155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:49.788784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:49.789483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:49.793704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:49.800066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:49.800808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:49.991370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:50.009828 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6a450173-2d4a-49b9-81e7-9747c8163fc6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1307 microversion: 2.1 time: 0.438066 Aug 06 21:01:50.013114 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1082/2141] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:49 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1307 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:50.199579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:50.200769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:50.209939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:50.210865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:50.211492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:50.212458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:50.213161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:50.213802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:50.283331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:50.293380 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9e324c0b-6662-4ab5-aeb0-eacf7eb32e37 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.524795 Aug 06 21:01:50.296291 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1060/2142] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:49 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:50.589154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:50.590752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:50.601464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:50.609749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:50.610369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:50.611306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:50.611803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:50.612306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:51.038010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:51.049426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:51.055956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:51.066989 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92b57f7a-f45b-4745-9947-07be9ccc592d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.873796 Aug 06 21:01:51.079750 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1083/2143] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:50 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:01:51.090528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:51.091311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:51.106451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:51.107084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:51.107721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:51.108538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:51.110757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:51.111278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:51.127938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:51.139885 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f8ea3b05-e123-4982-aa38-4687c706a239 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.554500 Aug 06 21:01:51.158176 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1061/2144] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:50 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:51.317097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:51.318128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:51.327420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:51.336176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:51.345432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:51.347039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:51.348930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:51.349600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:51.717257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:51.726414 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-520f9256-7247-4a3e-bbe9-c2569bbb6441 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.413929 Aug 06 21:01:51.727047 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1062/2145] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:51 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:51.754991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:51.765944 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb93d66e-51cf-4729-a3ca-843c571e4449 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1307 microversion: 2.1 time: 0.684841 Aug 06 21:01:51.766572 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1084/2146] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:51 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1307 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:51.909241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-863a8bfc-dced-432e-8bfa-5fa4a6bf6e84 req-fae361f8-b52d-44e2-85ca-29b6363e014a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cca29a9-9c71-47c0-b780-ba58daba21d2", "tag": "1a466934-a39f-46b2-be85-3afb1c577f76"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:51.952084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-863a8bfc-dced-432e-8bfa-5fa4a6bf6e84 req-fae361f8-b52d-44e2-85ca-29b6363e014a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:51.953194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-863a8bfc-dced-432e-8bfa-5fa4a6bf6e84 req-fae361f8-b52d-44e2-85ca-29b6363e014a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:51.954308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-863a8bfc-dced-432e-8bfa-5fa4a6bf6e84 req-fae361f8-b52d-44e2-85ca-29b6363e014a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:51.985860 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-863a8bfc-dced-432e-8bfa-5fa4a6bf6e84 req-fae361f8-b52d-44e2-85ca-29b6363e014a service nova] Creating event network-changed:1a466934-a39f-46b2-be85-3afb1c577f76 for instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 on nch1-master-1 Aug 06 21:01:52.007814 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-863a8bfc-dced-432e-8bfa-5fa4a6bf6e84 req-fae361f8-b52d-44e2-85ca-29b6363e014a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096961 Aug 06 21:01:52.011203 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1063/2147] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:52.095965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:52.096748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:52.105805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:52.109073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:52.114942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:52.115937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:52.116606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:52.119058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:52.163532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:52.164419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:52.176443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:52.183333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:52.184082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:52.185382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:52.186772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:52.188198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:52.499614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:52.511484 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1554fd78-8bf3-42c0-beab-30e46585836c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.353777 Aug 06 21:01:52.512364 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1064/2148] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:52 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:52.744312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:52.753583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:52.754273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:52.795714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:52.797485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:52.799680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:52.800706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:52.801344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:52.802964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:52.835763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:52.839813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:52.842158 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22cee6ab-4bd5-4c89-94aa-e05c283db8c4 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.750661 Aug 06 21:01:52.843846 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1085/2149] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:52 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:52.850688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:52.851625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:52.894434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:52.898340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:52.899059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:52.913485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:52.914113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:52.914920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.154575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:53.168591 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f00bf44e-ba50-499a-883a-e689af3be88d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.422502 Aug 06 21:01:53.171396 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1065/2150] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:52 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:53.178269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8eb6b236-9420-4244-9b42-026b6ad20f90 req-bd7a853c-8375-4758-9ab1-abf435c673a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b5d414-5de4-408a-a806-7d3c112f9448", "name": "network-vif-plugged", "status": "completed", "tag": "1fae6113-7214-4070-979c-38530aa829e3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:53.202932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8eb6b236-9420-4244-9b42-026b6ad20f90 req-bd7a853c-8375-4758-9ab1-abf435c673a8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.203843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8eb6b236-9420-4244-9b42-026b6ad20f90 req-bd7a853c-8375-4758-9ab1-abf435c673a8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.204287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8eb6b236-9420-4244-9b42-026b6ad20f90 req-bd7a853c-8375-4758-9ab1-abf435c673a8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.219765 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8eb6b236-9420-4244-9b42-026b6ad20f90 req-bd7a853c-8375-4758-9ab1-abf435c673a8 service nova] Creating event network-vif-plugged:1fae6113-7214-4070-979c-38530aa829e3 for instance 79b5d414-5de4-408a-a806-7d3c112f9448 on nch2-master-1 Aug 06 21:01:53.227527 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8eb6b236-9420-4244-9b42-026b6ad20f90 req-bd7a853c-8375-4758-9ab1-abf435c673a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053221 Aug 06 21:01:53.228508 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1066/2151] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:53.237923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-bf10e91c-9848-478e-991f-32671bbf995b req-e17a2c90-83e1-4c83-9f44-2a80df7a7631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e5a756-e2fc-4d64-9bcf-03773a4fdb09", "tag": "a39d4cd0-e638-48f9-b219-ba74284eacae"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:53.248317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bf10e91c-9848-478e-991f-32671bbf995b req-e17a2c90-83e1-4c83-9f44-2a80df7a7631 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.248811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bf10e91c-9848-478e-991f-32671bbf995b req-e17a2c90-83e1-4c83-9f44-2a80df7a7631 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.249465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bf10e91c-9848-478e-991f-32671bbf995b req-e17a2c90-83e1-4c83-9f44-2a80df7a7631 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.256178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:53.268601 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-bf10e91c-9848-478e-991f-32671bbf995b req-e17a2c90-83e1-4c83-9f44-2a80df7a7631 service nova] Creating event network-changed:a39d4cd0-e638-48f9-b219-ba74284eacae for instance a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 on nch1-master-1 Aug 06 21:01:53.276142 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-bf10e91c-9848-478e-991f-32671bbf995b req-e17a2c90-83e1-4c83-9f44-2a80df7a7631 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045429 Aug 06 21:01:53.277294 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1067/2152] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:53.425892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:53.438169 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b893ca4e-ef70-4b82-a524-e05dd2486e07 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1307 microversion: 2.1 time: 0.592833 Aug 06 21:01:53.442232 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1086/2153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:52 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1307 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:53.515463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2e3b9494-0b7c-474e-8d30-41357f8f5304"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:53.518378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:53.536666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.537536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.538300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.540996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.541730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.542384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.546923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:53.547550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:53.563692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.569738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.573514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.574460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.575160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.576125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.712608 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] HTTP exception thrown: Volume 2e3b9494-0b7c-474e-8d30-41357f8f5304 could not be found. Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Request method failure captured: Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments/6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada HTTP/1.1 Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 74 Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tZ3E-58OSZVFxcp5fKhU7M3XVF_aZe4RtInSeEmGLmC9r8OoBRgFwZp2bhj0MeKPTdAr6S82RBMHMk8cdzb_g6NpvaYu0UVRh5vmDJVAKe9oZIIGlg8Iy_pCVo3_gnqmH4QkCDk4iOueJTd_MQqQlvWbKWJt7ESyw7rPzDsbG1ewqY Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: a144007359694aa0b700198d0c384e3d Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesAdminNegativeTest-1414654127 Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 21:01:53.770513 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a144007359694aa0b700198d0c384e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a144007359694aa0b700198d0c384e3d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a144007359694aa0b700198d0c384e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a144007359694aa0b700198d0c384e3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesAdminNegativeTest-1414654127 Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: a144007359694aa0b700198d0c384e3d Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1414654127 Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesAdminNegativeTest-1414654127-project-admin Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: b5b60c17df8e4ec3a8236bfedde32eab Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesAdminNegativeTest-1414654127-project-admin Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: {"volumeAttachment": {"volumeId": "2e3b9494-0b7c-474e-8d30-41357f8f5304"}} Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:01:53.772328 ncdv-master-1 devstack@n-api.service[142462]: exception: Volume 2e3b9494-0b7c-474e-8d30-41357f8f5304 could not be found. Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'server_id': 'aa20eef6-07e5-4267-b6b8-cb709a0f5920', 'id': '6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada', 'body': {'volumeAttachment': {'volumeId': '2e3b9494-0b7c-474e-8d30-41357f8f5304'}}} Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:01:53.773374 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e3b9494-0b7c-474e-8d30-41357f8f5304 could not be found. (HTTP 404) (Request-ID: req-79159302-b3ae-4d22-9f13-2885e71f7858) Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 21:01:53.774827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e3b9494-0b7c-474e-8d30-41357f8f5304 could not be found. Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:01:53.777878 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 2e3b9494-0b7c-474e-8d30-41357f8f5304 could not be found. Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e3b9494-0b7c-474e-8d30-41357f8f5304 could not be found. Aug 06 21:01:53.782346 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:53.787532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Returning 400 to user: Volume 2e3b9494-0b7c-474e-8d30-41357f8f5304 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:01:53.788733 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a79a10f1-d7a7-4f80-8157-09d5441fdaff tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments/6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada" status: 400 len: 107 microversion: 2.1 time: 0.468274 Aug 06 21:01:53.789860 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1068/2154] 10.222.0.33 () {60 vars in 1433 bytes} [Sat Aug 6 21:01:53 2022] PUT /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments/6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada => generated 107 bytes in 470 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:01:53.874254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:53.874913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:53.893733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.897155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.897796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.898599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.899087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.899529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.918269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:53.931674 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d446d3b7-a4e0-4142-a4e0-45a4a1795ff6 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.389966 Aug 06 21:01:53.946674 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1087/2155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:53 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:53.952725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:53.953233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:53.966330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.967781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.969992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:53.973343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:53.974188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:53.974999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:54.146512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lazy-loading 'services' on Instance uuid aa20eef6-07e5-4267-b6b8-cb709a0f5920 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:01:54.298654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:54.317992 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments/6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada" status: 202 len: 0 microversion: 2.1 time: 0.369858 Aug 06 21:01:54.319765 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1088/2156] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Aug 6 21:01:53 2022] DELETE /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments/6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:01:54.344360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:54.348775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:54.361493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:54.368916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:54.369441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:54.369886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:54.375070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:54.375880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:54.376792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:54.378944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:54.384514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:54.390430 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5572607b-20ee-491f-b033-9c79dce7054a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.521779 Aug 06 21:01:54.391393 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1069/2157] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:53 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:54.406769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b73bb11d-d562-4e4d-b439-2c52a2c5cd6d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:54.428260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b73bb11d-d562-4e4d-b439-2c52a2c5cd6d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:54.447776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b73bb11d-d562-4e4d-b439-2c52a2c5cd6d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:54.453185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b73bb11d-d562-4e4d-b439-2c52a2c5cd6d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:54.453748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b73bb11d-d562-4e4d-b439-2c52a2c5cd6d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:54.455497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b73bb11d-d562-4e4d-b439-2c52a2c5cd6d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:54.458504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b73bb11d-d562-4e4d-b439-2c52a2c5cd6d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:54.459899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b73bb11d-d562-4e4d-b439-2c52a2c5cd6d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:54.545220 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b73bb11d-d562-4e4d-b439-2c52a2c5cd6d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152410 Aug 06 21:01:54.550103 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1070/2158] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:01:54 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:54.554061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:54.554812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:54.572010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:54.572508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:54.586667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:54.587696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:54.588199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:54.588649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:54.892005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:54.899860 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d3de6c1-95b0-4e4f-b1ec-807e5db9e28d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.578504 Aug 06 21:01:54.915157 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1089/2159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:54 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:54.963633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:54.964459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:54.979819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:54.985237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:54.989141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:54.991338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:54.994012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:54.994616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.076678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:55.089978 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1d69a3f5-88a2-4a82-8ec9-da107d25e1ca tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1307 microversion: 2.1 time: 0.542358 Aug 06 21:01:55.096148 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1071/2160] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:54 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1307 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:55.417505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:55.418156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:55.425613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:55.426388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:55.426859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.427561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:55.428281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:55.428724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.487152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:55.509290 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dafe044a-6c5f-432a-9501-bd6e4aeb5861 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.556282 Aug 06 21:01:55.510973 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1090/2161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:54 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:01:55.558530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-abe489ea-1d8d-4a8b-9758-2f3b86b248a8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:55.561668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-abe489ea-1d8d-4a8b-9758-2f3b86b248a8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:55.569072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abe489ea-1d8d-4a8b-9758-2f3b86b248a8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:55.569568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abe489ea-1d8d-4a8b-9758-2f3b86b248a8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:55.570011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abe489ea-1d8d-4a8b-9758-2f3b86b248a8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.570748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abe489ea-1d8d-4a8b-9758-2f3b86b248a8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:55.571956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abe489ea-1d8d-4a8b-9758-2f3b86b248a8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:55.572612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abe489ea-1d8d-4a8b-9758-2f3b86b248a8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.619726 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-abe489ea-1d8d-4a8b-9758-2f3b86b248a8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065364 Aug 06 21:01:55.627615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:55.631633 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1091/2162] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:01:55 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:01:55.636663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:55.638198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:55.640129 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfa150e9-7689-4286-bb56-a9ce03b1e017 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.226527 Aug 06 21:01:55.640871 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1072/2163] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:55 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:01:55.680609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:55.689271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:55.690234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Searching by: {'deleted': False, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:01:55.697806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:55.698490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:55.699781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.701777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:55.702444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:55.703348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.758412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:01:55.802421 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f43946d4-db2f-4723-9192-ba14bb2c24dc tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.126845 Aug 06 21:01:55.804094 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1092/2164] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:01:55 2022] GET /compute/v2.1/servers => generated 339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:55.820632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:55.827849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:55.829454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Searching by: {'deleted': False, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:01:55.833363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:55.843925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:55.845611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:55.846247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.847462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:55.848127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:55.848891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.886641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:01:55.918732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5c8ab63c-d8b0-41c5-9ac0-a50853ba15bb tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] Calling method '.version_select at 0x7f729d63f0d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:55.926136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:55.932376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:55.932859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:55.933297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:55.982338 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5c8ab63c-d8b0-41c5-9ac0-a50853ba15bb tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.124271 Aug 06 21:01:55.982962 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1093/2165] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 21:01:55 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:01:55.987848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1339607296", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "3187ba96-af9c-4655-aa30-5b4cd76c6eb6"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:56.053112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] validate_networks() for [('3187ba96-af9c-4655-aa30-5b4cd76c6eb6', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:01:56.075339 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b2a1b89a-f065-485b-ba57-8c4ce79a2910 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.259198 Aug 06 21:01:56.076175 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1073/2166] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:01:55 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:56.082488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:56.083171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:56.089409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.089913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.091832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.091832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.092065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.092746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.242169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:56.250048 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3192b5e2-5816-43c0-9a8c-8668f1e4bc0b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.171929 Aug 06 21:01:56.250856 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1074/2167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:56 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:56.258277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ccdc179-c7b4-4d55-9436-8579ccb0e1fa tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] Action: 'create', calling method: .version_select at 0x7f72a34ca550>, body: {"pool": "non_exist_pool"} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:56.301706 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-2ccdc179-c7b4-4d55-9436-8579ccb0e1fa tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] HTTP exception thrown: Floating IP pool not found. Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ccdc179-c7b4-4d55-9436-8579ccb0e1fa tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] Request method failure captured: Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 26 Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tbDttowaGgxuy4Xj1x-VlcksZM9Rm9N0UY3xxPvRXSRTm2g0Qkg8hw6ol8-iAcpE3M5nPTCM_CO-fnbUWDGp3O0HHlUWlNa1Abp1WiY_lCLwEO9EA3Oj2vpJmWBUAT7n19qCB3Q7HtOqEBLBgRxiaqq7JV-MtfmPjnAxy7R50AvLaI Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 064df62cbc9b447d85833fff49cac599 Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-871695834 Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:01:56.308642 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/064df62cbc9b447d85833fff49cac599"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_064df62cbc9b447d85833fff49cac599", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/064df62cbc9b447d85833fff49cac599"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/064df62cbc9b447d85833fff49cac599"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-871695834 Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 064df62cbc9b447d85833fff49cac599 Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-871695834 Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FloatingIPsNegativeTestJSON-871695834-project Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d2ece0a12baa4e0eb534865a7437bd9a Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-871695834-project Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: {"pool": "non_exist_pool"} Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: exception: Floating IP pool not found. Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 06 21:01:56.310775 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:01:56.312100 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.313821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ccdc179-c7b4-4d55-9436-8579ccb0e1fa tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] Returning 404 to user: Floating IP pool not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:01:56.315643 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2ccdc179-c7b4-4d55-9436-8579ccb0e1fa tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.063398 Aug 06 21:01:56.316919 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1075/2168] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:01:56 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:01:56.323597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8da351ee-33e8-498d-8c18-eda127dd2f31 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:56.336435 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8da351ee-33e8-498d-8c18-eda127dd2f31 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018541 Aug 06 21:01:56.337279 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1076/2169] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:01:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:01:56.342879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:56.343986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:56.350325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.350835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.351280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.351981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.352468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.352898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.474722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:01:56.475159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:01:56.475640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:01:56.476057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:01:56.476472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:01:56.486324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.487634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.488265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.489376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.489838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.490264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.510212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Getting quotas for project afc36f344d274f89b5139ba88bef375b. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:01:56.511008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:56.516599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Getting quotas for user 145439e0e0d549f89b17e81cbd46c580 and project afc36f344d274f89b5139ba88bef375b. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:01:56.519686 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ccb08dc1-b817-43ba-8d34-5de3c6ac8a49 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1486 microversion: 2.1 time: 0.181202 Aug 06 21:01:56.531845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:01:56.532579 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1077/2170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:56 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1486 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:56.538717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:01:56.545184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0b6ed55-d3c2-4805-b046-9e1343b5a3fb tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] Calling method '.version_select at 0x7f729d89a5e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:56.581568 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a84728ad-a36d-4392-91b6-420f5fa4b8dc tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597164 Aug 06 21:01:56.582564 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1094/2171] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:01:56.587121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:56.587728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:56.597480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.598164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.599080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.600540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.601456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.602367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.622206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-b0b6ed55-d3c2-4805-b046-9e1343b5a3fb tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e92c3196-7bd6-4c59-877c-69649585e937 could not be found", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:01:56.623138 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b0b6ed55-d3c2-4805-b046-9e1343b5a3fb tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] HTTP exception thrown: Floating IP not found for ID e92c3196-7bd6-4c59-877c-69649585e937 Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0b6ed55-d3c2-4805-b046-9e1343b5a3fb tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] Request method failure captured: Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-floating-ips/e92c3196-7bd6-4c59-877c-69649585e937 HTTP/1.1 Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tbDttowaGgxuy4Xj1x-VlcksZM9Rm9N0UY3xxPvRXSRTm2g0Qkg8hw6ol8-iAcpE3M5nPTCM_CO-fnbUWDGp3O0HHlUWlNa1Abp1WiY_lCLwEO9EA3Oj2vpJmWBUAT7n19qCB3Q7HtOqEBLBgRxiaqq7JV-MtfmPjnAxy7R50AvLaI Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 064df62cbc9b447d85833fff49cac599 Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-871695834 Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:01:56.625381 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/064df62cbc9b447d85833fff49cac599"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_064df62cbc9b447d85833fff49cac599", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/064df62cbc9b447d85833fff49cac599"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/064df62cbc9b447d85833fff49cac599"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-871695834 Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 064df62cbc9b447d85833fff49cac599 Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-871695834 Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FloatingIPsNegativeTestJSON-871695834-project Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d2ece0a12baa4e0eb534865a7437bd9a Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-871695834-project Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: exception: Floating IP not found for ID e92c3196-7bd6-4c59-877c-69649585e937 Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'e92c3196-7bd6-4c59-877c-69649585e937'} Aug 06 21:01:56.627329 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:01:56.628429 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e92c3196-7bd6-4c59-877c-69649585e937 could not be found Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cb7afd8-6247-4c15-a1e2-b5480e442cb8'] Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e92c3196-7bd6-4c59-877c-69649585e937. Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:56.630163 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e92c3196-7bd6-4c59-877c-69649585e937 Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:01:56.631975 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:01:56.633720 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e92c3196-7bd6-4c59-877c-69649585e937 Aug 06 21:01:56.633720 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:01:56.635011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0b6ed55-d3c2-4805-b046-9e1343b5a3fb tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] Returning 404 to user: Floating IP not found for ID e92c3196-7bd6-4c59-877c-69649585e937 {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:01:56.636161 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0b6ed55-d3c2-4805-b046-9e1343b5a3fb tempest-FloatingIPsNegativeTestJSON-871695834 tempest-FloatingIPsNegativeTestJSON-871695834-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/e92c3196-7bd6-4c59-877c-69649585e937" status: 404 len: 111 microversion: 2.1 time: 0.095108 Aug 06 21:01:56.637262 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1078/2172] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:01:56 2022] DELETE /compute/v2.1/os-floating-ips/e92c3196-7bd6-4c59-877c-69649585e937 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:01:56.656620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-baaf5b5c-1a45-4beb-af4e-27a6374fe4e1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-130057674"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:01:56.668700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-baaf5b5c-1a45-4beb-af4e-27a6374fe4e1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:56.678819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baaf5b5c-1a45-4beb-af4e-27a6374fe4e1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.679667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baaf5b5c-1a45-4beb-af4e-27a6374fe4e1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.680589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baaf5b5c-1a45-4beb-af4e-27a6374fe4e1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.681778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baaf5b5c-1a45-4beb-af4e-27a6374fe4e1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.682445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baaf5b5c-1a45-4beb-af4e-27a6374fe4e1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.683105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baaf5b5c-1a45-4beb-af4e-27a6374fe4e1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.851664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:56.863086 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c664e06f-1422-4965-8240-2b62b9673cd4 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.279204 Aug 06 21:01:56.866734 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1095/2173] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:56 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:56.873986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f0cfcc76-94df-47a4-9de0-2480bc22fa50 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:56.874908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f0cfcc76-94df-47a4-9de0-2480bc22fa50 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:56.960190 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-baaf5b5c-1a45-4beb-af4e-27a6374fe4e1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "POST /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448/action" status: 202 len: 0 microversion: 2.1 time: 0.320643 Aug 06 21:01:56.965720 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1079/2174] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:01:56 2022] POST /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 21:01:56.971069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f0cfcc76-94df-47a4-9de0-2480bc22fa50 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:56.973015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:56.973747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:56.979542 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f0cfcc76-94df-47a4-9de0-2480bc22fa50 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1218 microversion: 2.1 time: 0.111500 Aug 06 21:01:56.987680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.988110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.992479 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1096/2175] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:56 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:56.995509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:56.996931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:56.997472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:56.997922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.025684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:57.030286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:57.041639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.042150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.043264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.044882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.045908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.046591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.096146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:01:57.283266 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8058fcd1-383f-4d9f-bc34-1cc4c234a230 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 204 len: 0 microversion: 2.1 time: 0.271048 Aug 06 21:01:57.284565 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1097/2176] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:01:56 2022] DELETE /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:01:57.288056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:57.294235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f0778138-afeb-494b-b5f1-203bbb673a19 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d941c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:57.299872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:57.301553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:57.302953 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a092e46-bbb7-4084-9c8a-f5380694119d tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.335215 Aug 06 21:01:57.311878 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1080/2177] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:56 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:57.326068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:57.327872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:57.337683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.338162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.338815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.348099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.348773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.349383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.359447 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f0778138-afeb-494b-b5f1-203bbb673a19 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a" status: 200 len: 1411 microversion: 2.1 time: 0.073355 Aug 06 21:01:57.363148 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1098/2178] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:57 2022] GET /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:57.368276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:57.369595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:57.377545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.378386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.379372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.380532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.381256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.382279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.549370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:57.559104 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3dac9048-a127-4156-81cc-991c19ecbfa3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.243149 Aug 06 21:01:57.560574 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1081/2179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:57 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:57.567383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b9dac98-1058-4188-8e47-962fb3cc10a8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a34d85e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:57.625188 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6b9dac98-1058-4188-8e47-962fb3cc10a8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a" status: 200 len: 1411 microversion: 2.1 time: 0.062784 Aug 06 21:01:57.633748 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1082/2180] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:57 2022] GET /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:57.640318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9f00b5fe-e2db-4d40-b622-03a45f8fc46c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a34d8160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:57.660418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:57.681443 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a9e048c-7d4a-43f6-81a4-e2be90c8c9ae tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1713 microversion: 2.1 time: 0.316839 Aug 06 21:01:57.681958 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1099/2181] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:57 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1713 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:57.770208 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9f00b5fe-e2db-4d40-b622-03a45f8fc46c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a" status: 204 len: 0 microversion: 2.1 time: 0.134102 Aug 06 21:01:57.770915 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1083/2182] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:57 2022] DELETE /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:01:57.780848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-532feb0d-d18a-46ff-94c6-e7c384ffc4a8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d778e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:57.803999 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-532feb0d-d18a-46ff-94c6-e7c384ffc4a8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Image not found. Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-532feb0d-d18a-46ff-94c6-e7c384ffc4a8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a HTTP/1.1 Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:01:57.806173 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '700b92cf-dc2c-448c-a261-f6a20375310a'} Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:01:57.807852 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 700b92cf-dc2c-448c-a261-f6a20375310a Aug 06 21:01:57.808966 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:01:57.811198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 700b92cf-dc2c-448c-a261-f6a20375310a could not be found. Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:01:57.813284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-532feb0d-d18a-46ff-94c6-e7c384ffc4a8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:01:57.815247 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-532feb0d-d18a-46ff-94c6-e7c384ffc4a8 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a" status: 404 len: 62 microversion: 2.1 time: 0.036184 Aug 06 21:01:57.816804 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1100/2183] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:01:57 2022] GET /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:01:57.820083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:57.821094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:57.828207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.828842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.829382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.830226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.830791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.831286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.885899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:57.886961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:57.894536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.895373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.896016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.896977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:57.897661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:57.898093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:57.992003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:58.000552 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-89715a8a-bb58-44cd-b0f0-af86a7a44034 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1498 microversion: 2.1 time: 0.184212 Aug 06 21:01:58.001738 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1084/2184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:57 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1498 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:58.013760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:58.015776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:58.023270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:58.024497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:58.025157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:58.026639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:58.027379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:58.028101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:58.101185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:58.109440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:58.109627 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3ec460f4-4878-473c-a3f2-cf22eddfda1c tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.228068 Aug 06 21:01:58.110088 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1101/2185] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:57 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:58.117300 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e90760c6-62ec-459d-883f-d164649b9460 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1222 microversion: 2.1 time: 0.108047 Aug 06 21:01:58.118437 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1085/2186] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:58 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:58.340020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:58.340629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:58.348010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:58.348576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:58.349012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:58.349716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:58.350170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:58.350631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:58.581549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:58.582851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:58.601780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:58.601780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:58.602528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:58.603183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:58.604715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:58.604715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:58.679426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:58.697331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:58.697860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:58.699102 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c8e70a33-c060-49bb-b44d-b2b7f3a04b2f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.363286 Aug 06 21:01:58.699869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1102/2187] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:58 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:01:58.705363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:58.706202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:58.720928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:58.721431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:58.722285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:58.723285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:58.723757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:58.724195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:58.886382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:58.897007 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-402bdf98-6616-4a8a-80e8-7d7174e5cdc2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.319661 Aug 06 21:01:58.898014 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1086/2188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:58 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:59.022606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:59.023187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:59.030790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:59.033413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:59.034167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:59.035664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:59.036476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:59.037137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:59.361785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:59.364577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:59.375528 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-986a347b-c952-4b9d-bb2f-c2f12221d2e6 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1498 microversion: 2.1 time: 0.356666 Aug 06 21:01:59.375782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:59.376863 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1087/2189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:59 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:59.383906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:59.383906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:59.400612 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-86422820-b13e-4089-92b3-bf30676f48ea tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1713 microversion: 2.1 time: 0.698604 Aug 06 21:01:59.403932 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1103/2190] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:58 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1713 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:59.409863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:59.414876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:59.415588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:59.416697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:59.417566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:59.418335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:59.419620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:59.420150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:59.436419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:59.438409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:59.439789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:59.440646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:59.443578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:59.443964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:59.597674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:01:59.610109 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b672691b-97c5-4be0-991a-d2e7b7a19e36 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1276 microversion: 2.1 time: 0.204759 Aug 06 21:01:59.613048 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1104/2191] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:59 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1276 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:01:59.724417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:01:59.724908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:01:59.742717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:59.743220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:59.746507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:01:59.749830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:01:59.754175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:01:59.755971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.248565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:00.256803 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-196934dd-a5d0-4ee7-b1de-7aa77299ecea tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.878969 Aug 06 21:02:00.259067 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1088/2192] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:01:59 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:00.270585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:00.272810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:00.293555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.295346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.296044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.297056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.297812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.298773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.406973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:00.420157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:00.422903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:00.425470 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5e3b86c3-9b04-4bcf-b5a3-e5a0cb283468 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.705130 Aug 06 21:02:00.440780 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1105/2193] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:01:59 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:02:00.451890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-08fefff5-908a-49e5-926e-522cba034052 req-a818f938-ea50-43a0-bfcf-86bc455c0d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac44c669-09c1-4b2a-ab7e-2126661e2e87", "name": "network-vif-deleted", "tag": "7a6f9161-2804-4d29-bb69-124d7ceb4a28"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:00.462764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:00.466713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-08fefff5-908a-49e5-926e-522cba034052 req-a818f938-ea50-43a0-bfcf-86bc455c0d7a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.467498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-08fefff5-908a-49e5-926e-522cba034052 req-a818f938-ea50-43a0-bfcf-86bc455c0d7a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.468120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-08fefff5-908a-49e5-926e-522cba034052 req-a818f938-ea50-43a0-bfcf-86bc455c0d7a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.484367 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-08fefff5-908a-49e5-926e-522cba034052 req-a818f938-ea50-43a0-bfcf-86bc455c0d7a service nova] Creating event network-vif-deleted:7a6f9161-2804-4d29-bb69-124d7ceb4a28 for instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 on nch2-master-1 Aug 06 21:02:00.496994 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-08fefff5-908a-49e5-926e-522cba034052 req-a818f938-ea50-43a0-bfcf-86bc455c0d7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053633 Aug 06 21:02:00.497648 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1106/2194] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:00.513410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:00.515292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:00.520456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:00.532363 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8dfb6677-3447-4d95-abe9-e153f0b8fe74 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.271527 Aug 06 21:02:00.533139 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1089/2195] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:00 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:00.549696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.550206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.550994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.555421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.556044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.556625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.559907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:00.560449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:00.574461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.577753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.578260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.581351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.581997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.582615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.643597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.644089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.644719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.645347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lazy-loading 'fault' on Instance uuid ac44c669-09c1-4b2a-ab7e-2126661e2e87 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:02:00.697713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e7c88630854feb8e5f74c105f70825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9acff8060d543c3b8422b25fdc1119b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:00.708595 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9fc0890b-2a0d-459c-bbd0-542f46b5bba9 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 200 len: 1367 microversion: 2.1 time: 0.170890 Aug 06 21:02:00.709947 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1090/2196] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:00 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:00.715234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:00.716643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:00.725706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.726378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.727098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.728445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.729140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.729753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.810371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:00.819612 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cd8a741d-e0aa-4c3b-84b8-fc39933294be tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1276 microversion: 2.1 time: 0.108560 Aug 06 21:02:00.821264 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1091/2197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:00 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:00.826230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-80d9f5ae-7b78-416a-94d1-fbbff2a40237 req-137c54f4-b63e-4244-8e35-b1fa8efde188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-plugged", "status": "completed", "tag": "631ad28d-478e-497c-84f9-cb93dd852c28"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:00.836832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-80d9f5ae-7b78-416a-94d1-fbbff2a40237 req-137c54f4-b63e-4244-8e35-b1fa8efde188 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:00.837577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-80d9f5ae-7b78-416a-94d1-fbbff2a40237 req-137c54f4-b63e-4244-8e35-b1fa8efde188 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:00.838310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-80d9f5ae-7b78-416a-94d1-fbbff2a40237 req-137c54f4-b63e-4244-8e35-b1fa8efde188 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:00.852272 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-80d9f5ae-7b78-416a-94d1-fbbff2a40237 req-137c54f4-b63e-4244-8e35-b1fa8efde188 service nova] Creating event network-vif-plugged:631ad28d-478e-497c-84f9-cb93dd852c28 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:02:00.859726 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-80d9f5ae-7b78-416a-94d1-fbbff2a40237 req-137c54f4-b63e-4244-8e35-b1fa8efde188 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036977 Aug 06 21:02:00.860934 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1092/2198] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:01.255181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:01.266701 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-70b7a3c2-68e7-45ca-8582-ae1d949f31d2 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1504 microversion: 2.1 time: 0.765401 Aug 06 21:02:01.267315 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1107/2199] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:00 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1504 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:01.280546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:01.281932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:01.299129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.302584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.305197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.311166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.311656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.312315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.454453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:01.455143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:01.474518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.476149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.479369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.480532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.485026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.486028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.589508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:01.599817 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fdedbe6e-f900-45e2-9d35-da6954c6d9f7 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.323522 Aug 06 21:02:01.603119 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1093/2200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:01 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:01.609312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:01.610955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:01.616870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:01.618700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.619274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.619954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.621154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.621760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.622349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.801093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:01.809930 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2e715fe6-7e7a-43dd-94b2-4797cc1a8109 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.205400 Aug 06 21:02:01.811316 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1094/2201] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:01 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:01.816722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:01.817578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] [instance: ac44c669-09c1-4b2a-ab7e-2126661e2e87] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:01.828070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.829390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.830076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.831172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.832129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.832774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.851630 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] HTTP exception thrown: Instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 could not be found. Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Request method failure captured: Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 HTTP/1.1 Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tZ9uW96LywoF57_neU13pX63egJkTTqyLvm-vBbrJQyjHsvD8izKndhri9-Npbn6D05AFgpPMuCbvFL5d4XnY4Grk9dZZ9h6fktNi1BecH2NaYjhUILIJ-3joWHEc6wWGha8v6zV__HkbzIENP_2LNlAHHh5kB5jsTWXooib0GS9Qo Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: e9acff8060d543c3b8422b25fdc1119b Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestManualDisk-657152764 Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:01.853905 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e9acff8060d543c3b8422b25fdc1119b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e9acff8060d543c3b8422b25fdc1119b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e9acff8060d543c3b8422b25fdc1119b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e9acff8060d543c3b8422b25fdc1119b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestManualDisk-657152764 Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: e9acff8060d543c3b8422b25fdc1119b Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestManualDisk-657152764 Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestManualDisk-657152764-project Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 62e7c88630854feb8e5f74c105f70825 Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestManualDisk-657152764-project Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 could not be found. Aug 06 21:02:01.855969 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ac44c669-09c1-4b2a-ab7e-2126661e2e87'} Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 could not be found. Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:01.857400 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 could not be found. Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 could not be found. Aug 06 21:02:01.860345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:01.862931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Returning 404 to user: Instance ac44c669-09c1-4b2a-ab7e-2126661e2e87 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:01.862931 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e5f9fd6d-33b6-4bc6-9aac-7e40ab86c332 tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87" status: 404 len: 111 microversion: 2.1 time: 0.044583 Aug 06 21:02:01.862931 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1095/2202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:01 2022] GET /compute/v2.1/servers/ac44c669-09c1-4b2a-ab7e-2126661e2e87 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:01.867865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:01.868901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:01.882016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.883126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.883793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.884594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:01.885268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:01.885769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:01.993968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:02.004544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:02.022252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:02.034896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:02.037328 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-59cc4d0c-ea4a-438c-88c1-cd0a0ef50d7b tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.587576 Aug 06 21:02:02.038881 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1108/2203] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:02:01 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:02:02.047950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:02.059224 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4c9e84f4-8ddf-41e0-8473-558e1ae67656 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1318 microversion: 2.1 time: 0.194984 Aug 06 21:02:02.075519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4c529866-13ea-4a69-b404-dfcc63772c3c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] Calling method '.version_select at 0x7f729dacf550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:02.082443 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1096/2204] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:01 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:02.124122 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4c529866-13ea-4a69-b404-dfcc63772c3c tempest-ServersTestManualDisk-657152764 tempest-ServersTestManualDisk-657152764-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159788295" status: 202 len: 0 microversion: 2.1 time: 0.061345 Aug 06 21:02:02.126602 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1109/2205] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:02:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159788295 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:02.293466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:02.296134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:02.336121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:02.336751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:02.337211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:02.337979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:02.338509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:02.344381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:02.634487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:02.636173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:02.649038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:02.649812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:02.650510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:02.653041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:02.655129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:02.655820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.054506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:03.071167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:03.111345 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2ea55cec-52a7-4d97-b07e-a5c6a9ac052a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1486 microversion: 2.1 time: 0.820841 Aug 06 21:02:03.113127 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d89d5832-d358-41f5-b94a-2421c16da959 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.495475 Aug 06 21:02:03.120361 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1097/2206] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:02 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1486 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:03.124281 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1110/2207] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:02 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:03.137551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e7b3ce1a-4e19-422e-bcfd-1d0dfdf15b9d req-25deb218-e8b3-4437-824b-5ee21ebc23c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b3e0b2-4a04-49e9-9473-f8d34445decc", "tag": "7436128e-ec58-46e1-b96e-41110dfca498"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:03.141470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:03.143461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:03.160994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e7b3ce1a-4e19-422e-bcfd-1d0dfdf15b9d req-25deb218-e8b3-4437-824b-5ee21ebc23c7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.161359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.162006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.162586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.163455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.164034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.166576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.167219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e7b3ce1a-4e19-422e-bcfd-1d0dfdf15b9d req-25deb218-e8b3-4437-824b-5ee21ebc23c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.167682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e7b3ce1a-4e19-422e-bcfd-1d0dfdf15b9d req-25deb218-e8b3-4437-824b-5ee21ebc23c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.193963 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e7b3ce1a-4e19-422e-bcfd-1d0dfdf15b9d req-25deb218-e8b3-4437-824b-5ee21ebc23c7 service nova] Creating event network-changed:7436128e-ec58-46e1-b96e-41110dfca498 for instance 92b3e0b2-4a04-49e9-9473-f8d34445decc on nch2-master-1 Aug 06 21:02:03.213004 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e7b3ce1a-4e19-422e-bcfd-1d0dfdf15b9d req-25deb218-e8b3-4437-824b-5ee21ebc23c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088402 Aug 06 21:02:03.213167 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1098/2208] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:03.219517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-bacc8194-198d-4a78-a74c-babbcc8a392d req-0e78700d-81e8-4143-a399-05a9396b6187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-plugged", "status": "completed", "tag": "51739d7c-ad65-40a3-85bf-e2312dde6cb3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:03.236542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bacc8194-198d-4a78-a74c-babbcc8a392d req-0e78700d-81e8-4143-a399-05a9396b6187 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.237027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bacc8194-198d-4a78-a74c-babbcc8a392d req-0e78700d-81e8-4143-a399-05a9396b6187 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.237875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bacc8194-198d-4a78-a74c-babbcc8a392d req-0e78700d-81e8-4143-a399-05a9396b6187 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.256978 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-bacc8194-198d-4a78-a74c-babbcc8a392d req-0e78700d-81e8-4143-a399-05a9396b6187 service nova] Creating event network-vif-plugged:51739d7c-ad65-40a3-85bf-e2312dde6cb3 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:02:03.265793 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-bacc8194-198d-4a78-a74c-babbcc8a392d req-0e78700d-81e8-4143-a399-05a9396b6187 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051171 Aug 06 21:02:03.266762 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1099/2209] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:03.272971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:03.274310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:03.283291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.283827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.284233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.294246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.295667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.296145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.632928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:03.646689 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a931e867-0a31-4329-9fd1-773bc0491c3d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.521077 Aug 06 21:02:03.647334 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1111/2210] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:03 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:03.661834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:03.667876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:03.685246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.687162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.687819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.688563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.689028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.689460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.756420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:03.778597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:03.780437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:03.781839 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d01e8cb0-eacb-49c7-88f3-09b3705d855c tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.513801 Aug 06 21:02:03.794239 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1100/2211] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:02:03 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:02:03.798832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:03.798832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:03.804288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.804799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.805253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.805980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:03.806452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:03.807039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:03.834878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:02:04.003973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2118d0a9-a2fb-4e33-9b67-3eea458b5ccb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 204 len: 0 microversion: 2.1 time: 0.217930 Aug 06 21:02:04.006082 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1101/2212] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:03 2022] DELETE /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:02:04.028250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d98b396c-8936-40f1-b671-bfdaca0af3fb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a34caf70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:04.071427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:04.080195 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-d98b396c-8936-40f1-b671-bfdaca0af3fb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Image not found. Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d98b396c-8936-40f1-b671-bfdaca0af3fb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a HTTP/1.1 Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:04.082861 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '700b92cf-dc2c-448c-a261-f6a20375310a'} Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:04.084946 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 700b92cf-dc2c-448c-a261-f6a20375310a to delete Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:04.086096 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 700b92cf-dc2c-448c-a261-f6a20375310a could not be found. Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:04.087699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d98b396c-8936-40f1-b671-bfdaca0af3fb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:04.089428 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d98b396c-8936-40f1-b671-bfdaca0af3fb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a" status: 404 len: 62 microversion: 2.1 time: 0.065141 Aug 06 21:02:04.090894 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1082763f-e787-4c5f-9c9a-5206caae0b68 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1318 microversion: 2.1 time: 0.434252 Aug 06 21:02:04.091016 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1102/2213] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:04 2022] DELETE /compute/v2.1/images/700b92cf-dc2c-448c-a261-f6a20375310a => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:02:04.098054 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1112/2214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:03 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:04.104297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:04.111283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:04.119135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.119879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.120426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.121374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.123414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.124536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.145714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:04.147745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:04.158897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.161187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.161896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.169648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:02:04.170087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.170898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.171415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.241501 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.compute.api [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Instance is already in deleting state, ignoring this request Aug 06 21:02:04.242654 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c5f60aa7-7b3b-49dd-a266-d7c258e09d5c tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 204 len: 0 microversion: 2.1 time: 0.146395 Aug 06 21:02:04.243738 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1103/2215] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:04 2022] DELETE /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:02:04.253590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:04.254511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:04.265695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.266502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.267234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.268367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.268965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.269504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.446295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:04.463368 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c1d0181-a396-4938-b0d4-945bda36d842 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.322081 Aug 06 21:02:04.464098 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1113/2216] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:04 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:04.521406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:04.524015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:04.533684 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dd279713-a505-455e-8499-e9d128442057 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1492 microversion: 2.1 time: 0.284885 Aug 06 21:02:04.534708 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1104/2217] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:04 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1492 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:04.674783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:04.676008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:04.700048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.701814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.702455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.703953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.704865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.705930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.807985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:04.809098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:04.827474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.829365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.830705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.833262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:04.834899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:04.837742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:04.941164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:04.958778 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bf1df0b1-23eb-4543-baff-a9f26581fc89 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.291444 Aug 06 21:02:04.974987 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1114/2218] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:04 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:05.110845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:05.112167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:05.126485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:05.128571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:05.131212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:05.132323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:05.133659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:05.134303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:05.210197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:05.221948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:05.227127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:05.285062 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-95fcfd34-d51c-4d51-a805-b2cfa44f64ba tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.426734 Aug 06 21:02:05.285062 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1105/2219] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:02:04 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:02:05.344765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-plugged", "status": "completed", "tag": "6a277d3d-757e-4809-a72d-fac786fbec67"}, {"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-plugged", "status": "completed", "tag": "eb03162f-ec54-46ef-b2b4-b0acc1199e55"}, {"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-plugged", "status": "completed", "tag": "33e933e8-51c8-4eb2-8702-773e0049c053"}, {"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-plugged", "status": "completed", "tag": "d5834d81-de6d-4143-950a-49b591985c1f"}, {"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-plugged", "status": "completed", "tag": "858d1607-0948-4184-9b0c-ac1a999047cf"}, {"server_uuid": "79b5d414-5de4-408a-a806-7d3c112f9448", "name": "network-vif-plugged", "status": "completed", "tag": "1fae6113-7214-4070-979c-38530aa829e3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:05.365683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:05.374510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:05.375764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:05.411036 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Creating event network-vif-plugged:6a277d3d-757e-4809-a72d-fac786fbec67 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:02:05.414714 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Creating event network-vif-plugged:eb03162f-ec54-46ef-b2b4-b0acc1199e55 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:02:05.415451 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Creating event network-vif-plugged:33e933e8-51c8-4eb2-8702-773e0049c053 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:02:05.416056 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Creating event network-vif-plugged:d5834d81-de6d-4143-950a-49b591985c1f for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:02:05.417715 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Creating event network-vif-plugged:858d1607-0948-4184-9b0c-ac1a999047cf for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:02:05.418309 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] Creating event network-vif-plugged:1fae6113-7214-4070-979c-38530aa829e3 for instance 79b5d414-5de4-408a-a806-7d3c112f9448 on nch2-master-1 Aug 06 21:02:05.428470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:05.432074 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-911d10d9-bbe3-4bf8-a318-82fd4ba7091a req-ba0f6b35-d3c8-4f67-8b3f-e0baaacf2680 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.093384 Aug 06 21:02:05.433738 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1106/2220] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:05.439611 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-24ff1a25-cbbd-4d13-a80e-20accc8a033d tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1318 microversion: 2.1 time: 0.334093 Aug 06 21:02:05.440417 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1115/2221] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:05 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:05.486323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:05.487408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:05.501928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:05.506170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:05.506899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:05.509507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:05.510177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:05.516105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:05.562124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:05.563093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:05.584254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:05.585583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:05.586302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:05.587290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:05.587943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:05.589820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:05.819362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:05.834942 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b884688-9a68-4750-b6ea-0c93bb2afd78 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.353642 Aug 06 21:02:05.838407 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1107/2222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:05 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:05.981268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:05.982908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:05.985222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:05.986597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=26 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:05.994663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:05.995251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:05.995918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:05.996861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:05.997549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:05.998174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:06.249555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:06.261425 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b66bb259-e721-41f4-9d33-f40468dc2090 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.283828 Aug 06 21:02:06.263200 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1108/2223] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:05 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:06.268958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2032c09-f692-47ea-8efd-c110c7f3d7de"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:06.271925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:06.280310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:06.281553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:06.282009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:06.283046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:06.283645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:06.284243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:06.311439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:06.323548 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b02fe534-0128-41bb-8cf5-4cafb3850d30 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1492 microversion: 2.1 time: 0.771566 Aug 06 21:02:06.337797 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1116/2224] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:05 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1492 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:06.343620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:06.344414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:06.351345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:06.352140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:06.352717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:06.353570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:06.354155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:06.354749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:06.501182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=13 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:06.683058 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "POST /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418381 Aug 06 21:02:06.684207 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1109/2225] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:02:06 2022] POST /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:06.697434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:06.699439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:06.711096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:06.716621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:06.717411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:06.725527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:06.726384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:06.727223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:06.806255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:06.819322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:06.821100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:06.822434 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-19de0dce-cd4e-4d1d-94b9-f85917c052cb tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1879 microversion: 2.42 time: 0.483389 Aug 06 21:02:06.823268 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1117/2226] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:02:06 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1879 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:02:06.860383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:06.861184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:06.871065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:06.871907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:06.873104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:06.874194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:06.875095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:06.875896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:06.976605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=38 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:07.059134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:07.069030 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bd6b1420-8299-4107-8bfc-c4ebce599651 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1318 microversion: 2.1 time: 0.382403 Aug 06 21:02:07.086885 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1110/2227] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:06 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:07.284044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:07.284675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:07.293668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:07.294212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:07.294697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:07.295524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:07.295998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:07.296443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:07.451699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:07.462885 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d49b00ab-2357-495e-b524-77271726032e tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.608678 Aug 06 21:02:07.478335 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1118/2228] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:06 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:07.485245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:07.486101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:07.495253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:07.495983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:07.496642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:07.498693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:07.499885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:07.500477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:07.707620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:07.733614 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55014092-b23b-476a-a93d-0d6820d367cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.453571 Aug 06 21:02:07.738271 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1111/2229] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:07 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:07.756045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8b4efaef-945d-4293-98d0-d588c37efa7b req-438de515-66f7-4adf-8f7f-3dd646534168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e5a756-e2fc-4d64-9bcf-03773a4fdb09", "name": "network-vif-plugged", "status": "completed", "tag": "a39d4cd0-e638-48f9-b219-ba74284eacae"}, {"server_uuid": "5cca29a9-9c71-47c0-b780-ba58daba21d2", "name": "network-vif-plugged", "status": "completed", "tag": "1a466934-a39f-46b2-be85-3afb1c577f76"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:07.800316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43d0d15118242b7a60cc34c512fbe5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764e8bbcc05b47e5a647cf2a0fe82a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:07.811064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8b4efaef-945d-4293-98d0-d588c37efa7b req-438de515-66f7-4adf-8f7f-3dd646534168 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:07.811563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8b4efaef-945d-4293-98d0-d588c37efa7b req-438de515-66f7-4adf-8f7f-3dd646534168 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:07.812239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8b4efaef-945d-4293-98d0-d588c37efa7b req-438de515-66f7-4adf-8f7f-3dd646534168 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:07.814604 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9cbc7888-5147-4a6f-9e36-336d37dd9bd1 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 200 len: 1492 microversion: 2.1 time: 0.334293 Aug 06 21:02:07.817824 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1119/2230] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:07 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 1492 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:07.848196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:07.849002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:07.852878 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8b4efaef-945d-4293-98d0-d588c37efa7b req-438de515-66f7-4adf-8f7f-3dd646534168 service nova] Creating event network-vif-plugged:a39d4cd0-e638-48f9-b219-ba74284eacae for instance a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 on nch1-master-1 Aug 06 21:02:07.853619 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8b4efaef-945d-4293-98d0-d588c37efa7b req-438de515-66f7-4adf-8f7f-3dd646534168 service nova] Creating event network-vif-plugged:1a466934-a39f-46b2-be85-3afb1c577f76 for instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 on nch1-master-1 Aug 06 21:02:07.860061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:07.860514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:07.869603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:07.870383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:07.870914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:07.871351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:07.872741 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8b4efaef-945d-4293-98d0-d588c37efa7b req-438de515-66f7-4adf-8f7f-3dd646534168 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.132823 Aug 06 21:02:07.875027 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1112/2231] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:08.093483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:08.094139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:08.119881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:08.120628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:08.121229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:08.122691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:08.123891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:08.124512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:08.417209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:08.431234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:08.433155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:08.435667 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cbbf427a-03cd-439f-9f47-efd71582f0a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2838 microversion: 2.42 time: 0.591290 Aug 06 21:02:08.436706 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1120/2232] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:02:07 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2838 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:02:08.441929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-49c12f63-3fd5-4f12-b4f5-9f3ba61300f4 req-0f5754a1-400d-4fb8-9852-22b5725fe030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b5d414-5de4-408a-a806-7d3c112f9448", "name": "network-vif-deleted", "tag": "1fae6113-7214-4070-979c-38530aa829e3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:08.454327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49c12f63-3fd5-4f12-b4f5-9f3ba61300f4 req-0f5754a1-400d-4fb8-9852-22b5725fe030 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:08.455505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49c12f63-3fd5-4f12-b4f5-9f3ba61300f4 req-0f5754a1-400d-4fb8-9852-22b5725fe030 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:08.456109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49c12f63-3fd5-4f12-b4f5-9f3ba61300f4 req-0f5754a1-400d-4fb8-9852-22b5725fe030 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:08.470490 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-49c12f63-3fd5-4f12-b4f5-9f3ba61300f4 req-0f5754a1-400d-4fb8-9852-22b5725fe030 service nova] Creating event network-vif-deleted:1fae6113-7214-4070-979c-38530aa829e3 for instance 79b5d414-5de4-408a-a806-7d3c112f9448 on nch2-master-1 Aug 06 21:02:08.476921 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-49c12f63-3fd5-4f12-b4f5-9f3ba61300f4 req-0f5754a1-400d-4fb8-9852-22b5725fe030 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038591 Aug 06 21:02:08.480817 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1121/2233] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:08.486719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1b4daa32-9763-44bc-b70c-64d2a7a06e0e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:08.487570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1b4daa32-9763-44bc-b70c-64d2a7a06e0e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:08.494080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b4daa32-9763-44bc-b70c-64d2a7a06e0e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:08.494605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b4daa32-9763-44bc-b70c-64d2a7a06e0e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:08.495071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b4daa32-9763-44bc-b70c-64d2a7a06e0e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:08.495807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b4daa32-9763-44bc-b70c-64d2a7a06e0e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:08.496303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b4daa32-9763-44bc-b70c-64d2a7a06e0e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:08.496729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b4daa32-9763-44bc-b70c-64d2a7a06e0e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:08.626465 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1b4daa32-9763-44bc-b70c-64d2a7a06e0e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.143959 Aug 06 21:02:08.627320 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1122/2234] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Aug 6 21:02:08 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334/os-interface => generated 1832 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:02:08.658085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:08.662491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:08.678115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:08.678390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:08.682399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:08.683238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:08.683732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:08.684180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.034162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:09.042144 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d77ec5a2-2416-4961-8efe-547f59a3ac40 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.410390 Aug 06 21:02:09.042778 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1123/2235] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:08 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:09.065004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.065868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:09.072756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.073330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.073840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.074680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.075747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.076309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.151957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:09.165466 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ecd1d331-f234-4964-856b-82eb05b560b9 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1318 microversion: 2.1 time: 1.077788 Aug 06 21:02:09.182433 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1113/2236] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:08 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1318 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:09.195178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.196110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 79b5d414-5de4-408a-a806-7d3c112f9448] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:09.206977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.208005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.210262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.211705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.212409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.213047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.239080 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Instance 79b5d414-5de4-408a-a806-7d3c112f9448 could not be found. Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 HTTP/1.1 Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:09.241925 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 79b5d414-5de4-408a-a806-7d3c112f9448 could not be found. Aug 06 21:02:09.243268 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '79b5d414-5de4-408a-a806-7d3c112f9448'} Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b5d414-5de4-408a-a806-7d3c112f9448 could not be found. Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.243978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b5d414-5de4-408a-a806-7d3c112f9448 could not be found. Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b5d414-5de4-408a-a806-7d3c112f9448 could not be found. Aug 06 21:02:09.245101 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.248347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Instance 79b5d414-5de4-408a-a806-7d3c112f9448 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.249436 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-76f889af-b1bd-4477-9ebf-f977b843b45a tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448" status: 404 len: 111 microversion: 2.1 time: 0.065351 Aug 06 21:02:09.250285 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1114/2237] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:09 2022] GET /compute/v2.1/servers/79b5d414-5de4-408a-a806-7d3c112f9448 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:09.258707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4e578111-bb49-41de-9129-009a961a4964 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d89a310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.284548 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-4e578111-bb49-41de-9129-009a961a4964 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Image not found. Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4e578111-bb49-41de-9129-009a961a4964 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf HTTP/1.1 Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:09.286315 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'c1b56e76-756d-4f8f-9eb5-1613e03410bf'} Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.287505 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c1b56e76-756d-4f8f-9eb5-1613e03410bf to delete Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.288312 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1b56e76-756d-4f8f-9eb5-1613e03410bf could not be found. Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.289274 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:02:09.290306 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.291762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4e578111-bb49-41de-9129-009a961a4964 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.292690 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4e578111-bb49-41de-9129-009a961a4964 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf" status: 404 len: 62 microversion: 2.1 time: 0.038353 Aug 06 21:02:09.293266 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1115/2238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:09 2022] DELETE /compute/v2.1/images/c1b56e76-756d-4f8f-9eb5-1613e03410bf => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:02:09.302005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.303590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:09.310926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.311889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.312508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.313269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.313756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.314268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.334789 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b HTTP/1.1 Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:09.337534 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.338521 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7dd1e10d-f1cf-4c07-aa50-3ec0620b133b'} Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.339254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.343683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.344752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.344752 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-378d1eb5-436e-4387-85ab-45b65768bd80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 404 len: 111 microversion: 2.1 time: 0.041462 Aug 06 21:02:09.344752 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1116/2239] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:09 2022] DELETE /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:02:09.351283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.352033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:09.361547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.363188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.364221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.365137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.366451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.367206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.387044 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b HTTP/1.1 Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:09.389520 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.390979 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7dd1e10d-f1cf-4c07-aa50-3ec0620b133b'} Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.391587 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. Aug 06 21:02:09.392611 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.394385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Instance 7dd1e10d-f1cf-4c07-aa50-3ec0620b133b could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.394385 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9b89b7d9-04e2-44aa-8162-e1e352216917 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b" status: 404 len: 111 microversion: 2.1 time: 0.046588 Aug 06 21:02:09.394385 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1117/2240] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:09 2022] GET /compute/v2.1/servers/7dd1e10d-f1cf-4c07-aa50-3ec0620b133b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:09.400084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68a92a57-8760-4924-9443-655fa1d2fc14 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f72a367e5e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.426228 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-68a92a57-8760-4924-9443-655fa1d2fc14 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Image not found. Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68a92a57-8760-4924-9443-655fa1d2fc14 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 HTTP/1.1 Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:09.428104 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '609b4c81-cd58-4448-acaa-1b2ab00d8f77'} Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.429195 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 609b4c81-cd58-4448-acaa-1b2ab00d8f77 to delete Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.429861 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 609b4c81-cd58-4448-acaa-1b2ab00d8f77 could not be found. Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.431432 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68a92a57-8760-4924-9443-655fa1d2fc14 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.432444 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-68a92a57-8760-4924-9443-655fa1d2fc14 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77" status: 404 len: 62 microversion: 2.1 time: 0.034525 Aug 06 21:02:09.434690 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1118/2241] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:09 2022] DELETE /compute/v2.1/images/609b4c81-cd58-4448-acaa-1b2ab00d8f77 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:02:09.441861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.445541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:09.454100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.454635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.455251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.456196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.456837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.457446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.472875 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 HTTP/1.1 Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:09.474896 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.475975 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '75bcfa59-4102-4577-b6de-82c9c5d59911'} Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.476556 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.477566 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.481274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.482462 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f1a8cd66-e762-4645-842e-d673643e2c80 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 404 len: 111 microversion: 2.1 time: 0.046478 Aug 06 21:02:09.483877 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1119/2242] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:09 2022] DELETE /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:09.504885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.505677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 75bcfa59-4102-4577-b6de-82c9c5d59911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:09.527406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.528121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.528950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.530534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.531205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.531940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.563067 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 HTTP/1.1 Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:09.565008 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.566041 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '75bcfa59-4102-4577-b6de-82c9c5d59911'} Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.566675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. Aug 06 21:02:09.567609 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.569822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Instance 75bcfa59-4102-4577-b6de-82c9c5d59911 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.570972 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4151c678-168d-4835-9735-27b698dc1f0f tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911" status: 404 len: 111 microversion: 2.1 time: 0.081624 Aug 06 21:02:09.572255 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1120/2243] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:09 2022] GET /compute/v2.1/servers/75bcfa59-4102-4577-b6de-82c9c5d59911 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:09.587241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ed2d7fef-231a-4dd1-a466-2ffe85f599bb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '.version_select at 0x7f729d89a1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.623514 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-ed2d7fef-231a-4dd1-a466-2ffe85f599bb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Image not found. Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ed2d7fef-231a-4dd1-a466-2ffe85f599bb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 HTTP/1.1 Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:09.625647 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: exception: Image not found. Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '9c0e7aff-4058-4750-9a19-89c210bfd6f1'} Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.627449 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9c0e7aff-4058-4750-9a19-89c210bfd6f1 to delete Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.628197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9c0e7aff-4058-4750-9a19-89c210bfd6f1 could not be found. Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.629250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ed2d7fef-231a-4dd1-a466-2ffe85f599bb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Image not found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ed2d7fef-231a-4dd1-a466-2ffe85f599bb tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1" status: 404 len: 62 microversion: 2.1 time: 0.050714 Aug 06 21:02:09.631016 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1121/2244] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:09 2022] DELETE /compute/v2.1/images/9c0e7aff-4058-4750-9a19-89c210bfd6f1 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:02:09.635885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:09.639032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.639536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:09.646886 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0f25c1e0-de3b-4d31-acdd-29da013d803d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1360 microversion: 2.1 time: 0.591128 Aug 06 21:02:09.647484 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1124/2245] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:09 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1360 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:09.681714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.683642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.684503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.686628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.687127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.688701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.726227 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 HTTP/1.1 Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:09.727975 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.729036 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '27865ac3-9a8a-4568-ba57-3f022b07ba93'} Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.729621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.730575 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.734017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.734017 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6219112c-fdd6-41dc-ae4e-560b92fa2854 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 404 len: 111 microversion: 2.1 time: 0.095322 Aug 06 21:02:09.737877 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1122/2246] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:09 2022] DELETE /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:09.739021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:09.739643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] [instance: 27865ac3-9a8a-4568-ba57-3f022b07ba93] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:09.746432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.751780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.752542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.753587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:09.755233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:09.755895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:09.784885 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] HTTP exception thrown: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Request method failure captured: Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 HTTP/1.1 Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tXX61kF4j3NLHtSFAiElv_lNEfaK9yztYKwPFV4AOka4AC0XjEaLxRzpHcazN3IA81Zu8HN_etSXH4Z4NWIvjyu1_0PSPJs7iEaSKM31mTsYC1-9K6ufFKZWzomDxOKowwQObI5KcuuLLfTHeK4Mv-sHNP_4Yn7KpkV7r_yB1N0pyE Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:02:09.787918 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764e8bbcc05b47e5a647cf2a0fe82a20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764e8bbcc05b47e5a647cf2a0fe82a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 764e8bbcc05b47e5a647cf2a0fe82a20 Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesTestJSON-887859057 Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: d43d0d15118242b7a60cc34c512fbe5e Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesTestJSON-887859057-project Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.789117 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '27865ac3-9a8a-4568-ba57-3f022b07ba93'} Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:09.789754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. Aug 06 21:02:09.790747 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:09.791592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] Returning 404 to user: Instance 27865ac3-9a8a-4568-ba57-3f022b07ba93 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:09.791592 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-785252b2-b5cc-481a-83be-827b1df082b5 tempest-ImagesTestJSON-887859057 tempest-ImagesTestJSON-887859057-project] 10.222.0.33 "GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93" status: 404 len: 111 microversion: 2.1 time: 0.054567 Aug 06 21:02:09.794641 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1125/2247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:09 2022] GET /compute/v2.1/servers/27865ac3-9a8a-4568-ba57-3f022b07ba93 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:09.957801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d380fc4c-21e6-4d1a-a999-03a21f46b424 req-448a43c0-1b69-4f0b-8d10-967a58499c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b3e0b2-4a04-49e9-9473-f8d34445decc", "name": "network-vif-plugged", "status": "completed", "tag": "7436128e-ec58-46e1-b96e-41110dfca498"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:10.003299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d380fc4c-21e6-4d1a-a999-03a21f46b424 req-448a43c0-1b69-4f0b-8d10-967a58499c51 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:10.004253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d380fc4c-21e6-4d1a-a999-03a21f46b424 req-448a43c0-1b69-4f0b-8d10-967a58499c51 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:10.005507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d380fc4c-21e6-4d1a-a999-03a21f46b424 req-448a43c0-1b69-4f0b-8d10-967a58499c51 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:10.033419 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d380fc4c-21e6-4d1a-a999-03a21f46b424 req-448a43c0-1b69-4f0b-8d10-967a58499c51 service nova] Creating event network-vif-plugged:7436128e-ec58-46e1-b96e-41110dfca498 for instance 92b3e0b2-4a04-49e9-9473-f8d34445decc on nch2-master-1 Aug 06 21:02:10.043004 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d380fc4c-21e6-4d1a-a999-03a21f46b424 req-448a43c0-1b69-4f0b-8d10-967a58499c51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129233 Aug 06 21:02:10.045404 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1123/2248] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:10.068492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:10.069126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:10.077335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:10.078080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:10.078719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:10.079656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:10.080341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:10.080972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:10.189921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:10.191627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:10.201176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:10.202014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:10.202827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:10.203804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:10.204485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:10.205125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:10.275734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:10.294938 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4dc39728-414a-42a2-ae44-e81a84985486 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1317 microversion: 2.1 time: 0.224475 Aug 06 21:02:10.295783 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1126/2249] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:10 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:10.541118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-348ac38f-de88-4a7e-b751-ea16cc96e368 req-03ac09f5-05a4-4192-928b-1d97dd2b159d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "tag": "6a277d3d-757e-4809-a72d-fac786fbec67"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:10.554634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-348ac38f-de88-4a7e-b751-ea16cc96e368 req-03ac09f5-05a4-4192-928b-1d97dd2b159d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:10.555588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-348ac38f-de88-4a7e-b751-ea16cc96e368 req-03ac09f5-05a4-4192-928b-1d97dd2b159d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:10.556373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-348ac38f-de88-4a7e-b751-ea16cc96e368 req-03ac09f5-05a4-4192-928b-1d97dd2b159d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:10.572228 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-348ac38f-de88-4a7e-b751-ea16cc96e368 req-03ac09f5-05a4-4192-928b-1d97dd2b159d service nova] Creating event network-changed:6a277d3d-757e-4809-a72d-fac786fbec67 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:02:10.578755 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-348ac38f-de88-4a7e-b751-ea16cc96e368 req-03ac09f5-05a4-4192-928b-1d97dd2b159d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041557 Aug 06 21:02:10.583543 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1127/2250] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:02:10.672484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:10.674507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:10.696149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:10.698063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:10.700126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:10.702293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:10.703343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:10.704498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:10.951938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:10.954345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:10.968752 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca29b5e4-fb8e-44c8-b932-bc8c639edfc4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1543 microversion: 2.1 time: 0.299531 Aug 06 21:02:10.969361 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1128/2251] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:10 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1543 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:10.995893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f437504c-fe7b-4500-b88f-266400cfd0d4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:10.996333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f437504c-fe7b-4500-b88f-266400cfd0d4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:11.020789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f437504c-fe7b-4500-b88f-266400cfd0d4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.021556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f437504c-fe7b-4500-b88f-266400cfd0d4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.022219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f437504c-fe7b-4500-b88f-266400cfd0d4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.023603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f437504c-fe7b-4500-b88f-266400cfd0d4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.024280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f437504c-fe7b-4500-b88f-266400cfd0d4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.024914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f437504c-fe7b-4500-b88f-266400cfd0d4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.183209 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f437504c-fe7b-4500-b88f-266400cfd0d4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192765 Aug 06 21:02:11.186483 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1129/2252] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:02:10 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:11.318151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:11.318811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:11.330609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.333105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.333721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.334681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.336086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.338109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.660625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:11.691009 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-df11d0a2-1375-49c5-b97e-ff26304437a2 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1507 microversion: 2.1 time: 0.378325 Aug 06 21:02:11.708650 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1130/2253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:11 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:11.725076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e4660108-cb2d-4030-83f5-39d99125c9d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:11.730523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e4660108-cb2d-4030-83f5-39d99125c9d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:11.735830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:11.744123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4660108-cb2d-4030-83f5-39d99125c9d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.744621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4660108-cb2d-4030-83f5-39d99125c9d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.745056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4660108-cb2d-4030-83f5-39d99125c9d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.745768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4660108-cb2d-4030-83f5-39d99125c9d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.746225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4660108-cb2d-4030-83f5-39d99125c9d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.749924 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-021b3418-c2b2-4fdc-bc7e-0c8099adcdd4 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1318 microversion: 2.1 time: 1.562269 Aug 06 21:02:11.750221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4660108-cb2d-4030-83f5-39d99125c9d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.750796 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1124/2254] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:10 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1318 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:11.756054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c36a23ed-423a-4450-85df-fba9f038c1ee tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:11.767948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c36a23ed-423a-4450-85df-fba9f038c1ee tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:11.776948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c36a23ed-423a-4450-85df-fba9f038c1ee tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.777838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c36a23ed-423a-4450-85df-fba9f038c1ee tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.778772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c36a23ed-423a-4450-85df-fba9f038c1ee tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.780299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c36a23ed-423a-4450-85df-fba9f038c1ee tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.782101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c36a23ed-423a-4450-85df-fba9f038c1ee tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.783227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c36a23ed-423a-4450-85df-fba9f038c1ee tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.841118 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c36a23ed-423a-4450-85df-fba9f038c1ee tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09/ips" status: 200 len: 110 microversion: 2.1 time: 0.088503 Aug 06 21:02:11.841452 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1125/2255] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:02:11 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09/ips => generated 110 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:11.857148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1b62ba00-0e07-44d6-9a8d-14447c2c7291 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:11.857877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1b62ba00-0e07-44d6-9a8d-14447c2c7291 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:11.866066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b62ba00-0e07-44d6-9a8d-14447c2c7291 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.866932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b62ba00-0e07-44d6-9a8d-14447c2c7291 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.867589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b62ba00-0e07-44d6-9a8d-14447c2c7291 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.868463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b62ba00-0e07-44d6-9a8d-14447c2c7291 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.869106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b62ba00-0e07-44d6-9a8d-14447c2c7291 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.869718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b62ba00-0e07-44d6-9a8d-14447c2c7291 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.874952 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e4660108-cb2d-4030-83f5-39d99125c9d8 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159697 Aug 06 21:02:11.880820 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1131/2256] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:02:11 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:11.892098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:11.892838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:11.909265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.910038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.911057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.912523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.913898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.915043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.920284 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1b62ba00-0e07-44d6-9a8d-14447c2c7291 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09/ips" status: 200 len: 110 microversion: 2.1 time: 0.067919 Aug 06 21:02:11.924295 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1126/2257] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:02:11 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09/ips => generated 110 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:11.942635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0d7f39f0-34a9-4538-b47d-851743e16acd tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:11.943449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0d7f39f0-34a9-4538-b47d-851743e16acd tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:11.961433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7f39f0-34a9-4538-b47d-851743e16acd tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.962180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7f39f0-34a9-4538-b47d-851743e16acd tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.963484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7f39f0-34a9-4538-b47d-851743e16acd tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:11.967450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7f39f0-34a9-4538-b47d-851743e16acd tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:11.968240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7f39f0-34a9-4538-b47d-851743e16acd tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:11.968861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d7f39f0-34a9-4538-b47d-851743e16acd tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:12.030630 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0d7f39f0-34a9-4538-b47d-851743e16acd tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09/ips/tempest-ServerAddressesTestJSON-1805497021-network" status: 200 len: 95 microversion: 2.1 time: 0.097786 Aug 06 21:02:12.031267 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1127/2258] 10.222.0.33 () {58 vars in 1401 bytes} [Sat Aug 6 21:02:11 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09/ips/tempest-ServerAddressesTestJSON-1805497021-network => generated 95 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:02:12.049478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:12.050222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:12.062224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:12.062870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:12.063446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:12.064169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:12.064536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:12.070065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:12.115177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lazy-loading 'services' on Instance uuid 80940d4d-801b-4144-8d48-5e10a0f752a6 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:02:12.164682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:02:12.246107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:12.261250 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments/e2032c09-f692-47ea-8efd-c110c7f3d7de" status: 202 len: 0 microversion: 2.1 time: 0.378511 Aug 06 21:02:12.263723 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1132/2259] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Aug 6 21:02:11 2022] DELETE /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments/e2032c09-f692-47ea-8efd-c110c7f3d7de => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:12.339797 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c1860ff2-2d7c-413a-b7ec-3e724d16db13 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 204 len: 0 microversion: 2.1 time: 0.298499 Aug 06 21:02:12.341452 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1128/2260] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:12 2022] DELETE /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:02:12.352479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:12.353668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:12.366305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:12.368860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:12.371587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:12.372727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:12.373442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:12.376029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:12.771823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:12.774139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:12.783856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:12.784700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:12.785362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:12.786154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:12.791188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:12.791804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:13.166098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:13.181701 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a434ab98-8427-48d9-a44c-d1c1ec40a6ef tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1513 microversion: 2.1 time: 0.835421 Aug 06 21:02:13.182641 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1133/2261] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:12 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1513 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:13.300725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:13.316219 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-39314482-bb65-4a45-b356-495190630ac8 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1508 microversion: 2.1 time: 0.548518 Aug 06 21:02:13.317328 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1129/2262] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:12 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:13.441796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-82b810f9-b741-4653-a2f4-8cb23e783676 req-34e1be89-4042-42ad-8502-cc816c95bcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cca29a9-9c71-47c0-b780-ba58daba21d2", "tag": "1a466934-a39f-46b2-be85-3afb1c577f76"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:13.454150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-82b810f9-b741-4653-a2f4-8cb23e783676 req-34e1be89-4042-42ad-8502-cc816c95bcda service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:13.457145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-82b810f9-b741-4653-a2f4-8cb23e783676 req-34e1be89-4042-42ad-8502-cc816c95bcda service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:13.457857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-82b810f9-b741-4653-a2f4-8cb23e783676 req-34e1be89-4042-42ad-8502-cc816c95bcda service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:13.483361 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-82b810f9-b741-4653-a2f4-8cb23e783676 req-34e1be89-4042-42ad-8502-cc816c95bcda service nova] Creating event network-changed:1a466934-a39f-46b2-be85-3afb1c577f76 for instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 on nch1-master-1 Aug 06 21:02:13.491104 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-82b810f9-b741-4653-a2f4-8cb23e783676 req-34e1be89-4042-42ad-8502-cc816c95bcda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053929 Aug 06 21:02:13.492114 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1134/2263] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:14.207688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:14.208924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:14.229099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:14.231064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:14.234451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:14.237534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:14.238140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:14.238894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:14.705489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb18d9c2-cd2a-4a2b-aac8-8732280f54c7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:14.710867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fb18d9c2-cd2a-4a2b-aac8-8732280f54c7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:14.723523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb18d9c2-cd2a-4a2b-aac8-8732280f54c7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:14.724245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb18d9c2-cd2a-4a2b-aac8-8732280f54c7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:14.724839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb18d9c2-cd2a-4a2b-aac8-8732280f54c7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:14.725714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb18d9c2-cd2a-4a2b-aac8-8732280f54c7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:14.726365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb18d9c2-cd2a-4a2b-aac8-8732280f54c7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:14.727000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb18d9c2-cd2a-4a2b-aac8-8732280f54c7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:14.786345 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb18d9c2-cd2a-4a2b-aac8-8732280f54c7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086100 Aug 06 21:02:14.788022 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1135/2264] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:02:14 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:02:14.901670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ba99c6e-cdde-403a-b89a-967c92bfb09b tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:14.905253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ba99c6e-cdde-403a-b89a-967c92bfb09b tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:14.914449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba99c6e-cdde-403a-b89a-967c92bfb09b tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:14.915176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba99c6e-cdde-403a-b89a-967c92bfb09b tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:14.918181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba99c6e-cdde-403a-b89a-967c92bfb09b tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:14.921371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba99c6e-cdde-403a-b89a-967c92bfb09b tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:14.922521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba99c6e-cdde-403a-b89a-967c92bfb09b tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:14.923503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba99c6e-cdde-403a-b89a-967c92bfb09b tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:15.019053 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ba99c6e-cdde-403a-b89a-967c92bfb09b tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116486 Aug 06 21:02:15.019896 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1136/2265] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:02:14 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:02:15.025000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "cc54a2c0-3b44-406c-9e10-b221f92a2c83"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:15.028204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:15.039397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:15.039886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:15.042096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:15.045749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:15.046393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:15.046997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:15.081924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398134b8b4234816ae43a9230eae3c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a30ae4cede34e428cc6468b7a073497', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:15.099518 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-509120be-da41-45a5-be00-6b1fb5134e45 tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 200 len: 1513 microversion: 2.1 time: 0.899446 Aug 06 21:02:15.156636 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1130/2266] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:14 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 1513 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:15.157314 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] HTTP exception thrown: Volume d21ad95a-6dd2-42ac-b677-77c5b13e06e2 could not be found. Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Request method failure captured: Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc/os-volume_attachments/d21ad95a-6dd2-42ac-b677-77c5b13e06e2 HTTP/1.1 Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 74 Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tZ3E-58OSZVFxcp5fKhU7M3XVF_aZe4RtInSeEmGLmC9r8OoBRgFwZp2bhj0MeKPTdAr6S82RBMHMk8cdzb_g6NpvaYu0UVRh5vmDJVAKe9oZIIGlg8Iy_pCVo3_gnqmH4QkCDk4iOueJTd_MQqQlvWbKWJt7ESyw7rPzDsbG1ewqY Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: a144007359694aa0b700198d0c384e3d Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-VolumesAdminNegativeTest-1414654127 Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 21:02:15.161087 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a144007359694aa0b700198d0c384e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a144007359694aa0b700198d0c384e3d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a144007359694aa0b700198d0c384e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a144007359694aa0b700198d0c384e3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-VolumesAdminNegativeTest-1414654127 Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: a144007359694aa0b700198d0c384e3d Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1414654127 Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-VolumesAdminNegativeTest-1414654127-project-admin Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: b5b60c17df8e4ec3a8236bfedde32eab Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-VolumesAdminNegativeTest-1414654127-project-admin Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: {"volumeAttachment": {"volumeId": "cc54a2c0-3b44-406c-9e10-b221f92a2c83"}} Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:02:15.162156 ncdv-master-1 devstack@n-api.service[142461]: exception: Volume d21ad95a-6dd2-42ac-b677-77c5b13e06e2 could not be found. Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'server_id': '92b3e0b2-4a04-49e9-9473-f8d34445decc', 'id': 'd21ad95a-6dd2-42ac-b677-77c5b13e06e2', 'body': {'volumeAttachment': {'volumeId': 'cc54a2c0-3b44-406c-9e10-b221f92a2c83'}}} Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:02:15.162976 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d21ad95a-6dd2-42ac-b677-77c5b13e06e2 could not be found. (HTTP 404) (Request-ID: req-64996838-5643-4fa5-8266-afcdbe69a2a9) Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 21:02:15.163814 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d21ad95a-6dd2-42ac-b677-77c5b13e06e2 could not be found. Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:15.164733 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d21ad95a-6dd2-42ac-b677-77c5b13e06e2 could not be found. Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d21ad95a-6dd2-42ac-b677-77c5b13e06e2 could not be found. Aug 06 21:02:15.166367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:15.168150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] Returning 404 to user: Volume d21ad95a-6dd2-42ac-b677-77c5b13e06e2 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:15.168150 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9718c11f-3472-4a99-8f29-5b1df9ebc0b6 tempest-VolumesAdminNegativeTest-1414654127 tempest-VolumesAdminNegativeTest-1414654127-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc/os-volume_attachments/d21ad95a-6dd2-42ac-b677-77c5b13e06e2" status: 404 len: 109 microversion: 2.1 time: 0.141679 Aug 06 21:02:15.168150 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1137/2267] 10.222.0.33 () {60 vars in 1433 bytes} [Sat Aug 6 21:02:15 2022] PUT /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc/os-volume_attachments/d21ad95a-6dd2-42ac-b677-77c5b13e06e2 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:15.172631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:15.173732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:15.186202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:15.186878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:15.187422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:15.188247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:15.188884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:15.189559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:15.229543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:02:15.367379 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-45707d3b-30a8-45b4-8848-1f34282e87ec tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 204 len: 0 microversion: 2.1 time: 0.209128 Aug 06 21:02:15.374197 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1131/2268] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:15 2022] DELETE /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:02:15.378873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:15.379618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:15.389254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:15.390328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:15.391022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:15.392240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:15.392987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:15.393606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:15.519067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9a567ae6-8f8b-45e9-b36c-10109ed502a1 req-e377dd78-1079-47e3-a029-801e2cb31a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e5a756-e2fc-4d64-9bcf-03773a4fdb09", "name": "network-vif-deleted", "tag": "a39d4cd0-e638-48f9-b219-ba74284eacae"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:15.530803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9a567ae6-8f8b-45e9-b36c-10109ed502a1 req-e377dd78-1079-47e3-a029-801e2cb31a4d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:15.547335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9a567ae6-8f8b-45e9-b36c-10109ed502a1 req-e377dd78-1079-47e3-a029-801e2cb31a4d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:15.550264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9a567ae6-8f8b-45e9-b36c-10109ed502a1 req-e377dd78-1079-47e3-a029-801e2cb31a4d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:15.570868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9a567ae6-8f8b-45e9-b36c-10109ed502a1 req-e377dd78-1079-47e3-a029-801e2cb31a4d service nova] Creating event network-vif-deleted:a39d4cd0-e638-48f9-b219-ba74284eacae for instance a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 on nch1-master-1 Aug 06 21:02:15.576884 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9a567ae6-8f8b-45e9-b36c-10109ed502a1 req-e377dd78-1079-47e3-a029-801e2cb31a4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064142 Aug 06 21:02:15.579169 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1132/2269] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:02:15.647688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:15.658583 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bfeaba6b-42b0-4761-8d30-406f63bb079f tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1682 microversion: 2.1 time: 0.282987 Aug 06 21:02:15.659795 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1138/2270] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:15 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:16.164295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:16.165153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] [instance: a0e5a756-e2fc-4d64-9bcf-03773a4fdb09] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:16.172618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:16.173410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:16.174317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:16.175311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:16.175965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:16.176586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:16.193405 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] HTTP exception thrown: Instance a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 could not be found. Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Request method failure captured: Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 HTTP/1.1 Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7ta4f7K-XDhjTq1SPDmXKOoleBmEKDDQqoaRYbiIJIZcUPEPRtnc_pn7gn2GI1-33oVJlGp_p34MLg5948djY5a53Kz-XxMueAiVDtU__3jGLdMBgosmnRX8YTczw_xqxtM3xHOMtv7b0xydKt59EfBtTbw8aCsx3HzHhzyt-Wc-acE Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 5a30ae4cede34e428cc6468b7a073497 Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerAddressesTestJSON-680889369 Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:16.195411 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a30ae4cede34e428cc6468b7a073497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a30ae4cede34e428cc6468b7a073497", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a30ae4cede34e428cc6468b7a073497"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a30ae4cede34e428cc6468b7a073497"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerAddressesTestJSON-680889369 Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 5a30ae4cede34e428cc6468b7a073497 Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerAddressesTestJSON-680889369 Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerAddressesTestJSON-680889369-project Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 398134b8b4234816ae43a9230eae3c16 Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerAddressesTestJSON-680889369-project Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 could not be found. Aug 06 21:02:16.196754 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'a0e5a756-e2fc-4d64-9bcf-03773a4fdb09'} Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 could not be found. Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:16.197377 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 could not be found. Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 could not be found. Aug 06 21:02:16.198582 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:16.201226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] Returning 404 to user: Instance a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:16.202356 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3dd18031-9e5e-46ae-a227-50189ec2fc0d tempest-ServerAddressesTestJSON-680889369 tempest-ServerAddressesTestJSON-680889369-project] 10.222.0.33 "GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09" status: 404 len: 111 microversion: 2.1 time: 0.042254 Aug 06 21:02:16.202969 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1133/2271] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:16 2022] GET /compute/v2.1/servers/a0e5a756-e2fc-4d64-9bcf-03773a4fdb09 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:16.383869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:16.384725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:16.396049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:16.398768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:16.399312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:16.401239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:16.401904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:16.404952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:16.448583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:02:16.588032 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1c6c8f3e-23ca-44c1-9ca9-459d60edd9f7 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "DELETE /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 204 len: 0 microversion: 2.1 time: 0.208416 Aug 06 21:02:16.588817 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1139/2272] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:16 2022] DELETE /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:02:16.598304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:16.599782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:16.631211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:16.631723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:16.632180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:16.634278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:16.636456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:16.636951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:16.690920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:16.692963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:16.719462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:16.723283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:16.723778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:16.725067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:16.725698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:16.728500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:17.283691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:17.295192 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f6a634b8-a7bd-4261-b447-8b7aab3079cb tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1682 microversion: 2.1 time: 0.613750 Aug 06 21:02:17.295802 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1140/2273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:16 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1682 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:17.707463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:17.717096 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d92cbb7b-4859-4efb-9425-782434bc7fca tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1514 microversion: 2.1 time: 1.123773 Aug 06 21:02:17.717708 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1134/2274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:16 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1514 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:18.321027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:18.322208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:18.334919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:18.336068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:18.336657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:18.337917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:18.338577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:18.339176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:18.738330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:18.746727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:18.753905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:18.754812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:18.756171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:18.757058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:18.759947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:18.760658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:18.762915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:18.769478 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0228ce32-f96d-4a2f-9f89-3eda8d31d137 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1682 microversion: 2.1 time: 0.455704 Aug 06 21:02:18.771615 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1141/2275] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:18 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1682 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:19.699850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:19.709072 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5df48bd2-6c0e-4353-b0d0-45ead1b4321b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1514 microversion: 2.1 time: 0.974686 Aug 06 21:02:19.709670 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1135/2276] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:18 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1514 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:19.792731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:19.793446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:19.807241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:19.808181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:19.808634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:19.813455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:19.815519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:19.815519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:20.111294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:20.125974 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-721ca994-41da-476b-a823-508d56b13ef7 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1614 microversion: 2.1 time: 0.333396 Aug 06 21:02:20.127344 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1142/2277] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:19 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1614 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:20.737129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:20.738524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:20.766043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:20.768126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:20.771082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:20.772351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:20.773051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:20.773702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:21.048626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-9684bc81-1df3-4c95-b94c-b9d8c90cf31c req-68a82fd3-d65b-4a64-a9c0-0f6d30a636ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b3e0b2-4a04-49e9-9473-f8d34445decc", "name": "network-vif-deleted", "tag": "7436128e-ec58-46e1-b96e-41110dfca498"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:21.076676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9684bc81-1df3-4c95-b94c-b9d8c90cf31c req-68a82fd3-d65b-4a64-a9c0-0f6d30a636ab service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:21.077615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9684bc81-1df3-4c95-b94c-b9d8c90cf31c req-68a82fd3-d65b-4a64-a9c0-0f6d30a636ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:21.078261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9684bc81-1df3-4c95-b94c-b9d8c90cf31c req-68a82fd3-d65b-4a64-a9c0-0f6d30a636ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:21.119867 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-9684bc81-1df3-4c95-b94c-b9d8c90cf31c req-68a82fd3-d65b-4a64-a9c0-0f6d30a636ab service nova] Creating event network-vif-deleted:7436128e-ec58-46e1-b96e-41110dfca498 for instance 92b3e0b2-4a04-49e9-9473-f8d34445decc on nch2-master-1 Aug 06 21:02:21.150946 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-9684bc81-1df3-4c95-b94c-b9d8c90cf31c req-68a82fd3-d65b-4a64-a9c0-0f6d30a636ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091192 Aug 06 21:02:21.158191 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1143/2278] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:02:21.190120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:21.199028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:21.199905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:21.207068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:21.207750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:21.208370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:21.209859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:21.210279 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1215b080-51a5-4057-a081-9712e739a254 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 200 len: 1472 microversion: 2.1 time: 0.477502 Aug 06 21:02:21.210690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:21.211371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:21.211603 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1136/2279] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:20 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 1472 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:21.574742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5754e7eed1b48f8805b6dffefb37b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b2c35804a4799a75a327703a5e26e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:21.588858 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6c29442b-0c18-40c4-a9d0-0d4935222ff2 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 200 len: 1614 microversion: 2.1 time: 0.424900 Aug 06 21:02:21.603698 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1144/2280] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:21 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 1614 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:22.239572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:22.242106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: 92b3e0b2-4a04-49e9-9473-f8d34445decc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:22.261773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:22.266817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:22.268143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:22.271596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:22.274110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:22.274661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:22.321140 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] HTTP exception thrown: Instance 92b3e0b2-4a04-49e9-9473-f8d34445decc could not be found. Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Request method failure captured: Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc HTTP/1.1 Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tZi_0cgW6w4ByG3rOEeZzLInv91qFLN-u95tV10Y2qPY5Xa7jAZR7xrhKq9w8IxAb06dN1ReBgiXhirWl5L0HLsaat9n9Ad_bKnIhcCIbw6IsX-dAlWBZGaY4-mbWxLTfIdM20bAgbDD12xqJjGSutNXZasRk0WUvdadN1ck1Ilm9Q Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: afc36f344d274f89b5139ba88bef375b Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesAdminNegativeTest-1941017306 Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:22.327296 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afc36f344d274f89b5139ba88bef375b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afc36f344d274f89b5139ba88bef375b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afc36f344d274f89b5139ba88bef375b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afc36f344d274f89b5139ba88bef375b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesAdminNegativeTest-1941017306 Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: afc36f344d274f89b5139ba88bef375b Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1941017306 Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesAdminNegativeTest-1941017306-project Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 145439e0e0d549f89b17e81cbd46c580 Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesAdminNegativeTest-1941017306-project Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 92b3e0b2-4a04-49e9-9473-f8d34445decc could not be found. Aug 06 21:02:22.328680 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '92b3e0b2-4a04-49e9-9473-f8d34445decc'} Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b3e0b2-4a04-49e9-9473-f8d34445decc could not be found. Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:22.329539 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b3e0b2-4a04-49e9-9473-f8d34445decc could not be found. Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b3e0b2-4a04-49e9-9473-f8d34445decc could not be found. Aug 06 21:02:22.331122 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.333283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Returning 404 to user: Instance 92b3e0b2-4a04-49e9-9473-f8d34445decc could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:22.336241 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3f68dd6f-92e0-4293-a981-800e3b7f449b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc" status: 404 len: 111 microversion: 2.1 time: 0.100405 Aug 06 21:02:22.338539 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1137/2281] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:22 2022] GET /compute/v2.1/servers/92b3e0b2-4a04-49e9-9473-f8d34445decc => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:22.566055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-70a9043b-1d46-473d-a2e3-2cb110f03caa tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f729d9569d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-196112369", "description": "tempest-description-1060004184"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:22.618733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:22.620889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:22.631371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:22.632526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:22.633302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:22.634895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:22.635782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:22.636476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:22.659946 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] HTTP exception thrown: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Request method failure captured: Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 HTTP/1.1 Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tZMinQ4_NJ9QcKyYRO-lNQ2Zc8-cjSKw8QVT0st1VrmiACTgDK1Y5b3ZwgdA6Rjs18uXlx5vJeoIFAfdgZ0zvVN8mzlQvnR5Nn8ARtvCk8uWp5F3YHs1gqsTzkqIcD7wjsW-wAzFcSiH9k5pAn4Hm8a94m5xDCvJMKcBUMxjQoROw0 Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 155b2c35804a4799a75a327703a5e26e Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1978267485 Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:22.662637 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/155b2c35804a4799a75a327703a5e26e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_155b2c35804a4799a75a327703a5e26e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/155b2c35804a4799a75a327703a5e26e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/155b2c35804a4799a75a327703a5e26e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1978267485 Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 155b2c35804a4799a75a327703a5e26e Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1978267485 Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachSCSIVolumeTestJSON-1978267485-project Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d5754e7eed1b48f8805b6dffefb37b59 Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1978267485-project Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:22.664311 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '80940d4d-801b-4144-8d48-5e10a0f752a6'} Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:22.664971 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:22.665978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:22.668750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Returning 404 to user: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:22.671029 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5a04801b-ed28-4d39-8da1-1b424a86f912 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 404 len: 111 microversion: 2.1 time: 0.058247 Aug 06 21:02:22.676588 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1138/2282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:22 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:22.687858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a919145-c9ff-4215-a496-1a53e972ae78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '.version_select at 0x7f72a3634f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:22.710696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:22.730391 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a919145-c9ff-4215-a496-1a53e972ae78 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374206544" status: 202 len: 0 microversion: 2.1 time: 0.052265 Aug 06 21:02:22.735878 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1139/2283] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374206544 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:22.933439 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-70a9043b-1d46-473d-a2e3-2cb110f03caa tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.689842 Aug 06 21:02:22.935649 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1145/2284] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:02:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:22.952591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4a87a03-ed45-4595-9992-3aca5e602f9e tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f729d869f70>, body: {"security_group_rule": {"parent_group_id": "fd3d97ed-1b75-494d-a82d-a200de999253", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:23.230804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d03169f7-a5df-48ff-b662-b1fd30e84b0e req-68d277bf-8e15-402a-a5a9-fcc732a09b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80940d4d-801b-4144-8d48-5e10a0f752a6", "name": "network-vif-deleted", "tag": "20b98415-5b22-44b7-9d18-65751ef5aeaa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:23.273285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d03169f7-a5df-48ff-b662-b1fd30e84b0e req-68d277bf-8e15-402a-a5a9-fcc732a09b7f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:23.283789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d03169f7-a5df-48ff-b662-b1fd30e84b0e req-68d277bf-8e15-402a-a5a9-fcc732a09b7f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:23.285670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d03169f7-a5df-48ff-b662-b1fd30e84b0e req-68d277bf-8e15-402a-a5a9-fcc732a09b7f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:23.303972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:23.337781 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d03169f7-a5df-48ff-b662-b1fd30e84b0e req-68d277bf-8e15-402a-a5a9-fcc732a09b7f service nova] Creating event network-vif-deleted:20b98415-5b22-44b7-9d18-65751ef5aeaa for instance 80940d4d-801b-4144-8d48-5e10a0f752a6 on nch1-master-1 Aug 06 21:02:23.397974 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d03169f7-a5df-48ff-b662-b1fd30e84b0e req-68d277bf-8e15-402a-a5a9-fcc732a09b7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170876 Aug 06 21:02:23.407092 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1146/2285] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:02:23.708561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:23.709188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:23.726460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:23.728576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:23.731660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:23.733399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:23.734658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:23.736587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:23.821035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:02:24.013792 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0526bb9a-2534-4cd8-8ac3-930084343990 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 204 len: 0 microversion: 2.1 time: 0.312520 Aug 06 21:02:24.017316 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1147/2286] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:23 2022] DELETE /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:02:24.030913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:24.031971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:24.054395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:24.057504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:24.058834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:24.060354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:24.061030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:24.061665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:24.092275 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f4a87a03-ed45-4595-9992-3aca5e602f9e tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.146695 Aug 06 21:02:24.100081 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1140/2287] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:02:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:24.105869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8d296aa1-4f5c-46d2-9e14-97e7e3606e49 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f72a34ea670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2033680419", "description": "tempest-description-168041600"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:24.759622 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8d296aa1-4f5c-46d2-9e14-97e7e3606e49 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.657629 Aug 06 21:02:24.760632 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1141/2288] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:02:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:24.780728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfc4f679-18b9-45d3-b063-1f4032e8f7f1 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f72a354e1f0>, body: {"security_group_rule": {"parent_group_id": "ee9464b6-cbd4-4a9e-b235-073899a1ce6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:24.852199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:24.868799 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-320717e4-d129-426a-8e4d-ebeec1ae049b tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1681 microversion: 2.1 time: 0.839632 Aug 06 21:02:24.871614 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1148/2289] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:24 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1681 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:25.978420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-732ca0b4-db01-46bd-85de-cc6311402a47 tempest-ListImagesTestJSON-1740308963 tempest-ListImagesTestJSON-1740308963-project] Calling method '.version_select at 0x7f729da9da60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:26.058861 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-732ca0b4-db01-46bd-85de-cc6311402a47 tempest-ListImagesTestJSON-1740308963 tempest-ListImagesTestJSON-1740308963-project] 10.222.0.33 "GET /compute/v2.1/images/5135514a-af3f-4057-893c-38dd4d85e4cd" status: 200 len: 784 microversion: 2.1 time: 0.402037 Aug 06 21:02:26.060220 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1149/2290] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:02:25 2022] GET /compute/v2.1/images/5135514a-af3f-4057-893c-38dd4d85e4cd => generated 784 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:26.080503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:26.081353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:26.104174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:26.104678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:26.105119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:26.105856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:26.106315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:26.106884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:26.702608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:26.713292 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ab4d526-aa5f-4e27-80c4-5be1eee16296 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1681 microversion: 2.1 time: 0.651836 Aug 06 21:02:26.717881 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1150/2291] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:26 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1681 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:26.733970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6a2d0778-645c-43e7-be29-398e98540b11 tempest-ListImagesTestJSON-1740308963 tempest-ListImagesTestJSON-1740308963-project] Calling method '.version_select at 0x7f729ddab040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:27.045626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6a2d0778-645c-43e7-be29-398e98540b11 tempest-ListImagesTestJSON-1740308963 tempest-ListImagesTestJSON-1740308963-project] 10.222.0.33 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.326251 Aug 06 21:02:27.054163 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1151/2292] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:02:26 2022] GET /compute/v2.1/images => generated 445 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:27.064435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-631160d7-4b8e-4f98-ac12-f09caabf9636 tempest-ListImagesTestJSON-1740308963 tempest-ListImagesTestJSON-1740308963-project] Calling method '.version_select at 0x7f729dace940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:27.133785 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfc4f679-18b9-45d3-b063-1f4032e8f7f1 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 2.364508 Aug 06 21:02:27.134675 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1142/2293] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:02:24 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:27.151080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9ca7dac7-f54b-4fa0-b077-29402eda1b5b tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f72a34eaee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1863835779", "description": "tempest-description-240185121"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:27.151238 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-631160d7-4b8e-4f98-ac12-f09caabf9636 tempest-ListImagesTestJSON-1740308963 tempest-ListImagesTestJSON-1740308963-project] 10.222.0.33 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.095628 Aug 06 21:02:27.161655 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1152/2294] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 21:02:27 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:27.746149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:27.746943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:27.757883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:27.770018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:27.770613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:27.772239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:27.775642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:27.777482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:27.780612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:28.114666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:28.125711 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f74ab839-a251-466c-8ffb-89aa79a41938 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1681 microversion: 2.1 time: 0.386622 Aug 06 21:02:28.130116 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1153/2295] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:27 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1681 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:28.149376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:28.150138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:28.162713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:28.167127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:28.167591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:28.170812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:28.171313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:28.171766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:28.205106 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] HTTP exception thrown: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Request method failure captured: Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 HTTP/1.1 Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tZMinQ4_NJ9QcKyYRO-lNQ2Zc8-cjSKw8QVT0st1VrmiACTgDK1Y5b3ZwgdA6Rjs18uXlx5vJeoIFAfdgZ0zvVN8mzlQvnR5Nn8ARtvCk8uWp5F3YHs1gqsTzkqIcD7wjsW-wAzFcSiH9k5pAn4Hm8a94m5xDCvJMKcBUMxjQoROw0 Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 155b2c35804a4799a75a327703a5e26e Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1978267485 Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:02:28.206849 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/155b2c35804a4799a75a327703a5e26e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_155b2c35804a4799a75a327703a5e26e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/155b2c35804a4799a75a327703a5e26e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/155b2c35804a4799a75a327703a5e26e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1978267485 Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 155b2c35804a4799a75a327703a5e26e Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1978267485 Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachSCSIVolumeTestJSON-1978267485-project Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: d5754e7eed1b48f8805b6dffefb37b59 Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1978267485-project Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.208036 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '80940d4d-801b-4144-8d48-5e10a0f752a6'} Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:28.208637 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.209668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.212301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Returning 404 to user: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:28.213453 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ef2ef5f4-0671-4326-acc8-02d80bc32a79 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 404 len: 111 microversion: 2.1 time: 0.080307 Aug 06 21:02:28.214838 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1154/2296] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:02:28 2022] DELETE /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:28.228051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:28.229166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] [instance: 80940d4d-801b-4144-8d48-5e10a0f752a6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:28.236650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:28.237421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:28.238130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:28.240818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:28.241549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:28.242272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:28.273093 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] HTTP exception thrown: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Request method failure captured: Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 HTTP/1.1 Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tZMinQ4_NJ9QcKyYRO-lNQ2Zc8-cjSKw8QVT0st1VrmiACTgDK1Y5b3ZwgdA6Rjs18uXlx5vJeoIFAfdgZ0zvVN8mzlQvnR5Nn8ARtvCk8uWp5F3YHs1gqsTzkqIcD7wjsW-wAzFcSiH9k5pAn4Hm8a94m5xDCvJMKcBUMxjQoROw0 Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 155b2c35804a4799a75a327703a5e26e Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1978267485 Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:02:28.275752 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/155b2c35804a4799a75a327703a5e26e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_155b2c35804a4799a75a327703a5e26e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/155b2c35804a4799a75a327703a5e26e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/155b2c35804a4799a75a327703a5e26e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1978267485 Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 155b2c35804a4799a75a327703a5e26e Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1978267485 Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachSCSIVolumeTestJSON-1978267485-project Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: d5754e7eed1b48f8805b6dffefb37b59 Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1978267485-project Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.277077 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '80940d4d-801b-4144-8d48-5e10a0f752a6'} Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:28.277717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. Aug 06 21:02:28.279310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:02:28.282021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] Returning 404 to user: Instance 80940d4d-801b-4144-8d48-5e10a0f752a6 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:28.283457 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0647c542-3968-4b43-b99b-98183d46cc52 tempest-AttachSCSIVolumeTestJSON-1978267485 tempest-AttachSCSIVolumeTestJSON-1978267485-project] 10.222.0.33 "GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6" status: 404 len: 111 microversion: 2.1 time: 0.060344 Aug 06 21:02:28.284491 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1155/2297] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:28 2022] GET /compute/v2.1/servers/80940d4d-801b-4144-8d48-5e10a0f752a6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:28.328595 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9ca7dac7-f54b-4fa0-b077-29402eda1b5b tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.185073 Aug 06 21:02:28.329921 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1143/2298] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:02:27 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:28.342607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-33e0f15c-ff92-4be7-9751-ba71a322ebe2 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f729dc15af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-76340571", "description": "tempest-description-854326214"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:29.111453 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-33e0f15c-ff92-4be7-9751-ba71a322ebe2 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.770772 Aug 06 21:02:29.116862 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1156/2299] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:02:28 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:29.123234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-803584c4-ef7c-4886-a288-6977186ed0a7 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f72a34caca0>, body: {"security_group_rule": {"parent_group_id": "f9016865-f24f-43af-8e22-922beecc317c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7b952260-9fc2-4d4b-b99f-fb6d4fdca4dc"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:29.148639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:29.150101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:29.165929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:29.166808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:29.167485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:29.168442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:29.169466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:29.170129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:29.297320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:29.315687 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e46dc615-3f27-4e12-8b16-16181c9bf592 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1613 microversion: 2.1 time: 0.168276 Aug 06 21:02:29.317212 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1157/2300] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:29 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1613 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:30.058818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-77f8e7a0-ec61-4572-a110-cd210c033597 req-7bdc2d12-6ce7-4daa-aaa8-3452f1a29d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa20eef6-07e5-4267-b6b8-cb709a0f5920", "name": "network-vif-deleted", "tag": "a9c12b17-7937-408d-9e53-9a50f2743b91"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:30.136306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-77f8e7a0-ec61-4572-a110-cd210c033597 req-7bdc2d12-6ce7-4daa-aaa8-3452f1a29d8f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:30.136917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-77f8e7a0-ec61-4572-a110-cd210c033597 req-7bdc2d12-6ce7-4daa-aaa8-3452f1a29d8f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:30.143344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-77f8e7a0-ec61-4572-a110-cd210c033597 req-7bdc2d12-6ce7-4daa-aaa8-3452f1a29d8f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:30.195965 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-77f8e7a0-ec61-4572-a110-cd210c033597 req-7bdc2d12-6ce7-4daa-aaa8-3452f1a29d8f service nova] Creating event network-vif-deleted:a9c12b17-7937-408d-9e53-9a50f2743b91 for instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 on nch2-master-1 Aug 06 21:02:30.218246 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-77f8e7a0-ec61-4572-a110-cd210c033597 req-7bdc2d12-6ce7-4daa-aaa8-3452f1a29d8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165313 Aug 06 21:02:30.223951 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1158/2301] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:30.343637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:30.345267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:30.367759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:30.368257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:30.368716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:30.375344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:30.378578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:30.379555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:30.442381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:30.443205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:30.446282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:30.447036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lazy-loading 'fault' on Instance uuid aa20eef6-07e5-4267-b6b8-cb709a0f5920 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:02:30.495671 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-803584c4-ef7c-4886-a288-6977186ed0a7 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 1.376861 Aug 06 21:02:30.496638 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1144/2302] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:02:29 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:30.520021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5bc46e57-09d1-43b8-82e6-c0ea36030f99 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f729d8e4160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-171820793", "description": "tempest-description-1539613092"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:30.693964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145439e0e0d549f89b17e81cbd46c580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc36f344d274f89b5139ba88bef375b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:30.708952 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7c25b35f-8aaa-4b4b-b3f2-3fafa6146d4f tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 200 len: 1331 microversion: 2.1 time: 0.374063 Aug 06 21:02:30.723207 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1159/2303] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:30 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 1331 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:31.076253 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5bc46e57-09d1-43b8-82e6-c0ea36030f99 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.567229 Aug 06 21:02:31.077633 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1145/2304] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:02:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:31.093675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fe673704-2aca-4b70-a9e3-48f5eba62e25 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f729dc06940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1328569687", "description": "tempest-description-581511356"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:31.484965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2b34c83e-e1bf-487d-806c-1e5e72bef774 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Action: 'create', calling method: .version_select at 0x7f72a35b3c10>, body: {"keypair": {"name": "tempest-keypair-1135317626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpkX0C67eb/r3v+BgcZB8rscd++2rk61/zcs+/CGEHZ8vlm41fektU+kqmTd9M7VWxDQxxb32GPEa/JP8S5/SzUvo/oqUol4SWyc1Hh3pqVdKxoW0QQJOalrJosqSbZHA=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:31.524608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-2b34c83e-e1bf-487d-806c-1e5e72bef774 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:02:31.547781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-2b34c83e-e1bf-487d-806c-1e5e72bef774 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for user 66488ec9cca7421cb91ba817f2cb218c and project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:02:31.625213 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2b34c83e-e1bf-487d-806c-1e5e72bef774 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.384275 Aug 06 21:02:31.631340 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1146/2305] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:02:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:02:31.642458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ff44358e-cf78-4747-86fd-219c93554e14 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Calling method '.version_select at 0x7f72a34cadc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:31.649829 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fe673704-2aca-4b70-a9e3-48f5eba62e25 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.561153 Aug 06 21:02:31.657972 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1160/2306] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:02:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:31.662402 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ff44358e-cf78-4747-86fd-219c93554e14 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1135317626" status: 200 len: 498 microversion: 2.1 time: 0.029671 Aug 06 21:02:31.663276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce06a31a-fe59-4ddb-8c43-3773f310ba59 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f729daf0820>, body: {"security_group_rule": {"parent_group_id": "bf2d4ca4-28aa-41dc-aae4-3922aed90c92", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6af1fd4b-3755-4cb3-a8d2-175e6ee5c977"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:31.688775 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1147/2307] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:02:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1135317626 => generated 498 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:31.696502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eab42425-0355-402d-a890-db6a4d8e0922 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Calling method '.version_select at 0x7f729d869ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:31.752015 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eab42425-0355-402d-a890-db6a4d8e0922 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135317626" status: 202 len: 0 microversion: 2.1 time: 0.061769 Aug 06 21:02:31.761895 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1148/2308] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135317626 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:31.775725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:31.776609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] [instance: aa20eef6-07e5-4267-b6b8-cb709a0f5920] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:31.809567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:31.814983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:31.815646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:31.818892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:31.819735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:31.820336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:31.860783 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] HTTP exception thrown: Instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 could not be found. Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Request method failure captured: Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 HTTP/1.1 Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tZi_0cgW6w4ByG3rOEeZzLInv91qFLN-u95tV10Y2qPY5Xa7jAZR7xrhKq9w8IxAb06dN1ReBgiXhirWl5L0HLsaat9n9Ad_bKnIhcCIbw6IsX-dAlWBZGaY4-mbWxLTfIdM20bAgbDD12xqJjGSutNXZasRk0WUvdadN1ck1Ilm9Q Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: afc36f344d274f89b5139ba88bef375b Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesAdminNegativeTest-1941017306 Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:31.864342 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afc36f344d274f89b5139ba88bef375b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afc36f344d274f89b5139ba88bef375b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afc36f344d274f89b5139ba88bef375b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afc36f344d274f89b5139ba88bef375b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesAdminNegativeTest-1941017306 Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: afc36f344d274f89b5139ba88bef375b Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1941017306 Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesAdminNegativeTest-1941017306-project Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 145439e0e0d549f89b17e81cbd46c580 Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesAdminNegativeTest-1941017306-project Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 could not be found. Aug 06 21:02:31.865464 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'aa20eef6-07e5-4267-b6b8-cb709a0f5920'} Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 could not be found. Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:31.866112 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 could not be found. Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 could not be found. Aug 06 21:02:31.867149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:31.869081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Returning 404 to user: Instance aa20eef6-07e5-4267-b6b8-cb709a0f5920 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:31.869081 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-10a585ca-d654-4c36-8ef8-e6d5c3938892 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920" status: 404 len: 111 microversion: 2.1 time: 0.101256 Aug 06 21:02:31.870370 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1149/2309] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:31 2022] GET /compute/v2.1/servers/aa20eef6-07e5-4267-b6b8-cb709a0f5920 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:31.878022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-325f8977-a239-47e2-a5a6-ec4354bd51fe tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Action: 'create', calling method: .version_select at 0x7f729d8d94c0>, body: {"keypair": {"name": "tempest-keypair-1017588465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPs4+vHAzT2qsQUhC+ijz5M43etabFqy6RYj/i9ZqjCzIhuRi+NjkmQfuORMtnoobttFuD6aVJgh3Ktb9FJJfwQ62ZREipD3gpt8+lE39sPomJRfAT7PE/fmyKub/RggKg=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:31.911623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-325f8977-a239-47e2-a5a6-ec4354bd51fe tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:02:31.921474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-325f8977-a239-47e2-a5a6-ec4354bd51fe tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for user 66488ec9cca7421cb91ba817f2cb218c and project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:02:31.969973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-325f8977-a239-47e2-a5a6-ec4354bd51fe tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098228 Aug 06 21:02:31.971283 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1150/2310] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:02:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:31.984167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c571b778-d198-4ad0-9de2-717b1e436939 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] Calling method '.version_select at 0x7f729d869a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:32.032445 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c571b778-d198-4ad0-9de2-717b1e436939 tempest-VolumesAdminNegativeTest-1941017306 tempest-VolumesAdminNegativeTest-1941017306-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073919174" status: 202 len: 0 microversion: 2.1 time: 0.058891 Aug 06 21:02:32.033066 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1151/2311] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073919174 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:32.041222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-876d0f0d-c38a-421f-a8f4-e21fdc9759b5 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Calling method '.version_select at 0x7f729d8d9310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:32.078185 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-876d0f0d-c38a-421f-a8f4-e21fdc9759b5 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017588465" status: 202 len: 0 microversion: 2.1 time: 0.040959 Aug 06 21:02:32.079125 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1152/2312] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017588465 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:32.092331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b916ae7c-58ed-4740-a170-0a86e37cbbb6 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Action: 'create', calling method: .version_select at 0x7f729d982820>, body: {"keypair": {"name": "tempest-keypair-672372402", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:32.135053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b916ae7c-58ed-4740-a170-0a86e37cbbb6 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:02:32.154747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b916ae7c-58ed-4740-a170-0a86e37cbbb6 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for user 66488ec9cca7421cb91ba817f2cb218c and project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:02:32.219551 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b916ae7c-58ed-4740-a170-0a86e37cbbb6 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.133506 Aug 06 21:02:32.229834 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1153/2313] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:02:32 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:32.240397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f18c544-e6ef-4a01-8704-881ffaf81a93 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Calling method '.version_select at 0x7f729d889e50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:32.300005 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f18c544-e6ef-4a01-8704-881ffaf81a93 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-672372402" status: 202 len: 0 microversion: 2.1 time: 0.064333 Aug 06 21:02:32.301369 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1154/2314] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-672372402 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:32.318245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-408ce9fa-f332-46a8-b226-998355eaa10a tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Action: 'create', calling method: .version_select at 0x7f72a34eaca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-812939340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7mCaIs0w+SJg82HdFjpdedhwev5AeYlw4gXIsyNava5zpuNuyVd9vJ2O61x0s6cBJHKlOBp+v8FqXWpAZgaTr53eTjR4LLdWt1AmNKUm7hv+0kfOeznS53un5mgyCCKw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:32.347245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-408ce9fa-f332-46a8-b226-998355eaa10a tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:02:32.359522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-408ce9fa-f332-46a8-b226-998355eaa10a tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for user 66488ec9cca7421cb91ba817f2cb218c and project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:02:32.427707 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-408ce9fa-f332-46a8-b226-998355eaa10a tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.114282 Aug 06 21:02:32.429417 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1155/2315] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:02:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:32.445121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68e603bd-213f-4601-a116-865cc4bf9f2b tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Action: 'create', calling method: .version_select at 0x7f729d8e4f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-732238994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRQiiA1yk0oJJOeEUmPwIabLVZqbdoMMYFotYVP9KLzscQwjv3EX9gcMPPpsFRd4HW/RzNj40qgDVHWFChxlpC5+aR61cz7zI6PRyUiEKb6Sakypc/xKKJ0YuPM8jaqLQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:32.465624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-68e603bd-213f-4601-a116-865cc4bf9f2b tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:02:32.472087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-68e603bd-213f-4601-a116-865cc4bf9f2b tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for user 66488ec9cca7421cb91ba817f2cb218c and project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:02:32.506192 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-68e603bd-213f-4601-a116-865cc4bf9f2b tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.064584 Aug 06 21:02:32.520109 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1156/2316] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:02:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:02:32.536525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aa88ddc5-3662-4b36-ac0e-2de8f4641b8a tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Action: 'create', calling method: .version_select at 0x7f72a3634e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1468049756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQxadbDiPAJpUVq4nXW2QVmHKUu86vqoxSVAXVTtAevLtxx7jpiWHzwL9YLEecg22WVnRabqrBMXFnXVaUZ8gc58CSkI7U8NTu90PQcbWRiu9mTYfjSlgTN7C3QESidVQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:32.589436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-aa88ddc5-3662-4b36-ac0e-2de8f4641b8a tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:02:32.603491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-aa88ddc5-3662-4b36-ac0e-2de8f4641b8a tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Getting quotas for user 66488ec9cca7421cb91ba817f2cb218c and project 58e12fc91a56482d96deeb5001c85322. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:02:32.687440 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aa88ddc5-3662-4b36-ac0e-2de8f4641b8a tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.165504 Aug 06 21:02:32.693169 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1157/2317] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:02:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:32.706730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-37c65063-3346-4fb1-9b60-30a61bddea71 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Calling method '.version_select at 0x7f729d8d9940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:32.722822 ncdv-master-1 devstack@n-api.service[142462]: WARNING oslo_db.sqlalchemy.utils [None req-37c65063-3346-4fb1-9b60-30a61bddea71 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 06 21:02:32.750193 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-37c65063-3346-4fb1-9b60-30a61bddea71 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.045892 Aug 06 21:02:32.758861 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1158/2318] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:02:32 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:32.769044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cd323996-0a3d-47f6-b223-71e91577fc54 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Calling method '.version_select at 0x7f729d982160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:32.813220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:INSERT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:32.836278 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cd323996-0a3d-47f6-b223-71e91577fc54 tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1468049756" status: 202 len: 0 microversion: 2.1 time: 0.069783 Aug 06 21:02:32.842358 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1159/2319] 10.222.0.33 () {58 vars in 1278 bytes} [Sat Aug 6 21:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1468049756 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:02:32.871501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-931d166b-44f4-407a-b4a0-99a85ae500cf tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Calling method '.version_select at 0x7f729d8890d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:32.949072 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-931d166b-44f4-407a-b4a0-99a85ae500cf tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-732238994" status: 202 len: 0 microversion: 2.1 time: 0.104650 Aug 06 21:02:32.954087 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1160/2320] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-732238994 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:32.961712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6494502b-55b3-4b0e-9b5e-029e1b11572d tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] Calling method '.version_select at 0x7f72a34ea4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:33.002368 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6494502b-55b3-4b0e-9b5e-029e1b11572d tempest-KeyPairsV2TestJSON-1841388360 tempest-KeyPairsV2TestJSON-1841388360-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-812939340" status: 202 len: 0 microversion: 2.1 time: 0.046734 Aug 06 21:02:33.010122 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1161/2321] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-812939340 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:02:33.060887 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce06a31a-fe59-4ddb-8c43-3773f310ba59 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.401210 Aug 06 21:02:33.062055 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1161/2322] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:02:31 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:33.073674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55a2c65e-c772-464e-bc33-677c8d765030 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729d8e4c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:34.808046 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55a2c65e-c772-464e-bc33-677c8d765030 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6af1fd4b-3755-4cb3-a8d2-175e6ee5c977" status: 202 len: 0 microversion: 2.1 time: 1.736756 Aug 06 21:02:34.812229 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1162/2323] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:02:33 2022] DELETE /compute/v2.1/os-security-groups/6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 => generated 0 bytes in 1743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:34.821805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-57e65bbb-5c07-4c70-a8cc-c3083fd009e3 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729d6daa60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:35.033516 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-57e65bbb-5c07-4c70-a8cc-c3083fd009e3 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/bf2d4ca4-28aa-41dc-aae4-3922aed90c92" status: 200 len: 247 microversion: 2.1 time: 0.217829 Aug 06 21:02:35.043187 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1162/2324] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:02:34 2022] GET /compute/v2.1/os-security-groups/bf2d4ca4-28aa-41dc-aae4-3922aed90c92 => generated 247 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:35.050245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-08809576-d0b5-44ae-86ab-aa650c378c48 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f72a36349d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-238068862", "description": "tempest-description-1992028659"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:36.363088 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-08809576-d0b5-44ae-86ab-aa650c378c48 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.317198 Aug 06 21:02:36.375444 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1163/2325] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:02:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:36.425930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f8bf251-f408-40fb-bc42-f5f387efd02b tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f729dace5e0>, body: {"security_group_rule": {"parent_group_id": "9d51d722-4bd7-4399-9207-ec3c61d1860e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:37.298083 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f8bf251-f408-40fb-bc42-f5f387efd02b tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.920348 Aug 06 21:02:37.299026 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1163/2326] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:02:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:37.312580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0cbd2459-1aa6-48a5-9228-1149053912da tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Action: 'create', calling method: .version_select at 0x7f729d889310>, body: {"security_group_rule": {"parent_group_id": "9d51d722-4bd7-4399-9207-ec3c61d1860e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:38.924608 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0cbd2459-1aa6-48a5-9228-1149053912da tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.617397 Aug 06 21:02:38.934077 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1164/2327] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:02:37 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:38.940456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-28dd6a14-4067-4f13-9ef1-b15ab7bd8487 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729da9d670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:39.217447 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-28dd6a14-4067-4f13-9ef1-b15ab7bd8487 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/9d51d722-4bd7-4399-9207-ec3c61d1860e" status: 200 len: 664 microversion: 2.1 time: 0.278745 Aug 06 21:02:39.219364 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1164/2328] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:02:38 2022] GET /compute/v2.1/os-security-groups/9d51d722-4bd7-4399-9207-ec3c61d1860e => generated 664 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:02:39.235206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bd91b5de-476a-436b-9daa-a7f0ff770c91 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729d889940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:41.013471 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bd91b5de-476a-436b-9daa-a7f0ff770c91 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/f7b75672-1b95-4ee7-bac3-77a2fc554f96" status: 202 len: 0 microversion: 2.1 time: 1.782743 Aug 06 21:02:41.014957 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1165/2329] 10.222.0.33 () {58 vars in 1287 bytes} [Sat Aug 6 21:02:39 2022] DELETE /compute/v2.1/os-security-group-rules/f7b75672-1b95-4ee7-bac3-77a2fc554f96 => generated 0 bytes in 1785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:02:41.024994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-95432ab1-60cc-465c-9569-70e4a09b5952 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729dadd280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:41.035334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=12 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:41.036742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:42.041779 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-95432ab1-60cc-465c-9569-70e4a09b5952 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9d51d722-4bd7-4399-9207-ec3c61d1860e" status: 202 len: 0 microversion: 2.1 time: 1.020423 Aug 06 21:02:42.043753 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1165/2330] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:02:41 2022] DELETE /compute/v2.1/os-security-groups/9d51d722-4bd7-4399-9207-ec3c61d1860e => generated 0 bytes in 1023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:42.053677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-692df236-0064-4934-b0b9-1033536e5664 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729d982820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:42.065225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:42.544869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-692df236-0064-4934-b0b9-1033536e5664 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 does not exist", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:02:42.546454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.security_group_api [None req-692df236-0064-4934-b0b9-1033536e5664 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Neutron security group 6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 not found {{(pid=142462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 21:02:42.547204 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-692df236-0064-4934-b0b9-1033536e5664 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] HTTP exception thrown: Security group 6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 does not exist Aug 06 21:02:42.547204 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-dc0ef661-c684-47fb-a41c-4a7a0092fb05'] Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-692df236-0064-4934-b0b9-1033536e5664 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Request method failure captured: Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-security-groups/6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 HTTP/1.1 Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tbeNgZAYCqjVxek8tezYgU85I8cQSVV_fXortESSJRrDokznX_uFw9ZxxhfPdZe7hFhO-IlE4HkrBo4w6WvuVqMiPYdQAaBBTeyv0CJTfs3-R9xSW63qV9NQNdqXrOuvVnS5xdZDRaKHCuAiFy43lZ7lhsEGLjEiLhoujSuDHp-4P4 Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: ebf6d5c4c6624b849238429d19be6dc6 Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-48046257 Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:02:42.550269 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ebf6d5c4c6624b849238429d19be6dc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ebf6d5c4c6624b849238429d19be6dc6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebf6d5c4c6624b849238429d19be6dc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ebf6d5c4c6624b849238429d19be6dc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupRulesTestJSON-48046257 Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: ebf6d5c4c6624b849238429d19be6dc6 Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-48046257 Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupRulesTestJSON-48046257-project Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 393ed805f99d4b4c93500bcff599eb56 Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupRulesTestJSON-48046257-project Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: exception: Security group 6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 does not exist Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-dc0ef661-c684-47fb-a41c-4a7a0092fb05'] Aug 06 21:02:42.552281 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '6af1fd4b-3755-4cb3-a8d2-175e6ee5c977'} Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:02:42.553255 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 does not exist Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc0ef661-c684-47fb-a41c-4a7a0092fb05'] Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 21:02:42.555756 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 does not exist Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc0ef661-c684-47fb-a41c-4a7a0092fb05'] Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 does not exist Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc0ef661-c684-47fb-a41c-4a7a0092fb05'] Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:42.557371 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:02:42.560159 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:02:42.560159 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:02:42.560159 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:02:42.560159 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:02:42.560159 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 does not exist Aug 06 21:02:42.560159 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc0ef661-c684-47fb-a41c-4a7a0092fb05'] Aug 06 21:02:42.560159 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:02:42.563784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-692df236-0064-4934-b0b9-1033536e5664 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Returning 404 to user: Security group 6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 does not exist Aug 06 21:02:42.563784 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-dc0ef661-c684-47fb-a41c-4a7a0092fb05'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:02:42.565159 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-692df236-0064-4934-b0b9-1033536e5664 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6af1fd4b-3755-4cb3-a8d2-175e6ee5c977" status: 404 len: 194 microversion: 2.1 time: 0.516382 Aug 06 21:02:42.567327 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1166/2331] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:02:42 2022] DELETE /compute/v2.1/os-security-groups/6af1fd4b-3755-4cb3-a8d2-175e6ee5c977 => generated 194 bytes in 519 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:02:42.576001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2466a1b5-a604-4599-a3eb-347211d2c832 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729db19d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:43.130529 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2466a1b5-a604-4599-a3eb-347211d2c832 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/bf2d4ca4-28aa-41dc-aae4-3922aed90c92" status: 202 len: 0 microversion: 2.1 time: 0.558649 Aug 06 21:02:43.134220 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1166/2332] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:02:42 2022] DELETE /compute/v2.1/os-security-groups/bf2d4ca4-28aa-41dc-aae4-3922aed90c92 => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:43.136580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=24 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:43.137447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:43.147772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-27cf1c47-3606-41b0-acec-a996fe7c3035 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729d889040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:43.770292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1726218092", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:43.870775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] validate_networks() for [('cb422495-4cda-47dc-a05e-7fa8dcfe41b0', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:02:44.768960 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-27cf1c47-3606-41b0-acec-a996fe7c3035 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/7b952260-9fc2-4d4b-b99f-fb6d4fdca4dc" status: 202 len: 0 microversion: 2.1 time: 1.632931 Aug 06 21:02:44.770297 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1167/2333] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:02:43 2022] DELETE /compute/v2.1/os-security-groups/7b952260-9fc2-4d4b-b99f-fb6d4fdca4dc => generated 0 bytes in 1634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:44.778357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-253c46ad-d149-4d15-a5a5-a8fc390bac3c tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729d8d9430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:45.133320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:02:45.149208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:02:45.155297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:02:45.156210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:02:45.156798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:02:45.177115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:45.177609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:45.178050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:45.178923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:45.179392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:45.179841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:45.238356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Getting quotas for project ce57444bd40e42f4bf88177067f756b0. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:02:45.255662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Getting quotas for user 0902f98ad0254cc48ff7e0e5469e8f2d and project ce57444bd40e42f4bf88177067f756b0. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:02:45.293242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:02:45.297588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:02:45.391722 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd0423a4-69f7-467c-8d24-a52a65c4f8d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.905167 Aug 06 21:02:45.399339 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1167/2334] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:02:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:02:45.406526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c487729-4bcd-48a8-969c-4c4e51585dc4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:45.407551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1c487729-4bcd-48a8-969c-4c4e51585dc4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:45.564000 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-253c46ad-d149-4d15-a5a5-a8fc390bac3c tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f9016865-f24f-43af-8e22-922beecc317c" status: 202 len: 0 microversion: 2.1 time: 0.789798 Aug 06 21:02:45.565339 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1168/2335] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:02:44 2022] DELETE /compute/v2.1/os-security-groups/f9016865-f24f-43af-8e22-922beecc317c => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:45.573314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8dad4e0c-5ad8-44a0-82f3-ad5f2f8d6db9 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f72a3641f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:45.626949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1c487729-4bcd-48a8-969c-4c4e51585dc4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:45.639699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1c487729-4bcd-48a8-969c-4c4e51585dc4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1223 microversion: 2.1 time: 0.238290 Aug 06 21:02:45.655172 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1168/2336] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:45 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1223 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:46.665750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:46.667131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:46.685818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:46.686627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:46.687497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:46.688459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:46.689117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:46.690985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:46.912293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:46.926236 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-009e6c84-2ad4-47a3-a3fc-7879c4fe1301 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1219 microversion: 2.1 time: 0.264690 Aug 06 21:02:46.944588 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1169/2337] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:46 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1219 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:47.787852 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8dad4e0c-5ad8-44a0-82f3-ad5f2f8d6db9 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ee9464b6-cbd4-4a9e-b235-073899a1ce6b" status: 202 len: 0 microversion: 2.1 time: 2.218615 Aug 06 21:02:47.802676 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1169/2338] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:02:45 2022] DELETE /compute/v2.1/os-security-groups/ee9464b6-cbd4-4a9e-b235-073899a1ce6b => generated 0 bytes in 2234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:02:47.810895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8818b42a-2dd7-41a6-b2b8-aaf07fc47dd6 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] Calling method '.version_select at 0x7f729d609280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:47.955039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:47.960263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:47.979766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:47.980547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:47.981934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:47.983000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:47.983846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:47.984445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:48.191964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:48.211227 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ba218522-e371-4981-b087-8d6eb7c29620 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1281 microversion: 2.1 time: 0.261100 Aug 06 21:02:48.211834 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1170/2339] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:47 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1281 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:02:48.960091 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8818b42a-2dd7-41a6-b2b8-aaf07fc47dd6 tempest-SecurityGroupRulesTestJSON-48046257 tempest-SecurityGroupRulesTestJSON-48046257-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/fd3d97ed-1b75-494d-a82d-a200de999253" status: 202 len: 0 microversion: 2.1 time: 1.162816 Aug 06 21:02:48.960699 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1170/2340] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:02:47 2022] DELETE /compute/v2.1/os-security-groups/fd3d97ed-1b75-494d-a82d-a200de999253 => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:02:49.239842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:49.240394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:49.254930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:49.256708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:49.260484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:49.261409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:49.261916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:49.262370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:49.874878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:49.882808 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e33f7f73-a54d-416c-ad4f-889317baa403 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1281 microversion: 2.1 time: 0.652894 Aug 06 21:02:49.883400 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1171/2341] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:49 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1281 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:50.133430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd9c6b1b-3749-4c60-a47c-0e791297ddd7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:50.134694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cd9c6b1b-3749-4c60-a47c-0e791297ddd7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:50.151033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd9c6b1b-3749-4c60-a47c-0e791297ddd7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:50.152089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd9c6b1b-3749-4c60-a47c-0e791297ddd7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:50.152734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd9c6b1b-3749-4c60-a47c-0e791297ddd7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:50.159647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd9c6b1b-3749-4c60-a47c-0e791297ddd7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:50.160370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd9c6b1b-3749-4c60-a47c-0e791297ddd7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:50.160961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd9c6b1b-3749-4c60-a47c-0e791297ddd7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:50.912923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:50.914614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:50.958094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:50.958634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:50.959101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:50.959842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:50.960309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:50.963858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:51.419246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:51.440405 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55fc4c74-1476-4360-beb6-e7febff618d8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 0.535764 Aug 06 21:02:51.455826 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1172/2342] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:50 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:52.059443 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd9c6b1b-3749-4c60-a47c-0e791297ddd7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1813 microversion: 2.1 time: 1.931144 Aug 06 21:02:52.062984 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1171/2343] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:50 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1813 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:52.083579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a24e46fc-261d-4ccd-953e-c9562f4da922 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:52.086509 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:02:52.086509 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:02:52.088935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a24e46fc-261d-4ccd-953e-c9562f4da922 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:52.089541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a24e46fc-261d-4ccd-953e-c9562f4da922 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:52.089999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a24e46fc-261d-4ccd-953e-c9562f4da922 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:52.091017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a24e46fc-261d-4ccd-953e-c9562f4da922 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:52.091541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a24e46fc-261d-4ccd-953e-c9562f4da922 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:52.092083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a24e46fc-261d-4ccd-953e-c9562f4da922 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:52.191537 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a24e46fc-261d-4ccd-953e-c9562f4da922 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111713 Aug 06 21:02:52.192344 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1173/2344] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Aug 6 21:02:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:52.471525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:52.472292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:52.499817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:52.501620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:52.503602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:52.506739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:52.508160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:52.508897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:53.245460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:53.260895 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a1a4b1e0-2a94-4c94-b136-d8b134ac35ce tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 0.803211 Aug 06 21:02:53.267354 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1172/2345] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:52 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:54.294739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:54.296199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:54.312188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:54.315070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:54.315761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:54.319724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:54.320513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:54.321209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:55.152391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16790848-8bcf-47f7-95ea-4c0491214af2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa673255-11d9-4633-b5e3-fd8bc6522a18", "device": "/dev/xvdb"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:55.155715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-16790848-8bcf-47f7-95ea-4c0491214af2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:55.192380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16790848-8bcf-47f7-95ea-4c0491214af2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:55.193432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16790848-8bcf-47f7-95ea-4c0491214af2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:55.198825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16790848-8bcf-47f7-95ea-4c0491214af2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:55.199872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16790848-8bcf-47f7-95ea-4c0491214af2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:55.200969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16790848-8bcf-47f7-95ea-4c0491214af2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:55.201654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16790848-8bcf-47f7-95ea-4c0491214af2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:55.259659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:55.371659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:55.386326 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-80005538-6955-4abc-a605-63957aa4a506 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 1.096525 Aug 06 21:02:55.388669 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1174/2346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:54 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:55.516783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b109aa1-089b-47e1-bdc4-f841a166aab4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Action: 'create', calling method: .version_select at 0x7f72a3641f70>, body: {"keypair": {"name": "tempest-keypair-379976537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOifuyFdk2sFmrH3zFxwqRSVPfegEPeimbaiuTi01kG1SDdLD91BalwW+pa1iodIcXt2ZlvF7nnWKhKaCvJVcj35olPYwlDmJ1BkdEuLdOlnVUFVXViuJ7mDQoOAs9j4LQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:55.542590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-9b109aa1-089b-47e1-bdc4-f841a166aab4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Getting quotas for project 24244713faa54507b5973eea5083a635. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:02:55.551320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-9b109aa1-089b-47e1-bdc4-f841a166aab4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Getting quotas for user 5fbf3973b1d3431f9682be0eb6d8948a and project 24244713faa54507b5973eea5083a635. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:02:55.587304 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9b109aa1-089b-47e1-bdc4-f841a166aab4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168499 Aug 06 21:02:55.596086 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1175/2347] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:02:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:55.642438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:02:55.699092 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16790848-8bcf-47f7-95ea-4c0491214af2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "POST /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550039 Aug 06 21:02:55.700835 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1173/2348] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:02:55 2022] POST /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:56.118214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-37162031-0494-48be-83ed-c6864b4819e1 req-83169953-cfed-4a12-b0f7-a01155de51d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e12f01f-d078-4fac-85a3-d0a65a81eb77", "tag": "807fd1e4-c6e0-413e-bbdd-03813d524083"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:56.139131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-37162031-0494-48be-83ed-c6864b4819e1 req-83169953-cfed-4a12-b0f7-a01155de51d9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:56.140297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-37162031-0494-48be-83ed-c6864b4819e1 req-83169953-cfed-4a12-b0f7-a01155de51d9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:56.141018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-37162031-0494-48be-83ed-c6864b4819e1 req-83169953-cfed-4a12-b0f7-a01155de51d9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:56.165428 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-37162031-0494-48be-83ed-c6864b4819e1 req-83169953-cfed-4a12-b0f7-a01155de51d9 service nova] Creating event network-changed:807fd1e4-c6e0-413e-bbdd-03813d524083 for instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 on nch2-master-1 Aug 06 21:02:56.174672 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-37162031-0494-48be-83ed-c6864b4819e1 req-83169953-cfed-4a12-b0f7-a01155de51d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061924 Aug 06 21:02:56.176271 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1176/2349] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:02:56.409792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:56.410448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:56.427952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:56.428459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:56.428953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:56.433827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:56.434601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:56.435137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:56.900756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:56.913780 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3abd22d9-9567-4b9a-8661-794a6bd95fb4 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 0.510175 Aug 06 21:02:56.935020 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1174/2350] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:56 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:57.941340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:57.942075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:57.957616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:57.958063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:57.961100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:57.964138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:57.965809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:57.967637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:58.576359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-443381605", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f2a4ea94-9a38-4a67-b15b-7f85f5790a17"}], "security_groups": [{"name": "tempest-securitygroup--1712896086"}], "key_name": "tempest-keypair-379976537", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:02:58.910804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:02:58.923237 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bae016da-7804-4554-b7be-414140bf48d2 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 0.989150 Aug 06 21:02:58.928175 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1177/2351] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:57 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:02:58.951285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] validate_networks() for [('f2a4ea94-9a38-4a67-b15b-7f85f5790a17', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:02:59.440217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-167b4d19-9d31-443d-a831-63fe24544ed7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:02:59.441783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-167b4d19-9d31-443d-a831-63fe24544ed7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:02:59.452116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-167b4d19-9d31-443d-a831-63fe24544ed7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:59.452666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-167b4d19-9d31-443d-a831-63fe24544ed7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:59.453239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-167b4d19-9d31-443d-a831-63fe24544ed7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:02:59.454200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-167b4d19-9d31-443d-a831-63fe24544ed7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:02:59.454986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-167b4d19-9d31-443d-a831-63fe24544ed7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:02:59.455783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-167b4d19-9d31-443d-a831-63fe24544ed7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:00.227491 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-167b4d19-9d31-443d-a831-63fe24544ed7 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1859 microversion: 2.1 time: 0.793437 Aug 06 21:03:00.229301 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1178/2352] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:02:59 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1859 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:00.240736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:00.250501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:00.268321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:00.272005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:00.275627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:00.277095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:00.279258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:00.282697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:00.667763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Getting quotas for project 24244713faa54507b5973eea5083a635. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:03:00.698186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Getting quotas for user 5fbf3973b1d3431f9682be0eb6d8948a and project 24244713faa54507b5973eea5083a635. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:03:00.756768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:03:00.759587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:03:00.760460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:03:00.766924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:03:00.767477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:03:00.792635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:00.794600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:00.796369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:00.797670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:00.799417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:00.800010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:00.849578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Getting quotas for project 24244713faa54507b5973eea5083a635. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:03:00.865389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Getting quotas for user 5fbf3973b1d3431f9682be0eb6d8948a and project 24244713faa54507b5973eea5083a635. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:03:00.910778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:03:00.926137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:03:01.095524 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e7a0103-04f5-4ecc-853b-450e782ae0a4 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.523368 Aug 06 21:03:01.101053 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1175/2353] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:02:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 2527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:03:01.118893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:01.142881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:01.162471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:01.163916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:01.164530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:01.165591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:01.166504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:01.167243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:01.185599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:01.212375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lazy-loading 'flavor' on Instance uuid 5cca29a9-9c71-47c0-b780-ba58daba21d2 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:03:01.233287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Going to try to live migrate instance to nch2-master-1 {{(pid=142461) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 21:03:01.238763 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d30788a7-a065-46fb-ada3-0b58793307fd tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 1.007987 Aug 06 21:03:01.239891 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1179/2354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:00 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:01.268251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-838d9001-b58d-4cc1-8e6d-adf3b1dfe61d tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:01.269667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-838d9001-b58d-4cc1-8e6d-adf3b1dfe61d tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:01.503584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-838d9001-b58d-4cc1-8e6d-adf3b1dfe61d tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:01.530156 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-838d9001-b58d-4cc1-8e6d-adf3b1dfe61d tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1268 microversion: 2.1 time: 0.286311 Aug 06 21:03:01.532408 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1180/2355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:01 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1268 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:02.273625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:02.276196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:02.285696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:02.301355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:02.304480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:02.306513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:02.308945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:02.311456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:02.316203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:03.091645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:03.109943 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a6fe583c-85d5-4a10-a9e1-1ab2d5bc1b14 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 0.850514 Aug 06 21:03:03.117188 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1181/2356] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:02 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:03:03.126074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:03.134279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:03.160326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:03.163225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:03.163972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:03.166713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:03.168058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:03.169932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:03.366902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:03.382796 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bd7f059f-6977-4f93-a11a-2720aa61e64b tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1320 microversion: 2.1 time: 0.261528 Aug 06 21:03:03.386344 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1182/2357] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:03 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:04.140792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:04.142795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:04.164635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:04.165285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:04.165758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:04.170756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:04.175052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:04.175993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:04.568007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:04.588722 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3ffafbe2-c318-42a7-a121-126c4d210b2a tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 0.453487 Aug 06 21:03:04.607419 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1183/2358] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:04 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:04.665700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:04.666873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:04.696314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:04.696919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:04.697448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:04.698745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:04.700552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:04.701225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:04.890530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:04.925797 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cbcf4984-d19f-4419-8a15-3d8b141a0d32 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1326 microversion: 2.1 time: 0.311356 Aug 06 21:03:04.947624 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1184/2359] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:04 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1326 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:05.618233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:05.620641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:05.652136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:05.653721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:05.657405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:05.660228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:05.666452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:05.670401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:05.712721 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da63966a-06aa-4138-94b2-6156b40d0078 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/action" status: 202 len: 0 microversion: 2.1 time: 4.608836 Aug 06 21:03:05.713471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1176/2360] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:03:01 2022] POST /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/action => generated 0 bytes in 4612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:03:05.723714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:05.724484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:05.744917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:05.748153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:05.749300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:05.753277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:05.753995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:05.761679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:06.279872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:06.304613 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-18d6b9c4-9cb2-459d-98f8-fdc5c3f9d9aa tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 0.584023 Aug 06 21:03:06.305646 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1177/2361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:05 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:06.319615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:06.320613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:06.345470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:06.346695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:06.348047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:06.350286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:06.352874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:06.354842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:06.966132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:06.979668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:06.993109 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3475980e-2d5d-4f25-991f-40716913265b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 1.381803 Aug 06 21:03:06.997540 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-adbaeda1-92ff-4665-90c6-cb5d3378ec98 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1394 microversion: 2.1 time: 0.690573 Aug 06 21:03:07.006881 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1178/2362] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:06 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1394 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:07.007330 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1185/2363] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:05 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:07.334352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:07.335887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:07.351030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:07.353559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:07.356050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:07.360197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:07.360694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:07.367912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:07.673165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:07.689225 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1328e2d2-323a-4c9a-83f3-d53dca4c0372 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 0.359539 Aug 06 21:03:07.690727 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1179/2364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:07 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:08.033827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:08.035039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:08.063444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:08.064409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:08.086529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:08.094280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:08.095029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:08.096485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:08.097759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:08.098489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:08.102418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:08.104678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:08.105848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:08.106978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:08.107657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:08.108355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:09.633595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:09.651955 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d68a13b2-c4d0-4f5f-97bd-0099c878ac58 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1394 microversion: 2.1 time: 1.596050 Aug 06 21:03:09.688977 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1180/2365] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:08 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1394 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:09.697193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:09.698304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:09.708668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:09.709559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:09.710228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:09.711322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:09.712290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:09.712961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:09.817344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:09.835523 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-63a67020-e33f-49ba-b915-a95863f11bb3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 1.807942 Aug 06 21:03:09.838577 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1186/2366] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:08 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:09.852594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-046678df-b53f-4ae5-9ea8-3872f63b70e1 req-0bddc4c6-70ea-4a68-941a-25c172fe6632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e12f01f-d078-4fac-85a3-d0a65a81eb77", "name": "network-vif-plugged", "status": "completed", "tag": "807fd1e4-c6e0-413e-bbdd-03813d524083"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:09.876335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-046678df-b53f-4ae5-9ea8-3872f63b70e1 req-0bddc4c6-70ea-4a68-941a-25c172fe6632 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:09.882071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-046678df-b53f-4ae5-9ea8-3872f63b70e1 req-0bddc4c6-70ea-4a68-941a-25c172fe6632 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:09.882892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-046678df-b53f-4ae5-9ea8-3872f63b70e1 req-0bddc4c6-70ea-4a68-941a-25c172fe6632 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:09.908045 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-046678df-b53f-4ae5-9ea8-3872f63b70e1 req-0bddc4c6-70ea-4a68-941a-25c172fe6632 service nova] Creating event network-vif-plugged:807fd1e4-c6e0-413e-bbdd-03813d524083 for instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 on nch2-master-1 Aug 06 21:03:09.932216 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-046678df-b53f-4ae5-9ea8-3872f63b70e1 req-0bddc4c6-70ea-4a68-941a-25c172fe6632 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092005 Aug 06 21:03:09.933373 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1187/2367] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:10.245727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:10.281766 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78fc6545-f1a2-45c5-872d-8e8985e8ca28 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 0.590033 Aug 06 21:03:10.297212 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1181/2368] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:09 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:10.444468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-b31b4c5d-e3a9-40f2-a0b7-5def1215dbe2 req-a0ade32b-adcc-4624-acfe-7d23de30c18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e43c4cc-b1bd-44f6-8f63-9ca59bee3892", "tag": "c631e495-244d-4a84-ac2c-8aac6c8b7a23"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:10.467706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b31b4c5d-e3a9-40f2-a0b7-5def1215dbe2 req-a0ade32b-adcc-4624-acfe-7d23de30c18a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:10.468461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b31b4c5d-e3a9-40f2-a0b7-5def1215dbe2 req-a0ade32b-adcc-4624-acfe-7d23de30c18a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:10.470208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b31b4c5d-e3a9-40f2-a0b7-5def1215dbe2 req-a0ade32b-adcc-4624-acfe-7d23de30c18a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:10.505955 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-b31b4c5d-e3a9-40f2-a0b7-5def1215dbe2 req-a0ade32b-adcc-4624-acfe-7d23de30c18a service nova] Creating event network-changed:c631e495-244d-4a84-ac2c-8aac6c8b7a23 for instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 on nch1-master-1 Aug 06 21:03:10.521542 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-b31b4c5d-e3a9-40f2-a0b7-5def1215dbe2 req-a0ade32b-adcc-4624-acfe-7d23de30c18a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084365 Aug 06 21:03:10.522335 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1188/2369] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:03:10.716947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:10.719342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:10.745477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:10.751090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:10.751831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:10.752750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:10.753471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:10.754124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:10.842179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:10.860854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:10.862217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:10.876251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:10.877031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:10.879851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:10.880791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:10.882225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:10.886620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:10.890021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:11.259998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:11.264229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:11.277147 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-79c73640-d843-4f13-981b-9aa46be6f75a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1394 microversion: 2.1 time: 0.590652 Aug 06 21:03:11.280086 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1182/2370] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:10 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1394 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:11.307807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:11.310650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:11.326159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:11.331734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:11.332776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:11.333243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:11.334007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:11.334479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:11.337902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:11.513286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:11.758272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:11.768324 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b29eea57-1e4b-4fb2-ad07-790e11bfb5eb tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 0.466445 Aug 06 21:03:11.769637 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1183/2371] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:11 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:03:11.874498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:11.890790 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b141bd5f-1e4b-4da4-bdba-06347b73a3a8 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1323 microversion: 2.1 time: 1.034309 Aug 06 21:03:11.893562 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1189/2372] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:10 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1323 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:12.301465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:12.302493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:12.315221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:12.317905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:12.318674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:12.319745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:12.323215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:12.324181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:12.795804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:12.796439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:12.814317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:12.815144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:12.815780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:12.816701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:12.817332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:12.818708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:12.833218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:12.843642 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7264c851-de32-4855-85b0-4539e5c25179 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1394 microversion: 2.1 time: 0.547595 Aug 06 21:03:12.848542 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1184/2373] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:12 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1394 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:12.854083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=93 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:12.915404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:12.916037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:12.924376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:12.925164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:12.926082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:12.927054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:12.927715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:12.928328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:13.206030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:13.217757 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0fe48165-4276-4fc8-a0d1-f773bdffe60e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1517 microversion: 2.1 time: 0.306431 Aug 06 21:03:13.231729 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1185/2374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:12 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1517 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:03:13.241850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:13.244233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:13.252016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:13.252814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:13.253410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:13.254329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:13.255150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:13.255729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:13.287559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lazy-loading 'flavor' on Instance uuid 1e12f01f-d078-4fac-85a3-d0a65a81eb77 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:03:13.483740 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2f35d83-ec1f-4667-b353-5ec3705b7670 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action" status: 200 len: 32 microversion: 2.1 time: 0.245555 Aug 06 21:03:13.490134 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1186/2375] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:03:13 2022] POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:03:13.500916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:13.501657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:13.511211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:13.512003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:13.513423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:13.514496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:13.515202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:13.517049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:13.820493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:13.838763 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-202cb4e3-d1e7-4208-9963-b4d33ce1ca3e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 1.045849 Aug 06 21:03:13.843645 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1190/2376] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:12 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:13.858293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c4e33aeb-e931-4fd7-b61e-58378498aa2c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Action: 'create', calling method: .version_select at 0x7f729d96c040>, body: {"keypair": {"name": "tempest-keypair-1886386052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOKgd8tKkE19Pk8/S2Sm0Yh5F5CFpfIBR83pfNqnBWiEPki8yrgxsXYspny5ZlWV3TDNGp0PtzY55/Uy7C/eJyH92Mae0XUcn9R7IRRQLWsUgJvbdmGtlOmydk+waBXOQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:13.879090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:13.896914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c4e33aeb-e931-4fd7-b61e-58378498aa2c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Getting quotas for project e1ed29bedd5e4f4788958bad354166f3. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:03:13.917236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c4e33aeb-e931-4fd7-b61e-58378498aa2c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Getting quotas for user 78f7a58ae0b24b6a9aca96713dfe99b4 and project e1ed29bedd5e4f4788958bad354166f3. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:03:13.985740 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c4e33aeb-e931-4fd7-b61e-58378498aa2c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.138597 Aug 06 21:03:13.986852 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1191/2377] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Aug 6 21:03:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 21:03:13.994240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:13.996114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:14.010419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:14.011366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:14.011977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:14.013152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:14.013868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:14.014349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:14.098234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:14.111056 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-91179e68-31b7-40c4-a9b3-a4668bb0f773 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.618345 Aug 06 21:03:14.113831 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1187/2378] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:13 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:14.892854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:14.899309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:14.920582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:14.930048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:14.930831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:14.931446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:14.932352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:14.933029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:14.933610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:14.958325 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a0f27e2e-23b4-4e7e-9b0e-fafd7438870a tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1394 microversion: 2.1 time: 0.969898 Aug 06 21:03:14.960977 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1192/2379] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:13 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1394 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:15.147092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:15.147892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:15.165540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:15.176043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:15.177363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:15.180312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:15.182827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:15.185619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:15.701142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:15.719323 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e4ad71d-2c50-4e94-ae6f-fcbb341b8c56 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 0.858214 Aug 06 21:03:15.735420 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1188/2380] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:14 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:03:15.752685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0fcfee22-1fc9-4cc5-b5f6-ea30ca77daf8 req-444ed44c-25ab-4b89-bb4f-65c656764cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cca29a9-9c71-47c0-b780-ba58daba21d2", "name": "network-vif-unplugged", "status": "completed", "tag": "1a466934-a39f-46b2-be85-3afb1c577f76"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:15.764921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0fcfee22-1fc9-4cc5-b5f6-ea30ca77daf8 req-444ed44c-25ab-4b89-bb4f-65c656764cca service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:15.765790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0fcfee22-1fc9-4cc5-b5f6-ea30ca77daf8 req-444ed44c-25ab-4b89-bb4f-65c656764cca service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:15.766465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0fcfee22-1fc9-4cc5-b5f6-ea30ca77daf8 req-444ed44c-25ab-4b89-bb4f-65c656764cca service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:15.780304 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0fcfee22-1fc9-4cc5-b5f6-ea30ca77daf8 req-444ed44c-25ab-4b89-bb4f-65c656764cca service nova] Creating event network-vif-unplugged:1a466934-a39f-46b2-be85-3afb1c577f76 for instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 on nch1-master-1 Aug 06 21:03:15.792575 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0fcfee22-1fc9-4cc5-b5f6-ea30ca77daf8 req-444ed44c-25ab-4b89-bb4f-65c656764cca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055339 Aug 06 21:03:15.794875 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1189/2381] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:15.855148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:15.865701 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-96675970-d10b-453c-bfa1-379f703c469b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.729402 Aug 06 21:03:15.866407 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1193/2382] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:15 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:03:15.982228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:15.983630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:16.006234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:16.008013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:16.008646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:16.009682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:16.010578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:16.011895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:16.338966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-713410fa-64fb-4b0e-9cc3-63d60ed89780 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Action: 'create', calling method: .version_select at 0x7f729da9d670>, body: {"pool": null} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:16.744460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:16.757143 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-31bda3b1-969d-4ced-a8ed-c7cdbadf63b1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1394 microversion: 2.1 time: 0.780233 Aug 06 21:03:16.759406 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1194/2383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:15 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1394 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:03:16.765167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:16.766068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:16.773889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:16.774754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:16.776950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:16.780632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:16.781467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:16.782142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:17.680037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:17.689544 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1b52f35b-c76f-42c3-9a92-73d768d02154 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 0.928718 Aug 06 21:03:17.690362 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1195/2384] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:16 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:17.708912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:17.709838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:17.716279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:17.717030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:17.717474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:17.718269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:17.718837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:17.719555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:18.020507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:18.087843 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e7271c7d-d2af-417d-991e-6bb40d71d230 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.382523 Aug 06 21:03:18.107757 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1196/2385] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:17 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:18.128982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:18.131411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:18.169625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:18.170219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:18.170656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:18.171840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:18.173759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:18.174357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:18.620138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:18.637191 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d7c346ba-d7dd-4769-afae-2ba3d014f439 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1394 microversion: 2.1 time: 0.526759 Aug 06 21:03:18.638732 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1197/2386] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:18 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1394 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:18.646225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-efddedc5-9e75-46f2-b438-6490f52bfdb0 req-ceb3f01a-9da0-488d-98c8-611022e2db15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cca29a9-9c71-47c0-b780-ba58daba21d2", "tag": "1a466934-a39f-46b2-be85-3afb1c577f76"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:18.679931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-efddedc5-9e75-46f2-b438-6490f52bfdb0 req-ceb3f01a-9da0-488d-98c8-611022e2db15 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:18.680656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-efddedc5-9e75-46f2-b438-6490f52bfdb0 req-ceb3f01a-9da0-488d-98c8-611022e2db15 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:18.681717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-efddedc5-9e75-46f2-b438-6490f52bfdb0 req-ceb3f01a-9da0-488d-98c8-611022e2db15 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:18.719617 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-efddedc5-9e75-46f2-b438-6490f52bfdb0 req-ceb3f01a-9da0-488d-98c8-611022e2db15 service nova] Creating event network-changed:1a466934-a39f-46b2-be85-3afb1c577f76 for instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 on nch1-master-1 Aug 06 21:03:18.735194 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-efddedc5-9e75-46f2-b438-6490f52bfdb0 req-ceb3f01a-9da0-488d-98c8-611022e2db15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094601 Aug 06 21:03:18.736400 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1198/2387] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:18.755043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:18.772103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:18.780798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:18.781518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:18.782358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:18.783385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:18.784027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:18.784697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:19.158989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:19.174821 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b49eda69-7d58-474c-b248-221b052170af tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 0.434640 Aug 06 21:03:19.177108 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1199/2388] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:18 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:19.187101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:19.190436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:19.207176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:19.208055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:19.208552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:19.209391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:19.211155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:19.215338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:19.906000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:19.918135 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d972f32f-937f-450f-9edd-11c5bf83b601 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.736172 Aug 06 21:03:19.920468 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1200/2389] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:19 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:19.931547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-fbb608b5-96dc-4634-82a7-b670bee7229c req-45d06e71-5cb4-4daf-ba13-61aaca3a30a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e43c4cc-b1bd-44f6-8f63-9ca59bee3892", "name": "network-vif-plugged", "status": "completed", "tag": "c631e495-244d-4a84-ac2c-8aac6c8b7a23"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:19.977818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fbb608b5-96dc-4634-82a7-b670bee7229c req-45d06e71-5cb4-4daf-ba13-61aaca3a30a9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:19.978873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fbb608b5-96dc-4634-82a7-b670bee7229c req-45d06e71-5cb4-4daf-ba13-61aaca3a30a9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:19.979579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fbb608b5-96dc-4634-82a7-b670bee7229c req-45d06e71-5cb4-4daf-ba13-61aaca3a30a9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:20.007304 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-fbb608b5-96dc-4634-82a7-b670bee7229c req-45d06e71-5cb4-4daf-ba13-61aaca3a30a9 service nova] Creating event network-vif-plugged:c631e495-244d-4a84-ac2c-8aac6c8b7a23 for instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 on nch1-master-1 Aug 06 21:03:20.024270 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-fbb608b5-96dc-4634-82a7-b670bee7229c req-45d06e71-5cb4-4daf-ba13-61aaca3a30a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101762 Aug 06 21:03:20.025356 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1201/2390] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:20.036956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:20.043621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:20.058990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:20.062792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:20.063599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:20.064832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:20.065451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:20.067276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:21.020228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:21.038053 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e766a276-0378-42fe-8f61-7cd7b6f0a476 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1394 microversion: 2.1 time: 1.009840 Aug 06 21:03:21.039304 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1202/2391] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:20 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1394 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:21.064367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:21.065177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:21.085755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:21.086656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:21.087181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:21.089662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:21.093551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:21.094209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:21.444748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:21.462757 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ed8f8c75-ab9e-4163-8c69-054e8552fbdc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 0.416491 Aug 06 21:03:21.464649 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1203/2392] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:21 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:21.477608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:21.479844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:21.500941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:21.503332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:21.506589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:21.508007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:21.515393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:21.516223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:21.993786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:22.007404 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b83465c-ae1a-4068-b750-ba107823b11c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.540921 Aug 06 21:03:22.009772 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1204/2393] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:21 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:22.064821 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-713410fa-64fb-4b0e-9cc3-63d60ed89780 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.108947 Aug 06 21:03:22.073811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:22.073811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:22.079719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:22.079975 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1190/2394] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:03:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:22.080393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:22.080814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:22.081623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:22.085905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:22.089439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:22.114096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-46590bfc-168d-4504-90fc-6c54b1023f04 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Action: 'create', calling method: .version_select at 0x7f729d609ca0>, body: {"pool": null} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:22.596300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:22.637089 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f46ea63-3037-46df-b912-08c0eb034a4f tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1576 microversion: 2.1 time: 0.572037 Aug 06 21:03:22.661306 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1205/2395] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:22 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1576 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:03:22.697389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-230647910", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8d25f6f6-219c-4fd2-a8d9-1f1ed4d9f286"}, {"port": "4b549598-76da-47be-a95e-a307e09cc4a4", "tag": "port-1"}, {"port": "553098be-3b2e-4727-8f30-41b881e3dded", "tag": "port-2"}, {"uuid": "ec6d4b4f-3efd-4fb0-b4a0-d46042704832", "tag": "net-1"}, {"uuid": "ec6d4b4f-3efd-4fb0-b4a0-d46042704832"}, {"uuid": "31696491-7cdd-488b-8f3b-18319733a252", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "31696491-7cdd-488b-8f3b-18319733a252", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1c50e947-04ab-4f1c-af43-9bdf85fe71c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b158f367-0386-45c5-9634-fa98c720244b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1540120777"}], "key_name": "tempest-keypair-1886386052", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:23.064848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] validate_networks() for [('8d25f6f6-219c-4fd2-a8d9-1f1ed4d9f286', None, None, None, None, None), (None, None, '4b549598-76da-47be-a95e-a307e09cc4a4', None, None, None), (None, None, '553098be-3b2e-4727-8f30-41b881e3dded', None, None, None), ('ec6d4b4f-3efd-4fb0-b4a0-d46042704832', None, None, None, None, None), ('ec6d4b4f-3efd-4fb0-b4a0-d46042704832', None, None, None, None, None), ('31696491-7cdd-488b-8f3b-18319733a252', '10.2.2.100', None, None, None, None), ('31696491-7cdd-488b-8f3b-18319733a252', '10.2.2.200', None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:03:23.946899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:25.764540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=13 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:25.772200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:26.835031 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-46590bfc-168d-4504-90fc-6c54b1023f04 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.745843 Aug 06 21:03:26.835683 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1191/2396] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:03:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:26.842066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:26.843181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:26.851236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:26.851743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:26.852197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:26.852921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:26.853389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:26.853818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:27.071788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:27.080608 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d8b0951-d12a-4a01-8a7c-b2995ed25404 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1718 microversion: 2.1 time: 0.242750 Aug 06 21:03:27.081337 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1192/2397] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:26 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1718 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:27.086209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-976d0bc6-076e-42f8-9582-29d87231f797 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:27.087212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-976d0bc6-076e-42f8-9582-29d87231f797 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:27.095500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-976d0bc6-076e-42f8-9582-29d87231f797 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:27.097132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-976d0bc6-076e-42f8-9582-29d87231f797 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:27.097691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-976d0bc6-076e-42f8-9582-29d87231f797 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:27.098575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-976d0bc6-076e-42f8-9582-29d87231f797 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:27.099133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-976d0bc6-076e-42f8-9582-29d87231f797 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:27.099640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-976d0bc6-076e-42f8-9582-29d87231f797 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:27.207857 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-976d0bc6-076e-42f8-9582-29d87231f797 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125118 Aug 06 21:03:27.209163 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1193/2398] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:03:27 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:27.215669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:27.216831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:27.224096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:27.224890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:27.225765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:27.226737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:27.227399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:27.228075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:27.733322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:27.752306 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e05422c5-8c13-4b07-86a1-364d76589d94 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.541070 Aug 06 21:03:27.753611 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1194/2399] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:27 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:27.857324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1935947676", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "10fb936a-e68f-49ec-810f-9ce8e1dcd3b4"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:27.943477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] validate_networks() for [('10fb936a-e68f-49ec-810f-9ce8e1dcd3b4', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:03:28.815865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:03:28.816341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:03:28.816924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:03:28.817569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:03:28.818059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:03:28.831267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:28.832156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:28.832870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:28.833790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:28.836379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:28.837063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:28.868332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Getting quotas for project 2c6626cd5e8e4669a5ccb84df569d140. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:03:28.875165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Getting quotas for user 721aed6cddeb46cf9d8f33deaf6e5b8b and project 2c6626cd5e8e4669a5ccb84df569d140. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:03:28.891822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:03:28.897488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:03:28.964505 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a643f639-280d-428d-a6b6-4dd18af7d193 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207453 Aug 06 21:03:28.966195 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1195/2400] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:03:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:03:29.045574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ad017840-260c-41de-b088-5aba40abd7fa tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Calling method '.version_select at 0x7f72a3629280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:29.096021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-ad017840-260c-41de-b088-5aba40abd7fa tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1479f686-bcc5-41c3-ac07-13daafa58bc6 does not exist", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:03:29.096929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.security_group_api [None req-ad017840-260c-41de-b088-5aba40abd7fa tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Neutron security group 1479f686-bcc5-41c3-ac07-13daafa58bc6 not found {{(pid=142461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 21:03:29.097728 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-ad017840-260c-41de-b088-5aba40abd7fa tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] HTTP exception thrown: Security group 1479f686-bcc5-41c3-ac07-13daafa58bc6 does not exist Aug 06 21:03:29.097728 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-f4336fe9-0dbf-4769-bc91-db87eebceb9f'] Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ad017840-260c-41de-b088-5aba40abd7fa tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Request method failure captured: Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-security-groups/1479f686-bcc5-41c3-ac07-13daafa58bc6 HTTP/1.1 Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tce8XOw-Tg9US1R7HogNqPOceQOGFF-FMe7eUiaxpVrT205XvnLqGI9jhenO0oThrv5CjYweEtTqGoACpylysWyhuwA_cPWrReG9E7UDHnf231dfaMQDy7PbmRSe8p9gEuCGBcA8i7Bzb7OvOIKb7J82e6XKcAjv2-ZQ9iS9CxxztM Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 593535c3378c451baef5a3030a42d012 Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:03:29.100888 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/593535c3378c451baef5a3030a42d012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_593535c3378c451baef5a3030a42d012", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/593535c3378c451baef5a3030a42d012"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/593535c3378c451baef5a3030a42d012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 593535c3378c451baef5a3030a42d012 Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsNegativeTestJSON-88738508-project Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 6df409ba874342c29a452db74a60819a Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-88738508-project Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: exception: Security group 1479f686-bcc5-41c3-ac07-13daafa58bc6 does not exist Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-f4336fe9-0dbf-4769-bc91-db87eebceb9f'] Aug 06 21:03:29.102191 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '1479f686-bcc5-41c3-ac07-13daafa58bc6'} Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:29.102970 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1479f686-bcc5-41c3-ac07-13daafa58bc6 does not exist Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4336fe9-0dbf-4769-bc91-db87eebceb9f'] Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 21:03:29.104093 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1479f686-bcc5-41c3-ac07-13daafa58bc6 does not exist Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4336fe9-0dbf-4769-bc91-db87eebceb9f'] Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1479f686-bcc5-41c3-ac07-13daafa58bc6 does not exist Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4336fe9-0dbf-4769-bc91-db87eebceb9f'] Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:29.105078 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:29.106248 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:03:29.106248 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:03:29.106248 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:03:29.106248 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:03:29.106248 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1479f686-bcc5-41c3-ac07-13daafa58bc6 does not exist Aug 06 21:03:29.106248 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4336fe9-0dbf-4769-bc91-db87eebceb9f'] Aug 06 21:03:29.106248 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:29.108926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ad017840-260c-41de-b088-5aba40abd7fa tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Returning 404 to user: Security group 1479f686-bcc5-41c3-ac07-13daafa58bc6 does not exist Aug 06 21:03:29.108926 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-f4336fe9-0dbf-4769-bc91-db87eebceb9f'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:03:29.113379 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ad017840-260c-41de-b088-5aba40abd7fa tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/1479f686-bcc5-41c3-ac07-13daafa58bc6" status: 404 len: 194 microversion: 2.1 time: 0.143580 Aug 06 21:03:29.114331 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1196/2401] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:03:28 2022] DELETE /compute/v2.1/os-security-groups/1479f686-bcc5-41c3-ac07-13daafa58bc6 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:03:29.125681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ae20d12-93e5-4bc7-bc41-80c26b327a87 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Action: 'create', calling method: .version_select at 0x7f72a365aca0>, body: {"pool": null} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:29.788527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:03:29.789709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:03:29.791317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:03:29.791912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:03:29.793030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:03:29.824753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:29.833040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:29.833890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:29.834958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:29.835673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:29.836425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:29.875048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Getting quotas for project e1ed29bedd5e4f4788958bad354166f3. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:03:29.888158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Getting quotas for user 78f7a58ae0b24b6a9aca96713dfe99b4 and project e1ed29bedd5e4f4788958bad354166f3. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:03:30.222109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:03:30.225480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1c50e947-04ab-4f1c-af43-9bdf85fe71c4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b158f367-0386-45c5-9634-fa98c720244b',volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:03:30.687546 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.005655 Aug 06 21:03:30.688232 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1206/2402] 10.222.0.33 () {62 vars in 1189 bytes} [Sat Aug 6 21:03:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 8026 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:03:30.693056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:30.693873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:30.701392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:30.702720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:30.711335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:30.712091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:30.712664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:30.713254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:30.996915 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ae20d12-93e5-4bc7-bc41-80c26b327a87 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.880886 Aug 06 21:03:30.998154 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1197/2403] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:03:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:31.004218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:31.004977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:31.037356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:31.038966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:31.039738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:31.042042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:31.043116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:31.044099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:31.256122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:31.265120 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4aa3f03e-349f-4b42-8a60-ab7242067540 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.265799 Aug 06 21:03:31.266970 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1198/2404] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:30 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:31.276158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:31.279297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:31.287348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:31.288085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:31.288527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:31.289815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:31.292656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:31.293563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:31.450531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:31.465876 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2b4aa3f8-6485-41de-8043-641f1f70c2c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1708 microversion: 2.1 time: 0.775450 Aug 06 21:03:31.467263 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1207/2405] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:30 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1708 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:31.478957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d3e1176b-92c6-4372-a05e-3e163ab6596b req-a4f7574e-9db4-4b10-aa81-e5a74b0df9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e43c4cc-b1bd-44f6-8f63-9ca59bee3892", "tag": "c631e495-244d-4a84-ac2c-8aac6c8b7a23"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:31.495028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d3e1176b-92c6-4372-a05e-3e163ab6596b req-a4f7574e-9db4-4b10-aa81-e5a74b0df9c6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:31.498606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d3e1176b-92c6-4372-a05e-3e163ab6596b req-a4f7574e-9db4-4b10-aa81-e5a74b0df9c6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:31.499244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d3e1176b-92c6-4372-a05e-3e163ab6596b req-a4f7574e-9db4-4b10-aa81-e5a74b0df9c6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:31.523393 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d3e1176b-92c6-4372-a05e-3e163ab6596b req-a4f7574e-9db4-4b10-aa81-e5a74b0df9c6 service nova] Creating event network-changed:c631e495-244d-4a84-ac2c-8aac6c8b7a23 for instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 on nch1-master-1 Aug 06 21:03:31.525314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:31.534141 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d3e1176b-92c6-4372-a05e-3e163ab6596b req-a4f7574e-9db4-4b10-aa81-e5a74b0df9c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063202 Aug 06 21:03:31.538265 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1208/2406] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:31.549133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:31.550318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:31.555714 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce9ba936-8a3d-4b57-86b9-e0fe5f6690d1 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1576 microversion: 2.1 time: 0.285146 Aug 06 21:03:31.560383 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1199/2407] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:31 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1576 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:31.567652 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6c7f008a-bd88-4315-af24-0c10d5f358da tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005599 Aug 06 21:03:31.568642 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1200/2408] 10.222.0.33 () {58 vars in 1164 bytes} [Sat Aug 6 21:03:31 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 21:03:31.572520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:31.578518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1b97af92-1ae0-45bb-90d1-73c326a81f76 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:31.579560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1b97af92-1ae0-45bb-90d1-73c326a81f76 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:31.581380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:31.583222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:31.583513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:31.587319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:31.588452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:31.676879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1b97af92-1ae0-45bb-90d1-73c326a81f76 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:31.695614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1b97af92-1ae0-45bb-90d1-73c326a81f76 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:31.697088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1b97af92-1ae0-45bb-90d1-73c326a81f76 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:31.698270 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1b97af92-1ae0-45bb-90d1-73c326a81f76 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1285 microversion: 2.32 time: 0.128661 Aug 06 21:03:31.698887 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1201/2409] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:31 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:31.720829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba84a7db-774a-461b-811c-827ff5bc655a tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Action: 'create', calling method: .version_select at 0x7f72a3629af0>, body: {"pool": null} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:31.847973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:31.867887 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f767d185-4bed-4a2a-80b5-43f3cb4ad07a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1282 microversion: 2.1 time: 0.325296 Aug 06 21:03:31.868491 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1209/2410] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:31 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1282 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:31.885774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76668e82-aa79-4183-a030-ce8c73e08742 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '.version_select at 0x7f729d96c550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:31.890719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76668e82-aa79-4183-a030-ce8c73e08742 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:31.891231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76668e82-aa79-4183-a030-ce8c73e08742 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:31.891724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76668e82-aa79-4183-a030-ce8c73e08742 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:31.908351 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-76668e82-aa79-4183-a030-ce8c73e08742 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1170 microversion: 2.1 time: 0.038731 Aug 06 21:03:31.919453 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1210/2411] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 21:03:31 2022] GET /compute/v2.1/os-migrations => generated 1170 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:31.925816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a6f064f-d873-4d3a-9675-f484d24e7e54 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Calling method '.version_select at 0x7f72a353b3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:32.480556 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a6f064f-d873-4d3a-9675-f484d24e7e54 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.559688 Aug 06 21:03:32.483258 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1211/2412] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 21:03:31 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:32.490289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-adc0735f-9ae1-49ae-bb9e-1c43269af0d3 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:32.492389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-adc0735f-9ae1-49ae-bb9e-1c43269af0d3 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:32.509537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc0735f-9ae1-49ae-bb9e-1c43269af0d3 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:32.510379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc0735f-9ae1-49ae-bb9e-1c43269af0d3 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:32.510937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc0735f-9ae1-49ae-bb9e-1c43269af0d3 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:32.512014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc0735f-9ae1-49ae-bb9e-1c43269af0d3 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:32.514077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc0735f-9ae1-49ae-bb9e-1c43269af0d3 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:32.514870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adc0735f-9ae1-49ae-bb9e-1c43269af0d3 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:32.518478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:33.128227 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-adc0735f-9ae1-49ae-bb9e-1c43269af0d3 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1859 microversion: 2.1 time: 0.642901 Aug 06 21:03:33.129015 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1212/2413] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:32 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1859 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:33.133723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:33.134346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:33.159636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:33.160470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:33.163055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:33.164755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:33.171426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:33.172297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:33.576712 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba84a7db-774a-461b-811c-827ff5bc655a tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.865880 Aug 06 21:03:33.577435 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1202/2414] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:03:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:33.584244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc51cdab-2253-4ea5-a951-5453d1881501 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Calling method '.version_select at 0x7f729d746940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:33.766539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:33.780498 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-70ee4238-fe8a-43ee-8df0-0fd25ff37d3c tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.650294 Aug 06 21:03:33.784719 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1213/2415] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:33 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:33.800482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:33.802399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:33.818645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:33.819442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:33.822673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:33.823720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:33.824452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:33.825381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:34.104429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-dc51cdab-2253-4ea5-a951-5453d1881501 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:03:34.105145 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-dc51cdab-2253-4ea5-a951-5453d1881501 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 06 21:03:34.105145 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-91c9d086-afed-48db-a49d-a643a01e2f0a'] Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc51cdab-2253-4ea5-a951-5453d1881501 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Request method failure captured: Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-security-groups/536b04c4-288c-48b3-9577-129da7ce7b76 HTTP/1.1 Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tce8XOw-Tg9US1R7HogNqPOceQOGFF-FMe7eUiaxpVrT205XvnLqGI9jhenO0oThrv5CjYweEtTqGoACpylysWyhuwA_cPWrReG9E7UDHnf231dfaMQDy7PbmRSe8p9gEuCGBcA8i7Bzb7OvOIKb7J82e6XKcAjv2-ZQ9iS9CxxztM Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 593535c3378c451baef5a3030a42d012 Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:03:34.115962 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/593535c3378c451baef5a3030a42d012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_593535c3378c451baef5a3030a42d012", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/593535c3378c451baef5a3030a42d012"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/593535c3378c451baef5a3030a42d012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 593535c3378c451baef5a3030a42d012 Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupsNegativeTestJSON-88738508-project Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 6df409ba874342c29a452db74a60819a Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-88738508-project Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: exception: Insufficient rights for removing default security group. Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-91c9d086-afed-48db-a49d-a643a01e2f0a'] Aug 06 21:03:34.117152 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '536b04c4-288c-48b3-9577-129da7ce7b76'} Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:34.117942 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91c9d086-afed-48db-a49d-a643a01e2f0a'] Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 06 21:03:34.118992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91c9d086-afed-48db-a49d-a643a01e2f0a'] Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91c9d086-afed-48db-a49d-a643a01e2f0a'] Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:34.120084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:03:34.121168 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:03:34.121168 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:03:34.121168 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:03:34.121168 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 06 21:03:34.121168 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91c9d086-afed-48db-a49d-a643a01e2f0a'] Aug 06 21:03:34.121168 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:03:34.121168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc51cdab-2253-4ea5-a951-5453d1881501 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 06 21:03:34.121168 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-91c9d086-afed-48db-a49d-a643a01e2f0a'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:03:34.121168 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc51cdab-2253-4ea5-a951-5453d1881501 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/536b04c4-288c-48b3-9577-129da7ce7b76" status: 400 len: 182 microversion: 2.1 time: 0.538416 Aug 06 21:03:34.125860 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1203/2416] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:03:33 2022] DELETE /compute/v2.1/os-security-groups/536b04c4-288c-48b3-9577-129da7ce7b76 => generated 182 bytes in 548 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:03:34.133284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:34.133954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:34.158324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:34.158861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:34.171089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:34.172057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:34.172636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:34.173086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:34.202005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:34.253254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:34.272732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:34.274393 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d33a921b-8199-42e7-ae37-e7498c564703 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1593 microversion: 2.32 time: 0.486713 Aug 06 21:03:34.300020 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1214/2417] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:33 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1593 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:34.337878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e967615b-3455-4aac-bd45-b72d42df25c1 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:34.343184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e967615b-3455-4aac-bd45-b72d42df25c1 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:34.398609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e967615b-3455-4aac-bd45-b72d42df25c1 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:34.399384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e967615b-3455-4aac-bd45-b72d42df25c1 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:34.400314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e967615b-3455-4aac-bd45-b72d42df25c1 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:34.403214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e967615b-3455-4aac-bd45-b72d42df25c1 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:34.404461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e967615b-3455-4aac-bd45-b72d42df25c1 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:34.405059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e967615b-3455-4aac-bd45-b72d42df25c1 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:34.569747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:34.583941 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b92e4960-d46e-4b7f-9017-c6b176e6ab81 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1324 microversion: 2.1 time: 0.455369 Aug 06 21:03:34.588057 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1204/2418] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:34 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1324 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:34.598273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74861a47-d2bb-4e71-afce-6e88696bec5c tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Calling method '.version_select at 0x7f72a362b1f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:34.856699 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e967615b-3455-4aac-bd45-b72d42df25c1 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1859 microversion: 2.1 time: 0.553001 Aug 06 21:03:34.859518 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1215/2419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:34 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1859 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:34.865673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bea55f4-b9c3-4365-8d24-99e2c4866088 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Calling method '.version_select at 0x7f729d869670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:35.311734 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74861a47-d2bb-4e71-afce-6e88696bec5c tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/cc945a64-8642-438f-9893-13a6bf0fe990" status: 200 len: 141 microversion: 2.1 time: 0.722302 Aug 06 21:03:35.312562 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1205/2420] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:03:34 2022] GET /compute/v2.1/os-floating-ips/cc945a64-8642-438f-9893-13a6bf0fe990 => generated 141 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:35.320555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:35.321502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:35.331965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:35.332766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:35.333392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:35.334282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:35.335539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:35.336161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:35.492929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-2bea55f4-b9c3-4365-8d24-99e2c4866088 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 does not exist", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:03:35.495024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.security_group_api [None req-2bea55f4-b9c3-4365-8d24-99e2c4866088 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Neutron security group ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 not found {{(pid=142462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 21:03:35.497121 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-2bea55f4-b9c3-4365-8d24-99e2c4866088 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] HTTP exception thrown: Security group ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 does not exist Aug 06 21:03:35.497121 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-cdd35af3-d586-4eca-a30a-5ec8d2874860'] Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bea55f4-b9c3-4365-8d24-99e2c4866088 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Request method failure captured: Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-security-groups/ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 HTTP/1.1 Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tce8XOw-Tg9US1R7HogNqPOceQOGFF-FMe7eUiaxpVrT205XvnLqGI9jhenO0oThrv5CjYweEtTqGoACpylysWyhuwA_cPWrReG9E7UDHnf231dfaMQDy7PbmRSe8p9gEuCGBcA8i7Bzb7OvOIKb7J82e6XKcAjv2-ZQ9iS9CxxztM Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 593535c3378c451baef5a3030a42d012 Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:03:35.499686 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/593535c3378c451baef5a3030a42d012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_593535c3378c451baef5a3030a42d012", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/593535c3378c451baef5a3030a42d012"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/593535c3378c451baef5a3030a42d012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 593535c3378c451baef5a3030a42d012 Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsNegativeTestJSON-88738508-project Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 6df409ba874342c29a452db74a60819a Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-88738508-project Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: exception: Security group ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 does not exist Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-cdd35af3-d586-4eca-a30a-5ec8d2874860'] Aug 06 21:03:35.500834 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8'} Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:35.501588 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 does not exist Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdd35af3-d586-4eca-a30a-5ec8d2874860'] Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 21:03:35.502592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 does not exist Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdd35af3-d586-4eca-a30a-5ec8d2874860'] Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 does not exist Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdd35af3-d586-4eca-a30a-5ec8d2874860'] Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:35.503553 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:35.504984 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:03:35.504984 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:03:35.504984 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:03:35.504984 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:03:35.504984 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 does not exist Aug 06 21:03:35.504984 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdd35af3-d586-4eca-a30a-5ec8d2874860'] Aug 06 21:03:35.504984 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:35.504984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bea55f4-b9c3-4365-8d24-99e2c4866088 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Returning 404 to user: Security group ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 does not exist Aug 06 21:03:35.504984 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-cdd35af3-d586-4eca-a30a-5ec8d2874860'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:03:35.505828 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2bea55f4-b9c3-4365-8d24-99e2c4866088 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8" status: 404 len: 194 microversion: 2.1 time: 0.644932 Aug 06 21:03:35.506881 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1216/2421] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:03:34 2022] GET /compute/v2.1/os-security-groups/ffa6604f-b3b2-46f7-a9ba-8f2220b3a6c8 => generated 194 bytes in 646 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:03:35.519842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:35.520718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:35.530135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:35.531303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:35.532368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:35.533746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:35.534426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:35.535214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:35.554775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:35.573626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fc7c425a-686f-4162-82f0-89d5f845f27b tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.258467 Aug 06 21:03:35.575491 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1206/2422] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:35 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:35.592206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:35.595239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:35.616002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:35.616506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:35.616949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:35.617777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:35.624513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:35.625177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:35.750686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lazy-loading 'services' on Instance uuid 5cca29a9-9c71-47c0-b780-ba58daba21d2 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:03:35.822966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:35.856235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:35.863666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:35.864872 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7212cff3-0bd2-4fa1-8894-e330ffd413a4 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1593 microversion: 2.32 time: 0.285835 Aug 06 21:03:35.885664 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1207/2423] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:35 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1593 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:35.895797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b8ad9ef-d8fc-41ca-8dd5-ed92e0f10f53 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Calling method '.version_select at 0x7f729d766430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:35.937613 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4cf14529-e191-43fd-81db-9da2bccc2be8 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-volume_attachments/aa673255-11d9-4633-b5e3-fd8bc6522a18" status: 202 len: 0 microversion: 2.1 time: 0.419576 Aug 06 21:03:35.943638 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1217/2424] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Aug 6 21:03:35 2022] DELETE /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-volume_attachments/aa673255-11d9-4633-b5e3-fd8bc6522a18 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:03:35.958300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1b098837-ca4c-4af3-9c5b-cf603818ca51 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Action: 'update', calling method: .version_select at 0x7f729d982670>, body: {"security_group": {"name": "tempest-sg-1557773928", "description": "tempest-description-996933492"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:36.165016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-1b098837-ca4c-4af3-9c5b-cf603818ca51 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7bde692-e495-4934-8d31-f220d9b37faf does not exist", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:03:36.167031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.security_group_api [None req-1b098837-ca4c-4af3-9c5b-cf603818ca51 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Neutron security group c7bde692-e495-4934-8d31-f220d9b37faf not found {{(pid=142462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 21:03:36.168044 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-1b098837-ca4c-4af3-9c5b-cf603818ca51 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] HTTP exception thrown: Security group c7bde692-e495-4934-8d31-f220d9b37faf does not exist Aug 06 21:03:36.168044 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-d2fa976f-6c63-4fc9-9486-c036dc4a8cda'] Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1b098837-ca4c-4af3-9c5b-cf603818ca51 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Request method failure captured: Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/os-security-groups/c7bde692-e495-4934-8d31-f220d9b37faf HTTP/1.1 Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 101 Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tce8XOw-Tg9US1R7HogNqPOceQOGFF-FMe7eUiaxpVrT205XvnLqGI9jhenO0oThrv5CjYweEtTqGoACpylysWyhuwA_cPWrReG9E7UDHnf231dfaMQDy7PbmRSe8p9gEuCGBcA8i7Bzb7OvOIKb7J82e6XKcAjv2-ZQ9iS9CxxztM Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 593535c3378c451baef5a3030a42d012 Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:03:36.172632 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/593535c3378c451baef5a3030a42d012"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_593535c3378c451baef5a3030a42d012", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/593535c3378c451baef5a3030a42d012"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/593535c3378c451baef5a3030a42d012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 593535c3378c451baef5a3030a42d012 Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-88738508 Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupsNegativeTestJSON-88738508-project Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 6df409ba874342c29a452db74a60819a Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-88738508-project Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: {"security_group": {"name": "tempest-sg-1557773928", "description": "tempest-description-996933492"}} Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:03:36.174486 ncdv-master-1 devstack@n-api.service[142462]: exception: Security group c7bde692-e495-4934-8d31-f220d9b37faf does not exist Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-d2fa976f-6c63-4fc9-9486-c036dc4a8cda'] Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'c7bde692-e495-4934-8d31-f220d9b37faf', 'body': {'security_group': {'name': 'tempest-sg-1557773928', 'description': 'tempest-description-996933492'}}} Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:03:36.175307 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7bde692-e495-4934-8d31-f220d9b37faf does not exist Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2fa976f-6c63-4fc9-9486-c036dc4a8cda'] Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 06 21:03:36.177960 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7bde692-e495-4934-8d31-f220d9b37faf does not exist Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2fa976f-6c63-4fc9-9486-c036dc4a8cda'] Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7bde692-e495-4934-8d31-f220d9b37faf does not exist Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2fa976f-6c63-4fc9-9486-c036dc4a8cda'] Aug 06 21:03:36.179646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7bde692-e495-4934-8d31-f220d9b37faf does not exist Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2fa976f-6c63-4fc9-9486-c036dc4a8cda'] Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1b098837-ca4c-4af3-9c5b-cf603818ca51 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] Returning 404 to user: Security group c7bde692-e495-4934-8d31-f220d9b37faf does not exist Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: Neutron server returns request_ids: ['req-d2fa976f-6c63-4fc9-9486-c036dc4a8cda'] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:03:36.182169 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1b098837-ca4c-4af3-9c5b-cf603818ca51 tempest-SecurityGroupsNegativeTestJSON-88738508 tempest-SecurityGroupsNegativeTestJSON-88738508-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/c7bde692-e495-4934-8d31-f220d9b37faf" status: 404 len: 194 microversion: 2.1 time: 0.227911 Aug 06 21:03:36.184442 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1218/2425] 10.222.0.33 () {60 vars in 1290 bytes} [Sat Aug 6 21:03:35 2022] PUT /compute/v2.1/os-security-groups/c7bde692-e495-4934-8d31-f220d9b37faf => generated 194 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:03:36.190183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:36.191045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:36.211712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:36.212734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:36.213320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:36.214283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:36.215077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:36.216756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:36.681216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:36.695268 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2735be5c-6fe0-4b71-bd08-f589e9f3fc9e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1324 microversion: 2.1 time: 0.511369 Aug 06 21:03:36.698674 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1219/2426] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:36 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1324 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:36.710650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-dad53240-1521-48a2-9c56-9fe4602de953 req-6b026fb6-f8f7-48fb-9489-c26917913ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44af8cf4-3a6b-4b21-b646-ddf9853f484a", "tag": "17cae853-ea36-45e7-9b90-4cf71241cfe6"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:36.734508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-dad53240-1521-48a2-9c56-9fe4602de953 req-6b026fb6-f8f7-48fb-9489-c26917913ca0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:36.735592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-dad53240-1521-48a2-9c56-9fe4602de953 req-6b026fb6-f8f7-48fb-9489-c26917913ca0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:36.736219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-dad53240-1521-48a2-9c56-9fe4602de953 req-6b026fb6-f8f7-48fb-9489-c26917913ca0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:36.751935 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-dad53240-1521-48a2-9c56-9fe4602de953 req-6b026fb6-f8f7-48fb-9489-c26917913ca0 service nova] Creating event network-changed:17cae853-ea36-45e7-9b90-4cf71241cfe6 for instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a on nch2-master-1 Aug 06 21:03:36.757465 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-dad53240-1521-48a2-9c56-9fe4602de953 req-6b026fb6-f8f7-48fb-9489-c26917913ca0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057230 Aug 06 21:03:36.758660 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1220/2427] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:36.765823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6105abbf-8844-40be-92ed-723e54eebb1b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:36.769632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6105abbf-8844-40be-92ed-723e54eebb1b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:36.776713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6105abbf-8844-40be-92ed-723e54eebb1b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:36.777562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6105abbf-8844-40be-92ed-723e54eebb1b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:36.778268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6105abbf-8844-40be-92ed-723e54eebb1b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:36.779254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6105abbf-8844-40be-92ed-723e54eebb1b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:36.779928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6105abbf-8844-40be-92ed-723e54eebb1b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:36.781022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6105abbf-8844-40be-92ed-723e54eebb1b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:36.832894 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6105abbf-8844-40be-92ed-723e54eebb1b tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072654 Aug 06 21:03:36.834166 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1221/2428] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:03:36 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:36.841890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:36.843701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:36.851088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:36.852012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:36.852472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:36.854168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:36.854915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:36.855572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:37.341477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:37.358435 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6ff779af-dc8e-4787-856b-4533b4aa32cf tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.519030 Aug 06 21:03:37.359435 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1222/2429] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:36 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:37.366953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:37.376347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:37.383643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:37.384138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:37.386475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:37.390088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:37.390863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:37.391607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:37.987249 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b8ad9ef-d8fc-41ca-8dd5-ed92e0f10f53 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/cc945a64-8642-438f-9893-13a6bf0fe990" status: 202 len: 0 microversion: 2.1 time: 2.098780 Aug 06 21:03:37.990936 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1208/2430] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:03:35 2022] DELETE /compute/v2.1/os-floating-ips/cc945a64-8642-438f-9893-13a6bf0fe990 => generated 0 bytes in 2105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:03:38.004957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:38.005823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:38.018539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:38.019336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:38.020835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:38.022069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:38.022717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:38.023539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:38.043184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:38.061239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:38.063191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:38.067558 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-05121884-094f-4932-bad3-c7d777d9d142 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1661 microversion: 2.32 time: 0.706892 Aug 06 21:03:38.070380 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1223/2431] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:37 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1661 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:38.078292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-10c009c1-bf37-42bb-8768-35d928c0ed03 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:38.085902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-10c009c1-bf37-42bb-8768-35d928c0ed03 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:38.094410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10c009c1-bf37-42bb-8768-35d928c0ed03 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:38.095134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10c009c1-bf37-42bb-8768-35d928c0ed03 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:38.095641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10c009c1-bf37-42bb-8768-35d928c0ed03 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:38.096675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10c009c1-bf37-42bb-8768-35d928c0ed03 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:38.097550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10c009c1-bf37-42bb-8768-35d928c0ed03 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:38.098183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10c009c1-bf37-42bb-8768-35d928c0ed03 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:38.147320 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-10c009c1-bf37-42bb-8768-35d928c0ed03 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075539 Aug 06 21:03:38.150326 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1224/2432] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:03:38 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:03:38.179663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab9b3672-acde-442b-b419-f822e66b1c9e tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Calling method '.version_select at 0x7f729d9ab790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:38.319792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:38.335228 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e99a9aba-a20d-4bb1-9810-87e71dedd427 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1324 microversion: 2.1 time: 0.339095 Aug 06 21:03:38.336943 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1209/2433] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:37 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:38.383852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:38.388671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:38.405983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:38.410237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:38.412435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:38.413802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:38.417035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:38.417692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:38.754275 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab9b3672-acde-442b-b419-f822e66b1c9e tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.602358 Aug 06 21:03:38.755741 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1225/2434] 10.222.0.33 () {58 vars in 1164 bytes} [Sat Aug 6 21:03:38 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:03:38.767515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f7a01ad-ff64-46d4-9464-555b650558a4 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Calling method '.version_select at 0x7f729d9ab820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:38.853206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:38.907530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:38.919073 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab952c6d-af52-4832-9f5a-aff175327692 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.539182 Aug 06 21:03:38.922258 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1210/2435] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:38 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:03:39.096641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:39.097336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:39.113351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:39.114434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:39.115206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:39.116434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:39.120084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:39.120775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:39.335811 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f7a01ad-ff64-46d4-9464-555b650558a4 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.572038 Aug 06 21:03:39.337050 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1226/2436] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 21:03:38 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:03:39.353376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df874c48-2c3e-44fb-8e03-849d7b5744c8 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Calling method '.version_select at 0x7f729da1fdc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:39.797178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:39.843345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:39.849229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:39.852610 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-72e3f2a9-cb21-47b3-8e31-f2a9d19a4f15 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1708 microversion: 2.32 time: 0.759170 Aug 06 21:03:39.855024 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1211/2437] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:39 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1708 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:39.863843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:39.870849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:39.875625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:39.892968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:39.894085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:39.894817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:39.897890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:39.898631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:39.900557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:39.901473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:40.114192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:40.124925 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67944704-7983-4ee5-9ebf-daf5a2a1e2e7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1324 microversion: 2.1 time: 0.265750 Aug 06 21:03:40.126258 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1212/2438] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:39 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:40.132755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:40.133740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:40.144157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:40.145040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:40.145590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:40.146470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:40.147667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:40.148504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:40.417808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:40.433310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:40.436222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:40.437497 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f4af4f1a-128a-4f9e-a787-628865af3fa6 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2957 microversion: 2.42 time: 0.309297 Aug 06 21:03:40.438601 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1213/2439] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:40 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2957 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:40.456498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:40.457298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:40.466764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:40.467565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:40.468328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:40.469497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:40.470840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:40.471701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:40.650709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:40.659577 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-100d2e7a-663c-4ac5-b3a1-1af4e5b9833f tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1523 microversion: 2.1 time: 0.207158 Aug 06 21:03:40.660169 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1214/2440] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:40 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:40.664967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-27309aa9-60ad-4092-83a5-46017fb104dc tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:40.665688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-27309aa9-60ad-4092-83a5-46017fb104dc tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:40.672897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27309aa9-60ad-4092-83a5-46017fb104dc tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:40.673843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27309aa9-60ad-4092-83a5-46017fb104dc tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:40.674579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27309aa9-60ad-4092-83a5-46017fb104dc tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:40.675744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27309aa9-60ad-4092-83a5-46017fb104dc tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:40.676734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27309aa9-60ad-4092-83a5-46017fb104dc tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:40.677327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27309aa9-60ad-4092-83a5-46017fb104dc tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:40.808001 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-27309aa9-60ad-4092-83a5-46017fb104dc tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.146567 Aug 06 21:03:40.820064 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1215/2441] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Aug 6 21:03:40 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334/os-interface => generated 1832 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:40.890393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:40.892312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:40.904036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:40.911821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:40.912551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:40.913496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:40.914710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:40.915477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:41.159179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:41.172099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:41.174096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:41.175515 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0f826c83-405b-4146-9a33-a02c4fb53f78 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1696 microversion: 2.32 time: 0.297439 Aug 06 21:03:41.176345 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1216/2442] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:40 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1696 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:41.200239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:41.201375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:41.208967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:41.209696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:41.210305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:41.211445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:41.212186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:41.212666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:41.428754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:41.433020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:41.442275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-34693868-f5b9-457e-a1e3-2d8f3000818c tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1324 microversion: 2.1 time: 0.249674 Aug 06 21:03:41.443504 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1217/2443] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:41 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:41.448384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-25ec57ea-7eab-4c75-89cd-8ef2e3cfd539 req-63e7cdb0-2148-4bf8-b02c-3cfa43ae17ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44af8cf4-3a6b-4b21-b646-ddf9853f484a", "name": "network-vif-plugged", "status": "completed", "tag": "17cae853-ea36-45e7-9b90-4cf71241cfe6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:41.460127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-25ec57ea-7eab-4c75-89cd-8ef2e3cfd539 req-63e7cdb0-2148-4bf8-b02c-3cfa43ae17ba service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:41.460946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-25ec57ea-7eab-4c75-89cd-8ef2e3cfd539 req-63e7cdb0-2148-4bf8-b02c-3cfa43ae17ba service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:41.461688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-25ec57ea-7eab-4c75-89cd-8ef2e3cfd539 req-63e7cdb0-2148-4bf8-b02c-3cfa43ae17ba service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:41.477466 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-25ec57ea-7eab-4c75-89cd-8ef2e3cfd539 req-63e7cdb0-2148-4bf8-b02c-3cfa43ae17ba service nova] Creating event network-vif-plugged:17cae853-ea36-45e7-9b90-4cf71241cfe6 for instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a on nch2-master-1 Aug 06 21:03:41.485606 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-25ec57ea-7eab-4c75-89cd-8ef2e3cfd539 req-63e7cdb0-2148-4bf8-b02c-3cfa43ae17ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040565 Aug 06 21:03:41.487023 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1218/2444] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:41.656476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-480830203", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5fee4f47-5ab3-4921-b8aa-c6b0a41eb20e"}], "block_device_mapping_v2": [{"uuid": "4edf48a0-01d4-4349-bcb8-6225efa23271", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:41.683353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:41.789718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] validate_networks() for [('5fee4f47-5ab3-4921-b8aa-c6b0a41eb20e', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:03:42.728635 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df874c48-2c3e-44fb-8e03-849d7b5744c8 tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/59f588a9-f33d-425b-ba44-ed274222171d" status: 202 len: 0 microversion: 2.1 time: 3.381433 Aug 06 21:03:42.730286 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1227/2445] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:03:39 2022] DELETE /compute/v2.1/os-floating-ips/59f588a9-f33d-425b-ba44-ed274222171d => generated 0 bytes in 3384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:03:42.737482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:42.738659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:42.759906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:42.759906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:42.759906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:42.759906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:42.760512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:42.761586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:03:42.762447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:42.762969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:03:42.763567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:03:42.763992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:03:42.764418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:03:42.780706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:42.781539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:42.784593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:42.785787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:42.787126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:42.788468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:42.818530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for project e47f439135a6445fa29c8be6d69c1759. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:03:42.826887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Getting quotas for user ad1a96004778407584d1805b07ad1c5f and project e47f439135a6445fa29c8be6d69c1759. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:03:42.903752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:03:42.906339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4edf48a0-01d4-4349-bcb8-6225efa23271',volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:03:43.197171 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-81901fc8-aba9-496a-b21c-1476eb9454ea tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545441 Aug 06 21:03:43.199832 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1219/2446] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:03:43.215687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:43.217242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:43.252796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:43.253821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:43.255922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:43.259501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:43.260997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:43.261618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:43.379595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:43.391498 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f508ea4-ee28-4349-bc31-f05eecdb8991 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1503 microversion: 2.1 time: 0.655986 Aug 06 21:03:43.395223 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1228/2447] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:42 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1503 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:43.401370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:43.405104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:43.421560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:43.422319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:43.425193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:43.426123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:43.427192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:43.430524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:43.633402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:43.641628 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21e6faaa-09bf-493f-a771-f6697fa9ab1b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1521 microversion: 2.1 time: 0.245359 Aug 06 21:03:43.647093 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1229/2448] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:43 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:43.652138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-64bc9eb5-9b33-407a-a1e9-7b82d76b916f tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Calling method '.version_select at 0x7f72a34eaa60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:43.676012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:43.686689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:43.688210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:43.689462 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9061d157-cc9e-4a89-b906-c4e54c781484 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1743 microversion: 2.32 time: 0.488251 Aug 06 21:03:43.689932 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1220/2449] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:43 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1743 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:43.694718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e5d541fa-72a9-4840-b154-1dc331fa7d6d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:43.695518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e5d541fa-72a9-4840-b154-1dc331fa7d6d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:43.787328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e5d541fa-72a9-4840-b154-1dc331fa7d6d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:43.801772 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e5d541fa-72a9-4840-b154-1dc331fa7d6d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1052 microversion: 2.1 time: 0.110017 Aug 06 21:03:43.804508 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1221/2450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:43 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1052 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:43.814929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69e406da-4ffb-4e13-a032-2e0f1ac8db26 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Action: 'create', calling method: .version_select at 0x7f729daa4790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-179687097", "description": "tempest-description-1743509154"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:44.140064 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-69e406da-4ffb-4e13-a032-2e0f1ac8db26 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.332896 Aug 06 21:03:44.148155 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1222/2451] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:03:43 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:44.153986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65846bb7-3495-4c6e-a48a-80bb8b497ca3 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Action: 'create', calling method: .version_select at 0x7f729dace040>, body: {"pool": null} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:44.929284 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-64bc9eb5-9b33-407a-a1e9-7b82d76b916f tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/f4aa911f-e35d-420a-89d2-c31c7bf5ede9" status: 202 len: 0 microversion: 2.1 time: 1.280917 Aug 06 21:03:44.930190 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1230/2452] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:03:43 2022] DELETE /compute/v2.1/os-floating-ips/f4aa911f-e35d-420a-89d2-c31c7bf5ede9 => generated 0 bytes in 1282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:03:44.935794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-179687097"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:44.936358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:44.940698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:44.950772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:44.962306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:44.962903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:44.963696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:44.964179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:44.964763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:45.181585 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.network.security_group_api [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Adding security group 390f9777-618b-4120-b3d2-b14f15aea186 to port 807fd1e4-c6e0-413e-bbdd-03813d524083 Aug 06 21:03:45.948209 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-85537f0a-d9ad-459b-8685-c3b6aecab5b5 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action" status: 202 len: 0 microversion: 2.1 time: 1.016862 Aug 06 21:03:45.948839 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1231/2453] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:03:44 2022] POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:03:45.955444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:45.956643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:45.972944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:45.973528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:45.973892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:45.976745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:45.977231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:45.977676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:46.388224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:46.405154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:46.406933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:46.408160 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-571a8e9e-6eae-4064-9424-704c167d5dea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1837 microversion: 2.32 time: 0.458379 Aug 06 21:03:46.408741 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1232/2454] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:45 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1837 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:46.417556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:46.418208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:46.439096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:46.439598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:46.440046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:46.440763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:46.441404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:46.441992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:46.625093 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65846bb7-3495-4c6e-a48a-80bb8b497ca3 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.474262 Aug 06 21:03:46.627008 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1223/2455] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:03:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:46.633055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1b927e14-7f08-4c5f-bdd0-a6495ea8bfae tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] Calling method '.version_select at 0x7f729d68ca60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:46.954820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:46.963962 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7ddf7d53-e85a-44d5-8d69-e628721c9b97 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1210 microversion: 2.1 time: 0.554178 Aug 06 21:03:46.964677 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1233/2456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:46 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1210 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:47.046574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-377ca979-4e22-402d-b0fd-fe364b72cb37 tempest-AZV2TestJSON-450839619 tempest-AZV2TestJSON-450839619-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:47.048270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-377ca979-4e22-402d-b0fd-fe364b72cb37 tempest-AZV2TestJSON-450839619 tempest-AZV2TestJSON-450839619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:47.050020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-377ca979-4e22-402d-b0fd-fe364b72cb37 tempest-AZV2TestJSON-450839619 tempest-AZV2TestJSON-450839619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:47.050532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-377ca979-4e22-402d-b0fd-fe364b72cb37 tempest-AZV2TestJSON-450839619 tempest-AZV2TestJSON-450839619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:47.053493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-377ca979-4e22-402d-b0fd-fe364b72cb37 tempest-AZV2TestJSON-450839619 tempest-AZV2TestJSON-450839619-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:47.055510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-377ca979-4e22-402d-b0fd-fe364b72cb37 tempest-AZV2TestJSON-450839619 tempest-AZV2TestJSON-450839619-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:47.056426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-377ca979-4e22-402d-b0fd-fe364b72cb37 tempest-AZV2TestJSON-450839619 tempest-AZV2TestJSON-450839619-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:47.104001 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-377ca979-4e22-402d-b0fd-fe364b72cb37 tempest-AZV2TestJSON-450839619 tempest-AZV2TestJSON-450839619-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.137737 Aug 06 21:03:47.110950 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1234/2457] 10.222.0.33 () {58 vars in 1164 bytes} [Sat Aug 6 21:03:46 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:03:47.120154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-179687097"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:47.121939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:47.133992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:47.134983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:47.135766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:47.136659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:47.137711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:47.138431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:47.440683 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.network.security_group_api [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Removing security group 390f9777-618b-4120-b3d2-b14f15aea186 from port 807fd1e4-c6e0-413e-bbdd-03813d524083 Aug 06 21:03:48.053146 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-417ad7e2-a5cf-465b-9887-4f8609369d02 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action" status: 202 len: 0 microversion: 2.1 time: 0.939379 Aug 06 21:03:48.054990 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1235/2458] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:03:47 2022] POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:03:48.067059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ab703cdd-cd6e-4e94-8f59-26a292de4f2d req-bbe94ed9-a3d8-499f-ac88-c4079bec2d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e12f01f-d078-4fac-85a3-d0a65a81eb77", "tag": "807fd1e4-c6e0-413e-bbdd-03813d524083"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:48.084050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ab703cdd-cd6e-4e94-8f59-26a292de4f2d req-bbe94ed9-a3d8-499f-ac88-c4079bec2d24 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:48.085396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ab703cdd-cd6e-4e94-8f59-26a292de4f2d req-bbe94ed9-a3d8-499f-ac88-c4079bec2d24 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:48.086040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ab703cdd-cd6e-4e94-8f59-26a292de4f2d req-bbe94ed9-a3d8-499f-ac88-c4079bec2d24 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:48.108515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:48.113202 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ab703cdd-cd6e-4e94-8f59-26a292de4f2d req-bbe94ed9-a3d8-499f-ac88-c4079bec2d24 service nova] Creating event network-changed:807fd1e4-c6e0-413e-bbdd-03813d524083 for instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 on nch2-master-1 Aug 06 21:03:48.126207 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ab703cdd-cd6e-4e94-8f59-26a292de4f2d req-bbe94ed9-a3d8-499f-ac88-c4079bec2d24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069637 Aug 06 21:03:48.127600 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1236/2459] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:48.136262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-151001455", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "10fb936a-e68f-49ec-810f-9ce8e1dcd3b4"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:48.142097 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1b927e14-7f08-4c5f-bdd0-a6495ea8bfae tempest-FloatingIPDetailsTestJSON-245925640 tempest-FloatingIPDetailsTestJSON-245925640-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/9508fe28-12d8-4fbe-ad2f-cb7d1b101b15" status: 202 len: 0 microversion: 2.1 time: 1.513065 Aug 06 21:03:48.143272 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1224/2460] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:03:46 2022] DELETE /compute/v2.1/os-floating-ips/9508fe28-12d8-4fbe-ad2f-cb7d1b101b15 => generated 0 bytes in 1515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:03:48.157417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:48.159260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:48.170880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:48.171725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:48.172250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:48.173042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:48.173718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:48.174244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:48.227144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] validate_networks() for [('10fb936a-e68f-49ec-810f-9ce8e1dcd3b4', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:03:49.186087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:49.196200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:49.197919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:49.199142 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f67f37f3-d53e-4f5b-8dba-c29d95fa92d0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1858 microversion: 2.32 time: 1.054280 Aug 06 21:03:49.214608 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1225/2461] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:48 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1858 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:49.220552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c61f20f0-2172-470a-8011-bd5e95d992a6 req-20f1dfb2-78a8-4718-9857-089f7d570c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99066d99-3223-454e-a11e-eac4c8b2b39c", "tag": "1227f92a-3f4c-4021-a7c1-3435e595d3c5"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:49.232580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c61f20f0-2172-470a-8011-bd5e95d992a6 req-20f1dfb2-78a8-4718-9857-089f7d570c05 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:49.233235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c61f20f0-2172-470a-8011-bd5e95d992a6 req-20f1dfb2-78a8-4718-9857-089f7d570c05 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:49.233904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c61f20f0-2172-470a-8011-bd5e95d992a6 req-20f1dfb2-78a8-4718-9857-089f7d570c05 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:49.248656 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c61f20f0-2172-470a-8011-bd5e95d992a6 req-20f1dfb2-78a8-4718-9857-089f7d570c05 service nova] Creating event network-changed:1227f92a-3f4c-4021-a7c1-3435e595d3c5 for instance 99066d99-3223-454e-a11e-eac4c8b2b39c on nch1-master-1 Aug 06 21:03:49.253916 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c61f20f0-2172-470a-8011-bd5e95d992a6 req-20f1dfb2-78a8-4718-9857-089f7d570c05 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037729 Aug 06 21:03:49.254526 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1226/2462] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:49.260047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:49.260931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:49.268511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:49.269274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:49.270026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:49.270738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:49.271357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:49.272012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:49.567912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:49.591280 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7715fa64-5374-4384-8720-a9949b217732 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1198 microversion: 2.1 time: 0.333486 Aug 06 21:03:49.592569 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1227/2463] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:49 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1198 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:49.599125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-03a8e7b3-5c9e-4c58-8610-506baa64b754 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Action: 'create', calling method: .version_select at 0x7f729d6bb1f0>, body: {"pool": null} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:49.742094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:03:49.743350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:03:49.745300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:03:49.746171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:03:49.747311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:03:49.765939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:49.766441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:49.766909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:49.767843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:49.768456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:49.769049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:49.792976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Getting quotas for project 2c6626cd5e8e4669a5ccb84df569d140. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:03:49.800030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Getting quotas for user 721aed6cddeb46cf9d8f33deaf6e5b8b and project 2c6626cd5e8e4669a5ccb84df569d140. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:03:49.820333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:03:49.833471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:03:49.941283 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d3c653a8-1906-4a45-8dcd-97aadc64bf80 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.812163 Aug 06 21:03:49.949173 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1237/2464] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:03:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:03:49.969700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-babbb097-575e-4ea5-a503-481e4a870426 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:49.974382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-babbb097-575e-4ea5-a503-481e4a870426 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:50.067717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-babbb097-575e-4ea5-a503-481e4a870426 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:50.078249 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-babbb097-575e-4ea5-a503-481e4a870426 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 200 len: 1223 microversion: 2.1 time: 0.126458 Aug 06 21:03:50.079779 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1238/2465] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:49 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 1223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:50.160001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d7bf1e01-50c0-412c-973b-66acdf4ea5ba req-8f9623c3-348e-4c5f-be1c-4e14bde3e25b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "tag": "74538f9f-74be-4eb8-a576-48c3c9114977"}, {"name": "network-changed", "server_uuid": "1e12f01f-d078-4fac-85a3-d0a65a81eb77", "tag": "807fd1e4-c6e0-413e-bbdd-03813d524083"}, {"name": "network-changed", "server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "tag": "4b549598-76da-47be-a95e-a307e09cc4a4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:50.176266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7bf1e01-50c0-412c-973b-66acdf4ea5ba req-8f9623c3-348e-4c5f-be1c-4e14bde3e25b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:50.177275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7bf1e01-50c0-412c-973b-66acdf4ea5ba req-8f9623c3-348e-4c5f-be1c-4e14bde3e25b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:50.177979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7bf1e01-50c0-412c-973b-66acdf4ea5ba req-8f9623c3-348e-4c5f-be1c-4e14bde3e25b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:50.200742 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d7bf1e01-50c0-412c-973b-66acdf4ea5ba req-8f9623c3-348e-4c5f-be1c-4e14bde3e25b service nova] Creating event network-changed:74538f9f-74be-4eb8-a576-48c3c9114977 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:03:50.201788 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d7bf1e01-50c0-412c-973b-66acdf4ea5ba req-8f9623c3-348e-4c5f-be1c-4e14bde3e25b service nova] Creating event network-changed:807fd1e4-c6e0-413e-bbdd-03813d524083 for instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 on nch2-master-1 Aug 06 21:03:50.202719 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d7bf1e01-50c0-412c-973b-66acdf4ea5ba req-8f9623c3-348e-4c5f-be1c-4e14bde3e25b service nova] Creating event network-changed:4b549598-76da-47be-a95e-a307e09cc4a4 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:03:50.217866 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d7bf1e01-50c0-412c-973b-66acdf4ea5ba req-8f9623c3-348e-4c5f-be1c-4e14bde3e25b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.062779 Aug 06 21:03:50.235292 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1239/2466] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:50.271005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:50.275172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:50.289947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:50.290564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:50.291244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:50.293161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:50.294072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:50.294820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:50.852188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:50.868697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:50.870529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:50.876015 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8cac243b-af87-4bcc-9bc7-18e44c42dc52 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.636452 Aug 06 21:03:50.876946 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1240/2467] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:50 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:50.881727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:50.891505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:50.904738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:50.905564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:50.907132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:50.909383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:50.910113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:50.914620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:51.352487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:51.362918 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a56cbcf2-292b-4a25-9f3f-9e8e2ed28332 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1198 microversion: 2.1 time: 0.484558 Aug 06 21:03:51.364517 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1241/2468] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:50 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1198 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:51.369467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:51.371925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:51.384649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:51.390143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:51.391258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:51.392387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:51.393746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:51.396060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:51.541504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:51.553973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f3754138-4358-4db4-a7de-c1fcc2afd0e0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 200 len: 1283 microversion: 2.1 time: 0.187758 Aug 06 21:03:51.555422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1242/2469] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:51 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 1283 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:51.904157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:51.905448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:51.920508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:51.921102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:51.922319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:51.923242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:51.924050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:51.925577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:52.696194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:52.714356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:52.717858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:52.720147 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4a330883-cea0-448d-9d8c-4bcb127873f6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.821770 Aug 06 21:03:52.721296 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1243/2470] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:51 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:52.741941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:52.743059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:52.752168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:52.753029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:52.754074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:52.756006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:52.757270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:52.758214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:52.806767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:53.065371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:53.078849 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-07e8b5a9-73d3-49db-87a1-9fc7db75921d tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1198 microversion: 2.1 time: 0.354012 Aug 06 21:03:53.082760 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1244/2471] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:52 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1198 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:53.109305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1f83b600-0452-4d7f-9451-bc319ebb49da req-f1eb9ac9-e693-4610-8d6e-abb58e5c29e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "tag": "553098be-3b2e-4727-8f30-41b881e3dded"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:53.139002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1f83b600-0452-4d7f-9451-bc319ebb49da req-f1eb9ac9-e693-4610-8d6e-abb58e5c29e8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:53.140444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1f83b600-0452-4d7f-9451-bc319ebb49da req-f1eb9ac9-e693-4610-8d6e-abb58e5c29e8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:53.141577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1f83b600-0452-4d7f-9451-bc319ebb49da req-f1eb9ac9-e693-4610-8d6e-abb58e5c29e8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:53.163914 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1f83b600-0452-4d7f-9451-bc319ebb49da req-f1eb9ac9-e693-4610-8d6e-abb58e5c29e8 service nova] Creating event network-changed:553098be-3b2e-4727-8f30-41b881e3dded for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:03:53.171184 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1f83b600-0452-4d7f-9451-bc319ebb49da req-f1eb9ac9-e693-4610-8d6e-abb58e5c29e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074440 Aug 06 21:03:53.172640 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1245/2472] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:53.179018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:53.179920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:53.191242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:53.192282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:53.193162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:53.194122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:53.194654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:53.195263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:53.392228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:53.401943 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b40a703a-4e3b-41a5-847e-29bec9cf80ae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 200 len: 1281 microversion: 2.1 time: 0.227897 Aug 06 21:03:53.422632 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1246/2473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:53 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 1281 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:53.746054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:53.746796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:53.764268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:53.764972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:53.765940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:53.766767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:53.770185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:53.773500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:53.794765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:53.914326 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-03a8e7b3-5c9e-4c58-8610-506baa64b754 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.319769 Aug 06 21:03:53.919071 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1228/2474] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:03:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:53.935958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Action: 'action', calling method: .version_select at 0x7f72a07c1c10>, body: {"addFloatingIp": {"address": "172.35.4.212"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:53.938912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:53.946273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:53.947094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:53.947766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:53.948763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:53.950134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:53.951202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:54.039027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "refresh_cache-1e12f01f-d078-4fac-85a3-d0a65a81eb77" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:03:54.039667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquired lock "refresh_cache-1e12f01f-d078-4fac-85a3-d0a65a81eb77" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:03:54.543987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:54.561069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:54.563335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:54.564746 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cd244ea0-1e95-4d03-9807-0239f8770b02 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.824146 Aug 06 21:03:54.566311 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1247/2475] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:53 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:54.584736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:54.585686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:54.599047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:54.599634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:54.600226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:54.602661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:54.603168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:54.604017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:55.094197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:55.104586 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb0ce876-d8b7-4d1b-8f4d-c5aeadfdb471 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1198 microversion: 2.1 time: 0.536959 Aug 06 21:03:55.106977 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1248/2476] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:54 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1198 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:55.112102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:55.112879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:55.119800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:55.120472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:55.121092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:55.122749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:55.123373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:55.123972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:55.623632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:55.651459 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f7d86ff-c9bd-45d4-8783-f8ae2046fa6b tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 200 len: 1323 microversion: 2.1 time: 0.542753 Aug 06 21:03:55.655821 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1249/2477] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:55 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 1323 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:55.674349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-31f1aaab-e20c-4738-9c8a-5450199bb256 req-a6d07fa8-dc7f-4a89-96ff-b221c927c3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99066d99-3223-454e-a11e-eac4c8b2b39c", "name": "network-vif-plugged", "status": "completed", "tag": "1227f92a-3f4c-4021-a7c1-3435e595d3c5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:55.701184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-31f1aaab-e20c-4738-9c8a-5450199bb256 req-a6d07fa8-dc7f-4a89-96ff-b221c927c3c5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:55.701607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-31f1aaab-e20c-4738-9c8a-5450199bb256 req-a6d07fa8-dc7f-4a89-96ff-b221c927c3c5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:55.702058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-31f1aaab-e20c-4738-9c8a-5450199bb256 req-a6d07fa8-dc7f-4a89-96ff-b221c927c3c5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:55.735550 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-31f1aaab-e20c-4738-9c8a-5450199bb256 req-a6d07fa8-dc7f-4a89-96ff-b221c927c3c5 service nova] Creating event network-vif-plugged:1227f92a-3f4c-4021-a7c1-3435e595d3c5 for instance 99066d99-3223-454e-a11e-eac4c8b2b39c on nch1-master-1 Aug 06 21:03:55.753169 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-31f1aaab-e20c-4738-9c8a-5450199bb256 req-a6d07fa8-dc7f-4a89-96ff-b221c927c3c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092322 Aug 06 21:03:55.755366 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1250/2478] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:55.763428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ca4201f8-109b-41a0-991b-48d630389ca9 req-d4134823-a7f8-4f0f-8276-082e1df1f9de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "tag": "704b305d-9ef8-4035-989e-bd611601a7f3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:55.777174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ca4201f8-109b-41a0-991b-48d630389ca9 req-d4134823-a7f8-4f0f-8276-082e1df1f9de service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:55.778504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ca4201f8-109b-41a0-991b-48d630389ca9 req-d4134823-a7f8-4f0f-8276-082e1df1f9de service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:55.779008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ca4201f8-109b-41a0-991b-48d630389ca9 req-d4134823-a7f8-4f0f-8276-082e1df1f9de service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:55.796296 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ca4201f8-109b-41a0-991b-48d630389ca9 req-d4134823-a7f8-4f0f-8276-082e1df1f9de service nova] Creating event network-changed:704b305d-9ef8-4035-989e-bd611601a7f3 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:03:55.802268 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ca4201f8-109b-41a0-991b-48d630389ca9 req-d4134823-a7f8-4f0f-8276-082e1df1f9de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044925 Aug 06 21:03:55.803904 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1251/2479] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:55.810403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:55.811405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:55.819959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:55.821390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:55.822208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:55.825514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:55.826247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:55.826935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:56.732727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:56.755169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:56.757244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:56.760175 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d801b285-7afa-4917-a13d-03b903e02f0a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.954450 Aug 06 21:03:56.761026 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1252/2480] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:55 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:56.784634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-57c6a4a2-d88f-4477-86c6-01700f9706b8 req-67a0a9ba-8ae6-4a7b-bfab-55261947e204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5dbda8-dffe-45c4-9f4a-218908b4bf20", "tag": "ee6576de-0083-466c-b097-9591f714edf2"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:56.786777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Building network info cache for instance {{(pid=142461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:03:56.812168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-57c6a4a2-d88f-4477-86c6-01700f9706b8 req-67a0a9ba-8ae6-4a7b-bfab-55261947e204 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:56.812566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-57c6a4a2-d88f-4477-86c6-01700f9706b8 req-67a0a9ba-8ae6-4a7b-bfab-55261947e204 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:56.813185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-57c6a4a2-d88f-4477-86c6-01700f9706b8 req-67a0a9ba-8ae6-4a7b-bfab-55261947e204 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:56.834168 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-57c6a4a2-d88f-4477-86c6-01700f9706b8 req-67a0a9ba-8ae6-4a7b-bfab-55261947e204 service nova] Creating event network-changed:ee6576de-0083-466c-b097-9591f714edf2 for instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 on nch2-master-1 Aug 06 21:03:56.852279 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-57c6a4a2-d88f-4477-86c6-01700f9706b8 req-67a0a9ba-8ae6-4a7b-bfab-55261947e204 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071233 Aug 06 21:03:56.853327 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1253/2481] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:56.860589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:56.861581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:56.870304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:56.871011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:56.872181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:56.873077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:56.873701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:56.874293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:57.304153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:57.393429 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-75f22f87-330e-414a-af58-6b25db0d96ec tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1198 microversion: 2.1 time: 0.467003 Aug 06 21:03:57.397128 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1254/2482] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:56 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1198 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:57.423219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:57.428150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:57.446939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:57.454298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:57.455934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:57.457341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:57.460941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:57.461426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:57.977440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Updating instance_info_cache with network_info: [{"id": "807fd1e4-c6e0-413e-bbdd-03813d524083", "address": "fa:16:3e:fa:ff:73", "network": {"id": "cb422495-4cda-47dc-a05e-7fa8dcfe41b0", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-469722794-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce57444bd40e42f4bf88177067f756b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap807fd1e4-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:03:57.989338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:58.001056 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9730a42d-a8d1-4b00-aebd-049796585ad0 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 200 len: 1323 microversion: 2.1 time: 0.597266 Aug 06 21:03:58.004024 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1255/2483] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:57 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 1323 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:03:58.007537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Releasing lock "refresh_cache-1e12f01f-d078-4fac-85a3-d0a65a81eb77" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:03:58.008437 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8037b95a-e14f-4897-9259-9423738de3db tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action" status: 202 len: 0 microversion: 2.1 time: 4.084388 Aug 06 21:03:58.009054 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1229/2484] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:03:53 2022] POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action => generated 0 bytes in 4086 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 06 21:03:58.022032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Action: 'action', calling method: .version_select at 0x7f72a07c1af0>, body: {"removeFloatingIp": {"address": "172.35.4.212"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:58.034577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:58.035365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:58.056238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:58.057159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:58.057613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:58.058507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:58.059191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:58.061674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:58.315911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:58.321354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:58.343016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:58.343530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:58.344056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:58.344791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:58.345445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:58.346090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:58.719749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:58.736090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:58.739692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:58.741984 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-90897925-bbf5-4384-a0ed-0cb13ae0892c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.721037 Aug 06 21:03:58.744974 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1256/2485] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:03:58 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:03:58.753697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-0603a075-461a-4ff6-be9f-745c5eedf32a req-c1a943e4-c883-49fb-bf16-51fa1f73d08b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "tag": "3767dba4-c6b1-4af4-9bad-afbb01fd063a"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:03:58.779141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0603a075-461a-4ff6-be9f-745c5eedf32a req-c1a943e4-c883-49fb-bf16-51fa1f73d08b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:58.780090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0603a075-461a-4ff6-be9f-745c5eedf32a req-c1a943e4-c883-49fb-bf16-51fa1f73d08b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:58.782041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0603a075-461a-4ff6-be9f-745c5eedf32a req-c1a943e4-c883-49fb-bf16-51fa1f73d08b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:58.800019 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-0603a075-461a-4ff6-be9f-745c5eedf32a req-c1a943e4-c883-49fb-bf16-51fa1f73d08b service nova] Creating event network-changed:3767dba4-c6b1-4af4-9bad-afbb01fd063a for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:03:58.811698 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-0603a075-461a-4ff6-be9f-745c5eedf32a req-c1a943e4-c883-49fb-bf16-51fa1f73d08b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060072 Aug 06 21:03:58.813178 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1257/2486] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:58.821350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:58.830104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:58.831711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Searching by: {'deleted': False, 'project_id': '24244713faa54507b5973eea5083a635'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:03:58.841844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:58.842830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:58.844389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:58.845579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:58.846290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:58.847762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:58.975903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "refresh_cache-1e12f01f-d078-4fac-85a3-d0a65a81eb77" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:03:58.976507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquired lock "refresh_cache-1e12f01f-d078-4fac-85a3-d0a65a81eb77" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:03:58.984770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:03:59.003616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:03:59.069772 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7fd700dc-e4db-469e-9455-505285f22d74 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.254455 Aug 06 21:03:59.071295 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1258/2487] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:03:58 2022] GET /compute/v2.1/servers => generated 333 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:03:59.082898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:03:59.083939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:03:59.092596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:59.093321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:59.093926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:59.094928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:03:59.095641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:03:59.096232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:03:59.855970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:03:59.865138 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f0790888-5863-46a5-a741-19abb4402c34 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1381 microversion: 2.1 time: 0.792502 Aug 06 21:03:59.866090 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1259/2488] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:03:59 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1381 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:00.075192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:00.155237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d7035d0a-9264-4ef4-a948-dffc9073e65e req-59a36364-1bb8-4a4a-b5fa-fce6c53ae7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e12f01f-d078-4fac-85a3-d0a65a81eb77", "tag": "807fd1e4-c6e0-413e-bbdd-03813d524083"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:00.167309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7035d0a-9264-4ef4-a948-dffc9073e65e req-59a36364-1bb8-4a4a-b5fa-fce6c53ae7a1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:00.168130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7035d0a-9264-4ef4-a948-dffc9073e65e req-59a36364-1bb8-4a4a-b5fa-fce6c53ae7a1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:00.169028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7035d0a-9264-4ef4-a948-dffc9073e65e req-59a36364-1bb8-4a4a-b5fa-fce6c53ae7a1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:00.189479 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d7035d0a-9264-4ef4-a948-dffc9073e65e req-59a36364-1bb8-4a4a-b5fa-fce6c53ae7a1 service nova] Creating event network-changed:807fd1e4-c6e0-413e-bbdd-03813d524083 for instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 on nch2-master-1 Aug 06 21:04:00.198056 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d7035d0a-9264-4ef4-a948-dffc9073e65e req-59a36364-1bb8-4a4a-b5fa-fce6c53ae7a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329805 Aug 06 21:04:00.201027 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1260/2489] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:00.209945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:00.211516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:00.219981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:00.221169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:00.221859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:00.222816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:00.223528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:00.224461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:00.491176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:00.506451 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f48c867f-482e-47d2-a9a9-e75ab973b0e8 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 200 len: 1323 microversion: 2.1 time: 0.302248 Aug 06 21:04:00.508058 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1261/2490] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:00 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:00.522464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:00.532221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:00.534331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Searching by: {'deleted': False, 'project_id': '24244713faa54507b5973eea5083a635'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:04:00.555437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:00.557600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:00.558478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:00.560421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:00.562448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:00.565331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:00.639239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:04:00.718309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:00.732543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:00.733336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:00.733948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:00.815606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Building network info cache for instance {{(pid=142461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:04:01.156924 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ebd6c8ad-7144-476d-98a7-474b9a899f81 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.646466 Aug 06 21:04:01.158505 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1262/2491] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:04:00 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:01.173266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:01.173266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:01.188042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:01.190855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:01.191356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:01.192117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:01.194443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:01.196301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:01.638643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:01.654420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:01.656411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:01.663351 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-854f14ee-7f71-49a6-9e13-e5b6775da610 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.502221 Aug 06 21:04:01.664229 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1263/2492] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:01 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:01.672472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a67e6588-08e5-4218-807e-2486e30435c8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:01.680063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a67e6588-08e5-4218-807e-2486e30435c8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:01.694239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a67e6588-08e5-4218-807e-2486e30435c8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:01.695061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a67e6588-08e5-4218-807e-2486e30435c8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:01.695724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a67e6588-08e5-4218-807e-2486e30435c8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:01.696680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a67e6588-08e5-4218-807e-2486e30435c8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:01.697349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a67e6588-08e5-4218-807e-2486e30435c8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:01.697998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a67e6588-08e5-4218-807e-2486e30435c8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:01.808075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Updating instance_info_cache with network_info: [{"id": "807fd1e4-c6e0-413e-bbdd-03813d524083", "address": "fa:16:3e:fa:ff:73", "network": {"id": "cb422495-4cda-47dc-a05e-7fa8dcfe41b0", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-469722794-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ce57444bd40e42f4bf88177067f756b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap807fd1e4-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:04:01.817038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Releasing lock "refresh_cache-1e12f01f-d078-4fac-85a3-d0a65a81eb77" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:04:01.817919 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e9a79e27-2aa9-4c16-a2c8-a63dd7cc15b3 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action" status: 202 len: 0 microversion: 2.1 time: 3.801229 Aug 06 21:04:01.823618 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1230/2493] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:03:58 2022] POST /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77/action => generated 0 bytes in 3808 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 06 21:04:02.014448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3d881374-93bc-428f-91eb-cc408a2558fe req-57cccbbe-25a1-4b32-866a-817ccdd8dfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "tag": "a0f07aff-5b47-47bb-b63d-3dff727efe2d"}, {"name": "network-changed", "server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "tag": "dc2f2a9e-e294-4e5e-bc40-3584c6c59c89"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:02.029079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3d881374-93bc-428f-91eb-cc408a2558fe req-57cccbbe-25a1-4b32-866a-817ccdd8dfb8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:02.029575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3d881374-93bc-428f-91eb-cc408a2558fe req-57cccbbe-25a1-4b32-866a-817ccdd8dfb8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:02.030024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3d881374-93bc-428f-91eb-cc408a2558fe req-57cccbbe-25a1-4b32-866a-817ccdd8dfb8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:02.051723 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3d881374-93bc-428f-91eb-cc408a2558fe req-57cccbbe-25a1-4b32-866a-817ccdd8dfb8 service nova] Creating event network-changed:a0f07aff-5b47-47bb-b63d-3dff727efe2d for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:02.053837 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3d881374-93bc-428f-91eb-cc408a2558fe req-57cccbbe-25a1-4b32-866a-817ccdd8dfb8 service nova] Creating event network-changed:dc2f2a9e-e294-4e5e-bc40-3584c6c59c89 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:02.061884 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3d881374-93bc-428f-91eb-cc408a2558fe req-57cccbbe-25a1-4b32-866a-817ccdd8dfb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.232959 Aug 06 21:04:02.063016 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1231/2494] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:02.069035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd17bc94-f6ec-4bfe-9153-f3f15d6d9543 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:02.086362 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd17bc94-f6ec-4bfe-9153-f3f15d6d9543 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018495 Aug 06 21:04:02.098493 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1232/2495] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:04:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:02.104856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:02.106728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:02.114086 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a67e6588-08e5-4218-807e-2486e30435c8 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1532 microversion: 2.1 time: 0.448549 Aug 06 21:04:02.115090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:02.115584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:02.116021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:02.117015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:02.117477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:02.117992 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1264/2496] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:01 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1532 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:02.118101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:02.138045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-064a8993-998c-432e-bad2-65add46d8ece tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '.version_select at 0x7f72a34ea670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:02.306538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:02.316589 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eee22fbc-9936-42ea-b72a-9f4234972b82 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 200 len: 1323 microversion: 2.1 time: 0.216660 Aug 06 21:04:02.317957 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1233/2497] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:02 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 1323 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:02.401578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-200764a2-dca7-4baf-ab5f-1269482feb3c tempest-ListImageFiltersNegativeTestJSON-1726028926 tempest-ListImageFiltersNegativeTestJSON-1726028926-project] Calling method '.version_select at 0x7f729e28ef70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:02.443067 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-200764a2-dca7-4baf-ab5f-1269482feb3c tempest-ListImageFiltersNegativeTestJSON-1726028926 tempest-ListImageFiltersNegativeTestJSON-1726028926-project] HTTP exception thrown: Image not found. Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-200764a2-dca7-4baf-ab5f-1269482feb3c tempest-ListImageFiltersNegativeTestJSON-1726028926 tempest-ListImageFiltersNegativeTestJSON-1726028926-project] Request method failure captured: Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/images/02b7df66-7942-468b-988a-ad3118638492 HTTP/1.1 Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tdBhrVyiNXA3GmAwuVeKYzdi1MhMfhkjcz_8EeWKg_u1oBwzSY_qlZSXTAB4_wsdMbbqOGiD-CNdk65BY4X14T4IHuWzEQgjz358B9M27twkcQ-ItjEZlEyR-8iD-k1uXt8YVn66osFba57D4mSSbnWZCWQcTaGYYQYFscdTDJjlh8 Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 89c9fc448338409b81bfb23efbd52ed2 Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1726028926 Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:02.447289 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89c9fc448338409b81bfb23efbd52ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89c9fc448338409b81bfb23efbd52ed2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89c9fc448338409b81bfb23efbd52ed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89c9fc448338409b81bfb23efbd52ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1726028926 Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 89c9fc448338409b81bfb23efbd52ed2 Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1726028926 Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ListImageFiltersNegativeTestJSON-1726028926-project Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 797faa6fd1d44cbf8d2ef9176c50b45e Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1726028926-project Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '02b7df66-7942-468b-988a-ad3118638492'} Aug 06 21:04:02.448601 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:04:02.449479 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 02b7df66-7942-468b-988a-ad3118638492 Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:04:02.450609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02b7df66-7942-468b-988a-ad3118638492 could not be found. Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:02.452590 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:02.455917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-200764a2-dca7-4baf-ab5f-1269482feb3c tempest-ListImageFiltersNegativeTestJSON-1726028926 tempest-ListImageFiltersNegativeTestJSON-1726028926-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:02.458659 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-200764a2-dca7-4baf-ab5f-1269482feb3c tempest-ListImageFiltersNegativeTestJSON-1726028926 tempest-ListImageFiltersNegativeTestJSON-1726028926-project] 10.222.0.33 "GET /compute/v2.1/images/02b7df66-7942-468b-988a-ad3118638492" status: 404 len: 62 microversion: 2.1 time: 0.129555 Aug 06 21:04:02.458659 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1234/2498] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:04:02 2022] GET /compute/v2.1/images/02b7df66-7942-468b-988a-ad3118638492 => generated 62 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:04:02.460212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-16effe07-9415-4b64-a6ec-284871c3a5cb req-011a88cc-836a-4ac2-a935-65462f902dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5dbda8-dffe-45c4-9f4a-218908b4bf20", "name": "network-vif-plugged", "status": "completed", "tag": "ee6576de-0083-466c-b097-9591f714edf2"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:02.473791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-16effe07-9415-4b64-a6ec-284871c3a5cb req-011a88cc-836a-4ac2-a935-65462f902dbe service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:02.474223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-16effe07-9415-4b64-a6ec-284871c3a5cb req-011a88cc-836a-4ac2-a935-65462f902dbe service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:02.474892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-16effe07-9415-4b64-a6ec-284871c3a5cb req-011a88cc-836a-4ac2-a935-65462f902dbe service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:02.487535 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-16effe07-9415-4b64-a6ec-284871c3a5cb req-011a88cc-836a-4ac2-a935-65462f902dbe service nova] Creating event network-vif-plugged:ee6576de-0083-466c-b097-9591f714edf2 for instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 on nch2-master-1 Aug 06 21:04:02.494274 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-16effe07-9415-4b64-a6ec-284871c3a5cb req-011a88cc-836a-4ac2-a935-65462f902dbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042618 Aug 06 21:04:02.495363 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1235/2499] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:02.509291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fe688e1-067f-4df8-8824-186a5f9fc971 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:02.510201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3fe688e1-067f-4df8-8824-186a5f9fc971 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:02.518422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fe688e1-067f-4df8-8824-186a5f9fc971 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:02.519667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fe688e1-067f-4df8-8824-186a5f9fc971 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:02.520313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fe688e1-067f-4df8-8824-186a5f9fc971 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:02.521215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fe688e1-067f-4df8-8824-186a5f9fc971 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:02.523836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fe688e1-067f-4df8-8824-186a5f9fc971 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:02.524519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fe688e1-067f-4df8-8824-186a5f9fc971 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:02.944885 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3fe688e1-067f-4df8-8824-186a5f9fc971 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1532 microversion: 2.1 time: 0.448281 Aug 06 21:04:02.952843 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1236/2500] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:02 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1532 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:02.970695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-11975bd3-f1dd-46f7-842f-66c64eb04a98 req-f9a9b34f-cb0e-4bfb-b41e-2d14079635b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e12f01f-d078-4fac-85a3-d0a65a81eb77", "tag": "807fd1e4-c6e0-413e-bbdd-03813d524083"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:02.982881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-11975bd3-f1dd-46f7-842f-66c64eb04a98 req-f9a9b34f-cb0e-4bfb-b41e-2d14079635b7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:02.983654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-11975bd3-f1dd-46f7-842f-66c64eb04a98 req-f9a9b34f-cb0e-4bfb-b41e-2d14079635b7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:02.984303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-11975bd3-f1dd-46f7-842f-66c64eb04a98 req-f9a9b34f-cb0e-4bfb-b41e-2d14079635b7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:02.997416 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-11975bd3-f1dd-46f7-842f-66c64eb04a98 req-f9a9b34f-cb0e-4bfb-b41e-2d14079635b7 service nova] Creating event network-changed:807fd1e4-c6e0-413e-bbdd-03813d524083 for instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 on nch2-master-1 Aug 06 21:04:03.003982 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-11975bd3-f1dd-46f7-842f-66c64eb04a98 req-f9a9b34f-cb0e-4bfb-b41e-2d14079635b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049673 Aug 06 21:04:03.005619 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1237/2501] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:03.015933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:03.016530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:03.024224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:03.025969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:03.027374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:03.029203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:03.030577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:03.031737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:03.080934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:04:03.220043 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5209fa9a-0bf0-4ac6-bcdd-e666cf56f880 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 204 len: 0 microversion: 2.1 time: 0.208711 Aug 06 21:04:03.222957 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1238/2502] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:04:03 2022] DELETE /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:04:03.231130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:03.232190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:03.241294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:03.242103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:03.242892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:03.243760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:03.244372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:03.244985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:03.650185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:03.674775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:03.677837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:03.680834 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e35b1c29-4943-48ef-8542-e4442ec07c64 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.455312 Aug 06 21:04:03.681645 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1239/2503] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:03 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:03.695807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4df8b7d3-1060-4427-b268-aab03141d54a tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:03.700107 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:04:03.700107 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:04:03.710094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4df8b7d3-1060-4427-b268-aab03141d54a tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:03.710744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4df8b7d3-1060-4427-b268-aab03141d54a tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:03.711262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4df8b7d3-1060-4427-b268-aab03141d54a tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:03.712123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4df8b7d3-1060-4427-b268-aab03141d54a tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:03.712653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4df8b7d3-1060-4427-b268-aab03141d54a tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:03.713158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4df8b7d3-1060-4427-b268-aab03141d54a tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:03.765787 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4df8b7d3-1060-4427-b268-aab03141d54a tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.082763 Aug 06 21:04:03.766869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1240/2504] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Aug 6 21:04:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:03.773573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:03.774451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:03.782210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:03.782750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:03.783188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:03.784512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:03.785166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:03.785743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:04.106540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:04.115468 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-26e2c6db-062a-4504-bc3d-39a3ffaa21ec tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1701 microversion: 2.1 time: 0.347266 Aug 06 21:04:04.122317 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1241/2505] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:03 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1701 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:04.134355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:04.137017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:04.153984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:04.154634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:04.154979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:04.160405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:04.160903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:04.161387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:04.377698 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-064a8993-998c-432e-bad2-65add46d8ece tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/a76c478b-0ad7-4e56-9d45-d89a30d1328c" status: 202 len: 0 microversion: 2.1 time: 2.249792 Aug 06 21:04:04.387753 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1265/2506] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:04:02 2022] DELETE /compute/v2.1/os-floating-ips/a76c478b-0ad7-4e56-9d45-d89a30d1328c => generated 0 bytes in 2269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:04.396249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:04.404476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:04.417887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:04.420931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:04.421388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:04.422138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:04.422625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:04.423133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:04.464261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:04.469016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lazy-loading 'flavor' on Instance uuid 99066d99-3223-454e-a11e-eac4c8b2b39c {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:04:04.488139 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-85481c52-e5f5-4b57-8d14-7d8113951aec tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 200 len: 1323 microversion: 2.1 time: 0.364220 Aug 06 21:04:04.491266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Going to try to live migrate instance to nch2-master-1 {{(pid=142462) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 21:04:04.506004 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1242/2507] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:04 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:04.516957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f640ffc-5ecf-490a-92b4-0ceb807b8974 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '.version_select at 0x7f72a35bab80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:04.857266 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f640ffc-5ecf-490a-92b4-0ceb807b8974 tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/390f9777-618b-4120-b3d2-b14f15aea186" status: 202 len: 0 microversion: 2.1 time: 0.349602 Aug 06 21:04:04.857852 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1243/2508] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:04:04 2022] DELETE /compute/v2.1/os-security-groups/390f9777-618b-4120-b3d2-b14f15aea186 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:04.870964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:04.871651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:04.885176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:04.885693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:04.886140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:04.890971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:04.891498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:04.891950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:04.945525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:05.220109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:05.230776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:05.232307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:05.233469 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8add8c64-efd3-4713-9287-f3444f8252ea tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.374628 Aug 06 21:04:05.234029 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1244/2509] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:04 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:05.243803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:05.244660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:05.254719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:05.255686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:05.256166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:05.257081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:05.257702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:05.258363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:05.311464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:04:05.473527 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6bbf3985-c4d1-4c18-a511-b4b4b298376d tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 204 len: 0 microversion: 2.1 time: 0.238014 Aug 06 21:04:05.474136 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1245/2510] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:04:05 2022] DELETE /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:04:05.484872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:05.486248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:05.496795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:05.497989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:05.498816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:05.499904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:05.501339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:05.502002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:05.724477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fbf3973b1d3431f9682be0eb6d8948a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24244713faa54507b5973eea5083a635', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:05.733543 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a07e4eef-ad3f-4fbd-be0a-c4dd3cd4fdd7 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 200 len: 1701 microversion: 2.1 time: 0.257387 Aug 06 21:04:05.759280 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1246/2511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:05 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 1701 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:05.772072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:05.774786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:05.791130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:05.792025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:05.792779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:05.796179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:05.798357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:05.799075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:06.069284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:06.081465 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8dbbade-1e56-4b76-b36f-93065f43302e tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1509 microversion: 2.1 time: 0.320361 Aug 06 21:04:06.082057 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1247/2512] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:05 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:06.098529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:06.099453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:06.123358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:06.124108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:06.124553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:06.125899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:06.126357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:06.126806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:06.348687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:06.358519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-39ebb22d-1535-490d-b0a6-12a8df8269d2 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 200 len: 1520 microversion: 2.1 time: 0.273884 Aug 06 21:04:06.360174 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1248/2513] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:06 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:06.491727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-56f53c39-8f7d-48bc-b39a-b5024b1646c5 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Action: 'create', calling method: .version_select at 0x7f729dc15af0>, body: {"keypair": {"name": "tempest-keypair-1959580876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOcIXtQqiCvfzIMREVaEBWPtyilvnGwW8mfWNIXKVA5pP+TfRc/2opkJbLck856ltg9s+sOGc0Hj1PGBM43QuNya/Sng8FoGZZs0zZVjnnC/l6089h+/xuRPykUa+i6Vw=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:06.509703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-56f53c39-8f7d-48bc-b39a-b5024b1646c5 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Getting quotas for project 609ccfef33a94ae0ab5e082095e7ab1e. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:04:06.516634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-56f53c39-8f7d-48bc-b39a-b5024b1646c5 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Getting quotas for user a7e47a63c2e64d3584e044fae0fe2270 and project 609ccfef33a94ae0ab5e082095e7ab1e. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:04:06.548293 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-56f53c39-8f7d-48bc-b39a-b5024b1646c5 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.186650 Aug 06 21:04:06.551068 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1249/2514] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:04:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:06.583420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:06.584593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:06.596352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:06.597113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:06.597770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:06.598954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:06.599561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:06.600140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:06.903393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:06.940006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:06.942719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:06.950786 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2065c0e2-49a9-49e5-96c8-9fa2f458456b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.396703 Aug 06 21:04:06.954520 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1250/2515] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:06 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:06.963781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.19"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:06.967810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:06.974858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:06.975456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:06.975994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:06.976845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:06.977757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:06.978061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:07.006909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "refresh_cache-44af8cf4-3a6b-4b21-b646-ddf9853f484a" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:04:07.007596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquired lock "refresh_cache-44af8cf4-3a6b-4b21-b646-ddf9853f484a" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:04:09.383567 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c/action" status: 202 len: 0 microversion: 2.1 time: 4.993123 Aug 06 21:04:09.384196 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1266/2516] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:04:04 2022] POST /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c/action => generated 0 bytes in 4996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:09.389811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:09.400943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] [instance: 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:09.409464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:09.409986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:09.410435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:09.411385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:09.411862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:09.412307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:09.452716 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] HTTP exception thrown: Instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 could not be found. Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Request method failure captured: Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 HTTP/1.1 Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tb_nsmQB4yqEkE5B6-DXit_rUIyR4UUdgXLOQ6EdX_7QiatPblNSORURcIbteijdrUO9cYJxqJHvxacURGHEhWbeopHKsMsOl0XX6OZx6zz8jDYlHujvd2D5y876g14qFwYzR0Iz8G3aTKc5tOTYyp36vkURDZmHkWqbOOunPyNJzw Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 24244713faa54507b5973eea5083a635 Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-810119984 Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:04:09.454446 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24244713faa54507b5973eea5083a635"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24244713faa54507b5973eea5083a635", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24244713faa54507b5973eea5083a635"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24244713faa54507b5973eea5083a635"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-810119984 Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 24244713faa54507b5973eea5083a635 Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-810119984 Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-810119984-project Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 5fbf3973b1d3431f9682be0eb6d8948a Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-810119984-project Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 could not be found. Aug 06 21:04:09.455817 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '6e43c4cc-b1bd-44f6-8f63-9ca59bee3892'} Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 could not be found. Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:09.456467 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 could not be found. Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 could not be found. Aug 06 21:04:09.457527 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:09.459231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Returning 404 to user: Instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:09.459231 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0435de0-2b4b-4ae9-a45e-6d7008626278 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892" status: 404 len: 111 microversion: 2.1 time: 0.071540 Aug 06 21:04:09.459231 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1267/2517] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:09 2022] GET /compute/v2.1/servers/6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:04:09.469416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:09.471528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:09.498094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:09.501108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:09.501768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:09.502716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:09.504287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:09.504998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:09.785952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0902f98ad0254cc48ff7e0e5469e8f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce57444bd40e42f4bf88177067f756b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:09.802001 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f85dd19c-3e04-46e3-9520-768d1fce21ac tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 200 len: 1467 microversion: 2.1 time: 0.341012 Aug 06 21:04:09.804043 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1268/2518] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:09 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 1467 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:09.814622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-cfffc8ba-dded-4ed2-9560-3fbba0ffab6b req-f8153210-901e-4421-a4cf-e9f0211c92dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e43c4cc-b1bd-44f6-8f63-9ca59bee3892", "name": "network-vif-deleted", "tag": "c631e495-244d-4a84-ac2c-8aac6c8b7a23"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:09.841455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cfffc8ba-dded-4ed2-9560-3fbba0ffab6b req-f8153210-901e-4421-a4cf-e9f0211c92dc service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:09.848163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cfffc8ba-dded-4ed2-9560-3fbba0ffab6b req-f8153210-901e-4421-a4cf-e9f0211c92dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:09.849935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cfffc8ba-dded-4ed2-9560-3fbba0ffab6b req-f8153210-901e-4421-a4cf-e9f0211c92dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:09.873287 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-cfffc8ba-dded-4ed2-9560-3fbba0ffab6b req-f8153210-901e-4421-a4cf-e9f0211c92dc service nova] Creating event network-vif-deleted:c631e495-244d-4a84-ac2c-8aac6c8b7a23 for instance 6e43c4cc-b1bd-44f6-8f63-9ca59bee3892 on nch1-master-1 Aug 06 21:04:09.911573 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-cfffc8ba-dded-4ed2-9560-3fbba0ffab6b req-f8153210-901e-4421-a4cf-e9f0211c92dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094215 Aug 06 21:04:09.915102 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1269/2519] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:09.941341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:09.942444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:09.950122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:09.950844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:09.951470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:09.952388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:09.953012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:09.953606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:10.164779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Building network info cache for instance {{(pid=142461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:04:10.513062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:10.523473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:10.527949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:10.529411 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-24bdd785-4f1a-488b-98e2-2b2383c0c36a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.612964 Aug 06 21:04:10.536620 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1270/2520] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:09 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:10.547402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:10.548031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:10.562498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:10.566585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:10.567021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:10.567652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:10.568549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:10.569182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:10.569624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:10.581957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:10.715310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:10.986590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:11.013651 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e1012e7d-333c-4d91-b150-acf2103c14e5 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1391 microversion: 2.1 time: 0.475597 Aug 06 21:04:11.014265 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1271/2521] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:10 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1391 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:11.019199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bef05c71-6f89-4506-9dda-982c48a48f92 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] Calling method '.version_select at 0x7f72a36418b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:11.070114 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bef05c71-6f89-4506-9dda-982c48a48f92 tempest-ServersTestJSON-810119984 tempest-ServersTestJSON-810119984-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379976537" status: 202 len: 0 microversion: 2.1 time: 0.054259 Aug 06 21:04:11.070515 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1272/2522] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379976537 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:11.080179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-10554522-018c-4d19-bd05-27b4b32d0288 req-5b204da1-20c7-47d9-98cc-8a8e74aca09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e12f01f-d078-4fac-85a3-d0a65a81eb77", "name": "network-vif-deleted", "tag": "807fd1e4-c6e0-413e-bbdd-03813d524083"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:11.094810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-10554522-018c-4d19-bd05-27b4b32d0288 req-5b204da1-20c7-47d9-98cc-8a8e74aca09b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:11.096567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-10554522-018c-4d19-bd05-27b4b32d0288 req-5b204da1-20c7-47d9-98cc-8a8e74aca09b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:11.097213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-10554522-018c-4d19-bd05-27b4b32d0288 req-5b204da1-20c7-47d9-98cc-8a8e74aca09b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:11.122088 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-10554522-018c-4d19-bd05-27b4b32d0288 req-5b204da1-20c7-47d9-98cc-8a8e74aca09b service nova] Creating event network-vif-deleted:807fd1e4-c6e0-413e-bbdd-03813d524083 for instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 on nch2-master-1 Aug 06 21:04:11.133464 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-10554522-018c-4d19-bd05-27b4b32d0288 req-5b204da1-20c7-47d9-98cc-8a8e74aca09b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057126 Aug 06 21:04:11.134616 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1273/2523] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:11.151757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:11.152594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] [instance: 1e12f01f-d078-4fac-85a3-d0a65a81eb77] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:11.166100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:11.167252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:11.168090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:11.169180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:11.169818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:11.170421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:11.197268 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] HTTP exception thrown: Instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 could not be found. Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Request method failure captured: Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 HTTP/1.1 Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tbz6xGM6NEpB4L4GbmWZ0OULhhMwEzFg3dNJWYJILWaidp2hEqHtFUB-YzQVHa2bIpHtjGxQBoZsGQEFLGCqUdqQ4EXjDOsqaGe22eOuJmTYDboS1oo5_BrmsObr1dchtQcUXHBgvtxt50S3uZQH8BEZgKnFn8Obj3O3dFiigDkSLk Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: ce57444bd40e42f4bf88177067f756b0 Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1260229182 Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:04:11.201216 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce57444bd40e42f4bf88177067f756b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce57444bd40e42f4bf88177067f756b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce57444bd40e42f4bf88177067f756b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce57444bd40e42f4bf88177067f756b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1260229182 Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: ce57444bd40e42f4bf88177067f756b0 Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1260229182 Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerRescueTestJSONUnderV235-1260229182-project Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 0902f98ad0254cc48ff7e0e5469e8f2d Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1260229182-project Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 could not be found. Aug 06 21:04:11.202819 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '1e12f01f-d078-4fac-85a3-d0a65a81eb77'} Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 could not be found. Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:11.203739 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 could not be found. Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 could not be found. Aug 06 21:04:11.205138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:11.206368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] Returning 404 to user: Instance 1e12f01f-d078-4fac-85a3-d0a65a81eb77 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:11.207681 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-34828b14-f465-487b-bcb3-87c1491713be tempest-ServerRescueTestJSONUnderV235-1260229182 tempest-ServerRescueTestJSONUnderV235-1260229182-project] 10.222.0.33 "GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77" status: 404 len: 111 microversion: 2.1 time: 0.069204 Aug 06 21:04:11.210951 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1274/2524] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:11 2022] GET /compute/v2.1/servers/1e12f01f-d078-4fac-85a3-d0a65a81eb77 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:04:11.426281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Updating instance_info_cache with network_info: [{"id": "17cae853-ea36-45e7-9b90-4cf71241cfe6", "address": "fa:16:3e:23:76:42", "network": {"id": "10fb936a-e68f-49ec-810f-9ce8e1dcd3b4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977633459-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2c6626cd5e8e4669a5ccb84df569d140", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap17cae853-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:04:11.462255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Releasing lock "refresh_cache-44af8cf4-3a6b-4b21-b646-ddf9853f484a" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:04:11.463704 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-94a6dbde-95d7-4343-a647-9428357fb4a7 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "POST /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a/action" status: 202 len: 0 microversion: 2.1 time: 4.507724 Aug 06 21:04:11.465930 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1251/2525] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:04:06 2022] POST /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a/action => generated 0 bytes in 4510 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 06 21:04:11.474967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Action: 'action', calling method: .version_select at 0x7f72a09ad8b0>, body: {"addFloatingIp": {"address": "172.35.4.19"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:11.478053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:11.489779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:11.493242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:11.509840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:11.511008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:11.514454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:11.515695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:11.570451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:11.571380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:11.581706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:11.586958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:11.587607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:11.588539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:11.589426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:11.590179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:11.675977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "refresh_cache-dd5dbda8-dffe-45c4-9f4a-218908b4bf20" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:04:11.676785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquired lock "refresh_cache-dd5dbda8-dffe-45c4-9f4a-218908b4bf20" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:04:12.139893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:12.156821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:12.160437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:12.162099 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dac579c0-51c8-4ac4-b3ee-562191782f81 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.599417 Aug 06 21:04:12.165626 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1252/2526] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:11 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:12.172270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:12.173066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:12.188778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:12.189790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:12.190632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:12.191645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:12.192270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:12.192884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:12.465428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:12.479719 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-28c4ddbb-996f-4d3d-8c22-f8292fd853ab tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1391 microversion: 2.1 time: 0.312387 Aug 06 21:04:12.495790 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1253/2527] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:12 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:12.946659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8a3a2214-5b18-4993-9b72-8c4cee168975"}], "security_groups": [{"name": "tempest-securitygroup--57209304"}], "key_name": "tempest-keypair-1959580876", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:13.186959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] validate_networks() for [('8a3a2214-5b18-4993-9b72-8c4cee168975', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:04:13.727999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:14.628546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:04:14.630050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:04:14.631187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:04:14.631773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:04:14.632960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:04:14.657013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:14.659033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:14.659650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:14.661132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:14.661753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:14.662368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:14.701930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Getting quotas for project 609ccfef33a94ae0ab5e082095e7ab1e. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:04:14.712277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Getting quotas for user a7e47a63c2e64d3584e044fae0fe2270 and project 609ccfef33a94ae0ab5e082095e7ab1e. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:04:14.729669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:04:14.733560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:04:14.832316 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-499e6972-2f5a-4ec7-9c0a-72c7951a2d56 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.891685 Aug 06 21:04:14.834877 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1254/2528] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:04:12 2022] POST /compute/v2.1/servers => generated 407 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:04:14.853151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:14.857526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:14.889875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:14.891373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:14.894099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:14.898449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:14.901946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:14.903447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:15.436505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:15.459028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:15.461028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:15.462607 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c9b31b18-3f58-4368-a83d-ac5fbb7494a6 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.626090 Aug 06 21:04:15.478081 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1255/2529] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:14 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:15.485547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-6d334f32-bc78-4a32-80e9-2a8d5b8a7ea3 req-dd11c9d9-5f84-47eb-a44c-5c619d5bd084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44af8cf4-3a6b-4b21-b646-ddf9853f484a", "tag": "17cae853-ea36-45e7-9b90-4cf71241cfe6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:15.510117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6d334f32-bc78-4a32-80e9-2a8d5b8a7ea3 req-dd11c9d9-5f84-47eb-a44c-5c619d5bd084 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:15.511265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6d334f32-bc78-4a32-80e9-2a8d5b8a7ea3 req-dd11c9d9-5f84-47eb-a44c-5c619d5bd084 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:15.512686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6d334f32-bc78-4a32-80e9-2a8d5b8a7ea3 req-dd11c9d9-5f84-47eb-a44c-5c619d5bd084 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:15.545194 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-6d334f32-bc78-4a32-80e9-2a8d5b8a7ea3 req-dd11c9d9-5f84-47eb-a44c-5c619d5bd084 service nova] Creating event network-changed:17cae853-ea36-45e7-9b90-4cf71241cfe6 for instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a on nch2-master-1 Aug 06 21:04:15.561693 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-6d334f32-bc78-4a32-80e9-2a8d5b8a7ea3 req-dd11c9d9-5f84-47eb-a44c-5c619d5bd084 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082159 Aug 06 21:04:15.575163 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1256/2530] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:15.589694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:15.593927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:15.613374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:15.617138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:15.633236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:15.635514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:15.637427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:15.638957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:17.133486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:17.148373 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-885066b7-fac9-44b9-a9de-582e000aaefc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1391 microversion: 2.1 time: 1.571559 Aug 06 21:04:17.149330 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1257/2531] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:15 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1391 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:17.155225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:17.156185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:17.163344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:17.163845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:17.164938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:17.165963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:17.166429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:17.167048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:17.462832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:17.479925 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4cbfcd79-f124-4b9b-9f85-ebd527fac974 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1284 microversion: 2.1 time: 0.329350 Aug 06 21:04:17.482344 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1258/2532] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:17 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1284 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:17.523364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:17.525061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:17.545464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:17.547296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:17.549565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:17.555374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:17.559326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:17.562957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:18.033097 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.network.neutron [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] re-assign floating IP 172.35.4.19 from instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a Aug 06 21:04:18.156304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Building network info cache for instance {{(pid=142462) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:04:18.446852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:18.464908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:18.475150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:18.479497 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1632fa7d-63d0-4094-8c1c-91ffa060e0bc tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.993550 Aug 06 21:04:18.493880 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1259/2533] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:17 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:18.511005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-1bd455bb-3ba9-45fa-89ac-e0c766de947c req-9cc0ee50-07ce-4da4-8d07-cc9adbf8348a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44af8cf4-3a6b-4b21-b646-ddf9853f484a", "tag": "17cae853-ea36-45e7-9b90-4cf71241cfe6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:18.537902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1bd455bb-3ba9-45fa-89ac-e0c766de947c req-9cc0ee50-07ce-4da4-8d07-cc9adbf8348a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:18.543484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1bd455bb-3ba9-45fa-89ac-e0c766de947c req-9cc0ee50-07ce-4da4-8d07-cc9adbf8348a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:18.545802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1bd455bb-3ba9-45fa-89ac-e0c766de947c req-9cc0ee50-07ce-4da4-8d07-cc9adbf8348a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:18.579113 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-1bd455bb-3ba9-45fa-89ac-e0c766de947c req-9cc0ee50-07ce-4da4-8d07-cc9adbf8348a service nova] Creating event network-changed:17cae853-ea36-45e7-9b90-4cf71241cfe6 for instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a on nch2-master-1 Aug 06 21:04:18.599932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-1bd455bb-3ba9-45fa-89ac-e0c766de947c req-9cc0ee50-07ce-4da4-8d07-cc9adbf8348a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099033 Aug 06 21:04:18.601542 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1260/2534] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:18.620270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:18.625892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:18.637995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:18.638579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:18.639034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:18.639934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:18.640640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:18.641707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:18.710964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:19.174883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:19.188744 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1cbbbd0b-437c-4f07-97dc-7c69fcd37f4e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1391 microversion: 2.1 time: 0.582915 Aug 06 21:04:19.189377 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1261/2535] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:18 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1391 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:19.213885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:19.214527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:19.225293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:19.236386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:19.237362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:19.239009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:19.243071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:19.249971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:19.250706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:19.803589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:19.815275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ee4837a-bc58-47ee-845b-481f286226e4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1284 microversion: 2.1 time: 0.615352 Aug 06 21:04:19.833439 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1262/2536] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:19 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1284 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:19.844352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2c60008d-94ce-4609-8a52-c146f3ee22ec req-7eeb75b2-5170-4388-863c-761566500039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99066d99-3223-454e-a11e-eac4c8b2b39c", "name": "network-vif-unplugged", "status": "completed", "tag": "1227f92a-3f4c-4021-a7c1-3435e595d3c5"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:19.878350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2c60008d-94ce-4609-8a52-c146f3ee22ec req-7eeb75b2-5170-4388-863c-761566500039 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:19.879049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2c60008d-94ce-4609-8a52-c146f3ee22ec req-7eeb75b2-5170-4388-863c-761566500039 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:19.879629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2c60008d-94ce-4609-8a52-c146f3ee22ec req-7eeb75b2-5170-4388-863c-761566500039 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:19.932345 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2c60008d-94ce-4609-8a52-c146f3ee22ec req-7eeb75b2-5170-4388-863c-761566500039 service nova] Creating event network-vif-unplugged:1227f92a-3f4c-4021-a7c1-3435e595d3c5 for instance 99066d99-3223-454e-a11e-eac4c8b2b39c on nch1-master-1 Aug 06 21:04:19.941914 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2c60008d-94ce-4609-8a52-c146f3ee22ec req-7eeb75b2-5170-4388-863c-761566500039 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106751 Aug 06 21:04:19.948815 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1263/2537] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:19.958232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:19.962108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:19.979420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:19.981802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:19.982448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:19.984980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:19.986069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:19.989450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:20.548024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:20.557907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:20.560441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:20.561911 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-983ddb3f-e591-4372-bf3f-2e9578ec8fe0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.611559 Aug 06 21:04:20.563069 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1264/2538] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:19 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:20.567822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:20.568695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:20.577186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:20.579777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:20.580506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:20.581357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:20.587477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:20.588248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:21.145199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:21.169902 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8ecdf80-caea-44dd-9795-f41dc12113da tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1391 microversion: 2.1 time: 0.603418 Aug 06 21:04:21.172103 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1265/2539] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:20 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1391 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:21.180903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:21.183643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:21.201797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:21.205273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:21.207434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:21.208823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:21.209950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:21.211986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:21.287127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Updating instance_info_cache with network_info: [{"id": "17cae853-ea36-45e7-9b90-4cf71241cfe6", "address": "fa:16:3e:23:76:42", "network": {"id": "10fb936a-e68f-49ec-810f-9ce8e1dcd3b4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977633459-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2c6626cd5e8e4669a5ccb84df569d140", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap17cae853-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:04:21.297877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Building network info cache for instance {{(pid=142462) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:04:21.340805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:21.352669 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d610a089-ea55-4262-8771-6f553a1ce4a0 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1284 microversion: 2.1 time: 0.177818 Aug 06 21:04:21.353487 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1266/2540] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:21 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:21.366847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-119cee39-323f-4a47-9e9a-7c961f38ab98 req-9deefbf7-c7db-449a-8b7d-5051cb540b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5dbda8-dffe-45c4-9f4a-218908b4bf20", "tag": "ee6576de-0083-466c-b097-9591f714edf2"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:21.392094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-119cee39-323f-4a47-9e9a-7c961f38ab98 req-9deefbf7-c7db-449a-8b7d-5051cb540b69 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:21.395510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-119cee39-323f-4a47-9e9a-7c961f38ab98 req-9deefbf7-c7db-449a-8b7d-5051cb540b69 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:21.398504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-119cee39-323f-4a47-9e9a-7c961f38ab98 req-9deefbf7-c7db-449a-8b7d-5051cb540b69 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:21.430302 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-119cee39-323f-4a47-9e9a-7c961f38ab98 req-9deefbf7-c7db-449a-8b7d-5051cb540b69 service nova] Creating event network-changed:ee6576de-0083-466c-b097-9591f714edf2 for instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 on nch2-master-1 Aug 06 21:04:21.440774 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-119cee39-323f-4a47-9e9a-7c961f38ab98 req-9deefbf7-c7db-449a-8b7d-5051cb540b69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079940 Aug 06 21:04:21.446965 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1267/2541] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:21.491030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:21.589034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:21.591223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:21.610113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:21.613208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:21.614459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:21.615687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:21.616420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:21.618381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:22.213569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:22.246071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:22.253094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:22.256939 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a7bc6e99-5678-4e8e-96ef-e8a8af1e14e5 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.672331 Aug 06 21:04:22.289902 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1268/2542] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:21 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:22.309314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-4cf29078-f9e0-4b76-b442-ca3bb420eede req-b513c59d-6896-41ed-a839-b5cbbe6078ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99066d99-3223-454e-a11e-eac4c8b2b39c", "tag": "1227f92a-3f4c-4021-a7c1-3435e595d3c5"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:22.339298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4cf29078-f9e0-4b76-b442-ca3bb420eede req-b513c59d-6896-41ed-a839-b5cbbe6078ba service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:22.341753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4cf29078-f9e0-4b76-b442-ca3bb420eede req-b513c59d-6896-41ed-a839-b5cbbe6078ba service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:22.342213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4cf29078-f9e0-4b76-b442-ca3bb420eede req-b513c59d-6896-41ed-a839-b5cbbe6078ba service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:22.407073 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-4cf29078-f9e0-4b76-b442-ca3bb420eede req-b513c59d-6896-41ed-a839-b5cbbe6078ba service nova] Creating event network-changed:1227f92a-3f4c-4021-a7c1-3435e595d3c5 for instance 99066d99-3223-454e-a11e-eac4c8b2b39c on nch1-master-1 Aug 06 21:04:22.430757 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-4cf29078-f9e0-4b76-b442-ca3bb420eede req-b513c59d-6896-41ed-a839-b5cbbe6078ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139017 Aug 06 21:04:22.432600 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1269/2543] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:22.474227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:22.477027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:22.505893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:22.506396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:22.511398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:22.512903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:22.516198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:22.516360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:23.128826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:23.175629 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e62ae9a4-eff5-40f7-bd3f-4ce73ddc92ca tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1391 microversion: 2.1 time: 0.723173 Aug 06 21:04:23.196650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Updating instance_info_cache with network_info: [{"id": "ee6576de-0083-466c-b097-9591f714edf2", "address": "fa:16:3e:4b:f8:dd", "network": {"id": "10fb936a-e68f-49ec-810f-9ce8e1dcd3b4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977633459-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2c6626cd5e8e4669a5ccb84df569d140", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee6576de-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:04:23.205441 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1270/2544] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:22 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1391 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:23.211934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:23.221831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Releasing lock "refresh_cache-dd5dbda8-dffe-45c4-9f4a-218908b4bf20" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:04:23.223014 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a9b6e0e5-7730-4b7e-9293-bbe25dade2c5 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "POST /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20/action" status: 202 len: 0 microversion: 2.1 time: 11.753192 Aug 06 21:04:23.223866 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1275/2545] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:04:11 2022] POST /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20/action => generated 0 bytes in 11755 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 06 21:04:23.225630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:23.227695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:23.239133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:23.240313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:23.241152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:23.242160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:23.242949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:23.244131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:23.604111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-86d7ab07-0d32-4ea9-8c66-9b4fecec1488 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f729dd4f5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1311313239", "description": "tempest-description-1184684752"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:23.776475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:23.785447 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f436d902-d49a-4088-9703-a92db21958c4 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1350 microversion: 2.1 time: 0.578490 Aug 06 21:04:23.792359 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1271/2546] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:23 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1350 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:23.806757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.19"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:24.201339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:24.208105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:24.208803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:24.209079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:24.215803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:24.215803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:24.216079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:24.556362 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-86d7ab07-0d32-4ea9-8c66-9b4fecec1488 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.330340 Aug 06 21:04:24.560349 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1276/2547] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:04:23 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:24.572171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:24.578064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:24.592981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:24.597693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:24.599909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:24.601159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:24.602416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:24.603940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:24.683577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:24.722268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:25.068468 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] HTTP exception thrown: Floating IP 172.35.4.19 is not associated with instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a. Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Request method failure captured: Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a/action HTTP/1.1 Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 48 Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tcdpU5oIeXI51bIWxwgeXBWL2pQsmj3dbZEy7mhJXEoyo_W6Z9tJTvkPAkt9ObuqT9Ptn6jBpYtrueqgvldGTFWM4aSoJq12WkPgYvJSse7HhUUamXz2JsstxLH1IHipdf0RUooQAn9mRT02R0XB4Q_1XkdAj7mPVmyx9Bb0Spo_K4 Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 2c6626cd5e8e4669a5ccb84df569d140 Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:25.070366 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2c6626cd5e8e4669a5ccb84df569d140", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 2c6626cd5e8e4669a5ccb84df569d140 Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FloatingIPsAssociationTestJSON-1547435384-project Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 721aed6cddeb46cf9d8f33deaf6e5b8b Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1547435384-project Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: {"removeFloatingIp": {"address": "172.35.4.19"}} Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:04:25.071694 ncdv-master-1 devstack@n-api.service[142461]: exception: Floating IP 172.35.4.19 is not associated with instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a. Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '44af8cf4-3a6b-4b21-b646-ddf9853f484a', 'body': {'removeFloatingIp': {'address': '172.35.4.19'}}} Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.4.19 is not associated with instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a. Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:25.076335 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:25.077584 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:25.077584 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:25.077584 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:25.077584 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:25.077584 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.4.19 is not associated with instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a. Aug 06 21:04:25.077584 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:25.077584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Returning 409 to user: Floating IP 172.35.4.19 is not associated with instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:25.077584 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-88579cec-0bbf-44c9-9ea8-6eebf51c4784 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "POST /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a/action" status: 409 len: 145 microversion: 2.1 time: 1.277887 Aug 06 21:04:25.077584 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1272/2548] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:04:23 2022] POST /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a/action => generated 145 bytes in 1279 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:04:25.124545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:25.158039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:25.166784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:25.169188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-385087163", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": "none"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:25.171014 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f632ecd7-f263-4d5b-ad1b-577384a90603 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.608309 Aug 06 21:04:25.172380 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1277/2549] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:24 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:25.201909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:25.205110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:25.223694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:25.224834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:25.225752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:25.227140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:25.227835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:25.228491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:25.264561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:04:25.265105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:04:25.265762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:04:25.266268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:04:25.266955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:04:25.298471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:25.299514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:25.302872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:25.303886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:25.305660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:25.307510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:25.354976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Getting quotas for project 4e1d1731bd4d4143a97447b303dd5e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:04:25.364857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Getting quotas for user d836c65ccbdb4c52bfbf17291d00c83b and project 4e1d1731bd4d4143a97447b303dd5e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:04:25.382816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:04:25.385500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 9db9b304-51e0-4661-ac0a-d9fe3ec26d11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:04:25.486252 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a95d31fa-b2d6-4a20-993f-581291611f0f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.406020 Aug 06 21:04:25.488602 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1273/2550] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 21:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:04:25.494346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-70ba44b9-fae9-4928-88a1-4e8da22b73c7 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f72a35663a0>, body: {"security_group_rule": {"parent_group_id": "f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:25.756403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:25.768805 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a116debc-8480-4693-b429-58f669de87fd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1391 microversion: 2.1 time: 0.587748 Aug 06 21:04:25.781094 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1278/2551] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:25 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1391 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:25.781094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:25.781094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:25.800487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:25.800996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:25.811306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:25.812179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:25.813018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:25.813719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:26.250649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:26.268622 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9f98445c-ce18-482f-9a02-81f54a299908 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1350 microversion: 2.1 time: 0.496417 Aug 06 21:04:26.269312 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1279/2552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:25 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1350 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:26.287544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Action: 'action', calling method: .version_select at 0x7f72a07c3a60>, body: {"removeFloatingIp": {"address": "172.35.4.19"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:26.631721 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-70ba44b9-fae9-4928-88a1-4e8da22b73c7 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.140981 Aug 06 21:04:26.644597 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1274/2553] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:04:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:26.655913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:26.656874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 9db9b304-51e0-4661-ac0a-d9fe3ec26d11] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:26.666818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:26.667802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:26.669288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:26.671694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:26.673587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:26.675473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:26.963145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:26.973917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:26.975826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:26.979269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:26.983983 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab1d6805-94c6-44be-bd72-e3599b370016 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11" status: 200 len: 1273 microversion: 2.47 time: 0.337837 Aug 06 21:04:26.984574 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1275/2554] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:26 2022] GET /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11 => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:26.997236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-8b02ddf8-0d7a-4ba4-bfe2-535682aa6071 req-3c4c9cd6-f4f2-4a49-a6bd-f63af3a1fd82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff4055b-2061-4a10-a01a-34621eafbb70", "tag": "8c161fe9-da1e-4379-b4eb-c27bbd43db45"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:26.999166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:26.999885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:27.001098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:27.003063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:27.004300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:27.009873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:27.012817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8b02ddf8-0d7a-4ba4-bfe2-535682aa6071 req-3c4c9cd6-f4f2-4a49-a6bd-f63af3a1fd82 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:27.013404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8b02ddf8-0d7a-4ba4-bfe2-535682aa6071 req-3c4c9cd6-f4f2-4a49-a6bd-f63af3a1fd82 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:27.014369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8b02ddf8-0d7a-4ba4-bfe2-535682aa6071 req-3c4c9cd6-f4f2-4a49-a6bd-f63af3a1fd82 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:27.032038 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-8b02ddf8-0d7a-4ba4-bfe2-535682aa6071 req-3c4c9cd6-f4f2-4a49-a6bd-f63af3a1fd82 service nova] Creating event network-changed:8c161fe9-da1e-4379-b4eb-c27bbd43db45 for instance 3ff4055b-2061-4a10-a01a-34621eafbb70 on nch2-master-1 Aug 06 21:04:27.037982 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-8b02ddf8-0d7a-4ba4-bfe2-535682aa6071 req-3c4c9cd6-f4f2-4a49-a6bd-f63af3a1fd82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045120 Aug 06 21:04:27.039075 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1276/2555] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:27.047477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:27.048529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:27.056199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:27.056886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:27.057567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:27.059146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:27.059703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:27.060241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:27.400441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "refresh_cache-dd5dbda8-dffe-45c4-9f4a-218908b4bf20" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:04:27.401521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquired lock "refresh_cache-dd5dbda8-dffe-45c4-9f4a-218908b4bf20" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:04:27.432337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:27.444703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:27.446952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:27.448529 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-23353c2b-7191-487e-8abc-4bd909bcbb4b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.408171 Aug 06 21:04:27.449304 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1277/2556] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:27 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:27.455471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-abf6e911-e65a-4fa4-a7cd-8b9a57915a4c tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f72a351c160>, body: {"security_group_rule": {"parent_group_id": "f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:27.568403 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-abf6e911-e65a-4fa4-a7cd-8b9a57915a4c tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] HTTP exception thrown: This rule already exists in group f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4 Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-abf6e911-e65a-4fa4-a7cd-8b9a57915a4c tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Request method failure captured: Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 138 Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tdWeL6GtISh6y8MrCIyN1UkJUK-oQ8idRBhul7D08j2NiRbMVxJrpx_sIUp4_E0VBldUASKbGNhfJdV6meHQu16SUwPBmvysLzdESilpLveIGnHeyZD9vvOJuXpqv04s2poAYAobWa5C8cD-9AqsydByJ9Ph9-LuMfWj-SKmdCOPVM Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:27.571254 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4566277f215048cb9aaa09c4b3e577e8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: cc790d675b2e4bae8a38e0666f5c9e27 Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: {"security_group_rule": {"parent_group_id": "f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 06 21:04:27.573229 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: exception: This rule already exists in group f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4 Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4 Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:27.574130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4 Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4 Aug 06 21:04:27.576552 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:27.579537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-abf6e911-e65a-4fa4-a7cd-8b9a57915a4c tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Returning 400 to user: This rule already exists in group f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4 {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:27.580688 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-abf6e911-e65a-4fa4-a7cd-8b9a57915a4c tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.130122 Aug 06 21:04:27.581993 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1278/2557] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:04:27 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:04:27.591102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:27.592654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:27.606618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:27.607854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:27.611055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:27.611966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:27.612522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:27.613028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:27.830028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:27.856166 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2079eede-db3c-40d5-8214-59b7e46c4d04 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1391 microversion: 2.1 time: 0.271836 Aug 06 21:04:27.878775 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1279/2558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:27 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1391 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:27.887452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1046527877", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": "none"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:28.007716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:04:28.009033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:04:28.013184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:04:28.014534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:04:28.015430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:04:28.045763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:28.046584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:28.047069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:28.050150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:28.052342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:28.053953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:28.112991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Getting quotas for project 4e1d1731bd4d4143a97447b303dd5e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:04:28.127364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Getting quotas for user d836c65ccbdb4c52bfbf17291d00c83b and project 4e1d1731bd4d4143a97447b303dd5e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:04:28.158888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:04:28.172323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:04:28.259486 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1705136a-fda8-4011-8c4d-740ba5171134 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.377180 Aug 06 21:04:28.260506 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1280/2559] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 21:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:04:28.267193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:28.268408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:28.277863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:28.278910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:28.280709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:28.281430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:28.281907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:28.282365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:28.566242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:28.593174 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c689308b-7dd2-4dbb-856b-1685a9ac594a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1350 microversion: 2.1 time: 0.320314 Aug 06 21:04:28.594941 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1281/2560] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:28 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1350 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:28.616280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa52ddd5-0bb3-4445-aed0-e3596444b028 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Calling method '.version_select at 0x7f729d766f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:29.157587 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa52ddd5-0bb3-4445-aed0-e3596444b028 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/82023306-0569-48d7-8227-34d48d808338" status: 202 len: 0 microversion: 2.1 time: 0.558100 Aug 06 21:04:29.158220 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1282/2561] 10.222.0.33 () {58 vars in 1287 bytes} [Sat Aug 6 21:04:28 2022] DELETE /compute/v2.1/os-security-group-rules/82023306-0569-48d7-8227-34d48d808338 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:29.170807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66f6e249-aa08-4379-bccc-6f839bd1503d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:29.179333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-66f6e249-aa08-4379-bccc-6f839bd1503d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:29.205946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66f6e249-aa08-4379-bccc-6f839bd1503d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:29.209719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66f6e249-aa08-4379-bccc-6f839bd1503d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:29.210201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66f6e249-aa08-4379-bccc-6f839bd1503d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:29.211446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66f6e249-aa08-4379-bccc-6f839bd1503d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:29.212932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66f6e249-aa08-4379-bccc-6f839bd1503d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:29.212932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66f6e249-aa08-4379-bccc-6f839bd1503d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:29.251836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Building network info cache for instance {{(pid=142462) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:04:29.291331 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66f6e249-aa08-4379-bccc-6f839bd1503d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "PUT /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 992 microversion: 2.47 time: 0.126956 Aug 06 21:04:29.292087 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1283/2562] 10.222.0.33 () {62 vars in 1297 bytes} [Sat Aug 6 21:04:29 2022] PUT /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 992 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:04:29.305991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:29.305991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:29.310010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:29.310523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:29.311217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:29.311937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:29.312498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:29.312942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:29.660280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:29.700396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:29.707206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:29.718417 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3743e1c8-4188-49c7-9fd8-a2fd4a9e5daa tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.425168 Aug 06 21:04:29.730899 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1284/2563] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:29 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:29.743433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:29.751513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:29.759708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:29.761922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:29.762631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:29.763529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:29.764174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:29.764809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:29.796766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:30.196569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Updating instance_info_cache with network_info: [{"id": "ee6576de-0083-466c-b097-9591f714edf2", "address": "fa:16:3e:4b:f8:dd", "network": {"id": "10fb936a-e68f-49ec-810f-9ce8e1dcd3b4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977633459-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2c6626cd5e8e4669a5ccb84df569d140", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee6576de-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:04:30.221369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Releasing lock "refresh_cache-dd5dbda8-dffe-45c4-9f4a-218908b4bf20" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:04:30.223280 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-557c6f3d-040e-410f-96a4-9184e4382390 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "POST /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20/action" status: 202 len: 0 microversion: 2.1 time: 3.938981 Aug 06 21:04:30.226310 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1280/2564] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:04:26 2022] POST /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20/action => generated 0 bytes in 3956 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 06 21:04:30.234457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00fdb250-1673-47aa-9e58-8a945ad71a5f tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f729d982670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1852945074", "description": "tempest-description-19715874"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:30.236510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:30.258595 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-565ad464-a1b8-4e2b-b93d-63bcfbf5d5c3 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1381 microversion: 2.1 time: 0.512468 Aug 06 21:04:30.273576 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1285/2565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:29 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1381 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:30.282763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-aa992890-3390-49f5-b8f6-03cc99f17eca req-aa74a815-5443-4c65-a496-74ad7e5951bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5dbda8-dffe-45c4-9f4a-218908b4bf20", "tag": "ee6576de-0083-466c-b097-9591f714edf2"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:30.305355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-aa992890-3390-49f5-b8f6-03cc99f17eca req-aa74a815-5443-4c65-a496-74ad7e5951bc service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:30.305842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-aa992890-3390-49f5-b8f6-03cc99f17eca req-aa74a815-5443-4c65-a496-74ad7e5951bc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:30.306342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-aa992890-3390-49f5-b8f6-03cc99f17eca req-aa74a815-5443-4c65-a496-74ad7e5951bc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:30.335969 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-aa992890-3390-49f5-b8f6-03cc99f17eca req-aa74a815-5443-4c65-a496-74ad7e5951bc service nova] Creating event network-changed:ee6576de-0083-466c-b097-9591f714edf2 for instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 on nch2-master-1 Aug 06 21:04:30.342442 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-aa992890-3390-49f5-b8f6-03cc99f17eca req-aa74a815-5443-4c65-a496-74ad7e5951bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067442 Aug 06 21:04:30.343628 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1286/2566] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:30.351326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:30.352825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:30.364132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:30.364894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:30.365700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:30.366717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:30.367487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:30.368389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:30.524522 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-00fdb250-1673-47aa-9e58-8a945ad71a5f tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.296144 Aug 06 21:04:30.534519 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1281/2567] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:04:30 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:30.543066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:30.545093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:30.562379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:30.567519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:30.568053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:30.568884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:30.569365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:30.569838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:30.729985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:30.744002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:30.752177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:30.753911 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-856a35c0-584f-4f64-9b13-02aeca1261da tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1338 microversion: 2.47 time: 0.408544 Aug 06 21:04:30.754739 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1287/2568] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:30 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1338 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:30.760410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:30.766651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:30.788020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:30.788666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:30.796556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:30.798023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:30.798799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:30.799518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:30.861926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:04:30.867708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:30.877543 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3945a093-72cb-474c-8a26-b757635be644 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1350 microversion: 2.1 time: 0.341713 Aug 06 21:04:30.883796 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1282/2569] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:30 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1350 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:30.900961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b78f223-5f46-4dcd-8e62-09d1a8256886 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '.version_select at 0x7f729dc2f1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:30.913970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b78f223-5f46-4dcd-8e62-09d1a8256886 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:30.914602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b78f223-5f46-4dcd-8e62-09d1a8256886 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:30.916142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b78f223-5f46-4dcd-8e62-09d1a8256886 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:30.938439 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b78f223-5f46-4dcd-8e62-09d1a8256886 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1555 microversion: 2.1 time: 0.053132 Aug 06 21:04:30.943427 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1283/2570] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 21:04:30 2022] GET /compute/v2.1/os-migrations => generated 1555 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:30.956641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a541a575-3495-4db4-b7b3-bd97dabb8e81 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f72a34d8430>, body: {"security_group_rule": {"parent_group_id": "7e95ba2a-4529-4368-ad90-03a524982055", "ip_protocol": "tcp", "from_port": 454499928, "to_port": 22}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:31.001706 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8c489855-bf8d-42d1-ba46-5c9aa080149a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 204 len: 0 microversion: 2.1 time: 0.244446 Aug 06 21:04:31.002737 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1288/2571] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:04:30 2022] DELETE /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:04:31.012507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:31.014462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:31.026450 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a541a575-3495-4db4-b7b3-bd97dabb8e81 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] HTTP exception thrown: Invalid port range 454499928:22. Former value cannot be greater than the later Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a541a575-3495-4db4-b7b3-bd97dabb8e81 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Request method failure captured: Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 145 Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tdWeL6GtISh6y8MrCIyN1UkJUK-oQ8idRBhul7D08j2NiRbMVxJrpx_sIUp4_E0VBldUASKbGNhfJdV6meHQu16SUwPBmvysLzdESilpLveIGnHeyZD9vvOJuXpqv04s2poAYAobWa5C8cD-9AqsydByJ9Ph9-LuMfWj-SKmdCOPVM Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:04:31.029992 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4566277f215048cb9aaa09c4b3e577e8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: cc790d675b2e4bae8a38e0666f5c9e27 Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: {"security_group_rule": {"parent_group_id": "7e95ba2a-4529-4368-ad90-03a524982055", "ip_protocol": "tcp", "from_port": 454499928, "to_port": 22}} Aug 06 21:04:31.031763 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid port range 454499928:22. Former value cannot be greater than the later Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7e95ba2a-4529-4368-ad90-03a524982055', 'ip_protocol': 'tcp', 'from_port': 454499928, 'to_port': 22}}} Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 454499928:22. Former value cannot be greater than the later Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:31.032865 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 454499928:22. Former value cannot be greater than the later Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 454499928:22. Former value cannot be greater than the later Aug 06 21:04:31.034267 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.036928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a541a575-3495-4db4-b7b3-bd97dabb8e81 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Returning 400 to user: Invalid port range 454499928:22. Former value cannot be greater than the later {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:31.037513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:31.038242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:31.039430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:31.039818 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a541a575-3495-4db4-b7b3-bd97dabb8e81 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.094688 Aug 06 21:04:31.040605 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1284/2572] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:04:30 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:04:31.041042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:31.041824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:31.042293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:31.055717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3048d369-80e8-4d62-a50a-d8e8a45aca67 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:31.058384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3048d369-80e8-4d62-a50a-d8e8a45aca67 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:31.096215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3048d369-80e8-4d62-a50a-d8e8a45aca67 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:31.100800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3048d369-80e8-4d62-a50a-d8e8a45aca67 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:31.101626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3048d369-80e8-4d62-a50a-d8e8a45aca67 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:31.102798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3048d369-80e8-4d62-a50a-d8e8a45aca67 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:31.104918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3048d369-80e8-4d62-a50a-d8e8a45aca67 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:31.105893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3048d369-80e8-4d62-a50a-d8e8a45aca67 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:31.309660 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3048d369-80e8-4d62-a50a-d8e8a45aca67 tempest-LiveMigrationTest-363032342 tempest-LiveMigrationTest-363032342-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1532 microversion: 2.1 time: 0.266906 Aug 06 21:04:31.310857 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1285/2573] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:31 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1532 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:31.317016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.19"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:31.320121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:31.339024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:31.340494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:31.341574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:31.343166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:31.344077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:31.345294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:31.387448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "refresh_cache-44af8cf4-3a6b-4b21-b646-ddf9853f484a" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:04:31.388223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquired lock "refresh_cache-44af8cf4-3a6b-4b21-b646-ddf9853f484a" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:04:31.389381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:31.399758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:31.401341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:31.403039 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d84b61d8-260c-4447-b346-4a91866354b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.398593 Aug 06 21:04:31.403812 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1289/2574] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:31 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:31.422730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bd62412-855c-4dc6-8f4f-e299319235d7 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f72a3513ee0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1885969041", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:31.428973 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-8bd62412-855c-4dc6-8f4f-e299319235d7 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] HTTP exception thrown: Security group id should be uuid Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bd62412-855c-4dc6-8f4f-e299319235d7 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Request method failure captured: Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 131 Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tdWeL6GtISh6y8MrCIyN1UkJUK-oQ8idRBhul7D08j2NiRbMVxJrpx_sIUp4_E0VBldUASKbGNhfJdV6meHQu16SUwPBmvysLzdESilpLveIGnHeyZD9vvOJuXpqv04s2poAYAobWa5C8cD-9AqsydByJ9Ph9-LuMfWj-SKmdCOPVM Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:31.430668 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4566277f215048cb9aaa09c4b3e577e8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: cc790d675b2e4bae8a38e0666f5c9e27 Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1885969041", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:04:31.431903 ncdv-master-1 devstack@n-api.service[142461]: exception: Security group id should be uuid Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1885969041', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:31.432656 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bd62412-855c-4dc6-8f4f-e299319235d7 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Returning 400 to user: Security group id should be uuid {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:31.434430 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8bd62412-855c-4dc6-8f4f-e299319235d7 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027264 Aug 06 21:04:31.438014 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1290/2575] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:04:31 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:31.643258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-8d457d7d-3626-4a1c-983f-0ecdd4d3246f req-959ff7b3-15c4-421f-bf2a-6703bd5e2868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-plugged", "status": "completed", "tag": "4b549598-76da-47be-a95e-a307e09cc4a4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:31.668157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8d457d7d-3626-4a1c-983f-0ecdd4d3246f req-959ff7b3-15c4-421f-bf2a-6703bd5e2868 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:31.670692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8d457d7d-3626-4a1c-983f-0ecdd4d3246f req-959ff7b3-15c4-421f-bf2a-6703bd5e2868 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:31.671989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8d457d7d-3626-4a1c-983f-0ecdd4d3246f req-959ff7b3-15c4-421f-bf2a-6703bd5e2868 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:31.694380 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-8d457d7d-3626-4a1c-983f-0ecdd4d3246f req-959ff7b3-15c4-421f-bf2a-6703bd5e2868 service nova] Creating event network-vif-plugged:4b549598-76da-47be-a95e-a307e09cc4a4 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:31.701557 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-8d457d7d-3626-4a1c-983f-0ecdd4d3246f req-959ff7b3-15c4-421f-bf2a-6703bd5e2868 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262215 Aug 06 21:04:31.702885 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1291/2576] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:31.709407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:31.710448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:31.781505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:31.783899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:31.784991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:31.786118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:31.786944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:31.787643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:31.843495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:04:31.952220 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9ea6696-677d-47f1-8f76-593c15c37f81 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "DELETE /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 204 len: 0 microversion: 2.1 time: 0.247534 Aug 06 21:04:31.952864 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1292/2577] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:04:31 2022] DELETE /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:04:31.962450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-575fbafa-b307-45be-ad6c-2e774654947b tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f729d68caf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-346019325", "description": "tempest-description-843726917"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:32.182499 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-575fbafa-b307-45be-ad6c-2e774654947b tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.224604 Aug 06 21:04:32.184424 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1293/2578] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:04:31 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:32.190359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:32.191137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:32.201428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:32.201809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:32.202348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:32.203559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:32.204034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:32.204470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:32.292092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:32.302805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:32.304431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:32.305575 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f72c5125-ead3-40dc-b701-a96be35df6a2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1336 microversion: 2.47 time: 0.119761 Aug 06 21:04:32.310933 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1294/2579] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:32 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:32.321451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:32.323097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:32.332607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:32.333325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:32.334156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:32.334927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:32.335387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:32.336527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:32.557110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:32.571933 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71dfaaa7-8330-4762-9d0f-4184faba861c tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1350 microversion: 2.1 time: 0.257376 Aug 06 21:04:32.579469 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1295/2580] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:32 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1350 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:32.585883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:32.586960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:32.596283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:32.597222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:32.598012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:32.599275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:32.600118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:32.600584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:32.974980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:32.988338 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-20094bd8-a3bf-492f-8a7d-cb93b1393748 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1387 microversion: 2.1 time: 0.406885 Aug 06 21:04:32.989013 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1296/2581] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:32 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1387 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:32.994400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b388c53-3a49-4645-a042-4666e78f403b tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f72a3573e50>, body: {"security_group_rule": {"parent_group_id": "0fa2d13a-4e38-44f3-9eea-6c6f1825f280", "ip_protocol": "tempest-999-1731403983", "from_port": 22, "to_port": 22}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:33.047126 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7b388c53-3a49-4645-a042-4666e78f403b tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] HTTP exception thrown: Invalid IP protocol tempest-999-1731403983. Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b388c53-3a49-4645-a042-4666e78f403b tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Request method failure captured: Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 157 Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tdWeL6GtISh6y8MrCIyN1UkJUK-oQ8idRBhul7D08j2NiRbMVxJrpx_sIUp4_E0VBldUASKbGNhfJdV6meHQu16SUwPBmvysLzdESilpLveIGnHeyZD9vvOJuXpqv04s2poAYAobWa5C8cD-9AqsydByJ9Ph9-LuMfWj-SKmdCOPVM Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:33.050371 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4566277f215048cb9aaa09c4b3e577e8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: cc790d675b2e4bae8a38e0666f5c9e27 Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: {"security_group_rule": {"parent_group_id": "0fa2d13a-4e38-44f3-9eea-6c6f1825f280", "ip_protocol": "tempest-999-1731403983", "from_port": 22, "to_port": 22}} Aug 06 21:04:33.051645 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid IP protocol tempest-999-1731403983. Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0fa2d13a-4e38-44f3-9eea-6c6f1825f280', 'ip_protocol': 'tempest-999-1731403983', 'from_port': 22, 'to_port': 22}}} Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1731403983. Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:33.052313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1731403983. Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1731403983. Aug 06 21:04:33.053655 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:33.055402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b388c53-3a49-4645-a042-4666e78f403b tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Returning 400 to user: Invalid IP protocol tempest-999-1731403983. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:33.055402 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b388c53-3a49-4645-a042-4666e78f403b tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.062001 Aug 06 21:04:33.055402 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1297/2582] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:04:32 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:33.061522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:33.062228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:33.064487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:33.072007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:33.072692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:33.073120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:33.073963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:33.074779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:33.075108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:33.307242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:33.317334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:33.319165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:33.320441 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-90b083aa-b6c9-4148-b4b8-0426d1c008b2 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.266307 Aug 06 21:04:33.321238 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1298/2583] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:33 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:33.328718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc5200fa-1606-4514-b0a2-5c384a928531 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f729d68c4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1278118152", "description": "tempest-description-210258321"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:33.609435 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc5200fa-1606-4514-b0a2-5c384a928531 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.286786 Aug 06 21:04:33.610400 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1299/2584] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:04:33 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:33.626074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:33.629035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:33.647584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:33.649733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:33.650516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:33.655871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:33.656667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:33.657788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:33.766111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:33.776446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:33.778509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:33.779889 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74ddcc0e-7f7b-458f-ab23-747dfdc9ffd2 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1336 microversion: 2.47 time: 0.168449 Aug 06 21:04:33.799186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Building network info cache for instance {{(pid=142462) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:04:33.808813 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1300/2585] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:33 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1336 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:33.817243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:33.817931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:33.825683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:33.826189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:33.826724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:33.827468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:33.828159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:33.828587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:34.140365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:34.157032 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-51295365-cec1-4f53-86cd-a4d357cff82d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1350 microversion: 2.1 time: 0.343071 Aug 06 21:04:34.168236 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1301/2586] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:33 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1350 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:34.178311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-613971c0-1e1f-42cb-b478-ad2fcfc6a598 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f72a364b160>, body: {"security_group_rule": {"parent_group_id": "68959470-f675-4768-a8a1-b9d2a0f3133a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:34.340691 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-613971c0-1e1f-42cb-b478-ad2fcfc6a598 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-613971c0-1e1f-42cb-b478-ad2fcfc6a598 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Request method failure captured: Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 138 Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tdWeL6GtISh6y8MrCIyN1UkJUK-oQ8idRBhul7D08j2NiRbMVxJrpx_sIUp4_E0VBldUASKbGNhfJdV6meHQu16SUwPBmvysLzdESilpLveIGnHeyZD9vvOJuXpqv04s2poAYAobWa5C8cD-9AqsydByJ9Ph9-LuMfWj-SKmdCOPVM Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:34.344083 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4566277f215048cb9aaa09c4b3e577e8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: cc790d675b2e4bae8a38e0666f5c9e27 Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: {"security_group_rule": {"parent_group_id": "68959470-f675-4768-a8a1-b9d2a0f3133a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 06 21:04:34.345380 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'security_group_rule': {'parent_group_id': '68959470-f675-4768-a8a1-b9d2a0f3133a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:34.346060 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 06 21:04:34.347520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:34.348840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-613971c0-1e1f-42cb-b478-ad2fcfc6a598 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:34.348840 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-613971c0-1e1f-42cb-b478-ad2fcfc6a598 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.175174 Aug 06 21:04:34.348840 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1302/2587] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:04:34 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:04:34.366087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-plugged", "status": "completed", "tag": "553098be-3b2e-4727-8f30-41b881e3dded"}, {"server_uuid": "3ff4055b-2061-4a10-a01a-34621eafbb70", "name": "network-vif-plugged", "status": "completed", "tag": "8c161fe9-da1e-4379-b4eb-c27bbd43db45"}, {"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-plugged", "status": "completed", "tag": "704b305d-9ef8-4035-989e-bd611601a7f3"}, {"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-plugged", "status": "completed", "tag": "dc2f2a9e-e294-4e5e-bc40-3584c6c59c89"}, {"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-plugged", "status": "completed", "tag": "a0f07aff-5b47-47bb-b63d-3dff727efe2d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:34.381291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:34.382038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:34.383381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:34.404422 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] Creating event network-vif-plugged:553098be-3b2e-4727-8f30-41b881e3dded for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:34.405177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] Creating event network-vif-plugged:8c161fe9-da1e-4379-b4eb-c27bbd43db45 for instance 3ff4055b-2061-4a10-a01a-34621eafbb70 on nch2-master-1 Aug 06 21:04:34.405833 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] Creating event network-vif-plugged:704b305d-9ef8-4035-989e-bd611601a7f3 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:34.406738 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] Creating event network-vif-plugged:dc2f2a9e-e294-4e5e-bc40-3584c6c59c89 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:34.407393 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] Creating event network-vif-plugged:a0f07aff-5b47-47bb-b63d-3dff727efe2d for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:34.418685 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-dd1740ed-6072-4e27-b7c0-ee97c37cf844 req-0c901a16-1958-47d9-8ff9-bcd13276385f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.063666 Aug 06 21:04:34.423831 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1303/2588] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:34.440122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-eb476bbd-e16d-4aa4-9e43-9e4d2f065c9f req-f042a404-40b6-46c7-90d2-27cb0c6d430c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44af8cf4-3a6b-4b21-b646-ddf9853f484a", "tag": "17cae853-ea36-45e7-9b90-4cf71241cfe6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:34.456639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-eb476bbd-e16d-4aa4-9e43-9e4d2f065c9f req-f042a404-40b6-46c7-90d2-27cb0c6d430c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:34.457130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-eb476bbd-e16d-4aa4-9e43-9e4d2f065c9f req-f042a404-40b6-46c7-90d2-27cb0c6d430c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:34.457566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-eb476bbd-e16d-4aa4-9e43-9e4d2f065c9f req-f042a404-40b6-46c7-90d2-27cb0c6d430c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:34.470358 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-eb476bbd-e16d-4aa4-9e43-9e4d2f065c9f req-f042a404-40b6-46c7-90d2-27cb0c6d430c service nova] Creating event network-changed:17cae853-ea36-45e7-9b90-4cf71241cfe6 for instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a on nch2-master-1 Aug 06 21:04:34.476848 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-eb476bbd-e16d-4aa4-9e43-9e4d2f065c9f req-f042a404-40b6-46c7-90d2-27cb0c6d430c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051460 Aug 06 21:04:34.477837 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1304/2589] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:34.486992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:34.487715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:34.510633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:34.511327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:34.512459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:34.513811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:34.515520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:34.515967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:35.025859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:35.036140 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-54c7098f-719c-4d37-8e8c-99fb903f5e86 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1387 microversion: 2.1 time: 0.556964 Aug 06 21:04:35.059171 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1305/2590] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:34 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1387 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:35.066646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:35.070715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:35.089048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:35.094483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:35.095046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:35.098160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:35.098827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:35.099348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:35.143416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:35.802129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:35.819129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:35.821060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:35.822925 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-19ef7adf-5260-47c0-91d9-f060714f10b3 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.760113 Aug 06 21:04:35.824236 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1306/2591] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:35 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:35.829663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-19a5457d-614a-4fe2-b83e-beedb525a04a tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f729d68c3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-931993382", "description": "tempest-description-1531148068"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:36.130054 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-19a5457d-614a-4fe2-b83e-beedb525a04a tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.304587 Aug 06 21:04:36.140735 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1307/2592] 10.222.0.33 () {60 vars in 1180 bytes} [Sat Aug 6 21:04:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:36.153496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:36.154485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:36.165290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.165941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.166394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.167156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.168494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.169634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.239399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:36.249038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:36.250587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:36.251826 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9a6fcd10-b89b-47c9-b021-62dc799983e3 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1357 microversion: 2.47 time: 0.117976 Aug 06 21:04:36.252398 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1308/2593] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:36 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1357 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:36.257146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:36.258037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:36.265920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.266420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.266910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.267778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.268240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.268672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.415787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:36.424924 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0042a1b9-9cb6-453f-9ed4-df944b0a66dc tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1541 microversion: 2.1 time: 0.171491 Aug 06 21:04:36.425522 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1309/2594] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:36 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1541 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:36.430569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:36.431357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:36.437472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.437964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.438409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.439129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.439582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.440003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.580455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:36.588484 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d8969a55-5ba6-44dc-b924-35665cf6cd92 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1387 microversion: 2.1 time: 0.161677 Aug 06 21:04:36.589139 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1310/2595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:36 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1387 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:36.595017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a4f551b-ad88-4fb2-971a-d479cbb1fdda tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f729dadde50>, body: {"security_group_rule": {"parent_group_id": "5311e557-6326-4120-9854-b5de11d9895f", "ip_protocol": "tcp", "from_port": 22, "to_port": 988000739}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:36.643395 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5a4f551b-ad88-4fb2-971a-d479cbb1fdda tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] HTTP exception thrown: Invalid port range 22:988000739. Valid TCP ports should be between 1-65535 Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a4f551b-ad88-4fb2-971a-d479cbb1fdda tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Request method failure captured: Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 145 Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tdWeL6GtISh6y8MrCIyN1UkJUK-oQ8idRBhul7D08j2NiRbMVxJrpx_sIUp4_E0VBldUASKbGNhfJdV6meHQu16SUwPBmvysLzdESilpLveIGnHeyZD9vvOJuXpqv04s2poAYAobWa5C8cD-9AqsydByJ9Ph9-LuMfWj-SKmdCOPVM Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:36.645140 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4566277f215048cb9aaa09c4b3e577e8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: cc790d675b2e4bae8a38e0666f5c9e27 Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: {"security_group_rule": {"parent_group_id": "5311e557-6326-4120-9854-b5de11d9895f", "ip_protocol": "tcp", "from_port": 22, "to_port": 988000739}} Aug 06 21:04:36.646368 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid port range 22:988000739. Valid TCP ports should be between 1-65535 Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5311e557-6326-4120-9854-b5de11d9895f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 988000739}}} Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:988000739. Valid TCP ports should be between 1-65535 Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:36.647127 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:988000739. Valid TCP ports should be between 1-65535 Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:988000739. Valid TCP ports should be between 1-65535 Aug 06 21:04:36.648314 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:36.650004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a4f551b-ad88-4fb2-971a-d479cbb1fdda tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Returning 400 to user: Invalid port range 22:988000739. Valid TCP ports should be between 1-65535 {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:36.650004 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5a4f551b-ad88-4fb2-971a-d479cbb1fdda tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.055864 Aug 06 21:04:36.650004 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1311/2596] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:04:36 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:04:36.654871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:36.657760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:36.665050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.665549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.666698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.667688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.668941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.669557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.754884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:04:36.755528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:04:36.756015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:04:36.756465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:04:36.757041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:04:36.841242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:36.850123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.851417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.851932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.852787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.853313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.853808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.898052 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01a9e384-d2e2-49b4-b932-8277e63beebe tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "POST /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec/action" status: 202 len: 1079 microversion: 2.47 time: 0.247735 Aug 06 21:04:36.899379 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1312/2597] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 21:04:36 2022] POST /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec/action => generated 1079 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 06 21:04:36.906058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-76b879fa-c6c6-4dd9-9fe1-4b5f7a9e7d28 req-f1785464-0b58-4829-8101-658043bd8fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-plugged", "status": "completed", "tag": "74538f9f-74be-4eb8-a576-48c3c9114977"}, {"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-plugged", "status": "completed", "tag": "3767dba4-c6b1-4af4-9bad-afbb01fd063a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:36.940979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-76b879fa-c6c6-4dd9-9fe1-4b5f7a9e7d28 req-f1785464-0b58-4829-8101-658043bd8fe3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:36.942266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-76b879fa-c6c6-4dd9-9fe1-4b5f7a9e7d28 req-f1785464-0b58-4829-8101-658043bd8fe3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:36.943029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-76b879fa-c6c6-4dd9-9fe1-4b5f7a9e7d28 req-f1785464-0b58-4829-8101-658043bd8fe3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:36.972069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Updating instance_info_cache with network_info: [{"id": "17cae853-ea36-45e7-9b90-4cf71241cfe6", "address": "fa:16:3e:23:76:42", "network": {"id": "10fb936a-e68f-49ec-810f-9ce8e1dcd3b4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977633459-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2c6626cd5e8e4669a5ccb84df569d140", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap17cae853-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:04:36.980797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Releasing lock "refresh_cache-44af8cf4-3a6b-4b21-b646-ddf9853f484a" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:04:36.983138 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a1fec65-4bd2-4b33-9c94-440f35b47cae tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "POST /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a/action" status: 202 len: 0 microversion: 2.1 time: 5.669269 Aug 06 21:04:36.983636 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-76b879fa-c6c6-4dd9-9fe1-4b5f7a9e7d28 req-f1785464-0b58-4829-8101-658043bd8fe3 service nova] Creating event network-vif-plugged:74538f9f-74be-4eb8-a576-48c3c9114977 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:36.983761 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1286/2598] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:04:31 2022] POST /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a/action => generated 0 bytes in 5672 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 06 21:04:36.984467 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-76b879fa-c6c6-4dd9-9fe1-4b5f7a9e7d28 req-f1785464-0b58-4829-8101-658043bd8fe3 service nova] Creating event network-vif-plugged:3767dba4-c6b1-4af4-9bad-afbb01fd063a for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:36.990709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-76b879fa-c6c6-4dd9-9fe1-4b5f7a9e7d28 req-f1785464-0b58-4829-8101-658043bd8fe3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089753 Aug 06 21:04:36.991497 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1313/2599] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:36.991930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-89ff7380-f2f9-44e9-acff-b468e83b4b54 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:36.992646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-89ff7380-f2f9-44e9-acff-b468e83b4b54 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:37.001914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3976524f-ca03-425a-b79b-9f7dfa1eb9f8 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Action: 'create', calling method: .version_select at 0x7f72a351cca0>, body: {"security_group_rule": {"parent_group_id": "9d68a75e-99ff-4a13-b467-a51f95c2a5fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:37.003099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89ff7380-f2f9-44e9-acff-b468e83b4b54 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:37.003605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89ff7380-f2f9-44e9-acff-b468e83b4b54 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:37.004056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89ff7380-f2f9-44e9-acff-b468e83b4b54 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:37.004784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89ff7380-f2f9-44e9-acff-b468e83b4b54 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:37.005249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89ff7380-f2f9-44e9-acff-b468e83b4b54 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:37.005920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89ff7380-f2f9-44e9-acff-b468e83b4b54 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:37.031511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-3976524f-ca03-425a-b79b-9f7dfa1eb9f8 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d68a75e-99ff-4a13-b467-a51f95c2a5fd does not exist", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:04:37.032226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.security_group_api [None req-3976524f-ca03-425a-b79b-9f7dfa1eb9f8 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Neutron security group 9d68a75e-99ff-4a13-b467-a51f95c2a5fd not found {{(pid=142461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 06 21:04:37.032865 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3976524f-ca03-425a-b79b-9f7dfa1eb9f8 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] HTTP exception thrown: Security group 9d68a75e-99ff-4a13-b467-a51f95c2a5fd does not exist Aug 06 21:04:37.032865 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-c84a3e7b-83e1-4099-ac1d-c60cfc108f8c'] Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3976524f-ca03-425a-b79b-9f7dfa1eb9f8 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Request method failure captured: Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 138 Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tdWeL6GtISh6y8MrCIyN1UkJUK-oQ8idRBhul7D08j2NiRbMVxJrpx_sIUp4_E0VBldUASKbGNhfJdV6meHQu16SUwPBmvysLzdESilpLveIGnHeyZD9vvOJuXpqv04s2poAYAobWa5C8cD-9AqsydByJ9Ph9-LuMfWj-SKmdCOPVM Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:37.035397 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4566277f215048cb9aaa09c4b3e577e8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: cc790d675b2e4bae8a38e0666f5c9e27 Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: {"security_group_rule": {"parent_group_id": "9d68a75e-99ff-4a13-b467-a51f95c2a5fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 06 21:04:37.036917 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: exception: Security group 9d68a75e-99ff-4a13-b467-a51f95c2a5fd does not exist Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-c84a3e7b-83e1-4099-ac1d-c60cfc108f8c'] Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9d68a75e-99ff-4a13-b467-a51f95c2a5fd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:04:37.037803 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d68a75e-99ff-4a13-b467-a51f95c2a5fd does not exist Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c84a3e7b-83e1-4099-ac1d-c60cfc108f8c'] Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 06 21:04:37.040084 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d68a75e-99ff-4a13-b467-a51f95c2a5fd does not exist Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c84a3e7b-83e1-4099-ac1d-c60cfc108f8c'] Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d68a75e-99ff-4a13-b467-a51f95c2a5fd does not exist Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c84a3e7b-83e1-4099-ac1d-c60cfc108f8c'] Aug 06 21:04:37.041475 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d68a75e-99ff-4a13-b467-a51f95c2a5fd does not exist Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c84a3e7b-83e1-4099-ac1d-c60cfc108f8c'] Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3976524f-ca03-425a-b79b-9f7dfa1eb9f8 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Returning 404 to user: Security group 9d68a75e-99ff-4a13-b467-a51f95c2a5fd does not exist Aug 06 21:04:37.043520 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-c84a3e7b-83e1-4099-ac1d-c60cfc108f8c'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:37.044909 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3976524f-ca03-425a-b79b-9f7dfa1eb9f8 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.041978 Aug 06 21:04:37.050487 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1314/2600] 10.222.0.33 () {60 vars in 1195 bytes} [Sat Aug 6 21:04:36 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:04:37.056554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:37.057752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:37.067259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:37.068052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:37.068682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:37.069575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:37.070255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:37.071031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:37.282661 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-89ff7380-f2f9-44e9-acff-b468e83b4b54 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.297638 Aug 06 21:04:37.283549 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1287/2601] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:04:36 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70/os-interface => generated 285 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:37.289125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:37.289951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:37.315694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:37.316357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:37.316909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:37.317952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:37.318329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:37.318916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:37.435882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:37.447712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:37.456373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:37.458063 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-02a78476-2e3b-4788-8383-c2ea4091f682 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.172892 Aug 06 21:04:37.459805 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1288/2602] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:37 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:37.476237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15819ca2-a5b7-4302-986b-8f5329d371f4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '.version_select at 0x7f72a36a8f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:37.514656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:37.564462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:37.566438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:37.579883 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-83c85278-961a-4ea8-9870-683722a5063e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1879 microversion: 2.32 time: 0.527781 Aug 06 21:04:37.595650 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1315/2603] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:37 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1879 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:37.607900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4c5dc5da-71a4-430a-83a8-13727811e58a tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Calling method '.version_select at 0x7f72a351cf70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:37.671673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-4c5dc5da-71a4-430a-83a8-13727811e58a tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7bab5dd1-55aa-4411-8bc2-715e7f67251b does not exist", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:04:37.675246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.security_group_api [None req-4c5dc5da-71a4-430a-83a8-13727811e58a tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Neutron security group rule 7bab5dd1-55aa-4411-8bc2-715e7f67251b not found {{(pid=142461) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 06 21:04:37.675877 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-4c5dc5da-71a4-430a-83a8-13727811e58a tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] HTTP exception thrown: Security group rule 7bab5dd1-55aa-4411-8bc2-715e7f67251b does not exist Aug 06 21:04:37.675877 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-33eea396-6253-4bc9-a706-6779693bb713'] Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4c5dc5da-71a4-430a-83a8-13727811e58a tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Request method failure captured: Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-security-group-rules/7bab5dd1-55aa-4411-8bc2-715e7f67251b HTTP/1.1 Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tdWeL6GtISh6y8MrCIyN1UkJUK-oQ8idRBhul7D08j2NiRbMVxJrpx_sIUp4_E0VBldUASKbGNhfJdV6meHQu16SUwPBmvysLzdESilpLveIGnHeyZD9vvOJuXpqv04s2poAYAobWa5C8cD-9AqsydByJ9Ph9-LuMfWj-SKmdCOPVM Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:37.683208 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4566277f215048cb9aaa09c4b3e577e8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4566277f215048cb9aaa09c4b3e577e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4566277f215048cb9aaa09c4b3e577e8 Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458 Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: cc790d675b2e4bae8a38e0666f5c9e27 Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: exception: Security group rule 7bab5dd1-55aa-4411-8bc2-715e7f67251b does not exist Aug 06 21:04:37.684800 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-33eea396-6253-4bc9-a706-6779693bb713'] Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7bab5dd1-55aa-4411-8bc2-715e7f67251b'} Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.685631 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7bab5dd1-55aa-4411-8bc2-715e7f67251b does not exist Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33eea396-6253-4bc9-a706-6779693bb713'] Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 06 21:04:37.686849 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7bab5dd1-55aa-4411-8bc2-715e7f67251b does not exist Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33eea396-6253-4bc9-a706-6779693bb713'] Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7bab5dd1-55aa-4411-8bc2-715e7f67251b does not exist Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33eea396-6253-4bc9-a706-6779693bb713'] Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.689411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7bab5dd1-55aa-4411-8bc2-715e7f67251b does not exist Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33eea396-6253-4bc9-a706-6779693bb713'] Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4c5dc5da-71a4-430a-83a8-13727811e58a tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Returning 404 to user: Security group rule 7bab5dd1-55aa-4411-8bc2-715e7f67251b does not exist Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-33eea396-6253-4bc9-a706-6779693bb713'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:37.691164 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4c5dc5da-71a4-430a-83a8-13727811e58a tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/7bab5dd1-55aa-4411-8bc2-715e7f67251b" status: 404 len: 199 microversion: 2.1 time: 0.088450 Aug 06 21:04:37.692017 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1316/2604] 10.222.0.33 () {58 vars in 1287 bytes} [Sat Aug 6 21:04:37 2022] DELETE /compute/v2.1/os-security-group-rules/7bab5dd1-55aa-4411-8bc2-715e7f67251b => generated 199 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:04:37.703815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-cdda241e-b108-42f2-9b54-8d8392d416e0 req-3ed83f96-56ee-434a-8b96-98a8be3b7768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5dbda8-dffe-45c4-9f4a-218908b4bf20", "name": "network-vif-deleted", "tag": "ee6576de-0083-466c-b097-9591f714edf2"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:37.727853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cdda241e-b108-42f2-9b54-8d8392d416e0 req-3ed83f96-56ee-434a-8b96-98a8be3b7768 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:37.731167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cdda241e-b108-42f2-9b54-8d8392d416e0 req-3ed83f96-56ee-434a-8b96-98a8be3b7768 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:37.732020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cdda241e-b108-42f2-9b54-8d8392d416e0 req-3ed83f96-56ee-434a-8b96-98a8be3b7768 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:37.759861 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-cdda241e-b108-42f2-9b54-8d8392d416e0 req-3ed83f96-56ee-434a-8b96-98a8be3b7768 service nova] Creating event network-vif-deleted:ee6576de-0083-466c-b097-9591f714edf2 for instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 on nch2-master-1 Aug 06 21:04:37.773637 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-cdda241e-b108-42f2-9b54-8d8392d416e0 req-3ed83f96-56ee-434a-8b96-98a8be3b7768 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083352 Aug 06 21:04:37.774336 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1317/2605] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:37.788865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:37.789596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:37.804471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:37.805249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:37.806087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:37.807325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:37.808056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:37.808743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:37.925851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:37.938189 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-33cdc661-c3a2-490b-8b10-fac7119b6dfd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 200 len: 1183 microversion: 2.1 time: 0.160453 Aug 06 21:04:37.939062 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1318/2606] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:37 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 1183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:37.946002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f60790ab-e351-4f8e-bc49-9781522fe9a6 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Calling method '.version_select at 0x7f729dadd820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:38.081270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:38.142428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=12 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:38.467826 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15819ca2-a5b7-4302-986b-8f5329d371f4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/7c9d2084-0b51-4729-ac6e-5d5882e37da5" status: 200 len: 184 microversion: 2.1 time: 1.006464 Aug 06 21:04:38.473650 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1289/2607] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:04:37 2022] GET /compute/v2.1/os-floating-ips/7c9d2084-0b51-4729-ac6e-5d5882e37da5 => generated 184 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:38.489612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:38.492201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:38.496403 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f60790ab-e351-4f8e-bc49-9781522fe9a6 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5311e557-6326-4120-9854-b5de11d9895f" status: 202 len: 0 microversion: 2.1 time: 0.555745 Aug 06 21:04:38.497098 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1319/2608] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:04:37 2022] DELETE /compute/v2.1/os-security-groups/5311e557-6326-4120-9854-b5de11d9895f => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:38.506648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:38.507169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:38.508011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.19"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:38.511887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:38.519081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:38.519631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:38.520146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:38.724015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:38.737616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:38.740254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:38.741684 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-543d3f27-f43b-457f-a38b-90aff512ac57 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.261852 Aug 06 21:04:38.758292 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1290/2609] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:38 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:04:38.764214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e7036e14-71f1-43c9-a0cc-a649bde10f46 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Calling method '.version_select at 0x7f729dc8fa60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:38.827662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:38.850805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:38.851633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:38.853057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:38.858390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:38.859158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:38.859807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:39.393897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "refresh_cache-44af8cf4-3a6b-4b21-b646-ddf9853f484a" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:04:39.394638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquired lock "refresh_cache-44af8cf4-3a6b-4b21-b646-ddf9853f484a" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:04:40.031169 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e7036e14-71f1-43c9-a0cc-a649bde10f46 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/68959470-f675-4768-a8a1-b9d2a0f3133a" status: 202 len: 0 microversion: 2.1 time: 1.271583 Aug 06 21:04:40.032305 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1291/2610] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:04:38 2022] DELETE /compute/v2.1/os-security-groups/68959470-f675-4768-a8a1-b9d2a0f3133a => generated 0 bytes in 1273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:40.037539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:40.038308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:40.054992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:40.055791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:40.056390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:40.057271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:40.057875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:40.059293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:40.588165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Building network info cache for instance {{(pid=142461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:04:41.004499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:41.045079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:41.047172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:41.048887 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6e9c8c6d-99cf-4e18-b35e-be5f31ef651a tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2832 microversion: 2.32 time: 1.015107 Aug 06 21:04:41.061607 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1292/2611] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:40 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2832 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:41.070702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:41.073946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 99066d99-3223-454e-a11e-eac4c8b2b39c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:41.082527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:41.083347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:41.083738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:41.084841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:41.085353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:41.086010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:41.130505 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] HTTP exception thrown: Instance 99066d99-3223-454e-a11e-eac4c8b2b39c could not be found. Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Request method failure captured: Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c HTTP/1.1 Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tYX0j76iEqu6L5bjZifjRM57KIOWgJPRS40ebOHT7cznGTvPrxL-dOOy1JBXVtB_wktW5wA1DdO5DCBe95YWK-7uDgmjrWFPghHqx3PbG2eHc4KaPMiC-ykdT07TxEzFfB-5l29pKQ2pECVQEddTutlLym3wVklG8U6lZKiShbwHrA Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: e47f439135a6445fa29c8be6d69c1759 Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-LiveMigrationTest-875310508 Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:04:41.132192 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e47f439135a6445fa29c8be6d69c1759", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-LiveMigrationTest-875310508 Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: e47f439135a6445fa29c8be6d69c1759 Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-LiveMigrationTest-875310508 Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-LiveMigrationTest-875310508-project Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: ad1a96004778407584d1805b07ad1c5f Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-LiveMigrationTest-875310508-project Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 99066d99-3223-454e-a11e-eac4c8b2b39c could not be found. Aug 06 21:04:41.133435 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '99066d99-3223-454e-a11e-eac4c8b2b39c'} Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99066d99-3223-454e-a11e-eac4c8b2b39c could not be found. Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:41.134158 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99066d99-3223-454e-a11e-eac4c8b2b39c could not be found. Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99066d99-3223-454e-a11e-eac4c8b2b39c could not be found. Aug 06 21:04:41.137780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:41.140114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Returning 404 to user: Instance 99066d99-3223-454e-a11e-eac4c8b2b39c could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:41.140114 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72b2315b-ef28-4bbd-87cc-2efbbe704854 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c" status: 404 len: 111 microversion: 2.1 time: 0.076115 Aug 06 21:04:41.140114 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1293/2612] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:41 2022] GET /compute/v2.1/servers/99066d99-3223-454e-a11e-eac4c8b2b39c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:04:41.142034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f90e22f9-5e3f-44e6-af42-8124174b934a req-f88cad2e-f627-4612-848a-7e93c3abd67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff4055b-2061-4a10-a01a-34621eafbb70", "tag": "8c161fe9-da1e-4379-b4eb-c27bbd43db45"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:41.164985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f90e22f9-5e3f-44e6-af42-8124174b934a req-f88cad2e-f627-4612-848a-7e93c3abd67a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:41.165489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f90e22f9-5e3f-44e6-af42-8124174b934a req-f88cad2e-f627-4612-848a-7e93c3abd67a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:41.165926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f90e22f9-5e3f-44e6-af42-8124174b934a req-f88cad2e-f627-4612-848a-7e93c3abd67a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:41.196831 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f90e22f9-5e3f-44e6-af42-8124174b934a req-f88cad2e-f627-4612-848a-7e93c3abd67a service nova] Creating event network-changed:8c161fe9-da1e-4379-b4eb-c27bbd43db45 for instance 3ff4055b-2061-4a10-a01a-34621eafbb70 on nch2-master-1 Aug 06 21:04:41.212465 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f90e22f9-5e3f-44e6-af42-8124174b934a req-f88cad2e-f627-4612-848a-7e93c3abd67a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076325 Aug 06 21:04:41.212918 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1294/2613] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:41.236452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:41.237470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:41.251004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:41.251744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:41.252341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:41.259696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:41.260588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:41.261595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:41.590247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:41.599535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:41.615066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:41.616808 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b06cd373-9b44-454c-81c1-a40f8cc2adaf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.399132 Aug 06 21:04:41.617890 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1295/2614] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:41 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:41.624343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-69fc3407-eb34-49d8-b48f-d1b95a314fbf req-76a9867e-87f5-4a63-8768-ef47a3d5a6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99066d99-3223-454e-a11e-eac4c8b2b39c", "name": "network-vif-deleted", "tag": "1227f92a-3f4c-4021-a7c1-3435e595d3c5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:41.654907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-69fc3407-eb34-49d8-b48f-d1b95a314fbf req-76a9867e-87f5-4a63-8768-ef47a3d5a6a1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:41.655670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-69fc3407-eb34-49d8-b48f-d1b95a314fbf req-76a9867e-87f5-4a63-8768-ef47a3d5a6a1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:41.656275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-69fc3407-eb34-49d8-b48f-d1b95a314fbf req-76a9867e-87f5-4a63-8768-ef47a3d5a6a1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:41.695495 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-69fc3407-eb34-49d8-b48f-d1b95a314fbf req-76a9867e-87f5-4a63-8768-ef47a3d5a6a1 service nova] Creating event network-vif-deleted:1227f92a-3f4c-4021-a7c1-3435e595d3c5 for instance 99066d99-3223-454e-a11e-eac4c8b2b39c on nch2-master-1 Aug 06 21:04:41.701149 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-69fc3407-eb34-49d8-b48f-d1b95a314fbf req-76a9867e-87f5-4a63-8768-ef47a3d5a6a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081796 Aug 06 21:04:41.702195 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1296/2615] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:41.709193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0835400b-db92-4caa-83d6-f5da845483ff tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Calling method '.version_select at 0x7f729dc8f040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:41.962201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Updating instance_info_cache with network_info: [{"id": "17cae853-ea36-45e7-9b90-4cf71241cfe6", "address": "fa:16:3e:23:76:42", "network": {"id": "10fb936a-e68f-49ec-810f-9ce8e1dcd3b4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1977633459-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2c6626cd5e8e4669a5ccb84df569d140", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap17cae853-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:04:41.987432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Releasing lock "refresh_cache-44af8cf4-3a6b-4b21-b646-ddf9853f484a" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:04:41.990112 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-54151c3c-fae0-4649-851b-41703191f6c4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "POST /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a/action" status: 202 len: 0 microversion: 2.1 time: 3.486278 Aug 06 21:04:41.995304 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1320/2616] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:04:38 2022] POST /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a/action => generated 0 bytes in 3493 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 06 21:04:42.003397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2fd811ed-1549-436b-88a5-739f95760ffb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:42.004184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2fd811ed-1549-436b-88a5-739f95760ffb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:42.016661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd811ed-1549-436b-88a5-739f95760ffb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.017952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd811ed-1549-436b-88a5-739f95760ffb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:42.018638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd811ed-1549-436b-88a5-739f95760ffb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:42.020891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd811ed-1549-436b-88a5-739f95760ffb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.021611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd811ed-1549-436b-88a5-739f95760ffb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:42.022270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fd811ed-1549-436b-88a5-739f95760ffb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:42.272948 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2fd811ed-1549-436b-88a5-739f95760ffb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.276066 Aug 06 21:04:42.274432 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1321/2617] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Aug 6 21:04:41 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322/os-interface => generated 1831 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:42.293335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:42.294875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:42.306662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.307134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:42.307611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:42.309738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.310257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:42.310786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:42.369526 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] HTTP exception thrown: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Request method failure captured: Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 HTTP/1.1 Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tcdpU5oIeXI51bIWxwgeXBWL2pQsmj3dbZEy7mhJXEoyo_W6Z9tJTvkPAkt9ObuqT9Ptn6jBpYtrueqgvldGTFWM4aSoJq12WkPgYvJSse7HhUUamXz2JsstxLH1IHipdf0RUooQAn9mRT02R0XB4Q_1XkdAj7mPVmyx9Bb0Spo_K4 Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 2c6626cd5e8e4669a5ccb84df569d140 Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:42.372887 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2c6626cd5e8e4669a5ccb84df569d140", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 2c6626cd5e8e4669a5ccb84df569d140 Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FloatingIPsAssociationTestJSON-1547435384-project Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 721aed6cddeb46cf9d8f33deaf6e5b8b Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1547435384-project Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.374838 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'dd5dbda8-dffe-45c4-9f4a-218908b4bf20'} Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:42.375741 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.377422 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.387576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Returning 404 to user: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:42.389910 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-350952f6-4dd3-44ad-8ae0-2fec8dcf6040 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 404 len: 111 microversion: 2.1 time: 0.112845 Aug 06 21:04:42.391189 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1322/2618] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:04:42 2022] DELETE /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:04:42.434953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:42.436830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: dd5dbda8-dffe-45c4-9f4a-218908b4bf20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:42.454298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.455528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:42.456318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:42.457333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.458111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:42.458798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:42.478362 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] HTTP exception thrown: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Request method failure captured: Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 HTTP/1.1 Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tcdpU5oIeXI51bIWxwgeXBWL2pQsmj3dbZEy7mhJXEoyo_W6Z9tJTvkPAkt9ObuqT9Ptn6jBpYtrueqgvldGTFWM4aSoJq12WkPgYvJSse7HhUUamXz2JsstxLH1IHipdf0RUooQAn9mRT02R0XB4Q_1XkdAj7mPVmyx9Bb0Spo_K4 Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 2c6626cd5e8e4669a5ccb84df569d140 Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:42.482317 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2c6626cd5e8e4669a5ccb84df569d140", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 2c6626cd5e8e4669a5ccb84df569d140 Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FloatingIPsAssociationTestJSON-1547435384-project Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 721aed6cddeb46cf9d8f33deaf6e5b8b Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1547435384-project Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.483951 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'dd5dbda8-dffe-45c4-9f4a-218908b4bf20'} Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:42.484911 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. Aug 06 21:04:42.486122 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:42.490016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Returning 404 to user: Instance dd5dbda8-dffe-45c4-9f4a-218908b4bf20 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:42.491217 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aa35baa2-cd86-4e5e-ad00-e95be35270eb tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20" status: 404 len: 111 microversion: 2.1 time: 0.071904 Aug 06 21:04:42.492825 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1323/2619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:42 2022] GET /compute/v2.1/servers/dd5dbda8-dffe-45c4-9f4a-218908b4bf20 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:04:42.504527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:42.504806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:42.515327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.516163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:42.517302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:42.518491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.519651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:42.520433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:42.572088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:04:42.716723 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f633544-d562-4d42-9d45-f62e49cfa33a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 204 len: 0 microversion: 2.1 time: 0.220728 Aug 06 21:04:42.726609 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1324/2620] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:04:42 2022] DELETE /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:04:42.737557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d77fe589-4c30-418c-ad54-15db0919aa64 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '.version_select at 0x7f72a3489c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:42.969400 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0835400b-db92-4caa-83d6-f5da845483ff tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/0fa2d13a-4e38-44f3-9eea-6c6f1825f280" status: 202 len: 0 microversion: 2.1 time: 1.265684 Aug 06 21:04:42.970228 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1297/2621] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:04:41 2022] DELETE /compute/v2.1/os-security-groups/0fa2d13a-4e38-44f3-9eea-6c6f1825f280 => generated 0 bytes in 1267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:42.978202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:42.978906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:42.993807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.996743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:42.997433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:42.998395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:42.999673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:43.000116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:43.156461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:43.170281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:43.172024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:43.173355 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7d195656-cb39-482e-8982-8c1bccdb0676 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.199447 Aug 06 21:04:43.174162 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1298/2622] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:42 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:43.179239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:43.180113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:43.194835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:43.195618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:43.196315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:43.197120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:43.197664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:43.198176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:43.756462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:43.765453 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d0bb8e9c-4383-4517-a7da-d9b755d77e4f tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1668 microversion: 2.1 time: 0.590011 Aug 06 21:04:43.766185 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1299/2623] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:43 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1668 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:43.771403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a07d48f-1320-4b43-bdf3-16a483514089 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Calling method '.version_select at 0x7f729d92c9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:44.193229 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d77fe589-4c30-418c-ad54-15db0919aa64 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/7c9d2084-0b51-4729-ac6e-5d5882e37da5" status: 202 len: 0 microversion: 2.1 time: 1.461026 Aug 06 21:04:44.198093 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1325/2624] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:04:42 2022] DELETE /compute/v2.1/os-floating-ips/7c9d2084-0b51-4729-ac6e-5d5882e37da5 => generated 0 bytes in 1471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:44.203896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-968cab7c-32dc-4ed1-a109-7240bb6a02fb req-e08c4a0f-ff4c-4bf0-99c6-45d15b04c216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44af8cf4-3a6b-4b21-b646-ddf9853f484a", "tag": "17cae853-ea36-45e7-9b90-4cf71241cfe6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:44.219209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-968cab7c-32dc-4ed1-a109-7240bb6a02fb req-e08c4a0f-ff4c-4bf0-99c6-45d15b04c216 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:44.219766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-968cab7c-32dc-4ed1-a109-7240bb6a02fb req-e08c4a0f-ff4c-4bf0-99c6-45d15b04c216 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:44.220180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-968cab7c-32dc-4ed1-a109-7240bb6a02fb req-e08c4a0f-ff4c-4bf0-99c6-45d15b04c216 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:44.233837 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-968cab7c-32dc-4ed1-a109-7240bb6a02fb req-e08c4a0f-ff4c-4bf0-99c6-45d15b04c216 service nova] Creating event network-changed:17cae853-ea36-45e7-9b90-4cf71241cfe6 for instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a on nch2-master-1 Aug 06 21:04:44.244791 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-968cab7c-32dc-4ed1-a109-7240bb6a02fb req-e08c4a0f-ff4c-4bf0-99c6-45d15b04c216 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044782 Aug 06 21:04:44.245759 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1326/2625] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:44.252309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:44.253166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:44.260489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:44.261030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:44.261934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:44.263215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:44.263966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:44.264720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:44.641861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:44.661402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:44.668167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:44.669967 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6263048f-359d-4713-b8ca-d8f1ed1db217 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.422516 Aug 06 21:04:44.670457 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1327/2626] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:44 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:44.681794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:44.682441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:44.702429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:44.703098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:44.703665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:44.705819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:44.707092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:44.708996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:44.742750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:44.759008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:04:44.875959 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d8e445e-e9dd-49c2-b772-e8f135b2b3e4 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "DELETE /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 204 len: 0 microversion: 2.1 time: 0.202089 Aug 06 21:04:44.877528 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1328/2627] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:04:44 2022] DELETE /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:04:44.885179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:44.887123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:44.897113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:44.897991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:44.898806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:44.900072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:44.900939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:44.901627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:45.106431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:45.115984 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-98069440-888b-4d7a-8c9f-4f709325a433 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1668 microversion: 2.1 time: 0.236528 Aug 06 21:04:45.116806 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1329/2628] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:44 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1668 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:45.123260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:45.124322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:45.132392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:45.133257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:45.133944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:45.134931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:45.135679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:45.136206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:45.337475 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a07d48f-1320-4b43-bdf3-16a483514089 tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/7e95ba2a-4529-4368-ad90-03a524982055" status: 202 len: 0 microversion: 2.1 time: 1.569479 Aug 06 21:04:45.340571 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1300/2629] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:04:43 2022] DELETE /compute/v2.1/os-security-groups/7e95ba2a-4529-4368-ad90-03a524982055 => generated 0 bytes in 1573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:45.349242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b804d0a5-a9d0-46f3-9fd2-058db1ec880e tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] Calling method '.version_select at 0x7f72a36a8820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:45.374584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:45.388780 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fd86a612-4347-4e55-b3e6-b0af7a62101e tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1527 microversion: 2.1 time: 0.270301 Aug 06 21:04:45.398599 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1330/2630] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:45 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1527 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:45.698423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:45.699713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:45.706382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:45.707929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:45.707929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:45.708402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:45.708969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:45.709504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:45.796803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:45.807603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:45.810242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:45.812236 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa9ae5fc-0073-45d9-a2e4-feed3ba1c74f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.118725 Aug 06 21:04:45.830395 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1331/2631] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:45 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:46.146503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:46.146503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:46.159010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:46.161450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:46.162031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:46.164435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:46.167905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:46.168960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:46.286283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:46.299377 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5548b782-432a-4a31-9aa6-f31090077a46 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1601 microversion: 2.1 time: 0.159153 Aug 06 21:04:46.300757 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1332/2632] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:46 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:46.390532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-919666581", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "bd53e23e-165d-439d-8c54-2c268b82c772"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:46.463091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] validate_networks() for [('bd53e23e-165d-439d-8c54-2c268b82c772', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:04:46.709423 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b804d0a5-a9d0-46f3-9fd2-058db1ec880e tempest-SecurityGroupRulesNegativeTestJSON-1831896458 tempest-SecurityGroupRulesNegativeTestJSON-1831896458-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4" status: 202 len: 0 microversion: 2.1 time: 1.364880 Aug 06 21:04:46.715135 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1301/2633] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:04:45 2022] DELETE /compute/v2.1/os-security-groups/f72f5db9-1681-4e5b-bdbc-5ef29c3fe5d4 => generated 0 bytes in 1370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:46.728660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-49637ae9-4714-4e38-b217-4af7acead276 req-28b94fe2-d244-4cae-9544-8d0e90cf3359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "tag": "74538f9f-74be-4eb8-a576-48c3c9114977"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:46.752620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-49637ae9-4714-4e38-b217-4af7acead276 req-28b94fe2-d244-4cae-9544-8d0e90cf3359 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:46.752881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-49637ae9-4714-4e38-b217-4af7acead276 req-28b94fe2-d244-4cae-9544-8d0e90cf3359 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:46.753110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-49637ae9-4714-4e38-b217-4af7acead276 req-28b94fe2-d244-4cae-9544-8d0e90cf3359 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:46.766907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:46.770153 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-49637ae9-4714-4e38-b217-4af7acead276 req-28b94fe2-d244-4cae-9544-8d0e90cf3359 service nova] Creating event network-changed:74538f9f-74be-4eb8-a576-48c3c9114977 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:04:46.780068 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-49637ae9-4714-4e38-b217-4af7acead276 req-28b94fe2-d244-4cae-9544-8d0e90cf3359 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063341 Aug 06 21:04:46.781161 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1302/2634] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:46.790520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:46.791565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:46.799403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:46.800156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:46.800828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:46.801933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:46.802613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:46.803691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:47.273388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:04:47.274207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:04:47.274896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:04:47.275786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:04:47.276149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:04:47.301923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:47.302667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:47.303574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:47.304531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:47.310046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:47.311028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:47.350117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Getting quotas for project 1b871c1ed18840838016162c77dcaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:04:47.369165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:47.371706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Getting quotas for user bf5c9921f2554f058eca4fcf4ef0fde7 and project 1b871c1ed18840838016162c77dcaf88. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:04:47.395811 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fe9f9e81-27a4-4c82-a265-237e9c285fcd tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1527 microversion: 2.1 time: 0.613214 Aug 06 21:04:47.414220 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1303/2635] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:46 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1527 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:47.425195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:04:47.427759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:47.428726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:04:47.430845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:47.452557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:47.454245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:47.456000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:47.458822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:47.462191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:47.464570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:47.534518 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-346b5bae-7559-4ea2-b638-d307f5c395d8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232232 Aug 06 21:04:47.550165 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1333/2636] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:04:47.556634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-202c43c6-6838-412d-aa7f-9765f5aa2ba3 req-be11045e-dcd6-4082-bc44-f26848e8bd42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cca29a9-9c71-47c0-b780-ba58daba21d2", "name": "network-vif-deleted", "tag": "1a466934-a39f-46b2-be85-3afb1c577f76"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:47.568597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-202c43c6-6838-412d-aa7f-9765f5aa2ba3 req-be11045e-dcd6-4082-bc44-f26848e8bd42 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:47.569081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-202c43c6-6838-412d-aa7f-9765f5aa2ba3 req-be11045e-dcd6-4082-bc44-f26848e8bd42 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:47.569511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-202c43c6-6838-412d-aa7f-9765f5aa2ba3 req-be11045e-dcd6-4082-bc44-f26848e8bd42 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:47.582222 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-202c43c6-6838-412d-aa7f-9765f5aa2ba3 req-be11045e-dcd6-4082-bc44-f26848e8bd42 service nova] Creating event network-vif-deleted:1a466934-a39f-46b2-be85-3afb1c577f76 for instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 on nch2-master-1 Aug 06 21:04:47.591391 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-202c43c6-6838-412d-aa7f-9765f5aa2ba3 req-be11045e-dcd6-4082-bc44-f26848e8bd42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039234 Aug 06 21:04:47.592221 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1334/2637] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:47.603553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:47.612135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:47.631158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:47.631673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:47.632312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:47.633051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:47.633510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:47.633931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:47.723545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:47.724036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:47.724475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:47.725007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lazy-loading 'fault' on Instance uuid 5cca29a9-9c71-47c0-b780-ba58daba21d2 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:04:47.803177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:47.813678 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75d6ad5a-d670-4a22-8921-4b6cd7face87 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 200 len: 1325 microversion: 2.1 time: 0.220279 Aug 06 21:04:47.814619 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1335/2638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:47 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 1325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:47.821188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e66e6dfd-1030-4e4c-a618-e0790a3ce7a2 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:47.821796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e66e6dfd-1030-4e4c-a618-e0790a3ce7a2 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:47.842651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:47.858049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:47.862139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:47.863708 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99cfd901-cfad-493c-9be2-5dde3f265638 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.458211 Aug 06 21:04:47.864587 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1304/2639] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:47 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:47.995234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e66e6dfd-1030-4e4c-a618-e0790a3ce7a2 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:48.006338 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e66e6dfd-1030-4e4c-a618-e0790a3ce7a2 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1216 microversion: 2.1 time: 0.190469 Aug 06 21:04:48.020211 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1336/2640] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:47 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1216 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:48.424478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:48.427641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:48.444401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:48.446515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:48.447992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:48.453627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:48.454487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:48.455330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:48.841620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:48.842445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 5cca29a9-9c71-47c0-b780-ba58daba21d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:48.855271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:48.857007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:48.857710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:48.860550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:48.862430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:48.864324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:48.895643 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] HTTP exception thrown: Instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 could not be found. Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Request method failure captured: Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 HTTP/1.1 Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYX0j76iEqu6L5bjZifjRM57KIOWgJPRS40ebOHT7cznGTvPrxL-dOOy1JBXVtB_wktW5wA1DdO5DCBe95YWK-7uDgmjrWFPghHqx3PbG2eHc4KaPMiC-ykdT07TxEzFfB-5l29pKQ2pECVQEddTutlLym3wVklG8U6lZKiShbwHrA Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: e47f439135a6445fa29c8be6d69c1759 Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-LiveMigrationTest-875310508 Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:48.901048 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e47f439135a6445fa29c8be6d69c1759", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-LiveMigrationTest-875310508 Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: e47f439135a6445fa29c8be6d69c1759 Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-LiveMigrationTest-875310508 Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-LiveMigrationTest-875310508-project Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: ad1a96004778407584d1805b07ad1c5f Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-LiveMigrationTest-875310508-project Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 could not be found. Aug 06 21:04:48.903137 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '5cca29a9-9c71-47c0-b780-ba58daba21d2'} Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 could not be found. Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:48.904082 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 could not be found. Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 could not be found. Aug 06 21:04:48.906454 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:48.907978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Returning 404 to user: Instance 5cca29a9-9c71-47c0-b780-ba58daba21d2 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:48.907978 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-26c66f51-d56e-4bec-8805-87d3b7159216 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2" status: 404 len: 111 microversion: 2.1 time: 0.071443 Aug 06 21:04:48.907978 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1337/2641] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:48 2022] GET /compute/v2.1/servers/5cca29a9-9c71-47c0-b780-ba58daba21d2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:04:48.913796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:48.914439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:48.922844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:48.923416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:48.923872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:48.924738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:48.925213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:48.925715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:49.060629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:49.072843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:49.075734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:49.077718 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c492d72e-81af-4ea5-a964-e8f170c53966 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.169060 Aug 06 21:04:49.090687 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1338/2642] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:48 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:49.094999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6c6a5fe3-ab09-4863-b9f9-6dfe39e206e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '.version_select at 0x7f72a34eb0d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:49.106646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:49.138692 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6c6a5fe3-ab09-4863-b9f9-6dfe39e206e2 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045864944" status: 202 len: 0 microversion: 2.1 time: 0.053360 Aug 06 21:04:49.143037 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1339/2643] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:04:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045864944 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:04:49.148867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:49.149736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:49.158007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:49.158958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:49.159658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:49.162067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:49.165216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:49.165893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:49.166724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:49.173512 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1d88d02e-b6e7-4210-95b5-c452925d9d6f tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1527 microversion: 2.1 time: 0.753108 Aug 06 21:04:49.176769 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1305/2644] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:48 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1527 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:49.302728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:49.316539 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f3ca566-e848-4110-ba9d-b22668df373e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1268 microversion: 2.1 time: 0.169641 Aug 06 21:04:49.319484 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1340/2645] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:49 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:49.899499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-253a0462-e5a9-4913-b243-e438512a937f req-733f4db7-415d-4982-8575-5ef2ca52f542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44af8cf4-3a6b-4b21-b646-ddf9853f484a", "name": "network-vif-deleted", "tag": "17cae853-ea36-45e7-9b90-4cf71241cfe6"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:49.915100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-253a0462-e5a9-4913-b243-e438512a937f req-733f4db7-415d-4982-8575-5ef2ca52f542 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:49.918537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-253a0462-e5a9-4913-b243-e438512a937f req-733f4db7-415d-4982-8575-5ef2ca52f542 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:49.923910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-253a0462-e5a9-4913-b243-e438512a937f req-733f4db7-415d-4982-8575-5ef2ca52f542 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:49.945842 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-253a0462-e5a9-4913-b243-e438512a937f req-733f4db7-415d-4982-8575-5ef2ca52f542 service nova] Creating event network-vif-deleted:17cae853-ea36-45e7-9b90-4cf71241cfe6 for instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a on nch2-master-1 Aug 06 21:04:49.954276 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-253a0462-e5a9-4913-b243-e438512a937f req-733f4db7-415d-4982-8575-5ef2ca52f542 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059181 Aug 06 21:04:49.955357 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1306/2646] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:04:50.101906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:50.103354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:50.125232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:50.127865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:50.128541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:50.129478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:50.130790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:50.133997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:50.201665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:50.202424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:50.225372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:50.228956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:50.235342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:50.236146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:50.236640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:50.237085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:50.333582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:50.334978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:50.335709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:50.336505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lazy-loading 'fault' on Instance uuid 44af8cf4-3a6b-4b21-b646-ddf9853f484a {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:04:50.430180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721aed6cddeb46cf9d8f33deaf6e5b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6626cd5e8e4669a5ccb84df569d140', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:50.440293 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d4b3e44a-4637-4689-9b52-76e08957db0a tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 200 len: 1314 microversion: 2.1 time: 0.244792 Aug 06 21:04:50.443433 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1307/2647] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:50 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:50.449645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:50.451062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:50.459979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:50.460899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:50.461624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:50.462816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:50.463630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:50.464855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:50.476173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:50.490173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:50.491988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:50.499243 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37a1ab7a-ea9d-4227-85fb-d21d12c3c020 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.401587 Aug 06 21:04:50.505114 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1341/2648] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:50 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:50.565828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:50.578754 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-202bbcde-4e0e-4b5f-a351-ca2c3691ed1d tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1274 microversion: 2.1 time: 0.132298 Aug 06 21:04:50.579847 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1308/2649] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:50 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1274 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:51.341347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:51.342752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:51.352487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.352984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.353615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:51.354440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.355486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.355921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:51.387986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:04:51.461989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:51.462638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] [instance: 44af8cf4-3a6b-4b21-b646-ddf9853f484a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:51.477937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.480896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.481576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:51.482536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.485217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.485869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:51.510580 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] HTTP exception thrown: Instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a could not be found. Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Request method failure captured: Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a HTTP/1.1 Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tcdpU5oIeXI51bIWxwgeXBWL2pQsmj3dbZEy7mhJXEoyo_W6Z9tJTvkPAkt9ObuqT9Ptn6jBpYtrueqgvldGTFWM4aSoJq12WkPgYvJSse7HhUUamXz2JsstxLH1IHipdf0RUooQAn9mRT02R0XB4Q_1XkdAj7mPVmyx9Bb0Spo_K4 Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 2c6626cd5e8e4669a5ccb84df569d140 Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:04:51.518202 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2c6626cd5e8e4669a5ccb84df569d140", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c6626cd5e8e4669a5ccb84df569d140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 2c6626cd5e8e4669a5ccb84df569d140 Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1547435384 Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FloatingIPsAssociationTestJSON-1547435384-project Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 721aed6cddeb46cf9d8f33deaf6e5b8b Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1547435384-project Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a could not be found. Aug 06 21:04:51.519824 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '44af8cf4-3a6b-4b21-b646-ddf9853f484a'} Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a could not be found. Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:51.520894 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a could not be found. Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a could not be found. Aug 06 21:04:51.522250 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:51.523662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] Returning 404 to user: Instance 44af8cf4-3a6b-4b21-b646-ddf9853f484a could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:51.523747 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a65e61ac-9877-43b2-a4e9-98ee00ab11bc tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "DELETE /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 204 len: 0 microversion: 2.1 time: 0.184416 Aug 06 21:04:51.525816 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1342/2650] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:04:51 2022] DELETE /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:04:51.529261 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ee712d68-b143-4a7a-abf6-103b59fb2563 tempest-FloatingIPsAssociationTestJSON-1547435384 tempest-FloatingIPsAssociationTestJSON-1547435384-project] 10.222.0.33 "GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a" status: 404 len: 111 microversion: 2.1 time: 0.071745 Aug 06 21:04:51.533433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:51.534119 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1309/2651] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:51 2022] GET /compute/v2.1/servers/44af8cf4-3a6b-4b21-b646-ddf9853f484a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:04:51.535174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:51.545346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.546343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.547356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:51.548632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.549577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.550294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:51.550441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:51.551798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:51.560561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=53 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:51.562463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.563490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.564343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:51.565942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.566715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.567389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:51.773297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:51.789074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:51.793477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:51.796445 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8a2e36ca-3d86-4f3b-95c7-044cb7b5564f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.269319 Aug 06 21:04:51.797593 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1343/2652] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:51 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:51.806795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:51.809039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:51.821422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.822440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.823072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:51.825304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:51.825969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:51.826506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:52.236505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:52.251325 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8f4454a-d6be-40e7-bf05-613e706b76cd tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1484 microversion: 2.1 time: 0.714719 Aug 06 21:04:52.251831 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1310/2653] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:51 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1484 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:52.366056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:52.374786 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-481c1368-6a9a-46c6-b03f-0a816287d6d6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1316 microversion: 2.1 time: 0.575493 Aug 06 21:04:52.375650 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1344/2654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:51 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1316 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:52.826173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:52.827146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:52.836502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:52.838093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:52.838704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:52.840562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:52.842247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:52.842922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:53.086593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:53.102981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:53.109554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:53.113945 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dbb977c5-d028-4563-a254-b07ed4cc82e0 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.289282 Aug 06 21:04:53.123998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-718ac298-ee14-47e7-aea2-4b95c2a1e5c3 req-83554b16-e8f6-420a-b243-4a71d14a1c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484ddada-2ad7-4bd8-a298-196086372bc8", "name": "network-vif-deleted", "tag": "797fb5d8-810c-48f1-9f40-b8f36d0eba22"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:53.146761 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1311/2655] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:52 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:53.169432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-718ac298-ee14-47e7-aea2-4b95c2a1e5c3 req-83554b16-e8f6-420a-b243-4a71d14a1c88 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:53.170287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-718ac298-ee14-47e7-aea2-4b95c2a1e5c3 req-83554b16-e8f6-420a-b243-4a71d14a1c88 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:53.170910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-718ac298-ee14-47e7-aea2-4b95c2a1e5c3 req-83554b16-e8f6-420a-b243-4a71d14a1c88 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:53.196756 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-718ac298-ee14-47e7-aea2-4b95c2a1e5c3 req-83554b16-e8f6-420a-b243-4a71d14a1c88 service nova] Creating event network-vif-deleted:797fb5d8-810c-48f1-9f40-b8f36d0eba22 for instance 484ddada-2ad7-4bd8-a298-196086372bc8 on nch2-master-1 Aug 06 21:04:53.203981 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-718ac298-ee14-47e7-aea2-4b95c2a1e5c3 req-83554b16-e8f6-420a-b243-4a71d14a1c88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086148 Aug 06 21:04:53.205164 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1345/2656] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:04:53.274561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:53.275282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:53.288424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:53.290303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:53.295644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:53.296592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:53.297272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:53.297860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:53.358692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:53.359547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:53.360219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:53.360884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lazy-loading 'fault' on Instance uuid 484ddada-2ad7-4bd8-a298-196086372bc8 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:04:53.401009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:53.402367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:53.424326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:53.429515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:53.430021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:53.430458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:53.440627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:53.441328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:53.442321 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33ca4280-55e9-45f6-92a8-6ae1f1b1371e tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 200 len: 1300 microversion: 2.1 time: 0.172514 Aug 06 21:04:53.443048 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1312/2657] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:53 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 1300 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:53.451794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:53.459743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:53.557328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5f2036dc-43f9-471f-8de1-a3ba3f3552c9 req-d7d8234a-91ec-4459-a5bc-b6d4f0e9c3ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef52a471-ba57-48a9-9566-13b90df93e6c", "tag": "ed71803f-fe77-4eb5-8f8f-8c01bc9aabf8"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:53.581214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5f2036dc-43f9-471f-8de1-a3ba3f3552c9 req-d7d8234a-91ec-4459-a5bc-b6d4f0e9c3ef service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:53.581427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5f2036dc-43f9-471f-8de1-a3ba3f3552c9 req-d7d8234a-91ec-4459-a5bc-b6d4f0e9c3ef service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:53.581664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5f2036dc-43f9-471f-8de1-a3ba3f3552c9 req-d7d8234a-91ec-4459-a5bc-b6d4f0e9c3ef service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:53.615656 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-5f2036dc-43f9-471f-8de1-a3ba3f3552c9 req-d7d8234a-91ec-4459-a5bc-b6d4f0e9c3ef service nova] Creating event network-changed:ed71803f-fe77-4eb5-8f8f-8c01bc9aabf8 for instance ef52a471-ba57-48a9-9566-13b90df93e6c on nch1-master-1 Aug 06 21:04:53.629688 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5f2036dc-43f9-471f-8de1-a3ba3f3552c9 req-d7d8234a-91ec-4459-a5bc-b6d4f0e9c3ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087225 Aug 06 21:04:53.630867 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1313/2658] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:53.975538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:53.984509 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4f0369a4-efa5-463f-aca1-1e4811e0d114 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1316 microversion: 2.1 time: 0.592393 Aug 06 21:04:53.985317 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1346/2659] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:53 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1316 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:54.155472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:54.156180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:54.163779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:54.164470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:54.165062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:54.166140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:54.166639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:54.167093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:54.246347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:54.263592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:54.265260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:54.267336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8759e8d-22d4-43c0-b458-567979d89338 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.117674 Aug 06 21:04:54.282630 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1314/2660] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:54 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:54.465426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:54.466992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 484ddada-2ad7-4bd8-a298-196086372bc8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:54.476692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:54.477718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:54.478387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:54.479373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:54.480063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:54.480745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:54.497166 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] HTTP exception thrown: Instance 484ddada-2ad7-4bd8-a298-196086372bc8 could not be found. Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Request method failure captured: Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 HTTP/1.1 Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYX0j76iEqu6L5bjZifjRM57KIOWgJPRS40ebOHT7cznGTvPrxL-dOOy1JBXVtB_wktW5wA1DdO5DCBe95YWK-7uDgmjrWFPghHqx3PbG2eHc4KaPMiC-ykdT07TxEzFfB-5l29pKQ2pECVQEddTutlLym3wVklG8U6lZKiShbwHrA Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: e47f439135a6445fa29c8be6d69c1759 Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-LiveMigrationTest-875310508 Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:54.499406 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e47f439135a6445fa29c8be6d69c1759", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-LiveMigrationTest-875310508 Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: e47f439135a6445fa29c8be6d69c1759 Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-LiveMigrationTest-875310508 Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-LiveMigrationTest-875310508-project Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: ad1a96004778407584d1805b07ad1c5f Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-LiveMigrationTest-875310508-project Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 484ddada-2ad7-4bd8-a298-196086372bc8 could not be found. Aug 06 21:04:54.500743 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '484ddada-2ad7-4bd8-a298-196086372bc8'} Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484ddada-2ad7-4bd8-a298-196086372bc8 could not be found. Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:54.501486 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484ddada-2ad7-4bd8-a298-196086372bc8 could not be found. Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484ddada-2ad7-4bd8-a298-196086372bc8 could not be found. Aug 06 21:04:54.502686 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:54.503744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Returning 404 to user: Instance 484ddada-2ad7-4bd8-a298-196086372bc8 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:54.503744 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7119d560-58fe-49db-b93f-9a8fee77aa50 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8" status: 404 len: 111 microversion: 2.1 time: 0.040561 Aug 06 21:04:54.503744 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1347/2661] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:54 2022] GET /compute/v2.1/servers/484ddada-2ad7-4bd8-a298-196086372bc8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:04:54.510251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:54.511434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:54.519162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:54.519779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:54.520298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:54.521786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:54.522366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:54.523090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:54.585763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:04:54.713506 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-380b427c-ef34-48fe-a32e-99019df454ac tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 204 len: 0 microversion: 2.1 time: 0.206624 Aug 06 21:04:54.717451 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1315/2662] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:04:54 2022] DELETE /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:04:54.725633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:54.726425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:54.736296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:54.736969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:54.737642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:54.738707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:54.739585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:54.740246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:55.012150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:55.013164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:55.023137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:55.023834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:55.025241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:55.026273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:55.026970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:55.028015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:55.063711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:55.072067 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9d7b3a1-25c4-4bf5-871f-1f22788107b7 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1500 microversion: 2.1 time: 0.352484 Aug 06 21:04:55.072662 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1348/2663] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:54 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1500 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:55.299450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:55.300626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:55.316663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:55.317868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:55.318481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:55.321768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:55.324879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:55.326393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:55.365001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:55.375940 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c7f5712-c852-400e-afa1-85365d1b218e tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1316 microversion: 2.1 time: 0.373568 Aug 06 21:04:55.376857 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1316/2664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:55 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:55.462416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:55.477923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:55.484842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:55.486065 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7abce50f-df52-4569-9cc3-ae2c5437caa5 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.196952 Aug 06 21:04:55.503005 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1349/2665] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:55 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:56.095285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:56.098966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:56.109577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:56.110356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:56.110993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:56.111903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:56.112533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:56.113147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:56.429220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:56.445533 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5a1e78ec-d411-45f5-9bef-aa7d3d13456a tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1500 microversion: 2.1 time: 0.354954 Aug 06 21:04:56.446391 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1317/2666] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:56 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1500 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:56.466695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:56.467239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:56.474654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:56.475146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:56.475721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:56.476607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:56.477246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:56.477830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:56.565018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b053aa7f-19ff-4103-a42e-a920fa6c0c2b tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1265151808", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:56.568500 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-b053aa7f-19ff-4103-a42e-a920fa6c0c2b tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] HTTP exception thrown: min_count must be <= max_count Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b053aa7f-19ff-4103-a42e-a920fa6c0c2b tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Request method failure captured: Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 184 Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7td4szM5hBWCvHphMyzNfcvM3ULkScyZXOgXd7nUVZdNbQ8hNBpql0N1ku2nGO5aXmyRxa8e5KriE5FRM54kHk9wjDAzFa_9PLFgjij3WcAhJvboRwBKq3bJh-o1qxKH4TvQHsc5QY-Kg8bvetBLh56CvZ3aBH_t3e_-EzxIoAxd890 Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:56.570468 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31fda4f324b24803a973fc29926b74bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: afdab69360e54d38bd9e3fbb3f56b9b6 Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:56.571869 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1265151808", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: exception: min_count must be <= max_count Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1265151808', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:04:56.572537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b053aa7f-19ff-4103-a42e-a920fa6c0c2b tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Returning 400 to user: min_count must be <= max_count {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:56.576606 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b053aa7f-19ff-4103-a42e-a920fa6c0c2b tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.186136 Aug 06 21:04:56.585008 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1350/2667] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:04:56 2022] POST /compute/v2.1/servers => generated 74 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 21:04:56.591625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:56.592471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:56.600388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:56.601127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:56.601716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:56.602653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:56.603253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:56.603836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:56.699816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:56.709400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:56.711364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:56.713458 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4b4e5c28-ea05-4c5c-9619-dba92549025a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.126885 Aug 06 21:04:56.729988 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1351/2668] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:56 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:56.736122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f9f2202-0e48-4307-9065-9b5f3cc5ed04 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2066336265", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "max_count": 0}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f9f2202-0e48-4307-9065-9b5f3cc5ed04 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Request method failure captured: Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 168 Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7td4szM5hBWCvHphMyzNfcvM3ULkScyZXOgXd7nUVZdNbQ8hNBpql0N1ku2nGO5aXmyRxa8e5KriE5FRM54kHk9wjDAzFa_9PLFgjij3WcAhJvboRwBKq3bJh-o1qxKH4TvQHsc5QY-Kg8bvetBLh56CvZ3aBH_t3e_-EzxIoAxd890 Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:56.742494 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31fda4f324b24803a973fc29926b74bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: afdab69360e54d38bd9e3fbb3f56b9b6 Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:56.744041 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2066336265", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "max_count": 0}} Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2066336265', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'max_count': 0}}} Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 0 Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.744806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.746409 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.747847 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.747847 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.747847 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:04:56.747847 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:04:56.747847 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 06 21:04:56.747847 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.749112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f9f2202-0e48-4307-9065-9b5f3cc5ed04 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:56.750126 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4f9f2202-0e48-4307-9065-9b5f3cc5ed04 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018765 Aug 06 21:04:56.751099 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1352/2669] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:04:56 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:04:56.821750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-61c1dd31-8434-4485-84f0-45ff612a0e26 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-147853984", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "max_count": 2.5}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-61c1dd31-8434-4485-84f0-45ff612a0e26 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Request method failure captured: Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 169 Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7td4szM5hBWCvHphMyzNfcvM3ULkScyZXOgXd7nUVZdNbQ8hNBpql0N1ku2nGO5aXmyRxa8e5KriE5FRM54kHk9wjDAzFa_9PLFgjij3WcAhJvboRwBKq3bJh-o1qxKH4TvQHsc5QY-Kg8bvetBLh56CvZ3aBH_t3e_-EzxIoAxd890 Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:56.826988 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31fda4f324b24803a973fc29926b74bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: afdab69360e54d38bd9e3fbb3f56b9b6 Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:56.828605 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-147853984", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "max_count": 2.5}} Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-147853984', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'max_count': 2.5}}} Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 2.5 Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.829388 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.831016 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.835284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.835284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.835284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:04:56.835284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:04:56.835284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 06 21:04:56.835284 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.835284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-61c1dd31-8434-4485-84f0-45ff612a0e26 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:56.835284 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-61c1dd31-8434-4485-84f0-45ff612a0e26 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010662 Aug 06 21:04:56.838111 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1353/2670] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:04:56 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:04:56.893865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49675110-2f36-4f15-b8ca-d4fc2a68ada7 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-105341054", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 0}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49675110-2f36-4f15-b8ca-d4fc2a68ada7 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Request method failure captured: Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 167 Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7td4szM5hBWCvHphMyzNfcvM3ULkScyZXOgXd7nUVZdNbQ8hNBpql0N1ku2nGO5aXmyRxa8e5KriE5FRM54kHk9wjDAzFa_9PLFgjij3WcAhJvboRwBKq3bJh-o1qxKH4TvQHsc5QY-Kg8bvetBLh56CvZ3aBH_t3e_-EzxIoAxd890 Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:56.897972 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31fda4f324b24803a973fc29926b74bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: afdab69360e54d38bd9e3fbb3f56b9b6 Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:56.899569 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-105341054", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 0}} Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-105341054', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'min_count': 0}}} Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 0 Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.903156 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.904521 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.905774 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.905774 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.905774 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:04:56.905774 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:04:56.905774 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 06 21:04:56.905774 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.905774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49675110-2f36-4f15-b8ca-d4fc2a68ada7 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:56.905774 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-49675110-2f36-4f15-b8ca-d4fc2a68ada7 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010334 Aug 06 21:04:56.905774 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1354/2671] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:04:56 2022] POST /compute/v2.1/servers => generated 130 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:04:56.959664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3cead598-c6bb-43e3-a7bb-ca19bbf142c5 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-429818574", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 2.5}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3cead598-c6bb-43e3-a7bb-ca19bbf142c5 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Request method failure captured: Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 169 Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7td4szM5hBWCvHphMyzNfcvM3ULkScyZXOgXd7nUVZdNbQ8hNBpql0N1ku2nGO5aXmyRxa8e5KriE5FRM54kHk9wjDAzFa_9PLFgjij3WcAhJvboRwBKq3bJh-o1qxKH4TvQHsc5QY-Kg8bvetBLh56CvZ3aBH_t3e_-EzxIoAxd890 Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:04:56.963617 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31fda4f324b24803a973fc29926b74bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31fda4f324b24803a973fc29926b74bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31fda4f324b24803a973fc29926b74bc Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-361116131 Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: afdab69360e54d38bd9e3fbb3f56b9b6 Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-361116131-project Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:04:56.965121 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-429818574", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 2.5}} Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-429818574', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'min_count': 2.5}}} Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 2.5 Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.965921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.967317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:56.968551 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:56.968551 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:56.968551 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:04:56.968551 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:04:56.968551 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 06 21:04:56.968551 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:04:56.968551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3cead598-c6bb-43e3-a7bb-ca19bbf142c5 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:56.968551 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3cead598-c6bb-43e3-a7bb-ca19bbf142c5 tempest-MultipleCreateNegativeTestJSON-361116131 tempest-MultipleCreateNegativeTestJSON-361116131-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009256 Aug 06 21:04:56.974318 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1355/2672] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:04:56 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:04:57.165520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bfc242cd-e807-4281-84d4-42bce322a871 req-1c1795dc-b4bb-4aa7-84c6-f12fa6a4af41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32283b96-8517-4916-a1a1-8984fc7e664d", "name": "network-vif-deleted", "tag": "e53b42f6-ab95-43a2-8401-88deeffa1d8d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:57.188482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bfc242cd-e807-4281-84d4-42bce322a871 req-1c1795dc-b4bb-4aa7-84c6-f12fa6a4af41 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:57.189017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bfc242cd-e807-4281-84d4-42bce322a871 req-1c1795dc-b4bb-4aa7-84c6-f12fa6a4af41 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:57.191575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bfc242cd-e807-4281-84d4-42bce322a871 req-1c1795dc-b4bb-4aa7-84c6-f12fa6a4af41 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:57.208294 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bfc242cd-e807-4281-84d4-42bce322a871 req-1c1795dc-b4bb-4aa7-84c6-f12fa6a4af41 service nova] Creating event network-vif-deleted:e53b42f6-ab95-43a2-8401-88deeffa1d8d for instance 32283b96-8517-4916-a1a1-8984fc7e664d on nch1-master-1 Aug 06 21:04:57.227556 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bfc242cd-e807-4281-84d4-42bce322a871 req-1c1795dc-b4bb-4aa7-84c6-f12fa6a4af41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067230 Aug 06 21:04:57.228663 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1356/2673] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:04:57.246330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:57.264326 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-feae5de8-9d8a-4f7e-8cb6-da5ee5434550 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1316 microversion: 2.1 time: 0.816457 Aug 06 21:04:57.265715 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1318/2674] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:56 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1316 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:57.466837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:57.473004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:57.474373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:57.485521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:57.486537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:57.487638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:57.488641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:57.489752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:57.490404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:57.536132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:57.537310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:57.538066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:57.539147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lazy-loading 'fault' on Instance uuid 32283b96-8517-4916-a1a1-8984fc7e664d {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:04:57.597491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1a96004778407584d1805b07ad1c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47f439135a6445fa29c8be6d69c1759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:57.609784 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc5b7a1b-7eb0-4210-9cf2-d50a7e7f74b4 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 200 len: 1301 microversion: 2.1 time: 0.143798 Aug 06 21:04:57.611267 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1357/2675] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:57 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 1301 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:57.739039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:57.739680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:57.749188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:57.751043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:57.751820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:57.753470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:57.754175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:57.754819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:57.761785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:57.859890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:57.869175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:57.870861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:57.872272 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-42667bfe-a01f-420d-bdb0-dcc1b0740755 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.138474 Aug 06 21:04:57.872849 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1319/2676] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:57 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:58.288890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:58.289745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:58.293156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:04:58.298160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:58.298814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:58.299393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:58.300240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:58.300811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:58.301346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:58.458896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:58.467864 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d02af2f8-04d4-4933-a135-831b7df05a2a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1316 microversion: 2.1 time: 0.183467 Aug 06 21:04:58.468439 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1358/2677] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:58 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:04:58.633898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:58.634566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] [instance: 32283b96-8517-4916-a1a1-8984fc7e664d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:58.645995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:58.646703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:58.647289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:58.648163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:58.648688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:58.650048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:58.667900 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] HTTP exception thrown: Instance 32283b96-8517-4916-a1a1-8984fc7e664d could not be found. Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Request method failure captured: Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d HTTP/1.1 Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tYX0j76iEqu6L5bjZifjRM57KIOWgJPRS40ebOHT7cznGTvPrxL-dOOy1JBXVtB_wktW5wA1DdO5DCBe95YWK-7uDgmjrWFPghHqx3PbG2eHc4KaPMiC-ykdT07TxEzFfB-5l29pKQ2pECVQEddTutlLym3wVklG8U6lZKiShbwHrA Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: e47f439135a6445fa29c8be6d69c1759 Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-LiveMigrationTest-875310508 Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:04:58.670146 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e47f439135a6445fa29c8be6d69c1759", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47f439135a6445fa29c8be6d69c1759"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-LiveMigrationTest-875310508 Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: e47f439135a6445fa29c8be6d69c1759 Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-LiveMigrationTest-875310508 Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-LiveMigrationTest-875310508-project Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: ad1a96004778407584d1805b07ad1c5f Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-LiveMigrationTest-875310508-project Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 32283b96-8517-4916-a1a1-8984fc7e664d could not be found. Aug 06 21:04:58.671636 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '32283b96-8517-4916-a1a1-8984fc7e664d'} Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32283b96-8517-4916-a1a1-8984fc7e664d could not be found. Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:04:58.672442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32283b96-8517-4916-a1a1-8984fc7e664d could not be found. Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32283b96-8517-4916-a1a1-8984fc7e664d could not be found. Aug 06 21:04:58.673592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:04:58.676144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] Returning 404 to user: Instance 32283b96-8517-4916-a1a1-8984fc7e664d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:04:58.677559 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4d08d7ca-20a2-4a74-a59c-ebcff1782d18 tempest-LiveMigrationTest-875310508 tempest-LiveMigrationTest-875310508-project] 10.222.0.33 "GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d" status: 404 len: 111 microversion: 2.1 time: 0.048500 Aug 06 21:04:58.682143 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1320/2678] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:58 2022] GET /compute/v2.1/servers/32283b96-8517-4916-a1a1-8984fc7e664d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:04:58.897583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:58.898396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:58.911579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:58.912297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:58.915498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:58.918988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:58.919727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:58.922226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:59.055405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:59.072153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:59.078140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:59.080128 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-46eb281a-ee9c-45f7-936f-b7b0eeaecf63 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.187287 Aug 06 21:04:59.081131 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1359/2679] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:04:58 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:04:59.125004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d0599a61-1786-47bd-b5fb-b09cb2cced30 req-54b6780a-c8c2-471b-af4a-90357bfdbcd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef52a471-ba57-48a9-9566-13b90df93e6c", "name": "network-vif-plugged", "status": "completed", "tag": "ed71803f-fe77-4eb5-8f8f-8c01bc9aabf8"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:04:59.142613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d0599a61-1786-47bd-b5fb-b09cb2cced30 req-54b6780a-c8c2-471b-af4a-90357bfdbcd2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:59.143362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d0599a61-1786-47bd-b5fb-b09cb2cced30 req-54b6780a-c8c2-471b-af4a-90357bfdbcd2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:59.143956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d0599a61-1786-47bd-b5fb-b09cb2cced30 req-54b6780a-c8c2-471b-af4a-90357bfdbcd2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:59.156973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d0599a61-1786-47bd-b5fb-b09cb2cced30 req-54b6780a-c8c2-471b-af4a-90357bfdbcd2 service nova] Creating event network-vif-plugged:ed71803f-fe77-4eb5-8f8f-8c01bc9aabf8 for instance ef52a471-ba57-48a9-9566-13b90df93e6c on nch1-master-1 Aug 06 21:04:59.162667 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d0599a61-1786-47bd-b5fb-b09cb2cced30 req-54b6780a-c8c2-471b-af4a-90357bfdbcd2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042082 Aug 06 21:04:59.163825 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1321/2680] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:04:59.489665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:04:59.490463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:04:59.497879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:59.498618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:59.499211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:59.500634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:04:59.501361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:04:59.502053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:04:59.922591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:04:59.938180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0768486d-c8b4-40b3-9ee1-ff399fb59d00 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1316 microversion: 2.1 time: 0.452759 Aug 06 21:04:59.940128 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1360/2681] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:04:59 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:00.107012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:00.107727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:00.121874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:00.122375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:00.123019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:00.127625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:00.132589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:00.133335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:00.319309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:00.345290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:00.348443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:00.350174 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-75e8dfc1-24b2-4258-96ce-74af8d34fbdf tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.248627 Aug 06 21:05:00.351137 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1322/2682] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:00 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:00.966102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:00.967683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:00.976007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:00.976865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:00.977574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:00.978955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:00.980391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:00.981120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:01.379204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:01.380114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:01.400592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:01.403749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:01.406168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:01.409107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:01.411229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:01.412927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:01.463249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:01.483806 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-88797330-50de-46a9-bd0a-aa46c0d616c5 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1505 microversion: 2.1 time: 0.522489 Aug 06 21:05:01.486676 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1361/2683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:00 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:01.509985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:01.511314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:01.528085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:01.528595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:01.529046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:01.529810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:01.530275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:01.530759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:01.587078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:01.603528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:01.608062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:01.608981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:01.610011 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-777994ee-30ac-4f1d-88bf-18c7996e1a96 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c/os-instance-actions/req-346b5bae-7559-4ea2-b638-d307f5c395d8" status: 200 len: 313 microversion: 2.1 time: 0.104146 Aug 06 21:05:01.610528 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-77905e3d-d274-4f5c-bc90-30c62c7ab32c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.236662 Aug 06 21:05:01.620334 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1362/2684] 10.222.0.33 () {58 vars in 1419 bytes} [Sat Aug 6 21:05:01 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c/os-instance-actions/req-346b5bae-7559-4ea2-b638-d307f5c395d8 => generated 313 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:05:01.623654 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1323/2685] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:01 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:01.639125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42b7c646-bc7e-481d-b730-ca21891ab15b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:01.641404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42b7c646-bc7e-481d-b730-ca21891ab15b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:01.658874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42b7c646-bc7e-481d-b730-ca21891ab15b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:01.660288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42b7c646-bc7e-481d-b730-ca21891ab15b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:01.660991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42b7c646-bc7e-481d-b730-ca21891ab15b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:01.662000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42b7c646-bc7e-481d-b730-ca21891ab15b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:01.662705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42b7c646-bc7e-481d-b730-ca21891ab15b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:01.663592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42b7c646-bc7e-481d-b730-ca21891ab15b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:01.831158 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42b7c646-bc7e-481d-b730-ca21891ab15b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "POST /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c/action" status: 202 len: 0 microversion: 2.1 time: 0.199985 Aug 06 21:05:01.834975 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1363/2686] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:05:01 2022] POST /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:05:01.841515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:01.842159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:01.856716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:01.858050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:01.860996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:01.862583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:01.863249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:01.864221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:02.474953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:02.491072 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f65cbbb-3bfc-439b-b45f-5e7928522b27 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1507 microversion: 2.1 time: 0.654193 Aug 06 21:05:02.505160 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1324/2687] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:01 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1507 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:02.646909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:02.648541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:02.670646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:02.671723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:02.673989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:02.676435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:02.677139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:02.679560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:03.205497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:03.221261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:03.227272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:03.228778 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2eced171-8418-433c-9fd7-0cfd33e6963c tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1366 microversion: 2.47 time: 0.588804 Aug 06 21:05:03.229582 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1364/2688] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:02 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1366 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:03.515728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:03.516354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:03.538113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:03.539118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:03.543664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:03.544677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:03.548030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:03.548666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:04.054684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:04.068415 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-08c3b935-a1c9-4e0a-9862-36c43c4c7ad6 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1512 microversion: 2.1 time: 0.556500 Aug 06 21:05:04.070581 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1325/2689] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:03 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:04.253968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:04.255500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:04.273140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:04.273698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:04.278790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:04.279743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:04.280376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:04.281276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:04.447227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:04.464111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:04.466292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:04.477942 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd3be53f-afba-49d6-94d7-56ec23142587 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1372 microversion: 2.47 time: 0.229026 Aug 06 21:05:04.478585 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1365/2690] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:04 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:05.101828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:05.103102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:05.116830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:05.117318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:05.117774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:05.124688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:05.125205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:05.143036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:05.486518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:05.506250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:05.506932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:05.537918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:05.540001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:05.540855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:05.541702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:05.543552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:05.544216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:05.563787 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cdf4619c-18dc-493f-8776-0d0d3007629b tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1505 microversion: 2.1 time: 0.468448 Aug 06 21:05:05.575140 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1326/2691] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:05 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:05.600794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-24ea2fec-1794-49eb-a63b-4fd2fd656f88 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '.version_select at 0x7f72a36a8700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:05.602793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-24ea2fec-1794-49eb-a63b-4fd2fd656f88 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:05.632533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ea2fec-1794-49eb-a63b-4fd2fd656f88 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:05.637487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ea2fec-1794-49eb-a63b-4fd2fd656f88 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:05.639545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ea2fec-1794-49eb-a63b-4fd2fd656f88 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:05.640347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ea2fec-1794-49eb-a63b-4fd2fd656f88 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:05.643730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ea2fec-1794-49eb-a63b-4fd2fd656f88 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:05.644616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24ea2fec-1794-49eb-a63b-4fd2fd656f88 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:05.770735 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-24ea2fec-1794-49eb-a63b-4fd2fd656f88 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.178048 Aug 06 21:05:05.772620 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1327/2692] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Aug 6 21:05:05 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c/os-instance-actions => generated 611 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:05.791078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:05.791961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:05.810797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:05.813163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:05.813808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:05.814756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:05.817356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:05.818035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:05.888747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:05:06.093223 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a3830e9c-0e1e-4c83-a1b1-beadd430adf8 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 204 len: 0 microversion: 2.1 time: 0.311054 Aug 06 21:05:06.095717 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1328/2693] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:05:05 2022] DELETE /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:05:06.113374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:06.115175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:06.137363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:06.140689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:06.141613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:06.142855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:06.144736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:06.147256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:06.591502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:06.600875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:06.611031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:06.620940 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dedab1b4-a734-425c-ae4d-3ba1f85a04a4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1372 microversion: 2.47 time: 1.111194 Aug 06 21:05:06.622293 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1366/2694] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:05 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1372 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:05:06.757107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:06.774069 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-40ca91d6-b675-4c0e-a54c-cbf285728489 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1511 microversion: 2.1 time: 0.668144 Aug 06 21:05:06.775464 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1329/2695] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:06 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1511 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:07.654114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:07.655429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:07.692948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:07.693637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:07.694582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:07.699779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:07.701787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:07.706232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:07.803638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:07.804541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:07.818605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:07.829542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:07.830238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:07.831263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:07.831741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:07.832177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:08.099056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:08.103813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:08.144200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:08.147269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:08.148513 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01368b04-e683-4924-8dae-195030d7e02d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1357 microversion: 2.47 time: 0.502536 Aug 06 21:05:08.149093 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1367/2696] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:07 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1357 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:08.175059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:08.190890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:08.192562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Searching by: {'deleted': False, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:05:08.211441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:08.211969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:08.212429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:08.218694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:08.219808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:08.220784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:08.334077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf5c9921f2554f058eca4fcf4ef0fde7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b871c1ed18840838016162c77dcaf88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:08.345772 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f3945eb-db46-4f04-bab0-b41f81877923 tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 200 len: 1469 microversion: 2.1 time: 0.549514 Aug 06 21:05:08.348597 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1330/2697] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:07 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 1469 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:08.597093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:05:08.637901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-89ce67e7-535c-4eb3-be14-64ff738495db tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Action: 'create', calling method: .version_select at 0x7f729dcf8a60>, body: {"pool": null} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:08.766859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:08.775823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:08.776873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:08.777682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:08.791273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:08.794608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:08.914154 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a112ee76-eeed-4bfb-a835-a4396c4446aa tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.743152 Aug 06 21:05:08.914991 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1368/2698] 10.222.0.33 () {60 vars in 1187 bytes} [Sat Aug 6 21:05:08 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:05:08.920668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-782f6247-3d53-4d7e-b4fa-950fdd822766 req-2e362014-291a-4bc5-a743-79840df85558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef52a471-ba57-48a9-9566-13b90df93e6c", "name": "network-vif-deleted", "tag": "ed71803f-fe77-4eb5-8f8f-8c01bc9aabf8"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:08.931699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-782f6247-3d53-4d7e-b4fa-950fdd822766 req-2e362014-291a-4bc5-a743-79840df85558 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:08.932493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-782f6247-3d53-4d7e-b4fa-950fdd822766 req-2e362014-291a-4bc5-a743-79840df85558 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:08.933083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-782f6247-3d53-4d7e-b4fa-950fdd822766 req-2e362014-291a-4bc5-a743-79840df85558 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:08.952469 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-782f6247-3d53-4d7e-b4fa-950fdd822766 req-2e362014-291a-4bc5-a743-79840df85558 service nova] Creating event network-vif-deleted:ed71803f-fe77-4eb5-8f8f-8c01bc9aabf8 for instance ef52a471-ba57-48a9-9566-13b90df93e6c on nch1-master-1 Aug 06 21:05:08.959474 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-782f6247-3d53-4d7e-b4fa-950fdd822766 req-2e362014-291a-4bc5-a743-79840df85558 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042669 Aug 06 21:05:08.960618 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1369/2699] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:08.973357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:08.974650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:08.984717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:08.985841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:08.987213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:08.991133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:08.991949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:08.998751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:09.633801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:05:09.859388 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3168aeba-33de-4a23-8da1-867a258854d4 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 204 len: 0 microversion: 2.47 time: 0.892442 Aug 06 21:05:09.861237 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1370/2700] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:05:08 2022] DELETE /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 0 bytes in 896 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:05:09.872278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:09.876137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] [instance: ef52a471-ba57-48a9-9566-13b90df93e6c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:09.891617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:09.892031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:09.892483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:09.893207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:09.893668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:09.894108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:09.941613 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] HTTP exception thrown: Instance ef52a471-ba57-48a9-9566-13b90df93e6c could not be found. Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Request method failure captured: Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c HTTP/1.1 Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tducjOtNHdv_vONEBWI4oaS0M32_VZbg8gXuzrcy-YaUuNyKzJystoz2DnxGfkLl4IkTp_bpKQm_y8dy44ywb2vrJl1Sj5Rs358pZCYF2dWwsnJ05QukA5-dWsKLdyWgdU8hfnalwSHcX572Qsn6kAhQ49wk0TNydiy0BM7FSmpWd0 Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 1b871c1ed18840838016162c77dcaf88 Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-InstanceActionsTestJSON-676633724 Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:05:09.943397 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b871c1ed18840838016162c77dcaf88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b871c1ed18840838016162c77dcaf88", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b871c1ed18840838016162c77dcaf88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b871c1ed18840838016162c77dcaf88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-InstanceActionsTestJSON-676633724 Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 1b871c1ed18840838016162c77dcaf88 Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-InstanceActionsTestJSON-676633724 Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-InstanceActionsTestJSON-676633724-project Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bf5c9921f2554f058eca4fcf4ef0fde7 Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-InstanceActionsTestJSON-676633724-project Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ef52a471-ba57-48a9-9566-13b90df93e6c could not be found. Aug 06 21:05:09.945079 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ef52a471-ba57-48a9-9566-13b90df93e6c'} Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef52a471-ba57-48a9-9566-13b90df93e6c could not be found. Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:09.945946 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef52a471-ba57-48a9-9566-13b90df93e6c could not be found. Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef52a471-ba57-48a9-9566-13b90df93e6c could not be found. Aug 06 21:05:09.947308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:09.948845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] Returning 404 to user: Instance ef52a471-ba57-48a9-9566-13b90df93e6c could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:09.948845 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5382a2c-1354-4390-81be-49dc8f8d936a tempest-InstanceActionsTestJSON-676633724 tempest-InstanceActionsTestJSON-676633724-project] 10.222.0.33 "GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c" status: 404 len: 111 microversion: 2.1 time: 0.082598 Aug 06 21:05:09.954934 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1371/2701] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:09 2022] GET /compute/v2.1/servers/ef52a471-ba57-48a9-9566-13b90df93e6c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:09.968198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:09.968850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:09.991934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:09.992444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:09.993054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:09.993838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:09.994309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:09.997176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:10.351227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:10.378103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:10.433432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:10.434598 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e810ca7-6b7b-47a7-8882-ff06e7c8024d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1363 microversion: 2.47 time: 0.478480 Aug 06 21:05:10.454745 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1372/2702] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:09 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:11.477776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:11.478401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:11.496869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:11.497375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:11.497815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:11.510369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:11.511475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:11.515116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:11.836347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:11.850985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:11.856062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:11.860754 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f43f3170-6be4-4ab6-a588-de2f4f05a66d tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 200 len: 1363 microversion: 2.47 time: 0.384994 Aug 06 21:05:11.861709 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1373/2703] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:11 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:12.200955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d4e41b5a-e66a-4718-88de-a90a56100cbe tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Action: 'create', calling method: .version_select at 0x7f72a34eba60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-123950407", "policies": ["affinity"]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:12.257617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d4e41b5a-e66a-4718-88de-a90a56100cbe tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:12.274183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d4e41b5a-e66a-4718-88de-a90a56100cbe tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:12.367482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d4e41b5a-e66a-4718-88de-a90a56100cbe tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:12.377274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:12.396984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d4e41b5a-e66a-4718-88de-a90a56100cbe tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:12.449939 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d4e41b5a-e66a-4718-88de-a90a56100cbe tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.385999 Aug 06 21:05:12.456794 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1374/2704] 10.222.0.33 () {60 vars in 1174 bytes} [Sat Aug 6 21:05:12 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:12.470718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb7b07de-1534-42c2-8836-2a101f3d3f24 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Action: 'create', calling method: .version_select at 0x7f72a3526dc0>, body: {"server_group": {"name": "tempest-server-group-2082161766", "policies": ["affinity"]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:12.532986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-cb7b07de-1534-42c2-8836-2a101f3d3f24 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:12.545138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-cb7b07de-1534-42c2-8836-2a101f3d3f24 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:12.646823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-cb7b07de-1534-42c2-8836-2a101f3d3f24 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:12.684643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-cb7b07de-1534-42c2-8836-2a101f3d3f24 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:12.702788 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb7b07de-1534-42c2-8836-2a101f3d3f24 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.244356 Aug 06 21:05:12.704086 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1375/2705] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Aug 6 21:05:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:12.722484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-33432b32-f29d-4918-8b72-85511e8e7d8f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Action: 'create', calling method: .version_select at 0x7f72a3486700>, body: {"server_group": {"name": "tempest-server-group-2082161766", "policies": ["affinity"]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:12.781386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-33432b32-f29d-4918-8b72-85511e8e7d8f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:12.800137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-33432b32-f29d-4918-8b72-85511e8e7d8f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:12.875191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-33432b32-f29d-4918-8b72-85511e8e7d8f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:12.882468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-33432b32-f29d-4918-8b72-85511e8e7d8f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:12.900996 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-33432b32-f29d-4918-8b72-85511e8e7d8f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.189032 Aug 06 21:05:12.906601 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1376/2706] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Aug 6 21:05:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:12.908726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:12.909468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 219970b0-79d5-4925-9bac-b02cfe7dc2ec] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:12.917984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:12.918952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:12.919525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:12.920362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:12.921287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:12.922198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:12.940180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] HTTP exception thrown: Instance 219970b0-79d5-4925-9bac-b02cfe7dc2ec could not be found. Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Request method failure captured: Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec HTTP/1.1 Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tdX3G_SJS38bSMSXmfQfMO3NIicDx5rdbfGZDLVJuNy2RgLq0YypvheFJLy419EuA2PWGODbCaBfsmjyJg-PnKdjuadL6BLxMVvP00AUU7CE8QAIRkHE4lwO0wNvX9BM3zrAtUYRJIcCiWEgi58zLVB6o3xM5yJe8C543-IBu1Hg58 Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.47 Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4e1d1731bd4d4143a97447b303dd5e6a Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerShowV247Test-1429781684 Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:05:12.942419 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4e1d1731bd4d4143a97447b303dd5e6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4e1d1731bd4d4143a97447b303dd5e6a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4e1d1731bd4d4143a97447b303dd5e6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4e1d1731bd4d4143a97447b303dd5e6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerShowV247Test-1429781684 Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4e1d1731bd4d4143a97447b303dd5e6a Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerShowV247Test-1429781684 Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerShowV247Test-1429781684-project Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: d836c65ccbdb4c52bfbf17291d00c83b Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerShowV247Test-1429781684-project Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 219970b0-79d5-4925-9bac-b02cfe7dc2ec could not be found. Aug 06 21:05:12.944359 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '219970b0-79d5-4925-9bac-b02cfe7dc2ec'} Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 219970b0-79d5-4925-9bac-b02cfe7dc2ec could not be found. Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:12.945524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 219970b0-79d5-4925-9bac-b02cfe7dc2ec could not be found. Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 219970b0-79d5-4925-9bac-b02cfe7dc2ec could not be found. Aug 06 21:05:12.946990 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:12.948228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Returning 404 to user: Instance 219970b0-79d5-4925-9bac-b02cfe7dc2ec could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:12.949258 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-27501439-e474-4ebc-86f5-0a67b0e248d7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec" status: 404 len: 111 microversion: 2.47 time: 0.045292 Aug 06 21:05:12.950274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1377/2707] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:12 2022] GET /compute/v2.1/servers/219970b0-79d5-4925-9bac-b02cfe7dc2ec => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:05:12.957458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e4b5a0b-ae4e-4523-b68e-55f5c259c6e8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:12.999054 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e4b5a0b-ae4e-4523-b68e-55f5c259c6e8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/ee525150-3d14-4d47-adb4-96d4ae4d97eb" status: 204 len: 0 microversion: 2.1 time: 0.046985 Aug 06 21:05:13.000776 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1378/2708] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:05:12 2022] DELETE /compute/v2.1/os-server-groups/ee525150-3d14-4d47-adb4-96d4ae4d97eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:05:13.010208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:13.012191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 9db9b304-51e0-4661-ac0a-d9fe3ec26d11] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:13.025896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:13.027414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:13.028162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:13.029499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:13.030401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:13.031986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:13.068438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 9db9b304-51e0-4661-ac0a-d9fe3ec26d11] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:05:13.209540 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c36399f1-75c0-42a7-9931-1f1288b3707a tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11" status: 204 len: 0 microversion: 2.47 time: 0.205972 Aug 06 21:05:13.211060 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1379/2709] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:05:13 2022] DELETE /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:05:13.221836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6961aad-5701-45e8-82c6-15a062dc09fd tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:13.244022 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c6961aad-5701-45e8-82c6-15a062dc09fd tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.030192 Aug 06 21:05:13.244672 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1380/2710] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:05:13 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:13.256727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:13.257481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 9db9b304-51e0-4661-ac0a-d9fe3ec26d11] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:13.265909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:13.266580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:13.267069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:13.267979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:13.268443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:13.269534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:13.375523 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-89ce67e7-535c-4eb3-be14-64ff738495db tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.976165 Aug 06 21:05:13.377751 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1331/2711] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:05:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:13.384133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b904705-268a-4d44-b097-645081f8963d tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:13.450630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:13.470744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6b904705-268a-4d44-b097-645081f8963d tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/4b2eda02-4764-4fdd-9cfa-31adf4623f43" status: 204 len: 0 microversion: 2.1 time: 0.091155 Aug 06 21:05:13.474680 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1332/2712] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:05:13 2022] DELETE /compute/v2.1/os-server-groups/4b2eda02-4764-4fdd-9cfa-31adf4623f43 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:05:13.484796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:13.486378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:13.487671 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a89a12ea-2fb6-4c89-9683-e78c30412f29 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11" status: 200 len: 1362 microversion: 2.47 time: 0.235604 Aug 06 21:05:13.498038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-efb9b07c-78ad-403a-88f3-9eed8423a3a4 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Calling method '.version_select at 0x7f729d92c430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:13.509649 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1381/2713] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:13 2022] GET /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:13.535161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-52b7d634-74b0-44e9-a5f8-62e5098f09c1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:13.585956 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-52b7d634-74b0-44e9-a5f8-62e5098f09c1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.073112 Aug 06 21:05:13.596710 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1382/2714] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:05:13 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:13.612413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e1bc9a58-08c2-4c64-80af-ec4572e2af4b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Action: 'create', calling method: .version_select at 0x7f72a3520ee0>, body: {"server_group": {"name": "tempest-server-group-671891566", "policies": ["affinity"]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:13.697368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e1bc9a58-08c2-4c64-80af-ec4572e2af4b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:13.720123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e1bc9a58-08c2-4c64-80af-ec4572e2af4b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:13.846359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:13.908545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e1bc9a58-08c2-4c64-80af-ec4572e2af4b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:13.928061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e1bc9a58-08c2-4c64-80af-ec4572e2af4b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:13.974679 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e1bc9a58-08c2-4c64-80af-ec4572e2af4b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.376388 Aug 06 21:05:13.978309 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1383/2715] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Aug 6 21:05:13 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:13.990383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5697541-a997-40eb-a92d-be4c5e9c4518 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:14.065120 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5697541-a997-40eb-a92d-be4c5e9c4518 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1" status: 204 len: 0 microversion: 2.1 time: 0.079062 Aug 06 21:05:14.074176 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1384/2716] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:05:13 2022] DELETE /compute/v2.1/os-server-groups/2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:05:14.089169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-182cff64-865f-4baa-968b-f6bc241e9ac6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:14.117126 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-182cff64-865f-4baa-968b-f6bc241e9ac6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.039847 Aug 06 21:05:14.130630 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1385/2717] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:05:14 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:14.149900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-23f8b9bc-2b7b-49d6-a940-a2105d49db8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Action: 'create', calling method: .version_select at 0x7f72a3490b80>, body: {"server_group": {"name": "tempest-server-group-1058813272", "policies": ["anti-affinity"]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:14.216891 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-efb9b07c-78ad-403a-88f3-9eed8423a3a4 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/6aa2152e-3943-4d87-8a1a-bb0650a9e466" status: 200 len: 142 microversion: 2.1 time: 0.741525 Aug 06 21:05:14.218438 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1333/2718] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:05:13 2022] GET /compute/v2.1/os-floating-ips/6aa2152e-3943-4d87-8a1a-bb0650a9e466 => generated 142 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:14.223883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-23f8b9bc-2b7b-49d6-a940-a2105d49db8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:14.231151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d5d6e06a-1a48-4605-93b8-c40eb9f03faa tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Calling method '.version_select at 0x7f729d2f1040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:14.236502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-23f8b9bc-2b7b-49d6-a940-a2105d49db8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:14.344273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-23f8b9bc-2b7b-49d6-a940-a2105d49db8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:14.352290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-23f8b9bc-2b7b-49d6-a940-a2105d49db8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:14.371986 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-23f8b9bc-2b7b-49d6-a940-a2105d49db8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.234341 Aug 06 21:05:14.378071 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1386/2719] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Aug 6 21:05:14 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:05:14.384269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ebd12974-5f3f-4a5b-a58e-29894d654950 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:14.433648 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ebd12974-5f3f-4a5b-a58e-29894d654950 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/59f221e4-fe87-4b5b-884a-1c661904198e" status: 204 len: 0 microversion: 2.1 time: 0.053517 Aug 06 21:05:14.438523 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1387/2720] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:05:14 2022] DELETE /compute/v2.1/os-server-groups/59f221e4-fe87-4b5b-884a-1c661904198e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:05:14.444295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-385c247a-56cb-48d0-a795-286ad8770df9 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:14.478205 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-385c247a-56cb-48d0-a795-286ad8770df9 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.038357 Aug 06 21:05:14.479067 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1388/2721] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:05:14 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:14.526955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:14.527681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 9db9b304-51e0-4661-ac0a-d9fe3ec26d11] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:14.540147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:14.540707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:14.541148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:14.541917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:14.558743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:14.559489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:14.735956 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d5d6e06a-1a48-4605-93b8-c40eb9f03faa tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.509249 Aug 06 21:05:14.740939 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1334/2722] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 21:05:14 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:05:14.750845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-806872831", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "213969c4-7511-4e8b-965c-c36af8175c4a"}]}, "os:scheduler_hints": {"group": "ce7b1068-cecd-41b1-9505-9e134edf12a0"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:14.762040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:14.780819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:14.782419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd836c65ccbdb4c52bfbf17291d00c83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1d1731bd4d4143a97447b303dd5e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:14.792399 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8ae566eb-78ee-4634-8f01-9f85d11d1fd7 tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11" status: 200 len: 1362 microversion: 2.47 time: 0.270448 Aug 06 21:05:14.794759 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1389/2723] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:14 2022] GET /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:05:14.805859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-af88b8cc-e765-4f41-af5f-906944a389ba tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Calling method '.version_select at 0x7f72a3490dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:14.829737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] validate_networks() for [('213969c4-7511-4e8b-965c-c36af8175c4a', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:05:15.843860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:05:15.845128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:05:15.845765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:05:15.846321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:05:15.847208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:05:15.885245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:15.888300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:15.888767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:15.891184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:15.891658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:15.892110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:15.936916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:15.952206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:15.989836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:05:15.992268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:05:16.136934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:16.148163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:16.293973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:16.295974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:16.311546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Getting quotas for user a2df7f5bd4ae4f6d918bb18721a6ac5b and project 7dffa3e9ecbe4f118302bee4d90591ba. Resources: {'server_group_members'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:16.391108 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6477780d-620b-4127-97aa-da7cfa3543a0 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648668 Aug 06 21:05:16.398448 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1335/2724] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:05:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:05:16.407947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:16.411418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] [instance: 9db9b304-51e0-4661-ac0a-d9fe3ec26d11] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:16.425638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:16.426458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:16.427236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:16.429181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:16.429765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:16.430671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:16.469845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] HTTP exception thrown: Instance 9db9b304-51e0-4661-ac0a-d9fe3ec26d11 could not be found. Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Request method failure captured: Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11 HTTP/1.1 Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tdX3G_SJS38bSMSXmfQfMO3NIicDx5rdbfGZDLVJuNy2RgLq0YypvheFJLy419EuA2PWGODbCaBfsmjyJg-PnKdjuadL6BLxMVvP00AUU7CE8QAIRkHE4lwO0wNvX9BM3zrAtUYRJIcCiWEgi58zLVB6o3xM5yJe8C543-IBu1Hg58 Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.47 Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 4e1d1731bd4d4143a97447b303dd5e6a Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerShowV247Test-1429781684 Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:05:16.481296 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4e1d1731bd4d4143a97447b303dd5e6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4e1d1731bd4d4143a97447b303dd5e6a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4e1d1731bd4d4143a97447b303dd5e6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4e1d1731bd4d4143a97447b303dd5e6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerShowV247Test-1429781684 Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 4e1d1731bd4d4143a97447b303dd5e6a Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerShowV247Test-1429781684 Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerShowV247Test-1429781684-project Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d836c65ccbdb4c52bfbf17291d00c83b Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerShowV247Test-1429781684-project Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 9db9b304-51e0-4661-ac0a-d9fe3ec26d11 could not be found. Aug 06 21:05:16.482804 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '9db9b304-51e0-4661-ac0a-d9fe3ec26d11'} Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9db9b304-51e0-4661-ac0a-d9fe3ec26d11 could not be found. Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:16.483596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9db9b304-51e0-4661-ac0a-d9fe3ec26d11 could not be found. Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9db9b304-51e0-4661-ac0a-d9fe3ec26d11 could not be found. Aug 06 21:05:16.484746 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:16.487017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] Returning 404 to user: Instance 9db9b304-51e0-4661-ac0a-d9fe3ec26d11 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:16.490733 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9c18bfa8-a8cf-4569-bec8-9fed33ffd71f tempest-ServerShowV247Test-1429781684 tempest-ServerShowV247Test-1429781684-project] 10.222.0.33 "GET /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11" status: 404 len: 111 microversion: 2.47 time: 0.096861 Aug 06 21:05:16.491718 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1336/2725] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:16 2022] GET /compute/v2.1/servers/9db9b304-51e0-4661-ac0a-d9fe3ec26d11 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:05:16.500370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:16.502514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:16.528112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:16.529026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:16.529653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:16.531223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:16.531915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:16.532507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:16.572289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:05:16.780716 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1cc9bd00-7560-4195-b162-cf7928ceb13d tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 204 len: 0 microversion: 2.1 time: 0.287414 Aug 06 21:05:16.783347 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1337/2726] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:05:16 2022] DELETE /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:05:16.795058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-06979582-de33-41b5-a679-9f46321c9c87 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:16.797121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-06979582-de33-41b5-a679-9f46321c9c87 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:17.047837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-06979582-de33-41b5-a679-9f46321c9c87 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:17.066696 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-06979582-de33-41b5-a679-9f46321c9c87 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1212 microversion: 2.1 time: 0.279426 Aug 06 21:05:17.070744 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1338/2727] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:16 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1212 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:17.092067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:17.094233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:17.117767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:17.118355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:17.118838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:17.121021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:17.121842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:17.122951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:17.336100 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-af88b8cc-e765-4f41-af5f-906944a389ba tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/6aa2152e-3943-4d87-8a1a-bb0650a9e466" status: 202 len: 0 microversion: 2.1 time: 2.539738 Aug 06 21:05:17.342021 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1390/2728] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:05:14 2022] DELETE /compute/v2.1/os-floating-ips/6aa2152e-3943-4d87-8a1a-bb0650a9e466 => generated 0 bytes in 2546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:05:17.348232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba7aa902-cd65-451b-9bbb-6e02ebd95f61 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Action: 'create', calling method: .version_select at 0x7f72a3520430>, body: {"pool": null} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:17.973728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:17.987466 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-74269dc2-d8fd-484d-a814-561e380c9df8 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1666 microversion: 2.1 time: 0.915426 Aug 06 21:05:17.988073 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1339/2729] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:17 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1666 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:18.093391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:18.094053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:18.108682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:18.109136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:18.109592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:18.110324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:18.110817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:18.111257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:18.114403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:18.379893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:18.761270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:18.775540 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-34b35f3c-a2b0-4241-80d7-de55876c2d8b tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1208 microversion: 2.1 time: 0.687092 Aug 06 21:05:18.777060 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1340/2730] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:18 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1208 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:05:19.011371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:19.012465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:19.027057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:19.027558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:19.035171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:19.037039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:19.037613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:19.040712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:19.520599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:19.530621 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c05c48b-9386-41e5-bf7a-912883e15551 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1666 microversion: 2.1 time: 0.524503 Aug 06 21:05:19.538902 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1341/2731] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:19 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1666 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:05:19.798064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:19.798919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:19.807255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:19.808044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:19.808793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:19.810024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:19.811948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:19.812663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:19.955591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:19.971079 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c221ff24-dbce-46c4-ad3a-2b41678b3fc8 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1270 microversion: 2.1 time: 0.175472 Aug 06 21:05:19.971710 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1342/2732] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:19 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:05:20.493534 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba7aa902-cd65-451b-9bbb-6e02ebd95f61 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.149341 Aug 06 21:05:20.494230 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1391/2733] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:05:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:20.512524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9e8fea50-330e-4b6e-b4f3-0e0866a16166 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Calling method '.version_select at 0x7f729d302160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:20.554037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:20.554759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:20.567051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:20.567553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:20.567995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:20.569450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:20.569915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:20.570668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:20.660320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:20.686316 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ef942c02-f767-4a24-a90d-93379f56b048 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1600 microversion: 2.1 time: 0.137496 Aug 06 21:05:20.701475 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1392/2734] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:20 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:21.021531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:21.025320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:21.068402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:21.072340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:21.074958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:21.076208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:21.077372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:21.078093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:21.450137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:21.476006 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f05b494c-b5fb-4b93-9fa8-c3bc69b6da32 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1312 microversion: 2.1 time: 0.484000 Aug 06 21:05:21.476599 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1393/2735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:20 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1312 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:21.618242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5837c3bf-ac73-461f-9bc0-7bb99ff4382e req-7da87cb3-3a2e-4c77-aac2-1357354ac306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff4055b-2061-4a10-a01a-34621eafbb70", "name": "network-vif-deleted", "tag": "8c161fe9-da1e-4379-b4eb-c27bbd43db45"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:21.653779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5837c3bf-ac73-461f-9bc0-7bb99ff4382e req-7da87cb3-3a2e-4c77-aac2-1357354ac306 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:21.662840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5837c3bf-ac73-461f-9bc0-7bb99ff4382e req-7da87cb3-3a2e-4c77-aac2-1357354ac306 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:21.677331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5837c3bf-ac73-461f-9bc0-7bb99ff4382e req-7da87cb3-3a2e-4c77-aac2-1357354ac306 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:21.699845 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5837c3bf-ac73-461f-9bc0-7bb99ff4382e req-7da87cb3-3a2e-4c77-aac2-1357354ac306 service nova] Creating event network-vif-deleted:8c161fe9-da1e-4379-b4eb-c27bbd43db45 for instance 3ff4055b-2061-4a10-a01a-34621eafbb70 on nch2-master-1 Aug 06 21:05:21.711021 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5837c3bf-ac73-461f-9bc0-7bb99ff4382e req-7da87cb3-3a2e-4c77-aac2-1357354ac306 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096432 Aug 06 21:05:21.716836 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1394/2736] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:05:21.724852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:21.725653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:21.749295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:21.749817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:21.750312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:21.759217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:21.759767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:21.764220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:21.865291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:21.866202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:21.866851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:21.867498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lazy-loading 'fault' on Instance uuid 3ff4055b-2061-4a10-a01a-34621eafbb70 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:05:21.984635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e47a63c2e64d3584e044fae0fe2270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ccfef33a94ae0ab5e082095e7ab1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:22.004758 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc624c3d-b4a9-4410-8a86-d73adb4e8975 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 200 len: 1316 microversion: 2.1 time: 0.286530 Aug 06 21:05:22.028778 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1395/2737] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:21 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:22.497952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:22.498691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:22.507961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:22.509731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:22.513375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:22.514325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:22.516220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:22.516870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:22.817546 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9e8fea50-330e-4b6e-b4f3-0e0866a16166 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/88a69448-beea-4d62-afee-435368af3298" status: 202 len: 0 microversion: 2.1 time: 2.313117 Aug 06 21:05:22.825203 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1343/2738] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:05:20 2022] DELETE /compute/v2.1/os-floating-ips/88a69448-beea-4d62-afee-435368af3298 => generated 0 bytes in 2321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:05:22.835164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03729c06-07c4-429d-bec6-4876561450bb tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Calling method '.version_select at 0x7f729d2f1940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:22.945343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-03729c06-07c4-429d-bec6-4876561450bb tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 88a69448-beea-4d62-afee-435368af3298 could not be found", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:05:22.946205 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-03729c06-07c4-429d-bec6-4876561450bb tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] HTTP exception thrown: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03729c06-07c4-429d-bec6-4876561450bb tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Request method failure captured: Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/os-floating-ips/88a69448-beea-4d62-afee-435368af3298 HTTP/1.1 Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teEDiQPi6_G42Czzs-95YWB6FxjpZLLUCAkjYnPJRRLgLR48xywh70XGGbpvvwRHONewwOxmHG71fYKGpmdY3kav-ckY_WDToG3Ugu9cfDF2gFCxIU1kFaUubRpyJUIJnGij9T3l-cHd_0Edt5hoOBqLb-AxEQDRvEb1WhWcJuMa6g Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 92692c7d7d124e3599b2e764da8415ef Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FloatingIPsTestJSON-1254034377 Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:05:22.950341 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92692c7d7d124e3599b2e764da8415ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92692c7d7d124e3599b2e764da8415ef", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92692c7d7d124e3599b2e764da8415ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92692c7d7d124e3599b2e764da8415ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FloatingIPsTestJSON-1254034377 Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 92692c7d7d124e3599b2e764da8415ef Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1254034377 Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FloatingIPsTestJSON-1254034377-project Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1f9190aa4d52460f8636df2d87f11792 Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FloatingIPsTestJSON-1254034377-project Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: exception: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '88a69448-beea-4d62-afee-435368af3298'} Aug 06 21:05:22.951979 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:05:22.952823 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 88a69448-beea-4d62-afee-435368af3298 could not be found Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384429c4-d2b1-4021-a4fb-1050d8b4bff1'] Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298. Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:22.954129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:22.955914 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:22.957310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 Aug 06 21:05:22.957310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:22.957310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03729c06-07c4-429d-bec6-4876561450bb tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Returning 404 to user: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:22.959047 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03729c06-07c4-429d-bec6-4876561450bb tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/88a69448-beea-4d62-afee-435368af3298" status: 404 len: 111 microversion: 2.1 time: 0.131670 Aug 06 21:05:22.959047 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1344/2739] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:05:22 2022] GET /compute/v2.1/os-floating-ips/88a69448-beea-4d62-afee-435368af3298 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:22.975366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5758689-346a-4ad5-93d1-d562e47a7537 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Calling method '.version_select at 0x7f729d34de50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:23.024668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:23.029137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:23.038257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG neutronclient.v2_0.client [None req-b5758689-346a-4ad5-93d1-d562e47a7537 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 88a69448-beea-4d62-afee-435368af3298 could not be found", "detail": ""}} {{(pid=142462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:05:23.039292 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b5758689-346a-4ad5-93d1-d562e47a7537 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] HTTP exception thrown: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5758689-346a-4ad5-93d1-d562e47a7537 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Request method failure captured: Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-floating-ips/88a69448-beea-4d62-afee-435368af3298 HTTP/1.1 Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teEDiQPi6_G42Czzs-95YWB6FxjpZLLUCAkjYnPJRRLgLR48xywh70XGGbpvvwRHONewwOxmHG71fYKGpmdY3kav-ckY_WDToG3Ugu9cfDF2gFCxIU1kFaUubRpyJUIJnGij9T3l-cHd_0Edt5hoOBqLb-AxEQDRvEb1WhWcJuMa6g Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 92692c7d7d124e3599b2e764da8415ef Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FloatingIPsTestJSON-1254034377 Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:05:23.041944 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/92692c7d7d124e3599b2e764da8415ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_92692c7d7d124e3599b2e764da8415ef", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92692c7d7d124e3599b2e764da8415ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/92692c7d7d124e3599b2e764da8415ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FloatingIPsTestJSON-1254034377 Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 92692c7d7d124e3599b2e764da8415ef Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1254034377 Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FloatingIPsTestJSON-1254034377-project Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1f9190aa4d52460f8636df2d87f11792 Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FloatingIPsTestJSON-1254034377-project Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: exception: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '88a69448-beea-4d62-afee-435368af3298'} Aug 06 21:05:23.043810 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:05:23.044843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 88a69448-beea-4d62-afee-435368af3298 could not be found Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5fb692a-b563-4bc7-b03c-c4c4eb1846d8'] Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298. Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:23.046533 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:23.048256 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:23.049619 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 Aug 06 21:05:23.049619 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.049619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5758689-346a-4ad5-93d1-d562e47a7537 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] Returning 404 to user: Floating IP not found for ID 88a69448-beea-4d62-afee-435368af3298 {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:23.050883 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b5758689-346a-4ad5-93d1-d562e47a7537 tempest-FloatingIPsTestJSON-1254034377 tempest-FloatingIPsTestJSON-1254034377-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/88a69448-beea-4d62-afee-435368af3298" status: 404 len: 111 microversion: 2.1 time: 0.081046 Aug 06 21:05:23.055094 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1137c3c3-3f87-4962-879b-23d5ecee23d1 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1312 microversion: 2.1 time: 0.561637 Aug 06 21:05:23.055232 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1345/2740] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:05:22 2022] DELETE /compute/v2.1/os-floating-ips/88a69448-beea-4d62-afee-435368af3298 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:23.055471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1396/2741] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:22 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1312 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:23.066690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:23.067323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] [instance: 3ff4055b-2061-4a10-a01a-34621eafbb70] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:23.086456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:23.094036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:23.094739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:23.095886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:23.096619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:23.097144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:23.140367 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] HTTP exception thrown: Instance 3ff4055b-2061-4a10-a01a-34621eafbb70 could not be found. Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Request method failure captured: Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 HTTP/1.1 Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tdFVl24LNDNBd2f_GcFFlVTl53rsRuarjiNDZdY5Oiw4ycqQ1ZO70o7xu6u4daPqykhAJ58H8Ycqptdk2s456ZwIB5ZKGkhSRaNgsaZD_AI4QyAW5kfsiX3P-JYx-Yvx-ATfr8aN4jpa2WyQ0qRAfJhIk2_Ue0fM10Y3Mx-vJUUNNw Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 609ccfef33a94ae0ab5e082095e7ab1e Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestFqdnHostnames-441289886 Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:05:23.144798 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/609ccfef33a94ae0ab5e082095e7ab1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_609ccfef33a94ae0ab5e082095e7ab1e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/609ccfef33a94ae0ab5e082095e7ab1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/609ccfef33a94ae0ab5e082095e7ab1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestFqdnHostnames-441289886 Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 609ccfef33a94ae0ab5e082095e7ab1e Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-441289886 Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestFqdnHostnames-441289886-project Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a7e47a63c2e64d3584e044fae0fe2270 Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestFqdnHostnames-441289886-project Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 3ff4055b-2061-4a10-a01a-34621eafbb70 could not be found. Aug 06 21:05:23.146521 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '3ff4055b-2061-4a10-a01a-34621eafbb70'} Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff4055b-2061-4a10-a01a-34621eafbb70 could not be found. Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:23.147504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff4055b-2061-4a10-a01a-34621eafbb70 could not be found. Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff4055b-2061-4a10-a01a-34621eafbb70 could not be found. Aug 06 21:05:23.148923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:23.169026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Returning 404 to user: Instance 3ff4055b-2061-4a10-a01a-34621eafbb70 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:23.169963 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c7471829-21c1-4cea-b8a4-dd7713c6b581 tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70" status: 404 len: 111 microversion: 2.1 time: 0.113854 Aug 06 21:05:23.170640 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1346/2742] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:23 2022] GET /compute/v2.1/servers/3ff4055b-2061-4a10-a01a-34621eafbb70 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:23.182918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5aab25e-2739-4596-824b-e1c2ccdb1d5a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] Calling method '.version_select at 0x7f72a35d0160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:23.243352 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5aab25e-2739-4596-824b-e1c2ccdb1d5a tempest-ServersTestFqdnHostnames-441289886 tempest-ServersTestFqdnHostnames-441289886-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959580876" status: 202 len: 0 microversion: 2.1 time: 0.068287 Aug 06 21:05:23.247642 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1397/2743] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:05:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959580876 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:05:23.596120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f96cb176-966f-48c2-9594-7dc9a4d5de07 tempest-QuotaClassesAdmin257Test-1605494350 tempest-QuotaClassesAdmin257Test-1605494350-project-admin] Calling method '.version_select at 0x7f729d92c3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:23.597479 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:05:23.597479 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:05:23.619179 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f96cb176-966f-48c2-9594-7dc9a4d5de07 tempest-QuotaClassesAdmin257Test-1605494350 tempest-QuotaClassesAdmin257Test-1605494350-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.255530 Aug 06 21:05:23.634815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-323bf9f4-a71e-4a46-85e0-1150b74caa92 tempest-QuotaClassesAdmin257Test-1605494350 tempest-QuotaClassesAdmin257Test-1605494350-project-admin] Action: 'update', calling method: .version_select at 0x7f72a35baaf0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:23.639633 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:05:23.639633 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:05:23.643680 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1347/2744] 10.222.0.33 () {60 vars in 1226 bytes} [Sat Aug 6 21:05:23 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:05:23.816899 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-323bf9f4-a71e-4a46-85e0-1150b74caa92 tempest-QuotaClassesAdmin257Test-1605494350 tempest-QuotaClassesAdmin257Test-1605494350-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.186083 Aug 06 21:05:23.817763 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1398/2745] 10.222.0.33 () {62 vars in 1247 bytes} [Sat Aug 6 21:05:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 21:05:23.832357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-de937000-574c-455c-a5a6-dbe56ec575c7 tempest-QuotaClassesAdmin257Test-1605494350 tempest-QuotaClassesAdmin257Test-1605494350-project-admin] Calling method '.version_select at 0x7f729d92c9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:23.847234 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-de937000-574c-455c-a5a6-dbe56ec575c7 tempest-QuotaClassesAdmin257Test-1605494350 tempest-QuotaClassesAdmin257Test-1605494350-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.020519 Aug 06 21:05:23.854820 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1348/2746] 10.222.0.33 () {60 vars in 1226 bytes} [Sat Aug 6 21:05:23 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:05:23.859519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b957418d-0260-4670-a079-8fbb28c1ae61 tempest-QuotaClassesAdmin257Test-1605494350 tempest-QuotaClassesAdmin257Test-1605494350-project-admin] Action: 'update', calling method: .version_select at 0x7f72a35bad30>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:23.890707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=7,nova_api:INSERT=4,nova_api:UPDATE=9 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:23.968606 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b957418d-0260-4670-a079-8fbb28c1ae61 tempest-QuotaClassesAdmin257Test-1605494350 tempest-QuotaClassesAdmin257Test-1605494350-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.112837 Aug 06 21:05:23.969598 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1399/2747] 10.222.0.33 () {62 vars in 1247 bytes} [Sat Aug 6 21:05:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 21:05:24.031083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1c484745-c166-4086-81b6-172a15c19333 req-24cb82db-fe2f-4e2c-aa28-5aaf0688d85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd68e5c4-39bd-4c79-bb5f-e419d80cd081", "tag": "868bd349-0314-40d1-b952-b14f482ebd60"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:24.046965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1c484745-c166-4086-81b6-172a15c19333 req-24cb82db-fe2f-4e2c-aa28-5aaf0688d85c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:24.050251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1c484745-c166-4086-81b6-172a15c19333 req-24cb82db-fe2f-4e2c-aa28-5aaf0688d85c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:24.050769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1c484745-c166-4086-81b6-172a15c19333 req-24cb82db-fe2f-4e2c-aa28-5aaf0688d85c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:24.075540 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1c484745-c166-4086-81b6-172a15c19333 req-24cb82db-fe2f-4e2c-aa28-5aaf0688d85c service nova] Creating event network-changed:868bd349-0314-40d1-b952-b14f482ebd60 for instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 on nch2-master-1 Aug 06 21:05:24.077881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:24.078714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:24.091518 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1c484745-c166-4086-81b6-172a15c19333 req-24cb82db-fe2f-4e2c-aa28-5aaf0688d85c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064376 Aug 06 21:05:24.092088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:24.092594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:24.093228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:24.094123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:24.096305 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1349/2748] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:24.097408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:24.098015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:24.496821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:24.537599 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8a0a0b83-7849-41f1-9478-7a01d383fc53 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1312 microversion: 2.1 time: 0.458695 Aug 06 21:05:24.540853 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1400/2749] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:24 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1312 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:25.566882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:25.568238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:25.590989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:25.595647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:25.601876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:25.609320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:25.614327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:25.615181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:25.923001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:26.261662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:26.307858 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ea558f82-5677-49a0-8274-6fb8eb24b9ef tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1312 microversion: 2.1 time: 0.744218 Aug 06 21:05:26.309053 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1350/2750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:25 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1312 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:05:27.330999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:27.331794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:27.342129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:27.342771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:27.343290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:27.344101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:27.344802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:27.345321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:27.874369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:27.886966 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4eccea3e-2300-4b07-87b3-ac6f34dbab1e tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1312 microversion: 2.1 time: 0.560110 Aug 06 21:05:27.887564 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1401/2751] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:27 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1312 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:28.913273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:28.913927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:28.930573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:28.932960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:28.933820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:28.934865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:28.935772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:28.936442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:29.824016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:29.839453 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e111a689-d557-4878-b9fe-e9aed7410ad3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1312 microversion: 2.1 time: 0.932727 Aug 06 21:05:29.840508 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1351/2752] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:28 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1312 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:30.866612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:30.873501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:30.961551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:30.964830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:30.977410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:30.981173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:30.981679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:30.982130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:31.176670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2b4b8ed1-86bd-439e-acc4-abf1e3ef3679 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Calling method '.version_select at 0x7f729d9ab4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:31.320868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2b4b8ed1-86bd-439e-acc4-abf1e3ef3679 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 200 len: 371 microversion: 2.1 time: 0.415852 Aug 06 21:05:31.325318 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1352/2753] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:05:30 2022] GET /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:31.334997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-79d677d9-7cad-4e72-8ff6-e07c8fd10f8e tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Action: 'update', calling method: .version_select at 0x7f729d357040>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:31.476160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79d677d9-7cad-4e72-8ff6-e07c8fd10f8e tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:31.479519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79d677d9-7cad-4e72-8ff6-e07c8fd10f8e tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:31.481016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79d677d9-7cad-4e72-8ff6-e07c8fd10f8e tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:31.481991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79d677d9-7cad-4e72-8ff6-e07c8fd10f8e tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:31.483288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79d677d9-7cad-4e72-8ff6-e07c8fd10f8e tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:31.487242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-79d677d9-7cad-4e72-8ff6-e07c8fd10f8e tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:31.624395 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-79d677d9-7cad-4e72-8ff6-e07c8fd10f8e tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 200 len: 328 microversion: 2.1 time: 0.293448 Aug 06 21:05:31.625762 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1353/2754] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:05:31 2022] PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 328 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:31.806033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:31.822101 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2100ba69-b3fa-40a9-a5fb-cdd5be5a8b20 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1312 microversion: 2.1 time: 0.960943 Aug 06 21:05:31.835215 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1402/2755] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:30 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1312 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:31.981599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-202974989", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:32.077661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:05:32.847704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:32.849069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:32.868384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:32.869233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:32.870435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:32.872211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:32.873902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:32.874621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:33.159096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:05:33.159610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:05:33.160077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:05:33.160526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:05:33.161015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:05:33.185650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:33.186254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:33.187348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:33.188417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:33.189019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:33.189524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:33.232373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Getting quotas for project 8482c922e64f40d4b95793ac70044614. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:33.244920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Getting quotas for user e35e4972ca5547ca8abb304343bf1031 and project 8482c922e64f40d4b95793ac70044614. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:33.282375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.utils [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] cores quota exceeded for 8482c922e64f40d4b95793ac70044614, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=142462) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 06 21:05:33.283292 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Request method failure captured: Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 144 Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teZCHgH98VmYNZoUKnCRSqgPO9M2PKt8_qwhSaQklUK1TZK1Wue_nCseX8z5TXncat-POqbLnr-2f7bSQpMP-hK4qeAZ9BeT8Uh7ogQu3qDYhZAy8QLqiYsXQUQ-3WGuFdkBgMMgPmqBxvxJCtAEbzUYRuBt6n1NS9pHUi7r_yl1uw Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8482c922e64f40d4b95793ac70044614 Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:05:33.310339 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8482c922e64f40d4b95793ac70044614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8482c922e64f40d4b95793ac70044614", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8482c922e64f40d4b95793ac70044614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8482c922e64f40d4b95793ac70044614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8482c922e64f40d4b95793ac70044614 Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-QuotasAdminNegativeTest-1142244637-project Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e35e4972ca5547ca8abb304343bf1031 Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-QuotasAdminNegativeTest-1142244637-project Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-202974989", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} Aug 06 21:05:33.312176 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-202974989', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452'}}} Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 06 21:05:33.314438 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:33.315646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:33.317967 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:33.320959 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:33.320959 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:33.320959 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:33.320959 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:33.320959 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 06 21:05:33.320959 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:33.320959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:33.320959 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5fd8282f-771d-4d9e-9bab-47584764330e tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.461112 Aug 06 21:05:33.320959 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1354/2756] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:05:31 2022] POST /compute/v2.1/servers => generated 111 bytes in 1467 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:33.326014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-13ab55b7-8e51-41e3-8ca6-af3227acd865 req-b5b7f2ef-ff4b-45eb-975b-1bcb9392e174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd68e5c4-39bd-4c79-bb5f-e419d80cd081", "name": "network-vif-plugged", "status": "completed", "tag": "868bd349-0314-40d1-b952-b14f482ebd60"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:33.362100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-13ab55b7-8e51-41e3-8ca6-af3227acd865 req-b5b7f2ef-ff4b-45eb-975b-1bcb9392e174 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:33.363582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-13ab55b7-8e51-41e3-8ca6-af3227acd865 req-b5b7f2ef-ff4b-45eb-975b-1bcb9392e174 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:33.365535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-13ab55b7-8e51-41e3-8ca6-af3227acd865 req-b5b7f2ef-ff4b-45eb-975b-1bcb9392e174 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:33.403180 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-13ab55b7-8e51-41e3-8ca6-af3227acd865 req-b5b7f2ef-ff4b-45eb-975b-1bcb9392e174 service nova] Creating event network-vif-plugged:868bd349-0314-40d1-b952-b14f482ebd60 for instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 on nch2-master-1 Aug 06 21:05:33.424467 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-13ab55b7-8e51-41e3-8ca6-af3227acd865 req-b5b7f2ef-ff4b-45eb-975b-1bcb9392e174 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103441 Aug 06 21:05:33.426320 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1355/2757] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:33.449696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9792d4e0-d169-474b-ad44-947d53cf5873 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Action: 'update', calling method: .version_select at 0x7f729d2b1d30>, body: {"quota_set": {"cores": 20}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:33.649461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9792d4e0-d169-474b-ad44-947d53cf5873 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:33.650338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9792d4e0-d169-474b-ad44-947d53cf5873 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:33.652466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9792d4e0-d169-474b-ad44-947d53cf5873 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:33.654529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9792d4e0-d169-474b-ad44-947d53cf5873 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:33.657373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9792d4e0-d169-474b-ad44-947d53cf5873 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:33.658867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9792d4e0-d169-474b-ad44-947d53cf5873 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:33.797974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:33.812344 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f423827f-6577-4236-95c3-e7e4cd82e1ae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1312 microversion: 2.1 time: 0.968978 Aug 06 21:05:33.813499 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9792d4e0-d169-474b-ad44-947d53cf5873 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 200 len: 329 microversion: 2.1 time: 0.381066 Aug 06 21:05:33.815214 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1356/2758] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:05:33 2022] PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 329 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:33.815801 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1403/2759] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:32 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1312 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:05:33.852202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d15678ba-1007-406c-9119-47243d7f7f1b tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Calling method '.version_select at 0x7f729d2b10d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:34.130344 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d15678ba-1007-406c-9119-47243d7f7f1b tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 200 len: 371 microversion: 2.1 time: 0.282784 Aug 06 21:05:34.139334 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1357/2760] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:05:33 2022] GET /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:34.145388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-36a88093-4d61-4ab6-9225-db45da241b0a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Action: 'update', calling method: .version_select at 0x7f72a35d0940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:34.159861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:34.364067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36a88093-4d61-4ab6-9225-db45da241b0a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:34.364568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36a88093-4d61-4ab6-9225-db45da241b0a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:34.365010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36a88093-4d61-4ab6-9225-db45da241b0a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:34.365763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36a88093-4d61-4ab6-9225-db45da241b0a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:34.366224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36a88093-4d61-4ab6-9225-db45da241b0a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:34.366691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36a88093-4d61-4ab6-9225-db45da241b0a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:34.560001 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-36a88093-4d61-4ab6-9225-db45da241b0a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 200 len: 328 microversion: 2.1 time: 0.415854 Aug 06 21:05:34.563757 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1404/2761] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:05:34 2022] PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 328 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:05:34.659599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1200650491", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:34.788473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:05:34.844393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:34.844903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:34.875483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:34.875999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:34.883355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:34.886041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:34.890206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:34.891497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:35.562731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:35.584671 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-580dc314-2041-4c78-a0bf-24ff7d62d1b6 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1312 microversion: 2.1 time: 0.746091 Aug 06 21:05:35.585873 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1405/2762] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:34 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1312 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:35.736264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1797372952", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0827ee4a-610f-48e2-8263-78e781630780"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:35.893934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] validate_networks() for [('0827ee4a-610f-48e2-8263-78e781630780', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:05:35.903849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:05:35.905246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:05:35.906263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:05:35.907099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:05:35.907894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:05:35.961052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:35.965087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:35.965646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:35.973844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:35.978434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:35.980770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:36.068676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Getting quotas for project 8482c922e64f40d4b95793ac70044614. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:36.081881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Getting quotas for user e35e4972ca5547ca8abb304343bf1031 and project 8482c922e64f40d4b95793ac70044614. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:36.087815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:36.112661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.utils [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] instances quota exceeded for 8482c922e64f40d4b95793ac70044614, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=142462) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 06 21:05:36.113629 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Request method failure captured: Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 145 Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teZCHgH98VmYNZoUKnCRSqgPO9M2PKt8_qwhSaQklUK1TZK1Wue_nCseX8z5TXncat-POqbLnr-2f7bSQpMP-hK4qeAZ9BeT8Uh7ogQu3qDYhZAy8QLqiYsXQUQ-3WGuFdkBgMMgPmqBxvxJCtAEbzUYRuBt6n1NS9pHUi7r_yl1uw Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8482c922e64f40d4b95793ac70044614 Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:05:36.118263 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8482c922e64f40d4b95793ac70044614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8482c922e64f40d4b95793ac70044614", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8482c922e64f40d4b95793ac70044614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8482c922e64f40d4b95793ac70044614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8482c922e64f40d4b95793ac70044614 Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-QuotasAdminNegativeTest-1142244637-project Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e35e4972ca5547ca8abb304343bf1031 Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-QuotasAdminNegativeTest-1142244637-project Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1200650491", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} Aug 06 21:05:36.120971 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1200650491', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452'}}} Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 06 21:05:36.121702 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:36.124851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:36.129110 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:36.133933 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:36.133933 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:36.133933 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:36.133933 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:36.133933 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 06 21:05:36.133933 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:36.145921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:36.147288 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-716f5d57-4b65-4ba1-9467-edc9991656b2 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.495386 Aug 06 21:05:36.148627 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1358/2763] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:05:34 2022] POST /compute/v2.1/servers => generated 119 bytes in 1498 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:36.169293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4b1618d6-880b-4f67-b7e2-9c938801e3d1 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Action: 'update', calling method: .version_select at 0x7f729d2b1940>, body: {"quota_set": {"instances": 10}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:36.304904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b1618d6-880b-4f67-b7e2-9c938801e3d1 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:36.309907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b1618d6-880b-4f67-b7e2-9c938801e3d1 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:36.312314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b1618d6-880b-4f67-b7e2-9c938801e3d1 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:36.315528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b1618d6-880b-4f67-b7e2-9c938801e3d1 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:36.316270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b1618d6-880b-4f67-b7e2-9c938801e3d1 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:36.318415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b1618d6-880b-4f67-b7e2-9c938801e3d1 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:36.449680 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4b1618d6-880b-4f67-b7e2-9c938801e3d1 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 200 len: 329 microversion: 2.1 time: 0.293419 Aug 06 21:05:36.455267 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1359/2764] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:05:36 2022] PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 329 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:36.465427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3cc19f02-b6a7-4c6d-a3b4-619896a9d1e0 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Calling method '.version_select at 0x7f729d30b550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:36.610274 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3cc19f02-b6a7-4c6d-a3b4-619896a9d1e0 tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 200 len: 371 microversion: 2.1 time: 0.148997 Aug 06 21:05:36.611169 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1360/2765] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:05:36 2022] GET /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:36.617873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:36.621408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:36.642483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:36.644602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:36.645183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:36.646092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:36.646750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:36.647280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:37.130989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:37.142865 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-da252933-a653-47db-8903-ceca7f5bc64f tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1495 microversion: 2.1 time: 0.530118 Aug 06 21:05:37.160924 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1361/2766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:36 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1495 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:37.171608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-623c825f-8b80-4c1c-9da2-c469771ee4ad tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Action: 'update', calling method: .version_select at 0x7f729d27f3a0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:37.298944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-623c825f-8b80-4c1c-9da2-c469771ee4ad tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:37.300005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-623c825f-8b80-4c1c-9da2-c469771ee4ad tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:37.301741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-623c825f-8b80-4c1c-9da2-c469771ee4ad tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:37.303393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-623c825f-8b80-4c1c-9da2-c469771ee4ad tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:37.306676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-623c825f-8b80-4c1c-9da2-c469771ee4ad tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:37.309993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-623c825f-8b80-4c1c-9da2-c469771ee4ad tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:37.393004 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-623c825f-8b80-4c1c-9da2-c469771ee4ad tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 200 len: 325 microversion: 2.1 time: 0.230634 Aug 06 21:05:37.394234 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1362/2767] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:05:37 2022] PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 325 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:37.403903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72ab3e54-868a-4be6-a2d8-f49c7a199337 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:37.454268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.compute.server_groups [None req-72ab3e54-868a-4be6-a2d8-f49c7a199337 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Querying cell 7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) for 1 instances {{(pid=142462) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 06 21:05:37.455406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72ab3e54-868a-4be6-a2d8-f49c7a199337 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:37.456317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72ab3e54-868a-4be6-a2d8-f49c7a199337 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:37.457322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72ab3e54-868a-4be6-a2d8-f49c7a199337 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:37.485293 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72ab3e54-868a-4be6-a2d8-f49c7a199337 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/ce7b1068-cecd-41b1-9505-9e134edf12a0" status: 200 len: 221 microversion: 2.1 time: 0.089513 Aug 06 21:05:37.486734 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1363/2768] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:05:37 2022] GET /compute/v2.1/os-server-groups/ce7b1068-cecd-41b1-9505-9e134edf12a0 => generated 221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:37.500182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:37.501085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:37.520553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:37.522959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:37.523711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:37.527756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:37.528506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:37.529164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:37.587414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:05:37.609744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:05:37.610244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:05:37.610682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:05:37.611151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:05:37.611610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:05:37.637438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:37.638462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:37.640981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:37.641989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:37.642484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:37.642997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:37.708613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:37.718923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for user 7dcd210e197347f8ad1622ee882bee92 and project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:37.798723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:05:37.812496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:05:37.859688 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c6f942f-a38e-42b8-8979-50c60c32b85a tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 204 len: 0 microversion: 2.1 time: 0.343912 Aug 06 21:05:37.870258 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1364/2769] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:05:37 2022] DELETE /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:05:37.897137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1786490281", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:37.932428 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e4a1e72-701d-4b3e-9cee-0cf4fe0714e6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.345295 Aug 06 21:05:37.946187 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1406/2770] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:05:37.975006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:37.981971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:38.028024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:38.030875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:38.033315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:38.038950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:38.040769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:38.043693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:38.104830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:05:38.382863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:38.414879 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-290a8b29-3130-42ef-92fc-b724e0c78545 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1501 microversion: 2.1 time: 0.464948 Aug 06 21:05:38.416276 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1407/2771] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:37 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1501 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:38.422598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c33e84a5-ffcc-48e9-83db-bcb95d4133fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:38.423423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c33e84a5-ffcc-48e9-83db-bcb95d4133fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:38.514598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c33e84a5-ffcc-48e9-83db-bcb95d4133fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:38.530348 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c33e84a5-ffcc-48e9-83db-bcb95d4133fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1193 microversion: 2.1 time: 0.111458 Aug 06 21:05:38.542750 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1408/2772] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:38 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:38.683737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:05:38.683737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:05:38.683737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:05:38.684277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:05:38.684557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:05:38.704288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:38.705039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:38.705648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:38.706740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:38.707454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:38.708043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:38.790008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Getting quotas for project 8482c922e64f40d4b95793ac70044614. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:38.815678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Getting quotas for user e35e4972ca5547ca8abb304343bf1031 and project 8482c922e64f40d4b95793ac70044614. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:38.866017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.utils [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] ram quota exceeded for 8482c922e64f40d4b95793ac70044614, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=142462) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 06 21:05:38.869078 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Request method failure captured: Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 145 Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teZCHgH98VmYNZoUKnCRSqgPO9M2PKt8_qwhSaQklUK1TZK1Wue_nCseX8z5TXncat-POqbLnr-2f7bSQpMP-hK4qeAZ9BeT8Uh7ogQu3qDYhZAy8QLqiYsXQUQ-3WGuFdkBgMMgPmqBxvxJCtAEbzUYRuBt6n1NS9pHUi7r_yl1uw Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8482c922e64f40d4b95793ac70044614 Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:05:38.874479 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8482c922e64f40d4b95793ac70044614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8482c922e64f40d4b95793ac70044614", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8482c922e64f40d4b95793ac70044614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8482c922e64f40d4b95793ac70044614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8482c922e64f40d4b95793ac70044614 Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-QuotasAdminNegativeTest-1142244637-project Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e35e4972ca5547ca8abb304343bf1031 Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-QuotasAdminNegativeTest-1142244637-project Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1786490281", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} Aug 06 21:05:38.876173 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1786490281', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452'}}} Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 06 21:05:38.877094 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:38.878401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:38.879917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:38.881290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:38.881290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:38.881290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:38.881290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:38.881290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 06 21:05:38.881290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:38.881290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:38.881290 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0bbb73c2-e128-4b6c-9672-5ff56a61ad4f tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.004019 Aug 06 21:05:38.881290 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1365/2773] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:05:37 2022] POST /compute/v2.1/servers => generated 110 bytes in 1010 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:38.891936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7188d9da-8fc1-429d-9e2a-38993aa69e2a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Action: 'update', calling method: .version_select at 0x7f72a353a430>, body: {"quota_set": {"ram": 51200}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:39.210982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1881709722", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "b90fd2f1-dc4c-47d3-ba5e-d27eaf42df6f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:39.352589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] validate_networks() for [('b90fd2f1-dc4c-47d3-ba5e-d27eaf42df6f', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:05:39.832264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7188d9da-8fc1-429d-9e2a-38993aa69e2a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:39.832872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7188d9da-8fc1-429d-9e2a-38993aa69e2a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:39.839265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7188d9da-8fc1-429d-9e2a-38993aa69e2a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:39.846241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7188d9da-8fc1-429d-9e2a-38993aa69e2a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:39.848129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7188d9da-8fc1-429d-9e2a-38993aa69e2a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:39.851410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7188d9da-8fc1-429d-9e2a-38993aa69e2a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:40.142318 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7188d9da-8fc1-429d-9e2a-38993aa69e2a tempest-QuotasAdminNegativeTest-109507556 tempest-QuotasAdminNegativeTest-109507556-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 200 len: 329 microversion: 2.1 time: 1.254006 Aug 06 21:05:40.157100 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1366/2774] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:05:38 2022] PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 329 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:40.180640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:40.182807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:40.242752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:40.246907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:40.249456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:40.253676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:40.259730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:40.263518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:40.361696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:05:40.362208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:05:40.362829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:05:40.363491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:05:40.363931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:05:40.384717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:40.387021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:40.387490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:40.391392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:40.395419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:40.395953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:40.487537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Getting quotas for project 90a59ffcb8834a50b1e8fa57aa9e89d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:05:40.495275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Getting quotas for user e0943fdb586241b796e349e08c778f28 and project 90a59ffcb8834a50b1e8fa57aa9e89d2. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:05:40.539036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:05:40.543324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:05:40.585960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2df7f5bd4ae4f6d918bb18721a6ac5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dffa3e9ecbe4f118302bee4d90591ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:40.607109 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eba7888d-71ba-4fc4-8139-1c50c8300c25 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 200 len: 1459 microversion: 2.1 time: 0.446073 Aug 06 21:05:40.608829 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1367/2775] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:40 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 1459 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:40.621338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:40.621338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:40.647811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:40.649513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:40.649983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:40.652074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:40.668006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:40.668827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:40.685324 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cca6e68d-1728-4510-8a33-e595cad6b66a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.134719 Aug 06 21:05:40.686058 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1409/2776] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 21:05:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2143 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:05:40.698433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69ad0e1a-3585-498e-a53f-8fdf4b5ae913 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Action: 'update', calling method: .version_select at 0x7f729dadd940>, body: {"quota_set": {"ram": 0}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:40.714667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-69ad0e1a-3585-498e-a53f-8fdf4b5ae913 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e35e4972ca5547ca8abb304343bf1031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8482c922e64f40d4b95793ac70044614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69ad0e1a-3585-498e-a53f-8fdf4b5ae913 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Request method failure captured: Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 HTTP/1.1 Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 25 Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7teZCHgH98VmYNZoUKnCRSqgPO9M2PKt8_qwhSaQklUK1TZK1Wue_nCseX8z5TXncat-POqbLnr-2f7bSQpMP-hK4qeAZ9BeT8Uh7ogQu3qDYhZAy8QLqiYsXQUQ-3WGuFdkBgMMgPmqBxvxJCtAEbzUYRuBt6n1NS9pHUi7r_yl1uw Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8482c922e64f40d4b95793ac70044614 Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:05:40.731913 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8482c922e64f40d4b95793ac70044614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8482c922e64f40d4b95793ac70044614", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8482c922e64f40d4b95793ac70044614"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8482c922e64f40d4b95793ac70044614"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8482c922e64f40d4b95793ac70044614 Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1142244637 Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-QuotasAdminNegativeTest-1142244637-project Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e35e4972ca5547ca8abb304343bf1031 Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-QuotasAdminNegativeTest-1142244637-project Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: {"quota_set": {"ram": 0}} Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 06 21:05:40.733369 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '8482c922e64f40d4b95793ac70044614', 'body': {'quota_set': {'ram': 0}}} Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:05:40.734299 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:40.735507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:40.736870 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:40.736870 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:40.736870 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 06 21:05:40.736870 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 06 21:05:40.736870 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 06 21:05:40.736870 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:40.753625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69ad0e1a-3585-498e-a53f-8fdf4b5ae913 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:40.761427 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-69ad0e1a-3585-498e-a53f-8fdf4b5ae913 tempest-QuotasAdminNegativeTest-1142244637 tempest-QuotasAdminNegativeTest-1142244637-project] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614" status: 403 len: 116 microversion: 2.1 time: 0.074010 Aug 06 21:05:40.771757 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1410/2777] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:05:40 2022] PUT /compute/v2.1/os-quota-sets/8482c922e64f40d4b95793ac70044614 => generated 116 bytes in 85 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:40.803036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7cef2f0c-8a06-4bfc-99fa-a54ca7bc428e req-ab5ae32a-d72b-46ba-88fa-7016ac21d97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd68e5c4-39bd-4c79-bb5f-e419d80cd081", "name": "network-vif-deleted", "tag": "868bd349-0314-40d1-b952-b14f482ebd60"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:40.864797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7cef2f0c-8a06-4bfc-99fa-a54ca7bc428e req-ab5ae32a-d72b-46ba-88fa-7016ac21d97f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:40.865343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7cef2f0c-8a06-4bfc-99fa-a54ca7bc428e req-ab5ae32a-d72b-46ba-88fa-7016ac21d97f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:40.865791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7cef2f0c-8a06-4bfc-99fa-a54ca7bc428e req-ab5ae32a-d72b-46ba-88fa-7016ac21d97f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:40.911372 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7cef2f0c-8a06-4bfc-99fa-a54ca7bc428e req-ab5ae32a-d72b-46ba-88fa-7016ac21d97f service nova] Creating event network-vif-deleted:868bd349-0314-40d1-b952-b14f482ebd60 for instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 on nch2-master-1 Aug 06 21:05:40.935467 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7cef2f0c-8a06-4bfc-99fa-a54ca7bc428e req-ab5ae32a-d72b-46ba-88fa-7016ac21d97f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145349 Aug 06 21:05:40.937922 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1411/2778] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:40.955878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d4ae8f72-6abf-472c-abc8-717fb76348f1 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:40.964732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d4ae8f72-6abf-472c-abc8-717fb76348f1 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:41.236205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d4ae8f72-6abf-472c-abc8-717fb76348f1 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:41.279486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d4ae8f72-6abf-472c-abc8-717fb76348f1 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:41.288834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d4ae8f72-6abf-472c-abc8-717fb76348f1 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:41.294267 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d4ae8f72-6abf-472c-abc8-717fb76348f1 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1259 microversion: 2.21 time: 0.352237 Aug 06 21:05:41.297447 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1412/2779] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:40 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1259 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:41.641476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:41.644485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:41.698322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:41.699956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:41.746173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:41.751072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:41.752941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:41.753849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:41.807390 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] HTTP exception thrown: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Request method failure captured: Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 HTTP/1.1 Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7teH6La_LdBivdfYtFTDFhnjtrT4-SJMFnHs8S7Mz6owaZEUbY1Ma95eZ21mo-T7WxCfJgPXcaoiiHNg035KdX9RwUFBXa_rPjtLChr7HwabnD5BVLhLfTDpBYvUxSWq23liD1wY_csGE_6AsbpUFgBBmqGQdkKJkyLb3yfBhdfd75o Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:05:41.811116 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7dffa3e9ecbe4f118302bee4d90591ba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a2df7f5bd4ae4f6d918bb18721a6ac5b Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:41.812826 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'bd68e5c4-39bd-4c79-bb5f-e419d80cd081'} Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:41.813717 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:41.815220 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:41.819085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Returning 404 to user: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:41.822299 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f34e61a1-264d-4fb1-b0b5-8b869c4d401c tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 404 len: 111 microversion: 2.1 time: 0.195181 Aug 06 21:05:41.826067 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1413/2780] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:41 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:05:41.830651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:41.851080 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-00721c6d-383c-4a01-8a08-3f8c1ebc9382 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1251 microversion: 2.1 time: 1.236101 Aug 06 21:05:41.853101 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1368/2781] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:40 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1251 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:41.854474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed9042ee-56d1-4075-8d94-a93b748f8ab7 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:41.904886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.compute.server_groups [None req-ed9042ee-56d1-4075-8d94-a93b748f8ab7 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Querying cell 7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) for 1 instances {{(pid=142461) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 06 21:05:41.905641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed9042ee-56d1-4075-8d94-a93b748f8ab7 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:41.906163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed9042ee-56d1-4075-8d94-a93b748f8ab7 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:41.906641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed9042ee-56d1-4075-8d94-a93b748f8ab7 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:41.949315 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ed9042ee-56d1-4075-8d94-a93b748f8ab7 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.109775 Aug 06 21:05:41.952588 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1414/2782] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:05:41 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:41.964566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5bdbd1e5-c30d-4da0-9bea-fd25d5a424da tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:41.999072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.compute.server_groups [None req-5bdbd1e5-c30d-4da0-9bea-fd25d5a424da tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Querying cell 7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) for 1 instances {{(pid=142462) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 06 21:05:42.000112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bdbd1e5-c30d-4da0-9bea-fd25d5a424da tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:42.000762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bdbd1e5-c30d-4da0-9bea-fd25d5a424da tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:42.001400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bdbd1e5-c30d-4da0-9bea-fd25d5a424da tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:42.031037 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5bdbd1e5-c30d-4da0-9bea-fd25d5a424da tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/ce7b1068-cecd-41b1-9505-9e134edf12a0" status: 200 len: 183 microversion: 2.1 time: 0.070248 Aug 06 21:05:42.049983 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1369/2783] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:05:41 2022] GET /compute/v2.1/os-server-groups/ce7b1068-cecd-41b1-9505-9e134edf12a0 => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:05:42.057139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:42.057903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:42.065753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:42.066359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:42.066912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:42.067712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:42.068394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:42.069027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:42.118353 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] HTTP exception thrown: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Request method failure captured: Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 HTTP/1.1 Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7teH6La_LdBivdfYtFTDFhnjtrT4-SJMFnHs8S7Mz6owaZEUbY1Ma95eZ21mo-T7WxCfJgPXcaoiiHNg035KdX9RwUFBXa_rPjtLChr7HwabnD5BVLhLfTDpBYvUxSWq23liD1wY_csGE_6AsbpUFgBBmqGQdkKJkyLb3yfBhdfd75o Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:05:42.130647 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7dffa3e9ecbe4f118302bee4d90591ba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a2df7f5bd4ae4f6d918bb18721a6ac5b Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.132027 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'bd68e5c4-39bd-4c79-bb5f-e419d80cd081'} Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:42.132780 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.134044 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.148393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Returning 404 to user: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:42.151576 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71f047b3-079a-42e7-a74e-93096b6e1bdb tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 404 len: 111 microversion: 2.1 time: 0.099257 Aug 06 21:05:42.156720 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1415/2784] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:05:42 2022] DELETE /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:42.163143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:42.164171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] [instance: bd68e5c4-39bd-4c79-bb5f-e419d80cd081] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:42.199419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:42.200329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:42.201337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:42.208417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:42.209355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:42.210297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:42.282426 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] HTTP exception thrown: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Request method failure captured: Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 HTTP/1.1 Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teH6La_LdBivdfYtFTDFhnjtrT4-SJMFnHs8S7Mz6owaZEUbY1Ma95eZ21mo-T7WxCfJgPXcaoiiHNg035KdX9RwUFBXa_rPjtLChr7HwabnD5BVLhLfTDpBYvUxSWq23liD1wY_csGE_6AsbpUFgBBmqGQdkKJkyLb3yfBhdfd75o Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:05:42.288461 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7dffa3e9ecbe4f118302bee4d90591ba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a2df7f5bd4ae4f6d918bb18721a6ac5b Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.290157 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'bd68e5c4-39bd-4c79-bb5f-e419d80cd081'} Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:42.291190 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. Aug 06 21:05:42.292804 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.293923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Returning 404 to user: Instance bd68e5c4-39bd-4c79-bb5f-e419d80cd081 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:42.293923 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5371694b-4627-4618-aa3f-de5345d257ec tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081" status: 404 len: 111 microversion: 2.1 time: 0.132236 Aug 06 21:05:42.297777 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1370/2785] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:42 2022] GET /compute/v2.1/servers/bd68e5c4-39bd-4c79-bb5f-e419d80cd081 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:42.320822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:42.326954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-daed2264-2915-45c7-a1f5-f2e1582d4123 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:42.333704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:42.349712 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-daed2264-2915-45c7-a1f5-f2e1582d4123 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] HTTP exception thrown: Instance group 59f221e4-fe87-4b5b-884a-1c661904198e could not be found. Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-daed2264-2915-45c7-a1f5-f2e1582d4123 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Request method failure captured: Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-server-groups/59f221e4-fe87-4b5b-884a-1c661904198e HTTP/1.1 Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7teH6La_LdBivdfYtFTDFhnjtrT4-SJMFnHs8S7Mz6owaZEUbY1Ma95eZ21mo-T7WxCfJgPXcaoiiHNg035KdX9RwUFBXa_rPjtLChr7HwabnD5BVLhLfTDpBYvUxSWq23liD1wY_csGE_6AsbpUFgBBmqGQdkKJkyLb3yfBhdfd75o Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:05:42.373005 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7dffa3e9ecbe4f118302bee4d90591ba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a2df7f5bd4ae4f6d918bb18721a6ac5b Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance group 59f221e4-fe87-4b5b-884a-1c661904198e could not be found. Aug 06 21:05:42.374748 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '59f221e4-fe87-4b5b-884a-1c661904198e'} Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 59f221e4-fe87-4b5b-884a-1c661904198e could not be found. Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.375613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 59f221e4-fe87-4b5b-884a-1c661904198e could not be found. Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 59f221e4-fe87-4b5b-884a-1c661904198e could not be found. Aug 06 21:05:42.376812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.378039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-daed2264-2915-45c7-a1f5-f2e1582d4123 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Returning 404 to user: Instance group 59f221e4-fe87-4b5b-884a-1c661904198e could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:42.378039 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-daed2264-2915-45c7-a1f5-f2e1582d4123 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/59f221e4-fe87-4b5b-884a-1c661904198e" status: 404 len: 117 microversion: 2.1 time: 0.072782 Aug 06 21:05:42.378039 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1416/2786] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:05:42 2022] DELETE /compute/v2.1/os-server-groups/59f221e4-fe87-4b5b-884a-1c661904198e => generated 117 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:42.379929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:42.382113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:42.382822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:42.387522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-652f1f23-69fd-402b-8730-8acabe5da4f3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:42.387894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:42.388578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:42.389189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:42.410096 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-652f1f23-69fd-402b-8730-8acabe5da4f3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] HTTP exception thrown: Instance group 2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1 could not be found. Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-652f1f23-69fd-402b-8730-8acabe5da4f3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Request method failure captured: Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-server-groups/2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1 HTTP/1.1 Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7teH6La_LdBivdfYtFTDFhnjtrT4-SJMFnHs8S7Mz6owaZEUbY1Ma95eZ21mo-T7WxCfJgPXcaoiiHNg035KdX9RwUFBXa_rPjtLChr7HwabnD5BVLhLfTDpBYvUxSWq23liD1wY_csGE_6AsbpUFgBBmqGQdkKJkyLb3yfBhdfd75o Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:05:42.416088 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7dffa3e9ecbe4f118302bee4d90591ba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a2df7f5bd4ae4f6d918bb18721a6ac5b Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance group 2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1 could not be found. Aug 06 21:05:42.417849 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1'} Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1 could not be found. Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.418739 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1 could not be found. Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1 could not be found. Aug 06 21:05:42.420095 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.421229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-652f1f23-69fd-402b-8730-8acabe5da4f3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Returning 404 to user: Instance group 2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:42.423660 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-652f1f23-69fd-402b-8730-8acabe5da4f3 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1" status: 404 len: 117 microversion: 2.1 time: 0.041165 Aug 06 21:05:42.429902 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1417/2787] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:05:42 2022] DELETE /compute/v2.1/os-server-groups/2ecc6c5b-4a07-4497-adaa-2b1ff56fb9e1 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:42.445347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-875a4dfd-46e1-49dd-8d01-fc4084e67424 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:42.470437 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-875a4dfd-46e1-49dd-8d01-fc4084e67424 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] HTTP exception thrown: Instance group 4b2eda02-4764-4fdd-9cfa-31adf4623f43 could not be found. Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-875a4dfd-46e1-49dd-8d01-fc4084e67424 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Request method failure captured: Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-server-groups/4b2eda02-4764-4fdd-9cfa-31adf4623f43 HTTP/1.1 Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7teH6La_LdBivdfYtFTDFhnjtrT4-SJMFnHs8S7Mz6owaZEUbY1Ma95eZ21mo-T7WxCfJgPXcaoiiHNg035KdX9RwUFBXa_rPjtLChr7HwabnD5BVLhLfTDpBYvUxSWq23liD1wY_csGE_6AsbpUFgBBmqGQdkKJkyLb3yfBhdfd75o Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:05:42.472340 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7dffa3e9ecbe4f118302bee4d90591ba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a2df7f5bd4ae4f6d918bb18721a6ac5b Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance group 4b2eda02-4764-4fdd-9cfa-31adf4623f43 could not be found. Aug 06 21:05:42.474870 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4b2eda02-4764-4fdd-9cfa-31adf4623f43'} Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4b2eda02-4764-4fdd-9cfa-31adf4623f43 could not be found. Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.476132 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4b2eda02-4764-4fdd-9cfa-31adf4623f43 could not be found. Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4b2eda02-4764-4fdd-9cfa-31adf4623f43 could not be found. Aug 06 21:05:42.479285 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.482193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-875a4dfd-46e1-49dd-8d01-fc4084e67424 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Returning 404 to user: Instance group 4b2eda02-4764-4fdd-9cfa-31adf4623f43 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:42.486854 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-875a4dfd-46e1-49dd-8d01-fc4084e67424 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/4b2eda02-4764-4fdd-9cfa-31adf4623f43" status: 404 len: 117 microversion: 2.1 time: 0.050710 Aug 06 21:05:42.488433 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1418/2788] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:05:42 2022] DELETE /compute/v2.1/os-server-groups/4b2eda02-4764-4fdd-9cfa-31adf4623f43 => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:42.506326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02cd4a3b-a7e7-4306-a194-835a67fb9eae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:42.527246 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-02cd4a3b-a7e7-4306-a194-835a67fb9eae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] HTTP exception thrown: Instance group ee525150-3d14-4d47-adb4-96d4ae4d97eb could not be found. Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02cd4a3b-a7e7-4306-a194-835a67fb9eae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Request method failure captured: Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-server-groups/ee525150-3d14-4d47-adb4-96d4ae4d97eb HTTP/1.1 Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7teH6La_LdBivdfYtFTDFhnjtrT4-SJMFnHs8S7Mz6owaZEUbY1Ma95eZ21mo-T7WxCfJgPXcaoiiHNg035KdX9RwUFBXa_rPjtLChr7HwabnD5BVLhLfTDpBYvUxSWq23liD1wY_csGE_6AsbpUFgBBmqGQdkKJkyLb3yfBhdfd75o Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:05:42.528980 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7dffa3e9ecbe4f118302bee4d90591ba", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7dffa3e9ecbe4f118302bee4d90591ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7dffa3e9ecbe4f118302bee4d90591ba Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerGroupTestJSON-1443816683 Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a2df7f5bd4ae4f6d918bb18721a6ac5b Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerGroupTestJSON-1443816683-project Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance group ee525150-3d14-4d47-adb4-96d4ae4d97eb could not be found. Aug 06 21:05:42.530623 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ee525150-3d14-4d47-adb4-96d4ae4d97eb'} Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ee525150-3d14-4d47-adb4-96d4ae4d97eb could not be found. Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.531537 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ee525150-3d14-4d47-adb4-96d4ae4d97eb could not be found. Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ee525150-3d14-4d47-adb4-96d4ae4d97eb could not be found. Aug 06 21:05:42.534674 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:05:42.536071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02cd4a3b-a7e7-4306-a194-835a67fb9eae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Returning 404 to user: Instance group ee525150-3d14-4d47-adb4-96d4ae4d97eb could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:05:42.536071 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02cd4a3b-a7e7-4306-a194-835a67fb9eae tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/ee525150-3d14-4d47-adb4-96d4ae4d97eb" status: 404 len: 117 microversion: 2.1 time: 0.039969 Aug 06 21:05:42.538195 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1419/2789] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:05:42 2022] DELETE /compute/v2.1/os-server-groups/ee525150-3d14-4d47-adb4-96d4ae4d97eb => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:05:42.550239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a573c601-5b21-4d26-a3cb-6f5e8d775c88 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:42.581194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=5,nova_api:INSERT=7 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:42.602243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:42.617677 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a573c601-5b21-4d26-a3cb-6f5e8d775c88 tempest-ServerGroupTestJSON-1443816683 tempest-ServerGroupTestJSON-1443816683-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/ce7b1068-cecd-41b1-9505-9e134edf12a0" status: 204 len: 0 microversion: 2.1 time: 0.074311 Aug 06 21:05:42.620343 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1420/2790] 10.222.0.33 () {58 vars in 1266 bytes} [Sat Aug 6 21:05:42 2022] DELETE /compute/v2.1/os-server-groups/ce7b1068-cecd-41b1-9505-9e134edf12a0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:05:42.627161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:42.629099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:42.631360 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e68b2bb9-5f5f-4bbb-995f-d6f39d6e01ea tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1311 microversion: 2.21 time: 0.315923 Aug 06 21:05:42.637956 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1371/2791] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:42 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:05:42.886708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:42.887337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:42.902895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:42.905208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:42.905654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:42.907706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:42.909517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:42.910193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:43.673850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:43.675189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:43.687654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:43.688936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:43.689622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:43.690793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:43.691409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:43.692043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:43.747580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:43.783588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:43.792212 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d9ee7b0-0a3c-4478-9dfc-1b92ebb0aac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.912216 Aug 06 21:05:43.792806 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1421/2792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:42 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:43.913763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:43.957757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:43.959872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:43.961279 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b907ba10-e2b4-4c12-af9e-a4c48108f8c0 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1317 microversion: 2.21 time: 0.296678 Aug 06 21:05:43.968693 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1372/2793] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:43 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:44.817270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:44.818537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:44.835488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:44.836049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:44.837872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:44.840994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:44.843117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:44.843529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:45.023720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:45.025041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:45.032522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:45.033480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:45.034282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:45.035305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:45.035982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:45.036690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:45.068677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:05:45.204079 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1db3fd9e-c665-4aee-8428-48e8269ed42e tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 204 len: 0 microversion: 2.42 time: 0.635323 Aug 06 21:05:45.205076 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1422/2794] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:05:44 2022] DELETE /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:05:45.217006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:45.219687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:45.228616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:45.230210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:45.230898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:45.232299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:45.233002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:45.233867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:45.416647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:45.430054 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b673de15-ef59-45fd-9147-86aee93c7c26 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.616694 Aug 06 21:05:45.435479 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1373/2795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:44 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:45.443320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:45.444234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:45.456382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:45.457324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:45.458026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:45.459017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:45.460084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:45.460978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:45.476472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:45.489372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:45.499933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:45.503611 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb66fdc1-bd9d-46bc-9d14-017d989d3943 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1317 microversion: 2.21 time: 0.296883 Aug 06 21:05:45.504378 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1423/2796] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:45 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:46.152078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c11f7aae-62bb-469e-8aed-8967bb813a60 req-2e67718f-66ee-4210-8b64-0e9e4715dfae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6de9449c-2f19-42d8-8476-fb7ccf1b0c94", "tag": "81411f88-8c50-40a1-b174-1dfabe4d6575"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:46.177466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c11f7aae-62bb-469e-8aed-8967bb813a60 req-2e67718f-66ee-4210-8b64-0e9e4715dfae service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:46.178260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c11f7aae-62bb-469e-8aed-8967bb813a60 req-2e67718f-66ee-4210-8b64-0e9e4715dfae service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:46.179253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c11f7aae-62bb-469e-8aed-8967bb813a60 req-2e67718f-66ee-4210-8b64-0e9e4715dfae service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:46.204228 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c11f7aae-62bb-469e-8aed-8967bb813a60 req-2e67718f-66ee-4210-8b64-0e9e4715dfae service nova] Creating event network-changed:81411f88-8c50-40a1-b174-1dfabe4d6575 for instance 6de9449c-2f19-42d8-8476-fb7ccf1b0c94 on nch1-master-1 Aug 06 21:05:46.224538 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c11f7aae-62bb-469e-8aed-8967bb813a60 req-2e67718f-66ee-4210-8b64-0e9e4715dfae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077091 Aug 06 21:05:46.225464 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1424/2797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:05:46.266471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:46.278519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:46.288674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:46.290093 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-248758c7-e1ce-4d63-9041-621504b76130 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2963 microversion: 2.42 time: 0.853483 Aug 06 21:05:46.307358 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1374/2798] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:45 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2963 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:46.458646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:46.459466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:46.473263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:46.473752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:46.474499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:46.475434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:46.476176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:46.476765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:46.527866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:46.528966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:46.543377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:46.543798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:46.544237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:46.544956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:46.545419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:46.545846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:46.971444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:46.988116 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4cad6737-2bc6-4063-8cac-e2c66e8a928c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.532147 Aug 06 21:05:46.989152 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1425/2799] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:46 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:47.320970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:47.321813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:47.338481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:47.342534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:47.350512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:47.353185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:47.355786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:47.357176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:47.455511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:47.481807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:47.484087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:47.485327 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b7625242-4c96-41a4-a228-2f153ed0ba98 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1359 microversion: 2.21 time: 0.961915 Aug 06 21:05:47.512416 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1375/2800] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:46 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1359 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:48.013784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:48.015014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:48.020354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:48.031218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:48.032478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:48.033168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:48.034326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:48.035051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:48.035887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:48.052201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:48.066809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:48.069123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:48.077895 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8efc3063-b7c7-437f-a160-7e9447ffa696 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2963 microversion: 2.42 time: 0.760973 Aug 06 21:05:48.098192 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1426/2801] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:47 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2963 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:48.520302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:48.521891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:48.548013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:48.552976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:48.553560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:48.555838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:48.556337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:48.559804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:49.089184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:49.104486 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-69608f22-e49d-4a49-b367-a83ece720161 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 1.094062 Aug 06 21:05:49.118564 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1376/2802] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:48 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:49.126438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:49.126921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:49.152413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:49.153192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:49.153839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:49.154800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:49.155445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:49.156055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:49.612838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:49.629344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:49.631352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:49.632844 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d331130-474b-4d27-aebd-1515680627cc tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1359 microversion: 2.21 time: 1.117042 Aug 06 21:05:49.633635 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1427/2803] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:48 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1359 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:49.649639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:49.675002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:49.675002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:49.680720 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-871a6d6f-284d-48f6-a807-4d149f133828 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2963 microversion: 2.42 time: 0.560338 Aug 06 21:05:49.682284 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1377/2804] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:49 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2963 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:49.851004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cafbc1ab-92a7-4f2f-abe1-749bc67efa89 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:49.854813 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:05:49.854813 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:05:49.856026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cafbc1ab-92a7-4f2f-abe1-749bc67efa89 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:49.856517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cafbc1ab-92a7-4f2f-abe1-749bc67efa89 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:49.856962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cafbc1ab-92a7-4f2f-abe1-749bc67efa89 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:49.857710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cafbc1ab-92a7-4f2f-abe1-749bc67efa89 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:49.858167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cafbc1ab-92a7-4f2f-abe1-749bc67efa89 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:49.858716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cafbc1ab-92a7-4f2f-abe1-749bc67efa89 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:49.872819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:49.920302 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cafbc1ab-92a7-4f2f-abe1-749bc67efa89 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.266956 Aug 06 21:05:49.920909 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1428/2805] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:05:49 2022] GET /compute/v2.1/os-services => generated 947 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:49.935969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71542376-2a79-4e88-aff6-e227ef646b86 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:49.939565 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:05:49.939565 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:05:49.941155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71542376-2a79-4e88-aff6-e227ef646b86 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:49.941844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71542376-2a79-4e88-aff6-e227ef646b86 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:49.942459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71542376-2a79-4e88-aff6-e227ef646b86 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:49.943429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71542376-2a79-4e88-aff6-e227ef646b86 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:49.944443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71542376-2a79-4e88-aff6-e227ef646b86 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:49.945170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71542376-2a79-4e88-aff6-e227ef646b86 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:49.945898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=16 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:49.980951 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71542376-2a79-4e88-aff6-e227ef646b86 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.049888 Aug 06 21:05:49.981944 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1378/2806] 10.222.0.33 () {58 vars in 1174 bytes} [Sat Aug 6 21:05:49 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:49.995716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12230fd6-915b-43bc-8a6e-57034da73fba tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:49.998810 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:05:49.998810 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:05:50.000891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12230fd6-915b-43bc-8a6e-57034da73fba tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.001391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12230fd6-915b-43bc-8a6e-57034da73fba tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.001844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12230fd6-915b-43bc-8a6e-57034da73fba tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.002792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12230fd6-915b-43bc-8a6e-57034da73fba tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.003431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12230fd6-915b-43bc-8a6e-57034da73fba tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.004115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12230fd6-915b-43bc-8a6e-57034da73fba tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.031922 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12230fd6-915b-43bc-8a6e-57034da73fba tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041593 Aug 06 21:05:50.040198 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1429/2807] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Aug 6 21:05:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:50.046515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b3b4c79-ac2f-48ed-bce0-93b3bccf3d80 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:50.049025 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:05:50.049025 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:05:50.050450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b3b4c79-ac2f-48ed-bce0-93b3bccf3d80 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.050987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b3b4c79-ac2f-48ed-bce0-93b3bccf3d80 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.051441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b3b4c79-ac2f-48ed-bce0-93b3bccf3d80 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.052211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b3b4c79-ac2f-48ed-bce0-93b3bccf3d80 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.052718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b3b4c79-ac2f-48ed-bce0-93b3bccf3d80 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.053171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b3b4c79-ac2f-48ed-bce0-93b3bccf3d80 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.088191 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9b3b4c79-ac2f-48ed-bce0-93b3bccf3d80 tempest-ServicesAdminTestJSON-588779787 tempest-ServicesAdminTestJSON-588779787-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.045418 Aug 06 21:05:50.089375 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1379/2808] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:05:50 2022] GET /compute/v2.1/os-services => generated 947 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:50.126205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:50.126822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:50.135356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.136173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.136774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.137678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.138645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.139297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.501417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=84 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:50.506861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f5e7b389-8a5c-4380-b366-859e7d5bd03e req-483638d1-30a2-4559-a3cf-623c1b04172b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d94d029-8554-4b9d-950c-c1688ff520ac", "tag": "3b873d21-0b64-4f34-a3ae-65806840ac6c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:50.536536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f5e7b389-8a5c-4380-b366-859e7d5bd03e req-483638d1-30a2-4559-a3cf-623c1b04172b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.537330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f5e7b389-8a5c-4380-b366-859e7d5bd03e req-483638d1-30a2-4559-a3cf-623c1b04172b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.539097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f5e7b389-8a5c-4380-b366-859e7d5bd03e req-483638d1-30a2-4559-a3cf-623c1b04172b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.576663 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f5e7b389-8a5c-4380-b366-859e7d5bd03e req-483638d1-30a2-4559-a3cf-623c1b04172b service nova] Creating event network-changed:3b873d21-0b64-4f34-a3ae-65806840ac6c for instance 1d94d029-8554-4b9d-950c-c1688ff520ac on nch2-master-1 Aug 06 21:05:50.585599 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f5e7b389-8a5c-4380-b366-859e7d5bd03e req-483638d1-30a2-4559-a3cf-623c1b04172b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084713 Aug 06 21:05:50.586570 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1380/2809] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:50.638348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:50.650415 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-27ba9314-d5be-4936-9e9e-e113b073537d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.524960 Aug 06 21:05:50.651193 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1430/2810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:50 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:50.667342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:50.668906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:50.690814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.694398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.700880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.704400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.706974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.708952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.711526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:50.712222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:50.732729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.738075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.740267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:50.742412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:50.743176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:50.743829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:51.243020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=24 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:05:51.266185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:51.280193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:51.283722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:51.285602 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dda56cef-2be0-4c78-964d-c4b5a1155243 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1359 microversion: 2.21 time: 0.627662 Aug 06 21:05:51.287911 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1381/2811] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:50 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1359 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:51.508451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-fb80b0fc-7917-4ccd-b591-23bb9314c236 req-6c2dc4bd-31a9-4581-8e57-59d239a8678a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-unplugged", "status": "completed", "tag": "51739d7c-ad65-40a3-85bf-e2312dde6cb3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:51.545578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fb80b0fc-7917-4ccd-b591-23bb9314c236 req-6c2dc4bd-31a9-4581-8e57-59d239a8678a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:51.546645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fb80b0fc-7917-4ccd-b591-23bb9314c236 req-6c2dc4bd-31a9-4581-8e57-59d239a8678a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:51.548737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fb80b0fc-7917-4ccd-b591-23bb9314c236 req-6c2dc4bd-31a9-4581-8e57-59d239a8678a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:51.550492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:51.573040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:51.579699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:51.581243 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0147d440-1daf-46e7-9fc3-a1f507cbd43a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2942 microversion: 2.42 time: 0.873760 Aug 06 21:05:51.582780 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1431/2812] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:50 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2942 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:05:51.595790 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-fb80b0fc-7917-4ccd-b591-23bb9314c236 req-6c2dc4bd-31a9-4581-8e57-59d239a8678a service nova] Creating event network-vif-unplugged:51739d7c-ad65-40a3-85bf-e2312dde6cb3 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:05:51.616866 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-fb80b0fc-7917-4ccd-b591-23bb9314c236 req-6c2dc4bd-31a9-4581-8e57-59d239a8678a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113839 Aug 06 21:05:51.617975 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1382/2813] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:05:51.685023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:51.687951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:51.709182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:51.709970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:51.712477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:51.719303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:51.721100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:51.729002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:52.237428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:52.254938 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-568ec1e1-d93d-4174-86c6-2a1537f9aa5f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.580360 Aug 06 21:05:52.256804 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1432/2814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:51 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:52.313132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:52.313869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:52.327488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:52.332911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:52.333450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:52.334231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:52.334750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:52.335203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:52.617141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:52.617773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:52.628536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:52.637446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:52.638030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:52.641315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:52.641877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:52.642806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:52.643313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:52.646439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:52.649917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:52.652059 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f1cb7d61-94da-406c-b8bb-87d4c5ff18bf tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1359 microversion: 2.21 time: 0.345280 Aug 06 21:05:52.673889 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1383/2815] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:52 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1359 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:53.278250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:53.279260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:53.293451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:53.293964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:53.294396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:53.295143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:53.295854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:53.299300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:53.369176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:53.385980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:53.391190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:53.396430 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab0decff-3448-4a6c-b4ce-cb510310ac99 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2942 microversion: 2.42 time: 0.788030 Aug 06 21:05:53.399610 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1433/2816] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:52 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2942 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:05:53.684676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:53.685661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:53.704390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:53.706823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:53.707499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:53.709502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:53.713474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:53.714574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:54.169155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:54.190041 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3f92b15c-bf50-4239-bd32-635befccf62e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.916556 Aug 06 21:05:54.191475 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1384/2817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:53 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:54.217894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-62b6e7e2-462e-4967-92c9-1ef92ac558ed req-3abb840d-8706-4999-938a-2f2045b35d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-unplugged", "status": "completed", "tag": "eb03162f-ec54-46ef-b2b4-b0acc1199e55"}, {"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-unplugged", "status": "completed", "tag": "6a277d3d-757e-4809-a72d-fac786fbec67"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:54.235201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-62b6e7e2-462e-4967-92c9-1ef92ac558ed req-3abb840d-8706-4999-938a-2f2045b35d1c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:54.236267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-62b6e7e2-462e-4967-92c9-1ef92ac558ed req-3abb840d-8706-4999-938a-2f2045b35d1c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:54.237024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-62b6e7e2-462e-4967-92c9-1ef92ac558ed req-3abb840d-8706-4999-938a-2f2045b35d1c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:54.277956 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-62b6e7e2-462e-4967-92c9-1ef92ac558ed req-3abb840d-8706-4999-938a-2f2045b35d1c service nova] Creating event network-vif-unplugged:eb03162f-ec54-46ef-b2b4-b0acc1199e55 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:05:54.278987 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-62b6e7e2-462e-4967-92c9-1ef92ac558ed req-3abb840d-8706-4999-938a-2f2045b35d1c service nova] Creating event network-vif-unplugged:6a277d3d-757e-4809-a72d-fac786fbec67 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:05:54.293266 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-62b6e7e2-462e-4967-92c9-1ef92ac558ed req-3abb840d-8706-4999-938a-2f2045b35d1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.098393 Aug 06 21:05:54.294974 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1385/2818] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:54.374156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:54.391797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:54.393420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:54.394632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2ca38c9b-a2a0-48e0-988d-d41b98f73b92 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1359 microversion: 2.21 time: 0.717019 Aug 06 21:05:54.395208 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1434/2819] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:53 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1359 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:54.436758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:54.438084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:54.454766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:54.455285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:54.457613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:54.458722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:54.460396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:54.461840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:55.023494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-26e80282-eb2d-4a85-86f1-f5f82a0dc0f3 req-fc673957-d225-4fc1-b301-e6529d372428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-deleted", "tag": "eb03162f-ec54-46ef-b2b4-b0acc1199e55"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:55.059823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-26e80282-eb2d-4a85-86f1-f5f82a0dc0f3 req-fc673957-d225-4fc1-b301-e6529d372428 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:55.060530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-26e80282-eb2d-4a85-86f1-f5f82a0dc0f3 req-fc673957-d225-4fc1-b301-e6529d372428 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:55.069671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-26e80282-eb2d-4a85-86f1-f5f82a0dc0f3 req-fc673957-d225-4fc1-b301-e6529d372428 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:55.098220 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-26e80282-eb2d-4a85-86f1-f5f82a0dc0f3 req-fc673957-d225-4fc1-b301-e6529d372428 service nova] Creating event network-vif-deleted:eb03162f-ec54-46ef-b2b4-b0acc1199e55 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:05:55.114167 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-26e80282-eb2d-4a85-86f1-f5f82a0dc0f3 req-fc673957-d225-4fc1-b301-e6529d372428 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090727 Aug 06 21:05:55.115386 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1435/2820] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:05:55.216452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:55.217246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:55.230274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:55.231852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:55.232333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:55.237309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:55.238572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:55.239342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:55.633712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:55.682961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:55.684715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:55.696677 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2a3a4520-3de7-49a0-be00-d165b448b3e3 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2921 microversion: 2.42 time: 1.265785 Aug 06 21:05:55.697380 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1386/2821] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:54 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2921 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:55.711607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:55.718747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:55.732142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:55.732651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:55.736842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:55.737730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:55.739077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:55.741168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:55.878995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:55.899427 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fe8d7fcc-dc40-4eea-869f-1d18a2ffbb1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.684178 Aug 06 21:05:55.902860 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1436/2822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:55 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:56.398382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-a88bc187-6f73-493d-a70a-121b924b997b req-3fe0e46c-f4bc-48d1-8a6d-4e112530a2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-unplugged", "status": "completed", "tag": "33e933e8-51c8-4eb2-8702-773e0049c053"}, {"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-unplugged", "status": "completed", "tag": "d5834d81-de6d-4143-950a-49b591985c1f"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:56.444884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a88bc187-6f73-493d-a70a-121b924b997b req-3fe0e46c-f4bc-48d1-8a6d-4e112530a2d7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:56.445733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a88bc187-6f73-493d-a70a-121b924b997b req-3fe0e46c-f4bc-48d1-8a6d-4e112530a2d7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:56.447884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a88bc187-6f73-493d-a70a-121b924b997b req-3fe0e46c-f4bc-48d1-8a6d-4e112530a2d7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:56.487995 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a88bc187-6f73-493d-a70a-121b924b997b req-3fe0e46c-f4bc-48d1-8a6d-4e112530a2d7 service nova] Creating event network-vif-unplugged:33e933e8-51c8-4eb2-8702-773e0049c053 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:05:56.499938 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a88bc187-6f73-493d-a70a-121b924b997b req-3fe0e46c-f4bc-48d1-8a6d-4e112530a2d7 service nova] Creating event network-vif-unplugged:d5834d81-de6d-4143-950a-49b591985c1f for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:05:56.517598 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-a88bc187-6f73-493d-a70a-121b924b997b req-3fe0e46c-f4bc-48d1-8a6d-4e112530a2d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.123705 Aug 06 21:05:56.522682 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1437/2823] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:56.731090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:56.731802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:56.781698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:56.783571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:56.786387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:56.789586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:56.791316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:56.792987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:56.927159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:56.945760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:56.950782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:56.955163 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-312f5fde-b0f2-4734-9478-170d676cb10c tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1359 microversion: 2.21 time: 1.255104 Aug 06 21:05:56.957068 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1387/2824] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:55 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1359 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:56.981083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:56.999152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:57.019375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:57.019889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:57.020348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:57.021233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:57.022752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:57.023451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:57.458929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:57.474494 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b89ccec-0ff7-45a1-9c23-612933099f4e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.516062 Aug 06 21:05:57.475149 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1388/2825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:56 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:57.986500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:57.987247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:58.008485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:58.013544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:58.020207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:58.020987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:58.021486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:58.021936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:58.105911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:58.146575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:58.148973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:58.152030 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32c259f0-42b9-4098-a891-1869ae40ba91 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2760 microversion: 2.42 time: 1.429980 Aug 06 21:05:58.163852 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1438/2826] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:56 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2760 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:58.528547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ebf6bd78-ef22-4d1d-9caa-cdb0b3fb9935 tempest-FlavorsV2NegativeTest-566551008 tempest-FlavorsV2NegativeTest-566551008-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:58.551032 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ebf6bd78-ef22-4d1d-9caa-cdb0b3fb9935 tempest-FlavorsV2NegativeTest-566551008 tempest-FlavorsV2NegativeTest-566551008-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.383742 Aug 06 21:05:58.565799 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1439/2827] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:05:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:05:58.721001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-344027634", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "eadfb3f4-cbb1-489a-b7c2-f9a2e9d81cb2"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:58.781410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:58.800814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:58.802509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:58.813470 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-11737cc2-7c76-428b-a60b-8f92397c4a71 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1359 microversion: 2.21 time: 0.831534 Aug 06 21:05:58.822919 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1389/2828] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:57 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1359 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:58.837418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:58.839210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:58.858006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:58.858827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:58.863436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:58.866774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:58.870490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:58.871244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:58.908529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] validate_networks() for [('eadfb3f4-cbb1-489a-b7c2-f9a2e9d81cb2', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:05:59.238017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:59.251351 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d5785ff7-5e73-44bb-9f1c-f0203227cdbc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.425553 Aug 06 21:05:59.254140 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1390/2829] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:05:58 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:05:59.268013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:05:59.268725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:05:59.291998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:59.292713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:59.295231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:59.299222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:05:59.300309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:05:59.301251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:05:59.688244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:59.700569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:59.702802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:05:59.704868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e8588efa-37ae-4270-89cb-be5c20a02ec8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2713 microversion: 2.42 time: 0.448001 Aug 06 21:05:59.706280 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1391/2830] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:05:59 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2713 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:05:59.830915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1403239981", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5c00ae50-9c12-446f-a3fc-256b5e473c43"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:05:59.991076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] validate_networks() for [('5c00ae50-9c12-446f-a3fc-256b5e473c43', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:00.011736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:00.063382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:01.271329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:01.273847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:01.275848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:01.277191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:01.278318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:01.320589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.321623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.323442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:01.335103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:01.335567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:01.336032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:01.336455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:01.336882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:01.346898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.347570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.348039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:01.368954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.369454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.374314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:01.376082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.379721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:01.380441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.383190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:01.452008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:01.459502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for user bdf1b5180a814cf39234892c6c1f26df and project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:01.485023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Getting quotas for project 64300b6685d7478f8bfa92c2d6eb91d6. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:01.499302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:01.501408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Getting quotas for user 10b30a7d1ce94193970bdc076d481578 and project 64300b6685d7478f8bfa92c2d6eb91d6. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:01.511414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:01.546107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:01.549121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:01.629989 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a3b810f-bc2c-410f-a961-e2d840d28c44 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.922164 Aug 06 21:06:01.639862 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1392/2831] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:05:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:01.645547 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ea659342-79da-4cce-accc-f7b7f82c6418 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.059086 Aug 06 21:06:01.648443 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1440/2832] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:01.659707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-352e681d-825e-4c8c-bf87-31b170479397 req-3204af86-4cba-4981-820a-d3e89212058a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d94d029-8554-4b9d-950c-c1688ff520ac", "name": "network-vif-plugged", "status": "completed", "tag": "3b873d21-0b64-4f34-a3ae-65806840ac6c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:01.660479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-6aeb6020-7587-4db3-af1f-b33119ad1093 req-64423013-7c57-4bca-8113-f18813f725b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-deleted", "tag": "6a277d3d-757e-4809-a72d-fac786fbec67"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:01.692883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6aeb6020-7587-4db3-af1f-b33119ad1093 req-64423013-7c57-4bca-8113-f18813f725b6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.694722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6aeb6020-7587-4db3-af1f-b33119ad1093 req-64423013-7c57-4bca-8113-f18813f725b6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.695746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6aeb6020-7587-4db3-af1f-b33119ad1093 req-64423013-7c57-4bca-8113-f18813f725b6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:01.705714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-352e681d-825e-4c8c-bf87-31b170479397 req-3204af86-4cba-4981-820a-d3e89212058a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.706221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-352e681d-825e-4c8c-bf87-31b170479397 req-3204af86-4cba-4981-820a-d3e89212058a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.706712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-352e681d-825e-4c8c-bf87-31b170479397 req-3204af86-4cba-4981-820a-d3e89212058a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:01.726708 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-6aeb6020-7587-4db3-af1f-b33119ad1093 req-64423013-7c57-4bca-8113-f18813f725b6 service nova] Creating event network-vif-deleted:6a277d3d-757e-4809-a72d-fac786fbec67 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:06:01.748074 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-6aeb6020-7587-4db3-af1f-b33119ad1093 req-64423013-7c57-4bca-8113-f18813f725b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106219 Aug 06 21:06:01.753601 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1393/2833] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:01.764082 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-352e681d-825e-4c8c-bf87-31b170479397 req-3204af86-4cba-4981-820a-d3e89212058a service nova] Creating event network-vif-plugged:3b873d21-0b64-4f34-a3ae-65806840ac6c for instance 1d94d029-8554-4b9d-950c-c1688ff520ac on nch2-master-1 Aug 06 21:06:01.770281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:01.771331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:01.778632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-352e681d-825e-4c8c-bf87-31b170479397 req-3204af86-4cba-4981-820a-d3e89212058a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126135 Aug 06 21:06:01.779349 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1441/2834] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:01.793713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:01.795682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:01.807346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.808370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.809763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:01.812107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.812474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.812601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.813067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:01.816358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:01.817816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.819077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:01.823700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:01.825083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:02.506237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:02.520477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:02.524529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:02.531658 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36decc2f-7916-4776-a432-ff863db0814f tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1359 microversion: 2.21 time: 0.774864 Aug 06 21:06:02.532454 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1394/2835] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:01 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1359 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:02.543010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef33779a-cfec-424c-ae66-6df675f2856a tempest-FlavorsV2NegativeTest-566551008 tempest-FlavorsV2NegativeTest-566551008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1495887788", "imageRef": "5e5495ef-89c4-4c6b-82dd-9322c4ebac20", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:02.676847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-ef33779a-cfec-424c-ae66-6df675f2856a tempest-FlavorsV2NegativeTest-566551008 tempest-FlavorsV2NegativeTest-566551008-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:02.815573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:02.836693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:02.840456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:02.844990 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-25f54c2b-ddc7-4d02-b685-1b718e234ce7 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2950 microversion: 2.32 time: 1.063342 Aug 06 21:06:02.846286 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1442/2836] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:01 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2950 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:02.862857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:02.870765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:02.887892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:02.890451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:02.893685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:02.894896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:02.898200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:02.904309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:03.266102 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-ef33779a-cfec-424c-ae66-6df675f2856a tempest-FlavorsV2NegativeTest-566551008 tempest-FlavorsV2NegativeTest-566551008-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef33779a-cfec-424c-ae66-6df675f2856a tempest-FlavorsV2NegativeTest-566551008 tempest-FlavorsV2NegativeTest-566551008-project] Request method failure captured: Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 143 Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te14X1AasMrbYY2-62Gi__Mzt7pkwDWPJS9vbEHIwv2ut9i6uLY4KWbzfRcxjfsh0qYiMRpA4WkYVXMzEzfqp7e4aKCxKd7ep4YMqSwbVOMN9QgXvdHsX-pTJvdtplaNJctMVqsbq_9GvQFTC3qGxNhT6CNRHe_je5lPEebu3kbhiA Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: ec9464cebb2d40e3930fb285b21b37c7 Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FlavorsV2NegativeTest-566551008 Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:06:03.268856 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ec9464cebb2d40e3930fb285b21b37c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ec9464cebb2d40e3930fb285b21b37c7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec9464cebb2d40e3930fb285b21b37c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ec9464cebb2d40e3930fb285b21b37c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FlavorsV2NegativeTest-566551008 Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: ec9464cebb2d40e3930fb285b21b37c7 Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-566551008 Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FlavorsV2NegativeTest-566551008-project Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3d516f716bb443d483606e299f60d9fa Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FlavorsV2NegativeTest-566551008-project Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1495887788", "imageRef": "5e5495ef-89c4-4c6b-82dd-9322c4ebac20", "flavorRef": "452"}} Aug 06 21:06:03.270861 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: exception: Flavor's memory is too small for requested image. Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1495887788', 'imageRef': '5e5495ef-89c4-4c6b-82dd-9322c4ebac20', 'flavorRef': '452'}}} Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:03.272025 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:03.273602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:03.275923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:03.275923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:03.275923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:03.275923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:03.275923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 06 21:06:03.275923 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:03.277552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef33779a-cfec-424c-ae66-6df675f2856a tempest-FlavorsV2NegativeTest-566551008 tempest-FlavorsV2NegativeTest-566551008-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:03.278839 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ef33779a-cfec-424c-ae66-6df675f2856a tempest-FlavorsV2NegativeTest-566551008 tempest-FlavorsV2NegativeTest-566551008-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.745111 Aug 06 21:06:03.279684 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1395/2837] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:02 2022] POST /compute/v2.1/servers => generated 93 bytes in 746 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 21:06:03.306974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:03.313891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:03.350079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:03.350615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:03.352768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:03.360327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:03.364160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:03.364695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:03.889229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:03.898960 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba720ea5-b080-4e78-9117-c20e0ef39c72 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 1.049199 Aug 06 21:06:03.904663 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1443/2838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:02 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:03.928368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:03.929425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:03.946776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:03.950336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:03.951130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:03.952085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:03.954027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:03.955204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:04.098317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:04.123870 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-77d710b1-786d-4785-b2b0-d8cda9fa04ba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1267 microversion: 2.1 time: 0.210595 Aug 06 21:06:04.126037 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1444/2839] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:03 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:04.140618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:04.140618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:04.171067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:04.171766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:04.172135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:04.172898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:04.176806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:04.177234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:04.444288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:04.472125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:04.479168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:04.485108 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bbabecd1-dc7a-488a-ba0b-8b6864ea0b1f tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 2327 microversion: 2.42 time: 1.200112 Aug 06 21:06:04.488686 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1396/2840] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:03 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 2327 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:04.502170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-56725c51-d28f-4886-ae72-34e6ff7b38cb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:04.502962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-56725c51-d28f-4886-ae72-34e6ff7b38cb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:04.529369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56725c51-d28f-4886-ae72-34e6ff7b38cb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:04.530835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56725c51-d28f-4886-ae72-34e6ff7b38cb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:04.532343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56725c51-d28f-4886-ae72-34e6ff7b38cb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:04.533758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56725c51-d28f-4886-ae72-34e6ff7b38cb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:04.539290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56725c51-d28f-4886-ae72-34e6ff7b38cb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:04.540229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56725c51-d28f-4886-ae72-34e6ff7b38cb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:04.811008 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-56725c51-d28f-4886-ae72-34e6ff7b38cb tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.320751 Aug 06 21:06:04.821485 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1397/2841] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Aug 6 21:06:04 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322/os-interface => generated 1831 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:04.828215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:04.831304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:04.850866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:04.854021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:04.855539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:04.858570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:04.859297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:04.862947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.021457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:05.030963 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3240bc66-5857-4050-8a27-d3271a128a54 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1283 microversion: 2.1 time: 0.903721 Aug 06 21:06:05.047855 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1445/2842] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:04 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1283 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:05.061741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ef064599-c28f-4203-baad-6a8fddf62a75 req-68ed7dd8-4ce7-4a42-9186-c8e54d07f6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-deleted", "tag": "33e933e8-51c8-4eb2-8702-773e0049c053"}, {"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-deleted", "tag": "51739d7c-ad65-40a3-85bf-e2312dde6cb3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:05.083970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ef064599-c28f-4203-baad-6a8fddf62a75 req-68ed7dd8-4ce7-4a42-9186-c8e54d07f6d9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.084458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ef064599-c28f-4203-baad-6a8fddf62a75 req-68ed7dd8-4ce7-4a42-9186-c8e54d07f6d9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.086686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ef064599-c28f-4203-baad-6a8fddf62a75 req-68ed7dd8-4ce7-4a42-9186-c8e54d07f6d9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.116650 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ef064599-c28f-4203-baad-6a8fddf62a75 req-68ed7dd8-4ce7-4a42-9186-c8e54d07f6d9 service nova] Creating event network-vif-deleted:33e933e8-51c8-4eb2-8702-773e0049c053 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:06:05.117234 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ef064599-c28f-4203-baad-6a8fddf62a75 req-68ed7dd8-4ce7-4a42-9186-c8e54d07f6d9 service nova] Creating event network-vif-deleted:51739d7c-ad65-40a3-85bf-e2312dde6cb3 for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:06:05.138511 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ef064599-c28f-4203-baad-6a8fddf62a75 req-68ed7dd8-4ce7-4a42-9186-c8e54d07f6d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087829 Aug 06 21:06:05.143171 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1446/2843] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:05.157483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b5897caf-5d1b-476a-b5f6-feba6f871f56 req-27777d82-0bfa-45f5-b9af-82b9a7a6902a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de9449c-2f19-42d8-8476-fb7ccf1b0c94", "name": "network-vif-plugged", "status": "completed", "tag": "81411f88-8c50-40a1-b174-1dfabe4d6575"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:05.171453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b5897caf-5d1b-476a-b5f6-feba6f871f56 req-27777d82-0bfa-45f5-b9af-82b9a7a6902a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.172034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b5897caf-5d1b-476a-b5f6-feba6f871f56 req-27777d82-0bfa-45f5-b9af-82b9a7a6902a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.172587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b5897caf-5d1b-476a-b5f6-feba6f871f56 req-27777d82-0bfa-45f5-b9af-82b9a7a6902a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.201444 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b5897caf-5d1b-476a-b5f6-feba6f871f56 req-27777d82-0bfa-45f5-b9af-82b9a7a6902a service nova] Creating event network-vif-plugged:81411f88-8c50-40a1-b174-1dfabe4d6575 for instance 6de9449c-2f19-42d8-8476-fb7ccf1b0c94 on nch1-master-1 Aug 06 21:06:05.215394 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b5897caf-5d1b-476a-b5f6-feba6f871f56 req-27777d82-0bfa-45f5-b9af-82b9a7a6902a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068926 Aug 06 21:06:05.216861 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1447/2844] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:05.223654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:05.224714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:05.234702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.235423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.235926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.237430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.238186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.238963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.537412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:05.565929 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-49bd5c78-8fcb-46e3-a83b-13d8f90c6efb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1293 microversion: 2.1 time: 0.347286 Aug 06 21:06:05.584918 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1448/2845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:05 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1293 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:05.598482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:05.599132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:05.609296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.610139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.610850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.611782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.612434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.613058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.687001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:05.698540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:05.700760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:05.702266 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bbe82976-1ff7-4f6b-a9f4-74c2edbd8b15 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1552 microversion: 2.21 time: 0.878228 Aug 06 21:06:05.703182 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1398/2846] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:04 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1552 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:05.708570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:05.709490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:05.717773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.718655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.719325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.720255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.720964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.721670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.739427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:05.754513 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0e543571-2624-400c-98f8-ee846e0b5b9e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1273 microversion: 2.1 time: 0.160135 Aug 06 21:06:05.756274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1449/2847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:05 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:05.768909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:05.772377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:05.793374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.793927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.795521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.797804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:05.798309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:05.800176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:05.853562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:06:05.916628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:05.934361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:05.941713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd9a63d793aa4a55822bfe108df664a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d35f36722e4fc8ac7d222cf93883e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:05.945340 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-211913ee-c2a8-476c-8b4c-52e995ea2003 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 200 len: 1604 microversion: 2.42 time: 0.238559 Aug 06 21:06:05.947884 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1399/2848] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:05 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 1604 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:05.963828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:06.043773 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-63d3d137-f4ce-42d8-960d-411f8a4cfb54 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 204 len: 0 microversion: 2.21 time: 0.284760 Aug 06 21:06:06.046668 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1450/2849] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:06:05 2022] DELETE /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:06:06.055038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:06.056882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:06.087589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:06.092932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:06.094208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:06.104751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:06.105875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:06.114392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:06.117532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:06.117737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:06.118452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:06.119197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:06.119968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:06.123971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:06.125202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:06.126983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:06.268967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:06.279924 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-728ad7eb-e3d4-4194-882a-2adbcc2aa70e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1289 microversion: 2.1 time: 0.218756 Aug 06 21:06:06.281670 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1451/2850] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:06 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1289 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:06.591990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:06.592754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:06.600535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:06.601214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:06.601839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:06.602759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:06.604243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:06.604834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:06.871322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:06.897772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:06.901533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:06.902894 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a77e7bb1-8292-406a-ad0b-a4a69eb92053 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1558 microversion: 2.21 time: 0.852443 Aug 06 21:06:06.903874 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1400/2851] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:06 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1558 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:06:06.933331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:06.934390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:06.951380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:06.952829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:06.954113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:06.955211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:06.955994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:06.957412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:07.018971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:07.029346 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-764fe58a-cdbc-4566-8ae9-4d8fc8d6c1c2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1473 microversion: 2.1 time: 0.441621 Aug 06 21:06:07.037365 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1452/2852] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:06 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1473 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:06:07.055662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:07.055662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:07.059309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:07.066935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:07.067455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:07.068085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:07.074793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:07.075564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:07.076176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:07.138619 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] HTTP exception thrown: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Request method failure captured: Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 HTTP/1.1 Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYt0MGS_44Qnmst8Ov7bXNJuQSBLTYhWV9Zv7bN83nXs9UUjVCPvQPgCg15zKNuqUmbfqMgHHTHJnF07pykYHML2Wj1zTUpTdd2TSZxSJeAEg1dDjK5HQrM3omfJGij7wdbEZOaW8z_SoCofrS1PxTU2CkCDrQoLYYUul-iqWvcmjI Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.42 Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 26d35f36722e4fc8ac7d222cf93883e9 Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-144839246 Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:06:07.140340 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/26d35f36722e4fc8ac7d222cf93883e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_26d35f36722e4fc8ac7d222cf93883e9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26d35f36722e4fc8ac7d222cf93883e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26d35f36722e4fc8ac7d222cf93883e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TaggedBootDevicesTest_v242-144839246 Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 26d35f36722e4fc8ac7d222cf93883e9 Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-144839246 Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TaggedBootDevicesTest_v242-144839246-project Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dd9a63d793aa4a55822bfe108df664a3 Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TaggedBootDevicesTest_v242-144839246-project Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:07.142003 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '22aa5607-d6c1-404b-ad4f-36cfb67aa334'} Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:07.143064 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:07.144607 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:07.145934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Returning 404 to user: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:07.146699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a85317fd-697b-4a88-a899-0b8077f16a8a tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 404 len: 111 microversion: 2.42 time: 0.112453 Aug 06 21:06:07.147308 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1453/2853] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:07 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:06:07.170827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-377e265c-a9dd-49ac-aa30-e34e41a270a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '.version_select at 0x7f729d746940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:07.220496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-377e265c-a9dd-49ac-aa30-e34e41a270a8 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430971903" status: 204 len: 0 microversion: 2.42 time: 0.061947 Aug 06 21:06:07.222115 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1454/2854] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:06:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1430971903 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:06:07.235177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-460a036b-4199-4480-ae3d-8575cea98d95 req-f98865b4-d67f-40ea-8d95-152624347a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22aa5607-d6c1-404b-ad4f-36cfb67aa334", "name": "network-vif-deleted", "tag": "d5834d81-de6d-4143-950a-49b591985c1f"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:07.260358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-460a036b-4199-4480-ae3d-8575cea98d95 req-f98865b4-d67f-40ea-8d95-152624347a2e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:07.260862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-460a036b-4199-4480-ae3d-8575cea98d95 req-f98865b4-d67f-40ea-8d95-152624347a2e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:07.261303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-460a036b-4199-4480-ae3d-8575cea98d95 req-f98865b4-d67f-40ea-8d95-152624347a2e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:07.286823 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-460a036b-4199-4480-ae3d-8575cea98d95 req-f98865b4-d67f-40ea-8d95-152624347a2e service nova] Creating event network-vif-deleted:d5834d81-de6d-4143-950a-49b591985c1f for instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 on nch1-master-1 Aug 06 21:06:07.307590 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-460a036b-4199-4480-ae3d-8575cea98d95 req-f98865b4-d67f-40ea-8d95-152624347a2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076772 Aug 06 21:06:07.311308 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1455/2855] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:06:07.334513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:07.336038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:07.362457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:07.363046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:07.365328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:07.373316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:07.373316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:07.373316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:07.575652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:07.599966 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1cbd642e-1e0e-4908-8716-df19977049f9 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1289 microversion: 2.1 time: 0.287073 Aug 06 21:06:07.603676 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1456/2856] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:07 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1289 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:07.615560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1296737106", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:07.734127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] validate_networks() for [('0827ee4a-610f-48e2-8263-78e781630780', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:07.804341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:07.820277 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8016c887-6d27-422f-af77-5629f7aabc08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1315 microversion: 2.1 time: 0.894357 Aug 06 21:06:07.821217 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1401/2857] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:06 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:07.939807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:07.940699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:07.960211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:07.960725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:07.961162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:07.963858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:07.964536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:07.967977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:08.507510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:08.517366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:08.524411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:08.526444 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d35bca54-6a42-4651-a311-4712de1ef906 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1558 microversion: 2.21 time: 0.590996 Aug 06 21:06:08.531332 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1402/2858] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:07 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1558 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:06:08.621152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:08.621784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:08.637133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:08.637646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:08.638095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:08.638850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:08.639425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:08.639729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:09.128128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:09.142638 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b63db362-4d7f-4a69-8efc-71e79a84a05b tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1331 microversion: 2.1 time: 0.524439 Aug 06 21:06:09.153113 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1403/2859] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:08 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1331 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:06:09.158269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:09.158938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:09.174421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:09.175252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:09.175832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:09.176650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:09.177209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:09.177890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:09.222480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:09.223845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:09.224811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:09.227026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:09.230819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:09.243916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:09.245106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:09.245766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:09.246971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:09.247657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:09.248502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:09.270644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:09.287693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for user 7dcd210e197347f8ad1622ee882bee92 and project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:09.304357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:09.308521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 4b409fac-c5bf-4a05-bb04-01106727f788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:09.390480 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c02ca4a0-43de-478d-9005-e6459b70f3b8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.785692 Aug 06 21:06:09.393495 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1457/2860] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:09.405221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84407f7d-2da4-4351-aef7-8ab440e9c5f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:09.407912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-84407f7d-2da4-4351-aef7-8ab440e9c5f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 4b409fac-c5bf-4a05-bb04-01106727f788] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:09.443317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-84407f7d-2da4-4351-aef7-8ab440e9c5f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 4b409fac-c5bf-4a05-bb04-01106727f788] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:06:09.590937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:09.599614 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-017979c8-2440-446f-bbbf-3fc7e21072bc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1315 microversion: 2.1 time: 0.445122 Aug 06 21:06:09.606174 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1404/2861] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:09 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:09.618319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:09.619937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:09.641964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:09.644666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:09.647043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:09.648357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:09.652823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:09.656129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:10.095641 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.scheduler.client.report [None req-84407f7d-2da4-4351-aef7-8ab440e9c5f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Deleted allocations for instance 4b409fac-c5bf-4a05-bb04-01106727f788 Aug 06 21:06:10.101420 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.compute.api [None req-84407f7d-2da4-4351-aef7-8ab440e9c5f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 4b409fac-c5bf-4a05-bb04-01106727f788] Instance Mapping does not exist while attempting local delete cleanup. Aug 06 21:06:10.102369 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-84407f7d-2da4-4351-aef7-8ab440e9c5f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788" status: 204 len: 0 microversion: 2.1 time: 0.701626 Aug 06 21:06:10.103148 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1458/2862] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:06:09 2022] DELETE /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:06:10.112678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81642925-7dbc-4844-9ffd-55a7273af951 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:10.113319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-81642925-7dbc-4844-9ffd-55a7273af951 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 4b409fac-c5bf-4a05-bb04-01106727f788] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:10.132400 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-81642925-7dbc-4844-9ffd-55a7273af951 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81642925-7dbc-4844-9ffd-55a7273af951 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788 HTTP/1.1 Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:06:10.134788 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:06:10.136386 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4b409fac-c5bf-4a05-bb04-01106727f788'} Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:10.137273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:10.138779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81642925-7dbc-4844-9ffd-55a7273af951 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:10.141943 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-81642925-7dbc-4844-9ffd-55a7273af951 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788" status: 404 len: 111 microversion: 2.1 time: 0.028134 Aug 06 21:06:10.152971 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1459/2863] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:10 2022] GET /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:06:10.172448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:10.175153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:10.229249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:10.233283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:10.233959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:10.236782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:10.237451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:10.238795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:10.484779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:10.496360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:10.506105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e0943fdb586241b796e349e08c778f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a59ffcb8834a50b1e8fa57aa9e89d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:10.507999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:10.508635 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-645cb17e-f5b0-4709-9540-7d3b5d6adf31 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 200 len: 1558 microversion: 2.21 time: 0.901048 Aug 06 21:06:10.510505 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1405/2864] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:09 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 1558 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:10.515530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-94d400a5-27f1-4eef-8ebd-a2b9ad232a96 req-053833f6-de8c-44d6-8aa3-cf51495d8569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40435db-3fd6-4788-a4ed-e07c44c04191", "tag": "af80fdfe-5add-47f1-9533-5fddb985d49b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:10.527784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-94d400a5-27f1-4eef-8ebd-a2b9ad232a96 req-053833f6-de8c-44d6-8aa3-cf51495d8569 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:10.528518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-94d400a5-27f1-4eef-8ebd-a2b9ad232a96 req-053833f6-de8c-44d6-8aa3-cf51495d8569 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:10.529109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-94d400a5-27f1-4eef-8ebd-a2b9ad232a96 req-053833f6-de8c-44d6-8aa3-cf51495d8569 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:10.531535 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b86c248a-00ee-48d8-b653-d1023901f952 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1331 microversion: 2.1 time: 0.363290 Aug 06 21:06:10.532595 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1460/2865] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:10 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1331 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:10.539684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1983899461", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "0827ee4a-610f-48e2-8263-78e781630780"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:10.560860 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-94d400a5-27f1-4eef-8ebd-a2b9ad232a96 req-053833f6-de8c-44d6-8aa3-cf51495d8569 service nova] Creating event network-changed:af80fdfe-5add-47f1-9533-5fddb985d49b for instance c40435db-3fd6-4788-a4ed-e07c44c04191 on nch2-master-1 Aug 06 21:06:10.579752 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-94d400a5-27f1-4eef-8ebd-a2b9ad232a96 req-053833f6-de8c-44d6-8aa3-cf51495d8569 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067567 Aug 06 21:06:10.580377 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1406/2866] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:10.585597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a505428b-7be8-43ca-97d2-df7d9e548228 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a353a0d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:10.638985 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a505428b-7be8-43ca-97d2-df7d9e548228 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/18bc3e4f-1152-4f19-9f0f-f15b858a0ac5" status: 200 len: 661 microversion: 2.1 time: 0.057205 Aug 06 21:06:10.639561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1407/2867] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:10 2022] GET /compute/v2.1/images/18bc3e4f-1152-4f19-9f0f-f15b858a0ac5 => generated 661 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:10.651584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:10.652761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:10.659742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:10.661266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] validate_networks() for [('0827ee4a-610f-48e2-8263-78e781630780', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:10.662062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:10.664593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:10.665781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:10.669619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:10.670277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.030918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:11.040941 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2cf6d179-3fc6-451c-8065-49df612baa18 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1315 microversion: 2.1 time: 0.399004 Aug 06 21:06:11.041832 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1408/2868] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:10 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:11.050870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28af7001-e58d-4690-a5ef-815c1c637506 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d27f040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:11.100496 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28af7001-e58d-4690-a5ef-815c1c637506 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/18bc3e4f-1152-4f19-9f0f-f15b858a0ac5" status: 200 len: 661 microversion: 2.1 time: 0.056757 Aug 06 21:06:11.101078 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1409/2869] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:11 2022] GET /compute/v2.1/images/18bc3e4f-1152-4f19-9f0f-f15b858a0ac5 => generated 661 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:11.106924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1580fd29-a83d-4323-8dce-1ba31133b8ba req-1094aeb9-bfa3-48e3-8900-32abcbab61b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d94d029-8554-4b9d-950c-c1688ff520ac", "name": "network-vif-deleted", "tag": "3b873d21-0b64-4f34-a3ae-65806840ac6c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:11.156823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1580fd29-a83d-4323-8dce-1ba31133b8ba req-1094aeb9-bfa3-48e3-8900-32abcbab61b0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.157332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1580fd29-a83d-4323-8dce-1ba31133b8ba req-1094aeb9-bfa3-48e3-8900-32abcbab61b0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.157781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1580fd29-a83d-4323-8dce-1ba31133b8ba req-1094aeb9-bfa3-48e3-8900-32abcbab61b0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.175105 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1580fd29-a83d-4323-8dce-1ba31133b8ba req-1094aeb9-bfa3-48e3-8900-32abcbab61b0 service nova] Creating event network-vif-deleted:3b873d21-0b64-4f34-a3ae-65806840ac6c for instance 1d94d029-8554-4b9d-950c-c1688ff520ac on nch2-master-1 Aug 06 21:06:11.182640 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1580fd29-a83d-4323-8dce-1ba31133b8ba req-1094aeb9-bfa3-48e3-8900-32abcbab61b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079511 Aug 06 21:06:11.184513 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1410/2870] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:11.533882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:11.534911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:11.539955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:11.541218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:11.549394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.550219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.550906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.551696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.552347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.552984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.569103 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] HTTP exception thrown: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Request method failure captured: Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac HTTP/1.1 Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teiySvJbUVGxE891TKDGj0H-Tt_Wmc1A9dz-oM3iPhrIipc9zDcBIiTRatb5qIBx9WnFNGERm-n-wZVz9HQGdXi0-OD4WSBODICRhi63jotSQw0Jof-aYMCDkWy_xY2T81Ugf9vyiDlKOXHZSS8vHR9xqG-T1mPzGX_VlbgSFOHflI Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.21 Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 90a59ffcb8834a50b1e8fa57aa9e89d2 Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-InstanceActionsV221TestJSON-418718832 Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:06:11.571018 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a59ffcb8834a50b1e8fa57aa9e89d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a59ffcb8834a50b1e8fa57aa9e89d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a59ffcb8834a50b1e8fa57aa9e89d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a59ffcb8834a50b1e8fa57aa9e89d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-InstanceActionsV221TestJSON-418718832 Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 90a59ffcb8834a50b1e8fa57aa9e89d2 Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-418718832 Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-InstanceActionsV221TestJSON-418718832-project Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e0943fdb586241b796e349e08c778f28 Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-InstanceActionsV221TestJSON-418718832-project Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.573663 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '1d94d029-8554-4b9d-950c-c1688ff520ac'} Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:11.576086 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.577271 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.579810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Returning 404 to user: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:11.579810 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3cb02226-f1ad-4a52-8fa3-4d0b347ffe1a tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 404 len: 111 microversion: 2.21 time: 0.040097 Aug 06 21:06:11.579810 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1411/2871] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:11 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:06:11.579810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:11.579810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:11.585233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.585735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.586162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.586907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.588004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.588650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.787623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:11.788749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:11.789514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:11.790048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:11.790705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:11.800893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.802425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.803002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.803885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.804895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.805594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.818399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:11.828983 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-080d3211-f79e-49c2-8d9b-05f511f2f8b6 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1331 microversion: 2.1 time: 0.254423 Aug 06 21:06:11.831825 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1412/2872] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:11 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1331 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:11.836967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8735b8d9-3f03-4786-a4f1-955b7320768b tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '.version_select at 0x7f729db624c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:11.838838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8735b8d9-3f03-4786-a4f1-955b7320768b tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:11.842669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:11.845730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8735b8d9-3f03-4786-a4f1-955b7320768b tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.846225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8735b8d9-3f03-4786-a4f1-955b7320768b tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.847323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8735b8d9-3f03-4786-a4f1-955b7320768b tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.848057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8735b8d9-3f03-4786-a4f1-955b7320768b tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.848526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8735b8d9-3f03-4786-a4f1-955b7320768b tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.848957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8735b8d9-3f03-4786-a4f1-955b7320768b tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.859127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for user 7dcd210e197347f8ad1622ee882bee92 and project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:11.874997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:11.877399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:11.922653 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8735b8d9-3f03-4786-a4f1-955b7320768b tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.089511 Aug 06 21:06:11.929613 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1413/2873] 10.222.0.33 () {60 vars in 1337 bytes} [Sat Aug 6 21:06:11 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac/os-instance-actions => generated 611 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:06:11.950165 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74d2feb7-cbc8-4e50-9707-af3d1a0e27c5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416173 Aug 06 21:06:11.951359 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1461/2874] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:11.958897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:11.959917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:11.964010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3bca70cf-a007-4eff-855c-c190d94cdb93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:11.965021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3bca70cf-a007-4eff-855c-c190d94cdb93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:11.967499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.967998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.968442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.969206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:11.969838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:11.970427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:11.986479 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] HTTP exception thrown: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Request method failure captured: Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac HTTP/1.1 Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teiySvJbUVGxE891TKDGj0H-Tt_Wmc1A9dz-oM3iPhrIipc9zDcBIiTRatb5qIBx9WnFNGERm-n-wZVz9HQGdXi0-OD4WSBODICRhi63jotSQw0Jof-aYMCDkWy_xY2T81Ugf9vyiDlKOXHZSS8vHR9xqG-T1mPzGX_VlbgSFOHflI Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.21 Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 90a59ffcb8834a50b1e8fa57aa9e89d2 Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-InstanceActionsV221TestJSON-418718832 Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:06:11.989202 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a59ffcb8834a50b1e8fa57aa9e89d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a59ffcb8834a50b1e8fa57aa9e89d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a59ffcb8834a50b1e8fa57aa9e89d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a59ffcb8834a50b1e8fa57aa9e89d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-InstanceActionsV221TestJSON-418718832 Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 90a59ffcb8834a50b1e8fa57aa9e89d2 Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-418718832 Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-InstanceActionsV221TestJSON-418718832-project Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e0943fdb586241b796e349e08c778f28 Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-InstanceActionsV221TestJSON-418718832-project Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.990785 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '1d94d029-8554-4b9d-950c-c1688ff520ac'} Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:11.991970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:11.993931 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:11.995395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Returning 404 to user: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:11.996352 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5035850f-04ac-4f7e-aee6-eeff8c680139 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 404 len: 111 microversion: 2.21 time: 0.042590 Aug 06 21:06:11.999995 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1414/2875] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:06:11 2022] DELETE /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:06:12.007731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:12.008371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] [instance: 1d94d029-8554-4b9d-950c-c1688ff520ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:12.015390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:12.015885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:12.016417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:12.017122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:12.017758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:12.018186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:12.032846 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] HTTP exception thrown: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Request method failure captured: Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac HTTP/1.1 Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teiySvJbUVGxE891TKDGj0H-Tt_Wmc1A9dz-oM3iPhrIipc9zDcBIiTRatb5qIBx9WnFNGERm-n-wZVz9HQGdXi0-OD4WSBODICRhi63jotSQw0Jof-aYMCDkWy_xY2T81Ugf9vyiDlKOXHZSS8vHR9xqG-T1mPzGX_VlbgSFOHflI Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.21 Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 90a59ffcb8834a50b1e8fa57aa9e89d2 Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-InstanceActionsV221TestJSON-418718832 Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:06:12.034407 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a59ffcb8834a50b1e8fa57aa9e89d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a59ffcb8834a50b1e8fa57aa9e89d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a59ffcb8834a50b1e8fa57aa9e89d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a59ffcb8834a50b1e8fa57aa9e89d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-InstanceActionsV221TestJSON-418718832 Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 90a59ffcb8834a50b1e8fa57aa9e89d2 Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-418718832 Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-InstanceActionsV221TestJSON-418718832-project Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e0943fdb586241b796e349e08c778f28 Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-InstanceActionsV221TestJSON-418718832-project Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:12.036117 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '1d94d029-8554-4b9d-950c-c1688ff520ac'} Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:12.036929 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. Aug 06 21:06:12.038442 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:12.039765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] Returning 404 to user: Instance 1d94d029-8554-4b9d-950c-c1688ff520ac could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:12.039765 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5057b032-cdfa-4a20-9c63-fcfb52091ae2 tempest-InstanceActionsV221TestJSON-418718832 tempest-InstanceActionsV221TestJSON-418718832-project] 10.222.0.33 "GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac" status: 404 len: 111 microversion: 2.21 time: 0.032203 Aug 06 21:06:12.040416 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1415/2876] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:12 2022] GET /compute/v2.1/servers/1d94d029-8554-4b9d-950c-c1688ff520ac => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:06:12.064732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:12.065505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:12.072618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:12.073348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:12.073949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:12.075019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:12.075643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:12.076402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:12.097939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3bca70cf-a007-4eff-855c-c190d94cdb93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:12.120743 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3bca70cf-a007-4eff-855c-c190d94cdb93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1221 microversion: 2.1 time: 0.161766 Aug 06 21:06:12.140988 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1462/2877] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:11 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:12.442166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:12.444828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:12.463750 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-93b711ff-9d40-4bca-bfd6-0a5db9b605b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1315 microversion: 2.1 time: 0.402318 Aug 06 21:06:12.467333 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1416/2878] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:12 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:12.702848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-20693f35-373b-4d0e-b802-f6b780d1ea40 req-11fdc699-3a4c-47cf-b0b0-ea4e6667b4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be18f2f2-b05d-4311-b737-d8638166b755", "tag": "6c25cbbe-4c18-4a9c-985b-71b904cbe8a3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:12.747916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-20693f35-373b-4d0e-b802-f6b780d1ea40 req-11fdc699-3a4c-47cf-b0b0-ea4e6667b4f0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:12.755019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-20693f35-373b-4d0e-b802-f6b780d1ea40 req-11fdc699-3a4c-47cf-b0b0-ea4e6667b4f0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:12.755991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-20693f35-373b-4d0e-b802-f6b780d1ea40 req-11fdc699-3a4c-47cf-b0b0-ea4e6667b4f0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:12.779404 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-20693f35-373b-4d0e-b802-f6b780d1ea40 req-11fdc699-3a4c-47cf-b0b0-ea4e6667b4f0 service nova] Creating event network-changed:6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 for instance be18f2f2-b05d-4311-b737-d8638166b755 on nch2-master-1 Aug 06 21:06:12.796870 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-20693f35-373b-4d0e-b802-f6b780d1ea40 req-11fdc699-3a4c-47cf-b0b0-ea4e6667b4f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100586 Aug 06 21:06:12.798639 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1463/2879] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:12.849771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21744974-e8ce-45d7-8de7-9157b2531e9c tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dcd9d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:12.854749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:12.855690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:12.866748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:12.881520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:12.882093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:12.882915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:12.883410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:12.891582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:12.939142 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21744974-e8ce-45d7-8de7-9157b2531e9c tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/3b93a2d0-75ff-4704-8b69-2047382c30d9" status: 200 len: 662 microversion: 2.1 time: 0.099861 Aug 06 21:06:12.950731 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1417/2880] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:12 2022] GET /compute/v2.1/images/3b93a2d0-75ff-4704-8b69-2047382c30d9 => generated 662 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:12.956323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-222313ca-8f50-4b58-8f52-f02b412dba6f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d2435e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:13.030436 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-222313ca-8f50-4b58-8f52-f02b412dba6f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/3b93a2d0-75ff-4704-8b69-2047382c30d9" status: 200 len: 662 microversion: 2.1 time: 0.078040 Aug 06 21:06:13.031062 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1418/2881] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:12 2022] GET /compute/v2.1/images/3b93a2d0-75ff-4704-8b69-2047382c30d9 => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:13.150387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:13.151467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:13.186004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:13.187973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:13.195914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:13.199587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:13.200072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:13.201081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:13.404915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:13.423316 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b7b8bc0f-e69b-4e09-ae5f-113712299667 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1273 microversion: 2.1 time: 0.277177 Aug 06 21:06:13.433783 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1419/2882] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:13 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:13.456661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:13.465161 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bcb39a9d-35f2-4a08-9bb2-c25865b19c80 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1331 microversion: 2.1 time: 0.616208 Aug 06 21:06:13.466408 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1464/2883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:12 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1331 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:13.489998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:13.490956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:13.501357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:13.502118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:13.502824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:13.503779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:13.504434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:13.505063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:14.218446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:14.233182 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99fd1eb8-c71f-41bb-a2e4-16a4fcb6a5a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1315 microversion: 2.1 time: 0.747874 Aug 06 21:06:14.234536 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1420/2884] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:13 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:14.457677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:14.459064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:14.474014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:14.474899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:14.475510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:14.476378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:14.477228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:14.478739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:14.489633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:14.490569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:14.503569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:14.511021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:14.513951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:14.517287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:14.521829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:14.522511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:14.525443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:14.705333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:14.716596 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8b5821b0-1268-4c9c-9371-03461f6c4ac5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1279 microversion: 2.1 time: 0.263135 Aug 06 21:06:14.719166 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1465/2885] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:14 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1279 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:14.729717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5150884b-57a9-4492-bb14-a0e36f4accff tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d5f5af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:14.800193 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5150884b-57a9-4492-bb14-a0e36f4accff tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/a13e406a-a765-4cc0-b007-a53adcfa4ac9" status: 200 len: 660 microversion: 2.1 time: 0.079598 Aug 06 21:06:14.807609 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1466/2886] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:14 2022] GET /compute/v2.1/images/a13e406a-a765-4cc0-b007-a53adcfa4ac9 => generated 660 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:14.818827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f97286a-4a2c-439e-bc43-f16c9e1c2d18 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d68ca60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:14.920787 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f97286a-4a2c-439e-bc43-f16c9e1c2d18 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/a13e406a-a765-4cc0-b007-a53adcfa4ac9" status: 200 len: 660 microversion: 2.1 time: 0.108494 Aug 06 21:06:14.921493 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1467/2887] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:14 2022] GET /compute/v2.1/images/a13e406a-a765-4cc0-b007-a53adcfa4ac9 => generated 660 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:15.030469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-12216676", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:15.088493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:15.102019 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-80794605-5c37-4ee2-9d24-b483fbd49bb4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1331 microversion: 2.1 time: 0.617157 Aug 06 21:06:15.106123 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1421/2888] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:14 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1331 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:15.141113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:15.260196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:15.261518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:15.269282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:15.274095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:15.275185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:15.275947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:15.276524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:15.281576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:15.620199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:15.633339 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-81e2bf7e-a927-45cb-b98f-300ef05e33a1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1315 microversion: 2.1 time: 0.376597 Aug 06 21:06:15.647634 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1422/2889] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:15 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:15.750720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:15.753373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:15.767136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:15.767994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:15.768657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:15.770273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:15.770990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:15.772397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:16.503564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:16.507322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:16.508684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:16.509257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:16.509722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:16.509882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:16.520687 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a63927b9-f408-473b-b2ef-4ba1edc7be0c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1321 microversion: 2.1 time: 0.776269 Aug 06 21:06:16.522325 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1423/2890] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:15 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1321 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:16.528990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:16.529863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:16.537579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:16.539476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:16.541909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:16.544649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:16.545311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:16.546220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:16.548916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:16.549568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:16.550263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:16.554015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:16.556046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:16.557706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:16.622080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Getting quotas for project 6b68ddb3badb454dac41733610ea2b71. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:16.633097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Getting quotas for user 55a4c0dae0d04e55b786ca572769bf8c and project 6b68ddb3badb454dac41733610ea2b71. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:16.675887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:16.694443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:16.866521 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7c04bcb6-51fd-42d0-b957-38e7a3557d0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838337 Aug 06 21:06:16.888559 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1468/2891] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:16.896315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-59ad10eb-99e9-43d3-81d2-42dbe790c191 req-d270cc32-934e-42bd-bc1b-031bb76c4028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40435db-3fd6-4788-a4ed-e07c44c04191", "name": "network-vif-plugged", "status": "completed", "tag": "af80fdfe-5add-47f1-9533-5fddb985d49b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:16.913691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-59ad10eb-99e9-43d3-81d2-42dbe790c191 req-d270cc32-934e-42bd-bc1b-031bb76c4028 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:16.915181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-59ad10eb-99e9-43d3-81d2-42dbe790c191 req-d270cc32-934e-42bd-bc1b-031bb76c4028 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:16.916949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-59ad10eb-99e9-43d3-81d2-42dbe790c191 req-d270cc32-934e-42bd-bc1b-031bb76c4028 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:16.933085 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-59ad10eb-99e9-43d3-81d2-42dbe790c191 req-d270cc32-934e-42bd-bc1b-031bb76c4028 service nova] Creating event network-vif-plugged:af80fdfe-5add-47f1-9533-5fddb985d49b for instance c40435db-3fd6-4788-a4ed-e07c44c04191 on nch2-master-1 Aug 06 21:06:16.940175 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-59ad10eb-99e9-43d3-81d2-42dbe790c191 req-d270cc32-934e-42bd-bc1b-031bb76c4028 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049387 Aug 06 21:06:16.941454 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1469/2892] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:16.951072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:16.952362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:16.969873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:16.970777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:16.972257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:16.973634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:16.974624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:16.975417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:17.203908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:17.214636 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-31f129bd-8d64-4917-a891-029f980def15 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1331 microversion: 2.1 time: 0.690918 Aug 06 21:06:17.215238 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1424/2893] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:16 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1331 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:17.232905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2136203865", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:17.346694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:17.668447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:17.692097 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7ead26e3-df3c-4b13-8ed7-c7aef08f7ca0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1315 microversion: 2.1 time: 0.749132 Aug 06 21:06:17.693049 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1470/2894] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:16 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:17.703496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:17.704097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:17.718036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:17.718630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:17.721722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:17.723395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:17.727115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:17.728101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:17.956153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:17.970375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:17.971008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:17.979511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:17.979974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:18.018143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:18.019140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:18.020800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:18.023274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:18.025500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:18.026171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:18.088531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Getting quotas for project 6b68ddb3badb454dac41733610ea2b71. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:18.109521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Getting quotas for user 55a4c0dae0d04e55b786ca572769bf8c and project 6b68ddb3badb454dac41733610ea2b71. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:18.138869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:18.141293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:18.257526 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2b636b1c-267d-4d14-9e7c-fd8b2418cc64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037052 Aug 06 21:06:18.294349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:18.306035 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9bb2c86e-ca57-402c-a044-deead971af30 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1321 microversion: 2.1 time: 0.611815 Aug 06 21:06:18.311176 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1471/2896] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:17 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1321 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:18.312141 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1425/2896] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:18.316339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:18.322862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:18.358796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:18.359029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-81bff177-ba3f-4e66-abd9-54c131e6a465 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:18.359711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-81bff177-ba3f-4e66-abd9-54c131e6a465 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:18.363020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:18.363484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:18.364246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:18.364701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:18.382932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:18.839566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-81bff177-ba3f-4e66-abd9-54c131e6a465 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:18.855022 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-81bff177-ba3f-4e66-abd9-54c131e6a465 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1218 microversion: 2.1 time: 0.537670 Aug 06 21:06:18.873658 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1426/2897] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:18 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1218 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:18.873658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:18.874107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:18.886860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:18.887443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:18.892628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:18.893561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:18.894066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:18.894598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:18.998675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:19.014481 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-68862012-465e-4b00-ae9f-0aebb7e8e3d4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1331 microversion: 2.1 time: 0.700151 Aug 06 21:06:19.015787 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1472/2898] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:18 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1331 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:19.292546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c68d0405-bd4b-4e28-82b2-acba0e71a058 req-78f4f391-085c-4578-a06f-67a3ae5d408e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7fe8c8c-7873-436b-8c54-e98ce91b892d", "tag": "418ecee8-abe8-4192-a9f3-260457ad87ce"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:19.316595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c68d0405-bd4b-4e28-82b2-acba0e71a058 req-78f4f391-085c-4578-a06f-67a3ae5d408e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:19.317693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c68d0405-bd4b-4e28-82b2-acba0e71a058 req-78f4f391-085c-4578-a06f-67a3ae5d408e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:19.318503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c68d0405-bd4b-4e28-82b2-acba0e71a058 req-78f4f391-085c-4578-a06f-67a3ae5d408e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:19.360074 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c68d0405-bd4b-4e28-82b2-acba0e71a058 req-78f4f391-085c-4578-a06f-67a3ae5d408e service nova] Creating event network-changed:418ecee8-abe8-4192-a9f3-260457ad87ce for instance b7fe8c8c-7873-436b-8c54-e98ce91b892d on nch1-master-1 Aug 06 21:06:19.380180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c68d0405-bd4b-4e28-82b2-acba0e71a058 req-78f4f391-085c-4578-a06f-67a3ae5d408e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092270 Aug 06 21:06:19.383401 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1473/2899] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:19.395763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:19.398728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:19.426275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:19.426932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:19.427463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:19.431375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:19.432220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:19.435850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:19.638360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:19.655034 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1276136e-fe1b-44ee-bd18-2e4cb61a1bd4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1503 microversion: 2.1 time: 0.785210 Aug 06 21:06:19.666593 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1427/2900] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:18 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1503 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:19.848789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-92809672", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:19.934066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:19.947262 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc2b2100-b1d2-4614-8161-8432b94ec87c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1321 microversion: 2.1 time: 0.558535 Aug 06 21:06:19.948440 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1474/2901] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:19 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1321 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:19.953546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:19.955044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:19.964528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:19.965183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:19.965789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:19.967146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:19.967776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:19.968218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:19.984698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] validate_networks() for [('bd0495d3-ebe3-46a8-845b-41c3f0fc9a67', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:20.017234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:06:20.273835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:20.390531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=9 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:20.421439 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ffca867-ebd0-47a0-959d-5ca273dc4f83 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 204 len: 0 microversion: 2.1 time: 0.469953 Aug 06 21:06:20.424290 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1475/2902] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:06:19 2022] DELETE /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:06:20.441196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:20.442210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:20.454160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:20.461084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:20.462867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:20.463898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:20.464576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:20.465929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:20.650716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:20.659769 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d0c54a99-8ac1-4cb8-9079-ca2978628c9b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1288 microversion: 2.1 time: 0.229612 Aug 06 21:06:20.679812 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1476/2903] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:20 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1288 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:20.693542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:20.694520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:20.715998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:20.716819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:20.718776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:20.723269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:20.725311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:20.729278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.047191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:21.059390 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5e6a3aff-21cf-476f-88f2-5a965a22d6a4 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1331 microversion: 2.1 time: 0.377597 Aug 06 21:06:21.060449 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1477/2904] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:20 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1331 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:21.077374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-98cd435e-c0b2-49e4-b8f4-a6b5bc1741f0 req-dce5aa00-4779-4c5e-917d-39d9d01dbaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be18f2f2-b05d-4311-b737-d8638166b755", "name": "network-vif-plugged", "status": "completed", "tag": "6c25cbbe-4c18-4a9c-985b-71b904cbe8a3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:21.098320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-98cd435e-c0b2-49e4-b8f4-a6b5bc1741f0 req-dce5aa00-4779-4c5e-917d-39d9d01dbaee service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:21.099356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-98cd435e-c0b2-49e4-b8f4-a6b5bc1741f0 req-dce5aa00-4779-4c5e-917d-39d9d01dbaee service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:21.100116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-98cd435e-c0b2-49e4-b8f4-a6b5bc1741f0 req-dce5aa00-4779-4c5e-917d-39d9d01dbaee service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.118197 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-98cd435e-c0b2-49e4-b8f4-a6b5bc1741f0 req-dce5aa00-4779-4c5e-917d-39d9d01dbaee service nova] Creating event network-vif-plugged:6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 for instance be18f2f2-b05d-4311-b737-d8638166b755 on nch2-master-1 Aug 06 21:06:21.140064 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-98cd435e-c0b2-49e4-b8f4-a6b5bc1741f0 req-dce5aa00-4779-4c5e-917d-39d9d01dbaee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077575 Aug 06 21:06:21.140779 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1478/2905] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:21.158743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:21.161448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:21.178661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:21.179451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:21.179904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.184454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:21.184954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:21.186124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.220565 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] HTTP exception thrown: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Request method failure captured: Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 HTTP/1.1 Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tYt0MGS_44Qnmst8Ov7bXNJuQSBLTYhWV9Zv7bN83nXs9UUjVCPvQPgCg15zKNuqUmbfqMgHHTHJnF07pykYHML2Wj1zTUpTdd2TSZxSJeAEg1dDjK5HQrM3omfJGij7wdbEZOaW8z_SoCofrS1PxTU2CkCDrQoLYYUul-iqWvcmjI Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.42 Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 26d35f36722e4fc8ac7d222cf93883e9 Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-144839246 Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:06:21.222380 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/26d35f36722e4fc8ac7d222cf93883e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_26d35f36722e4fc8ac7d222cf93883e9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26d35f36722e4fc8ac7d222cf93883e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26d35f36722e4fc8ac7d222cf93883e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TaggedBootDevicesTest_v242-144839246 Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 26d35f36722e4fc8ac7d222cf93883e9 Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-144839246 Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TaggedBootDevicesTest_v242-144839246-project Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dd9a63d793aa4a55822bfe108df664a3 Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TaggedBootDevicesTest_v242-144839246-project Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:21.224140 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '22aa5607-d6c1-404b-ad4f-36cfb67aa334'} Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:21.224996 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:21.229522 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:21.230917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Returning 404 to user: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:21.230917 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3fad75a4-d222-4b16-85bc-2ba2afd64e76 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 404 len: 111 microversion: 2.42 time: 0.080939 Aug 06 21:06:21.230917 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1479/2906] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:06:21 2022] DELETE /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:06:21.234052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:21.234898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:21.242207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:21.243016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:21.243872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.244756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:21.245381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:21.246082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.687607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:21.705539 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5cfe217a-7ca6-48e0-ae21-40c9a16ff5ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1509 microversion: 2.1 time: 0.475464 Aug 06 21:06:21.708435 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1480/2907] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:21 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:21.716290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:21.722676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:21.739707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:21.742892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:21.744020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.744800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:21.745279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:21.745720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.814502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:21.815710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:21.816644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:21.818456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:21.819508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:21.831427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:21.832073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:21.832686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.833585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:21.834123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:21.834690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:21.861880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Getting quotas for project 8046f1ab9c004060965dced02db4b7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:21.869413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Getting quotas for user f7cf258df10248d0bdcf64fa075c132c and project 8046f1ab9c004060965dced02db4b7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:21.887486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:21.891032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:21.960025 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c762433a-2400-4052-8262-5332142cda2f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.295620 Aug 06 21:06:21.963732 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1428/2908] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:21.984598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:21.985738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] [instance: 22aa5607-d6c1-404b-ad4f-36cfb67aa334] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:22.012133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:22.015705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:22.016507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:22.017456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:22.019320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:22.019982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:22.051298 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] HTTP exception thrown: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Request method failure captured: Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 HTTP/1.1 Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tYt0MGS_44Qnmst8Ov7bXNJuQSBLTYhWV9Zv7bN83nXs9UUjVCPvQPgCg15zKNuqUmbfqMgHHTHJnF07pykYHML2Wj1zTUpTdd2TSZxSJeAEg1dDjK5HQrM3omfJGij7wdbEZOaW8z_SoCofrS1PxTU2CkCDrQoLYYUul-iqWvcmjI Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.42 Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 26d35f36722e4fc8ac7d222cf93883e9 Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-144839246 Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:06:22.058505 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/26d35f36722e4fc8ac7d222cf93883e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_26d35f36722e4fc8ac7d222cf93883e9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26d35f36722e4fc8ac7d222cf93883e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/26d35f36722e4fc8ac7d222cf93883e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TaggedBootDevicesTest_v242-144839246 Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 26d35f36722e4fc8ac7d222cf93883e9 Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-144839246 Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TaggedBootDevicesTest_v242-144839246-project Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: dd9a63d793aa4a55822bfe108df664a3 Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TaggedBootDevicesTest_v242-144839246-project Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:22.060318 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '22aa5607-d6c1-404b-ad4f-36cfb67aa334'} Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:22.061172 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. Aug 06 21:06:22.062625 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:22.066192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] Returning 404 to user: Instance 22aa5607-d6c1-404b-ad4f-36cfb67aa334 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:22.067398 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f22fd514-70a4-408b-a09e-561b6e0d9110 tempest-TaggedBootDevicesTest_v242-144839246 tempest-TaggedBootDevicesTest_v242-144839246-project] 10.222.0.33 "GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334" status: 404 len: 111 microversion: 2.42 time: 0.089665 Aug 06 21:06:22.071074 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1429/2909] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:21 2022] GET /compute/v2.1/servers/22aa5607-d6c1-404b-ad4f-36cfb67aa334 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:06:22.089250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:22.093389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:22.109379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:22.109940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:22.113041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:22.114178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:22.115077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:22.115529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:22.349136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:22.359720 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8094579f-de75-4ca8-a3fd-1a870d896990 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1276 microversion: 2.1 time: 0.286204 Aug 06 21:06:22.359720 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1430/2910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:22 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1276 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:22.364329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7533003-2410-4eeb-a6f8-513ee0d28873 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:22.365016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f7533003-2410-4eeb-a6f8-513ee0d28873 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:22.513405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f7533003-2410-4eeb-a6f8-513ee0d28873 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:22.521495 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7533003-2410-4eeb-a6f8-513ee0d28873 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1220 microversion: 2.1 time: 0.160760 Aug 06 21:06:22.522865 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1431/2911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:22 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:22.529343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:22.530357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:22.539617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:22.540504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:22.541384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:22.542391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:22.543585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:22.544234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:23.371832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:23.387511 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aece67e8-01b5-4ac9-b45a-1acb119bc2fa tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1331 microversion: 2.1 time: 0.862452 Aug 06 21:06:23.404446 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1432/2912] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:22 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1331 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:23.411128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1897302838", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:23.542975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] validate_networks() for [('bd0495d3-ebe3-46a8-845b-41c3f0fc9a67', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:23.708113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:23.736906 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d40822f4-380c-45f5-9c6e-0238fb95fc06 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1321 microversion: 2.1 time: 2.025493 Aug 06 21:06:23.763279 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1481/2913] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:21 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1321 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:23.770826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:23.772025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:23.786531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:23.787414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:23.788138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:23.788993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:23.789505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:23.790757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:23.973376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:24.009158 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c4a9b833-f0ba-42d7-9057-83d31f72dcba tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 200 len: 1467 microversion: 2.1 time: 0.244278 Aug 06 21:06:24.015385 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1482/2914] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:23 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 1467 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:24.044107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:24.046461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:24.075018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:24.075546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:24.075998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:24.084796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:24.085405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:24.085870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:24.784856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:24.799903 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ad3a535d-1ee8-4add-819c-38584bd5f352 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1318 microversion: 2.1 time: 0.773866 Aug 06 21:06:24.801083 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1483/2915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:24 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:24.831317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-4a3ea62c-d113-4bef-8e06-8a1bee06ecbe req-8da75794-3702-45e5-8796-935e6b48d8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40435db-3fd6-4788-a4ed-e07c44c04191", "name": "network-vif-deleted", "tag": "af80fdfe-5add-47f1-9533-5fddb985d49b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:24.872261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4a3ea62c-d113-4bef-8e06-8a1bee06ecbe req-8da75794-3702-45e5-8796-935e6b48d8a2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:24.872778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4a3ea62c-d113-4bef-8e06-8a1bee06ecbe req-8da75794-3702-45e5-8796-935e6b48d8a2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:24.873234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4a3ea62c-d113-4bef-8e06-8a1bee06ecbe req-8da75794-3702-45e5-8796-935e6b48d8a2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:24.917733 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-4a3ea62c-d113-4bef-8e06-8a1bee06ecbe req-8da75794-3702-45e5-8796-935e6b48d8a2 service nova] Creating event network-vif-deleted:af80fdfe-5add-47f1-9533-5fddb985d49b for instance c40435db-3fd6-4788-a4ed-e07c44c04191 on nch2-master-1 Aug 06 21:06:24.928132 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-4a3ea62c-d113-4bef-8e06-8a1bee06ecbe req-8da75794-3702-45e5-8796-935e6b48d8a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120116 Aug 06 21:06:24.935362 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1484/2916] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:24.945997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:24.947343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:24.965135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:24.966771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:24.967451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:24.968190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:24.968662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:24.969122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:25.200986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:25.209143 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4b225bad-76cd-4795-8e8b-058b90d137b5 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1534 microversion: 2.1 time: 0.271507 Aug 06 21:06:25.209862 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1485/2917] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:24 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1534 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:25.216105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:25.216974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:25.232361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:25.233223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:25.233818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:25.234658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:25.235588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:25.236241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:25.463096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:25.476098 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22af6c03-c1b7-4010-8171-d133c0ff1a69 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1321 microversion: 2.1 time: 0.264773 Aug 06 21:06:25.476693 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1486/2918] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:25 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:25.497471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:25.498939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:25.509483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:25.509965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:25.510985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:25.511913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:25.512372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:25.513900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:25.539263 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 HTTP/1.1 Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:06:25.541180 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:06:25.542855 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'c40435db-3fd6-4788-a4ed-e07c44c04191'} Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:25.543817 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:06:25.545240 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:25.547681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:25.548725 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-34c24da5-3cf9-4108-b274-fab64a96552e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 404 len: 111 microversion: 2.1 time: 0.070786 Aug 06 21:06:25.549773 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1487/2919] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:25 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:06:25.554932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a439f853-5ff8-4649-b601-6ea613e30729 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Action: 'create', calling method: .version_select at 0x7f72a3497670>, body: {"pool": "da449dbb-c538-4888-8526-fbd7999668ff"} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:25.824831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:25.825259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:25.825813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:25.826407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:25.827140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:25.846615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:25.847596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:25.849307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:25.850691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:25.851324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:25.851977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:25.877251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Getting quotas for project 8046f1ab9c004060965dced02db4b7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:25.883974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Getting quotas for user f7cf258df10248d0bdcf64fa075c132c and project 8046f1ab9c004060965dced02db4b7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:25.921732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:25.929724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:26.048319 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0dbf83ea-3593-48a2-9c37-8c6282f968d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.642135 Aug 06 21:06:26.055025 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1433/2920] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:26.067595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-fdbdc26a-4247-4c10-90b0-0dcea5b1697a req-c4b44bfa-4ab0-41ba-8b13-c03720eef847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7fe8c8c-7873-436b-8c54-e98ce91b892d", "name": "network-vif-plugged", "status": "completed", "tag": "418ecee8-abe8-4192-a9f3-260457ad87ce"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:26.084835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fdbdc26a-4247-4c10-90b0-0dcea5b1697a req-c4b44bfa-4ab0-41ba-8b13-c03720eef847 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:26.085323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fdbdc26a-4247-4c10-90b0-0dcea5b1697a req-c4b44bfa-4ab0-41ba-8b13-c03720eef847 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:26.086125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fdbdc26a-4247-4c10-90b0-0dcea5b1697a req-c4b44bfa-4ab0-41ba-8b13-c03720eef847 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:26.101620 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-fdbdc26a-4247-4c10-90b0-0dcea5b1697a req-c4b44bfa-4ab0-41ba-8b13-c03720eef847 service nova] Creating event network-vif-plugged:418ecee8-abe8-4192-a9f3-260457ad87ce for instance b7fe8c8c-7873-436b-8c54-e98ce91b892d on nch1-master-1 Aug 06 21:06:26.110236 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-fdbdc26a-4247-4c10-90b0-0dcea5b1697a req-c4b44bfa-4ab0-41ba-8b13-c03720eef847 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052724 Aug 06 21:06:26.111158 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1434/2921] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:26.117751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-175263486", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5c00ae50-9c12-446f-a3fc-256b5e473c43"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:26.201572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] validate_networks() for [('5c00ae50-9c12-446f-a3fc-256b5e473c43', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:26.589368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:26.669928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=28 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:27.514025 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a439f853-5ff8-4649-b601-6ea613e30729 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.962972 Aug 06 21:06:27.514762 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1488/2922] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:06:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:27.520271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:27.521079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:27.534528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:27.535501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:27.536164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:27.537107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:27.537783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:27.538492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:28.170241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:28.171705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:28.172716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:28.173453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:28.174134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:28.184865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:28.185724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:28.186179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:28.186954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:28.187420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:28.187858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:28.208090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:28.209476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:28.216565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for user bdf1b5180a814cf39234892c6c1f26df and project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:28.227932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f1f9ea3c-7f9a-475e-bc6d-fdcdc49d872a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1318 microversion: 2.1 time: 0.711534 Aug 06 21:06:28.236140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:28.239004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:28.252193 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1489/2923] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:27 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:28.257925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:28.259980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:28.281934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:28.282955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:28.283813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:28.285356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:28.288597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:28.290015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:28.401317 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-13a13944-9884-497c-a1d9-398bdddcb292 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.288708 Aug 06 21:06:28.415447 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1435/2924] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:28.422266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:28.423181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:28.438511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:28.439491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:28.439827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:28.440712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:28.441665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:28.441970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:28.510135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:28.540502 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-066ef9b4-9ece-4b8e-ae1b-fdc002a4f6c5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1280 microversion: 2.1 time: 0.293849 Aug 06 21:06:28.543327 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1490/2925] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:28 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1280 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:28.800287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-568575594", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": "none"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:28.892610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:28.893595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:28.894910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:28.897813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:28.898641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:28.943659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:28.944563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:28.945976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:28.947999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:28.948588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:28.949359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:28.966770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:28.979724 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3ffc1f3d-227e-41ec-b80a-98a099c3ad23 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1501 microversion: 2.1 time: 0.562799 Aug 06 21:06:28.980553 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1436/2926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:28 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1501 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:28.988295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Getting quotas for project 95da58be1d84408098e2cf3513db3846. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:28.990346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.236"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:28.997449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:29.003511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Getting quotas for user d4b581ed648446a59900f2d275de4bf4 and project 95da58be1d84408098e2cf3513db3846. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:29.007077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:29.012753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:29.013397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:29.014309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:29.014915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:29.017625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:29.041304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:29.043659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:29.067813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:06:29.068249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquired lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:06:29.140938 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71841a38-5dac-4515-ac43-332bcb53b210 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.591164 Aug 06 21:06:29.152286 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1491/2927] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 21:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:06:29.173640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-1c423637-7da4-4355-8f8e-c1d12e0527af req-d1033239-79e8-42a1-9e18-c046e242fed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0926358-eed5-4b13-a285-2f56c382bce4", "tag": "5c0b2605-3a4d-45dd-876d-81e3e36ceb49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:29.189994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1c423637-7da4-4355-8f8e-c1d12e0527af req-d1033239-79e8-42a1-9e18-c046e242fed4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:29.193116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1c423637-7da4-4355-8f8e-c1d12e0527af req-d1033239-79e8-42a1-9e18-c046e242fed4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:29.194854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1c423637-7da4-4355-8f8e-c1d12e0527af req-d1033239-79e8-42a1-9e18-c046e242fed4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:29.222340 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-1c423637-7da4-4355-8f8e-c1d12e0527af req-d1033239-79e8-42a1-9e18-c046e242fed4 service nova] Creating event network-changed:5c0b2605-3a4d-45dd-876d-81e3e36ceb49 for instance e0926358-eed5-4b13-a285-2f56c382bce4 on nch2-master-1 Aug 06 21:06:29.231771 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-1c423637-7da4-4355-8f8e-c1d12e0527af req-d1033239-79e8-42a1-9e18-c046e242fed4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077550 Aug 06 21:06:29.235299 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1492/2928] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:29.250817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:29.251814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:29.263321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:29.263816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:29.264770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:29.265740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:29.266486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:29.267548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:29.416611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:29.432703 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4567c316-0dcc-403f-b910-7500b448a8e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1218 microversion: 2.1 time: 0.195183 Aug 06 21:06:29.433756 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1493/2929] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:29 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1218 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:29.449524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:29.450257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:29.457882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:29.458373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:29.458862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:29.459607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:29.460030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:29.460454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:29.784882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:29.794451 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-09fdd46f-8751-4df7-8f8d-47993135086e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1501 microversion: 2.1 time: 0.359586 Aug 06 21:06:29.814575 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1494/2930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:29 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1501 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:29.814575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a532773-0d5f-46ae-aa2b-140a12a5e581 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:29.814575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a532773-0d5f-46ae-aa2b-140a12a5e581 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:29.952577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a532773-0d5f-46ae-aa2b-140a12a5e581 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:29.980486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a532773-0d5f-46ae-aa2b-140a12a5e581 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:29.982346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a532773-0d5f-46ae-aa2b-140a12a5e581 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:29.983813 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a532773-0d5f-46ae-aa2b-140a12a5e581 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1277 microversion: 2.54 time: 0.181641 Aug 06 21:06:29.985651 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1495/2931] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:29 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:29.998992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:29.999816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:30.011441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:30.015314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:30.015999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:30.016920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:30.017553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:30.022848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:30.482988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:30.503464 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2b210697-a1a7-4b1f-9256-bf726005d8c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1318 microversion: 2.1 time: 0.516494 Aug 06 21:06:30.504076 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1496/2932] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:29 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:30.510082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:30.510998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:30.521818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:30.523450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:30.525402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:30.526788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:30.527422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:30.528506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:30.903190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:30.911414 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5a35fd7c-a2cf-4d77-b898-de2e94a1da0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1322 microversion: 2.1 time: 0.405876 Aug 06 21:06:30.912230 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1497/2933] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:30 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:30.919662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:30.920360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:30.927745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:30.928241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:30.928678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:30.929653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:30.930110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:30.930624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:30.948046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:30.967155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:06:31.088054 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-430857a8-ded1-47d1-b09b-5a988e514ccf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 204 len: 0 microversion: 2.1 time: 0.173336 Aug 06 21:06:31.088536 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1498/2934] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:06:30 2022] DELETE /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:06:31.101544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:31.102443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:31.109785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:31.110300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:31.110757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:31.111627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:31.112177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:31.112868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:31.252574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:31.264513 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4645f6e1-70c1-41ae-abc9-3676e3fd081f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1284 microversion: 2.1 time: 0.174661 Aug 06 21:06:31.267673 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1499/2935] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:31 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:31.293057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:31.294540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:31.314407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:31.319373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:31.320028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:31.321738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:31.322439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:31.322909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:31.703888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:31.714824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:31.716428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:31.717870 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9290ac3e-5e40-4320-a613-a6f2d8c08a77 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1273 microversion: 2.54 time: 0.451163 Aug 06 21:06:31.731093 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1500/2936] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:31 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1273 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:31.738759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:31.739387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:31.746029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:31.746524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:31.747055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:31.747771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:31.748344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:31.748779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:31.865562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Building network info cache for instance {{(pid=142462) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:06:32.053663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:32.069676 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-98752ce7-b053-40f1-9279-9ee77a73b2f5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1507 microversion: 2.1 time: 0.334501 Aug 06 21:06:32.072826 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1501/2937] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:31 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:32.101120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-acc5a887-ff93-467f-9e44-30806d5a630d req-7b408033-1890-4ce0-99fc-8a726257c76b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032e6b85-4ab1-4fed-818b-e3893ebc09c8", "tag": "700bbba7-9867-4e5a-b588-1da283ca9b16"}, {"name": "network-changed", "server_uuid": "13d43d45-c3b6-44b0-8241-b8ff218d15d4", "tag": "8ff6ffec-0dff-42e5-a7d2-cacb6354afb1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:32.127122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-acc5a887-ff93-467f-9e44-30806d5a630d req-7b408033-1890-4ce0-99fc-8a726257c76b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:32.130736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-acc5a887-ff93-467f-9e44-30806d5a630d req-7b408033-1890-4ce0-99fc-8a726257c76b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:32.131292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-acc5a887-ff93-467f-9e44-30806d5a630d req-7b408033-1890-4ce0-99fc-8a726257c76b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:32.167190 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-acc5a887-ff93-467f-9e44-30806d5a630d req-7b408033-1890-4ce0-99fc-8a726257c76b service nova] Creating event network-changed:700bbba7-9867-4e5a-b588-1da283ca9b16 for instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 on nch1-master-1 Aug 06 21:06:32.180256 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-acc5a887-ff93-467f-9e44-30806d5a630d req-7b408033-1890-4ce0-99fc-8a726257c76b service nova] Creating event network-changed:8ff6ffec-0dff-42e5-a7d2-cacb6354afb1 for instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 on nch2-master-1 Aug 06 21:06:32.213783 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-acc5a887-ff93-467f-9e44-30806d5a630d req-7b408033-1890-4ce0-99fc-8a726257c76b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.123478 Aug 06 21:06:32.215776 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1502/2938] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:32.231117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:32.236953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:32.267363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:32.268060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:32.269101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:32.269972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:32.270534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:32.273007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:32.694269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:32.711557 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b272b258-aa4d-4af0-8226-f0c8e528add4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1318 microversion: 2.1 time: 0.492065 Aug 06 21:06:32.712819 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1503/2939] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:32 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:32.717631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:32.723965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:32.736806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:32.737901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:32.738643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:32.739590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:32.740563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:32.741932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:33.276180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:33.292510 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92d227cc-ad33-4c74-b742-fb753d82f8e5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1322 microversion: 2.1 time: 0.578556 Aug 06 21:06:33.306631 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1504/2940] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:32 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1322 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:33.311784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-eec76a04-844f-4a40-8760-fcdb681cc31d req-a8c16bc2-4710-4cb2-83ad-a58595569ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b66ce3-9ebf-4346-93e9-39e370d165ba", "tag": "d1dc8821-1ddb-4099-bc78-ac1cfb6b4170"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:33.331196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-eec76a04-844f-4a40-8760-fcdb681cc31d req-a8c16bc2-4710-4cb2-83ad-a58595569ee0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:33.332131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-eec76a04-844f-4a40-8760-fcdb681cc31d req-a8c16bc2-4710-4cb2-83ad-a58595569ee0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:33.332854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-eec76a04-844f-4a40-8760-fcdb681cc31d req-a8c16bc2-4710-4cb2-83ad-a58595569ee0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:33.347207 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-eec76a04-844f-4a40-8760-fcdb681cc31d req-a8c16bc2-4710-4cb2-83ad-a58595569ee0 service nova] Creating event network-changed:d1dc8821-1ddb-4099-bc78-ac1cfb6b4170 for instance 16b66ce3-9ebf-4346-93e9-39e370d165ba on nch2-master-1 Aug 06 21:06:33.354212 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-eec76a04-844f-4a40-8760-fcdb681cc31d req-a8c16bc2-4710-4cb2-83ad-a58595569ee0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045815 Aug 06 21:06:33.355516 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1505/2941] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:33.362279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:33.363240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:33.371269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:33.372076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:33.372714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:33.373666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:33.374313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:33.374951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:33.496050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:33.507187 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb20ea98-c6bf-4158-9244-6421d4d333ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1272 microversion: 2.1 time: 0.150141 Aug 06 21:06:33.508180 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1506/2942] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:33 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:33.513861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-647b7ee6-2970-4d25-aa6f-2e99d8323d7c req-24edc31f-3083-4322-87da-d4732e7e5528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0926358-eed5-4b13-a285-2f56c382bce4", "name": "network-vif-plugged", "status": "completed", "tag": "5c0b2605-3a4d-45dd-876d-81e3e36ceb49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:33.526265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-647b7ee6-2970-4d25-aa6f-2e99d8323d7c req-24edc31f-3083-4322-87da-d4732e7e5528 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:33.526897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-647b7ee6-2970-4d25-aa6f-2e99d8323d7c req-24edc31f-3083-4322-87da-d4732e7e5528 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:33.527349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-647b7ee6-2970-4d25-aa6f-2e99d8323d7c req-24edc31f-3083-4322-87da-d4732e7e5528 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:33.545350 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-647b7ee6-2970-4d25-aa6f-2e99d8323d7c req-24edc31f-3083-4322-87da-d4732e7e5528 service nova] Creating event network-vif-plugged:5c0b2605-3a4d-45dd-876d-81e3e36ceb49 for instance e0926358-eed5-4b13-a285-2f56c382bce4 on nch2-master-1 Aug 06 21:06:33.552977 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-647b7ee6-2970-4d25-aa6f-2e99d8323d7c req-24edc31f-3083-4322-87da-d4732e7e5528 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042780 Aug 06 21:06:33.554165 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1507/2943] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:33.578347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:33.579859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:33.602085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:33.603585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:33.604096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:33.605266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:33.619015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:33.621350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:33.815644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:33.830385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:33.832680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:33.834052 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1925505-dde8-4390-80db-c6b1bf75297b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1335 microversion: 2.54 time: 0.276687 Aug 06 21:06:33.834918 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1508/2944] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:33 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1335 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:33.851806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:33.853477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:33.860801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:33.861464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:33.861999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:33.862855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:33.863586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:33.864288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:34.333287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Updating instance_info_cache with network_info: [{"id": "6c25cbbe-4c18-4a9c-985b-71b904cbe8a3", "address": "fa:16:3e:90:c4:83", "network": {"id": "eadfb3f4-cbb1-489a-b7c2-f9a2e9d81cb2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-528977055-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "64300b6685d7478f8bfa92c2d6eb91d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6c25cbbe-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:06:34.373412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Releasing lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:06:34.379210 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-282a9e48-44b8-4431-8bea-c934d63be73c tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action" status: 202 len: 0 microversion: 2.1 time: 5.393060 Aug 06 21:06:34.381020 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1437/2945] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:06:28 2022] POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action => generated 0 bytes in 5400 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 06 21:06:34.406917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:34.407869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:34.420615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:34.439424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:34.442577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:34.443864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:34.444642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:34.445123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:34.447883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:34.448685 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bbef0ff3-caef-4e89-a6f9-0b8db3b5d2b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1507 microversion: 2.1 time: 0.601471 Aug 06 21:06:34.469713 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1509/2946] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:33 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:34.480026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:34.480741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:34.487156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:34.488110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:34.490330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:34.491451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:34.492130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:34.493435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:34.709683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:34.727579 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c322c0e6-592a-4047-af18-ce66abec75c4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1322 microversion: 2.1 time: 0.256592 Aug 06 21:06:34.740674 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1510/2947] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:34 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:34.747640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b91cbef6-23dd-44d0-83da-23bd0a79d2aa req-cd187573-233e-4dce-8801-6a7e3983547d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be18f2f2-b05d-4311-b737-d8638166b755", "tag": "6c25cbbe-4c18-4a9c-985b-71b904cbe8a3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:34.767959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b91cbef6-23dd-44d0-83da-23bd0a79d2aa req-cd187573-233e-4dce-8801-6a7e3983547d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:34.768910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b91cbef6-23dd-44d0-83da-23bd0a79d2aa req-cd187573-233e-4dce-8801-6a7e3983547d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:34.769556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b91cbef6-23dd-44d0-83da-23bd0a79d2aa req-cd187573-233e-4dce-8801-6a7e3983547d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:34.786934 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b91cbef6-23dd-44d0-83da-23bd0a79d2aa req-cd187573-233e-4dce-8801-6a7e3983547d service nova] Creating event network-changed:6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 for instance be18f2f2-b05d-4311-b737-d8638166b755 on nch2-master-1 Aug 06 21:06:34.794320 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b91cbef6-23dd-44d0-83da-23bd0a79d2aa req-cd187573-233e-4dce-8801-6a7e3983547d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051858 Aug 06 21:06:34.795671 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1511/2948] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:34.804791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7f246fe7-40c0-4cc3-b761-b157e96d0c23 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Action: 'create', calling method: .version_select at 0x7f729d8e9940>, body: {"pool": "da449dbb-c538-4888-8526-fbd7999668ff"} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:35.313739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:35.346352 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-13282319-4c61-4751-954e-2c066b5237ea tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1318 microversion: 2.1 time: 0.962837 Aug 06 21:06:35.350339 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1438/2949] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:34 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1318 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:35.365611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:35.366749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:35.382211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:35.383494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:35.384802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:35.386944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:35.388501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:35.390159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:35.761763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:35.778681 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e5529a2b-75ab-41a2-939d-d4c702a4da99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1314 microversion: 2.1 time: 0.424938 Aug 06 21:06:35.779829 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1439/2950] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:35 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:35.787785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:35.788799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:35.807301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:35.808057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:35.809285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:35.810242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:35.810944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:35.811646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:35.836407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:36.023631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:36.050639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:36.052204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:36.056966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8d3e6554-304b-47e0-9def-13eef9ed2c82 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1356 microversion: 2.54 time: 0.275660 Aug 06 21:06:36.059892 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1440/2951] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:35 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1356 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:36.073308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:36.073941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:36.076083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:36.098933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:36.099458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:36.100081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:36.100827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:36.101298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:36.101739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:36.202531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:36.203085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:36.205348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:36.207116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lazy-loading 'fault' on Instance uuid b7fe8c8c-7873-436b-8c54-e98ce91b892d {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:06:36.511839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:36.519722 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-98b5e234-50c3-485f-8815-2ad29ebb6981 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 200 len: 1311 microversion: 2.1 time: 0.451395 Aug 06 21:06:36.534843 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1441/2952] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:36 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 1311 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:36.541908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:36.542974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:36.550713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:36.551537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:36.552189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:36.553113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:36.553822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:36.554945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.052243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:37.063005 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-107b08b5-4e86-474c-b940-44dc87ec8cc8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1322 microversion: 2.1 time: 0.526383 Aug 06 21:06:37.063671 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1442/2953] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:36 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:37.077855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-757b4c34-2ea7-4b61-ba74-c496755b07fb tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Action: 'create', calling method: .version_select at 0x7f729d1cb310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2093719221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXZrFg5WrcZrfxn6lz0Lj5UDNfHPIqSD8Qa5cP5bEPefPh2ylV/wWLfe4/U4hQP9yvAjVnHqzkiZVlN3Qlb341ircCKKoc7dmlIgvEw91AMl08/6o/XdzQpbnePUOlVYg=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:37.104600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-757b4c34-2ea7-4b61-ba74-c496755b07fb tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Getting quotas for project 95da58be1d84408098e2cf3513db3846. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:37.111427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-757b4c34-2ea7-4b61-ba74-c496755b07fb tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Getting quotas for user d4b581ed648446a59900f2d275de4bf4 and project 95da58be1d84408098e2cf3513db3846. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:37.146102 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-757b4c34-2ea7-4b61-ba74-c496755b07fb tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.081117 Aug 06 21:06:37.146902 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1443/2954] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Aug 6 21:06:37 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 21:06:37.154043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:37.154951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:37.161408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.162014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.162538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.163668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.164456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.165587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.262044 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7f246fe7-40c0-4cc3-b761-b157e96d0c23 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.463717 Aug 06 21:06:37.262743 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1512/2955] 10.222.0.33 () {60 vars in 1170 bytes} [Sat Aug 6 21:06:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:37.267633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7cdd7d40-9841-4928-9acf-55f1ff02f68a req-d38f3931-3912-464e-8b31-6e1e24afaffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d43d45-c3b6-44b0-8241-b8ff218d15d4", "name": "network-vif-plugged", "status": "completed", "tag": "8ff6ffec-0dff-42e5-a7d2-cacb6354afb1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:37.279183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7cdd7d40-9841-4928-9acf-55f1ff02f68a req-d38f3931-3912-464e-8b31-6e1e24afaffd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.279762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7cdd7d40-9841-4928-9acf-55f1ff02f68a req-d38f3931-3912-464e-8b31-6e1e24afaffd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.280259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7cdd7d40-9841-4928-9acf-55f1ff02f68a req-d38f3931-3912-464e-8b31-6e1e24afaffd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.290768 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7cdd7d40-9841-4928-9acf-55f1ff02f68a req-d38f3931-3912-464e-8b31-6e1e24afaffd service nova] Creating event network-vif-plugged:8ff6ffec-0dff-42e5-a7d2-cacb6354afb1 for instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 on nch2-master-1 Aug 06 21:06:37.295728 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7cdd7d40-9841-4928-9acf-55f1ff02f68a req-d38f3931-3912-464e-8b31-6e1e24afaffd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031626 Aug 06 21:06:37.296537 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1513/2956] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:37.307082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:37.308028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:37.317614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.318673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.319580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.321465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.322235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.323140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.530335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:37.538809 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-14e514dc-d14b-4e70-908a-4e1388446e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1314 microversion: 2.1 time: 0.240211 Aug 06 21:06:37.539418 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1514/2957] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:37 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:37.544100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3fd7fe8a-af36-4f53-a2b4-63c3c240cb31 req-29b0b4dc-c678-4511-9340-39bbe764a705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7fe8c8c-7873-436b-8c54-e98ce91b892d", "name": "network-vif-deleted", "tag": "418ecee8-abe8-4192-a9f3-260457ad87ce"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:37.550672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:37.556298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3fd7fe8a-af36-4f53-a2b4-63c3c240cb31 req-29b0b4dc-c678-4511-9340-39bbe764a705 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.556794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3fd7fe8a-af36-4f53-a2b4-63c3c240cb31 req-29b0b4dc-c678-4511-9340-39bbe764a705 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.557368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3fd7fe8a-af36-4f53-a2b4-63c3c240cb31 req-29b0b4dc-c678-4511-9340-39bbe764a705 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.571681 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3fd7fe8a-af36-4f53-a2b4-63c3c240cb31 req-29b0b4dc-c678-4511-9340-39bbe764a705 service nova] Creating event network-vif-deleted:418ecee8-abe8-4192-a9f3-260457ad87ce for instance b7fe8c8c-7873-436b-8c54-e98ce91b892d on nch1-master-1 Aug 06 21:06:37.578320 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3fd7fe8a-af36-4f53-a2b4-63c3c240cb31 req-29b0b4dc-c678-4511-9340-39bbe764a705 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037574 Aug 06 21:06:37.578971 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1515/2958] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:37.584658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2093719221", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:37.587682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:37.594574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.595091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.595538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.596261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.596729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.597172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.687782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:37.688218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:37.688704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:37.689124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:37.689548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:37.763665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:37.774853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:37.782256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.782782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.783225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.783938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.784400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.784828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.819432 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bbe7cd1b-9660-46ce-ac37-c517ef45a598 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "POST /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b/action" status: 202 len: 1139 microversion: 2.54 time: 0.239219 Aug 06 21:06:37.820066 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1516/2959] 10.222.0.33 () {62 vars in 1320 bytes} [Sat Aug 6 21:06:37 2022] POST /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b/action => generated 1139 bytes in 241 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 06 21:06:37.828296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.218"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:37.831484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:37.839027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.839766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.840378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.841443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:37.842201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:37.842850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:37.873333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:06:37.874089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquired lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:06:37.973539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:37.984747 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3566b614-b07d-4738-9edd-50aa493e6bfb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1318 microversion: 2.1 time: 0.836363 Aug 06 21:06:37.985347 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1444/2960] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:37 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1318 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:37.994132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:37.995119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:38.004239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:38.005004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:38.005771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:38.006822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:38.007446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:38.008145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:38.026175 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d HTTP/1.1 Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:06:38.028279 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:06:38.029877 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'b7fe8c8c-7873-436b-8c54-e98ce91b892d'} Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:38.030776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:06:38.032259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.034362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:38.035416 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-889e0587-198b-4803-a816-e23a1c95134b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 404 len: 111 microversion: 2.1 time: 0.047987 Aug 06 21:06:38.046485 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1445/2961] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:37 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:06:38.052043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:38.052938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:38.060112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:38.060875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:38.061497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:38.062364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:38.062998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:38.063593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:38.156312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:38.165850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:38.167612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:38.168876 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c177c9c-4f6b-4023-93e9-4faebbf72874 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.120850 Aug 06 21:06:38.169543 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1446/2962] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:38 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:38.174280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfa741fc-ca14-4364-a1bb-a51d547b916a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'create', calling method: .version_select at 0x7f729d23d310>, body: {"keypair": {"name": "tempest-key-1054140117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGn0szgOUPPOsmhdAiUXzLuDVKeMLpn+u+FRwa+sJGBnDh+DcgrZTd7bBteaVOBFkSiY8r+rHdYWr+iQEgOApger64EnMzE40Ca/Jz6rGIWLb25anHly5JgM/PKZUktBA=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:38.197480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-dfa741fc-ca14-4364-a1bb-a51d547b916a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for project dbbbe30122a7461ea225294728dc8af7. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:38.199937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:38.203763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-dfa741fc-ca14-4364-a1bb-a51d547b916a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for user 7dcd210e197347f8ad1622ee882bee92 and project dbbbe30122a7461ea225294728dc8af7. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:38.234335 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfa741fc-ca14-4364-a1bb-a51d547b916a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.063468 Aug 06 21:06:38.235539 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1447/2963] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:06:38 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:38.242096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:38.243368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:38.256770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:38.257290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:38.259281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:38.262152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:38.262932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:38.264243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:38.607727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.218 (759eded9-4d6d-440b-b912-b97a4306a2ad) with port 6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network da449dbb-c538-4888-8526-fbd7999668ff.", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:06:38.609417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Releasing lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:06:38.609417 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.218 (759eded9-4d6d-440b-b912-b97a4306a2ad) with port 6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network da449dbb-c538-4888-8526-fbd7999668ff. Aug 06 21:06:38.609417 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-e84a446f-8e10-4ee2-bb3e-23f2e8942da7'] Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Request method failure captured: Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action HTTP/1.1 Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 46 Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te1XZpAHBkhTi6IwtpU8rJCdbwHhi3ZU1Txvs-Jd1t7mrwYS-sHLayZ9D_WzLNUaYQMbDQpdETErWMkZvHFiMych0GnW02yQFJKMqXXo30GtUgHntHIss5Kuc4p9f4vR-ztupWiRPPFwUsWtmEPiX2rRJTG_QiGHt6Sd_6o5EX9a8g Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:06:38.611529 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64300b6685d7478f8bfa92c2d6eb91d6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 10b30a7d1ce94193970bdc076d481578 Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: {"addFloatingIp": {"address": "172.35.4.218"}} Aug 06 21:06:38.613109 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: exception: Cannot associate floating IP 172.35.4.218 (759eded9-4d6d-440b-b912-b97a4306a2ad) with port 6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network da449dbb-c538-4888-8526-fbd7999668ff. Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-e84a446f-8e10-4ee2-bb3e-23f2e8942da7'] Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'be18f2f2-b05d-4311-b737-d8638166b755', 'body': {'addFloatingIp': {'address': '172.35.4.218'}}} Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:06:38.613883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:06:38.614952 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.4.218 (759eded9-4d6d-440b-b912-b97a4306a2ad) with port 6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network da449dbb-c538-4888-8526-fbd7999668ff. Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e84a446f-8e10-4ee2-bb3e-23f2e8942da7'] Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.4.218 (759eded9-4d6d-440b-b912-b97a4306a2ad) with port 6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network da449dbb-c538-4888-8526-fbd7999668ff. Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e84a446f-8e10-4ee2-bb3e-23f2e8942da7'] Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.616547 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.4.218 (759eded9-4d6d-440b-b912-b97a4306a2ad) with port 6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network da449dbb-c538-4888-8526-fbd7999668ff. Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e84a446f-8e10-4ee2-bb3e-23f2e8942da7'] Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.618910 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:38.622783 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.622783 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:38.622783 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:38.622783 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:38.622783 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:38.622783 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:38.622783 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.4.218 (759eded9-4d6d-440b-b912-b97a4306a2ad) with port 6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network da449dbb-c538-4888-8526-fbd7999668ff. Aug 06 21:06:38.622783 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e84a446f-8e10-4ee2-bb3e-23f2e8942da7'] Aug 06 21:06:38.622783 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:38.630572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Returning 400 to user: Cannot associate floating IP 172.35.4.218 (759eded9-4d6d-440b-b912-b97a4306a2ad) with port 6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network da449dbb-c538-4888-8526-fbd7999668ff. Aug 06 21:06:38.630572 ncdv-master-1 devstack@n-api.service[142461]: Neutron server returns request_ids: ['req-e84a446f-8e10-4ee2-bb3e-23f2e8942da7'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:38.630572 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4588bbfd-81e7-4dfe-bc6c-9242d2bebc43 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action" status: 400 len: 381 microversion: 2.1 time: 0.805683 Aug 06 21:06:38.630572 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1517/2964] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:06:37 2022] POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action => generated 381 bytes in 807 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:06:38.636112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48ef62a3-cd09-4d29-a9e9-987a5267bd78 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '.version_select at 0x7f72a365a700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:38.650833 ncdv-master-1 devstack@n-api.service[142461]: WARNING oslo_db.sqlalchemy.utils [None req-48ef62a3-cd09-4d29-a9e9-987a5267bd78 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 06 21:06:38.669004 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-48ef62a3-cd09-4d29-a9e9-987a5267bd78 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.040388 Aug 06 21:06:38.673046 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1518/2965] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:06:38 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:38.688242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:38.693955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:38.708570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:38.709441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:38.710364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:38.716563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:38.717524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:38.718193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:38.718797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:38.720382 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-734d5767-1644-4b36-b43a-d0eadc55ff6c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1322 microversion: 2.1 time: 0.482989 Aug 06 21:06:38.727520 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1448/2966] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:38 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:38.738755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b3e7037-14a8-4ad5-bd9d-c66a7deaeb33 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '.version_select at 0x7f729d204160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:38.967784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:38.970052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:38.978325 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba9051ba-3307-4a7b-b6bf-07a52ff1ef40 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1314 microversion: 2.1 time: 0.303435 Aug 06 21:06:38.979383 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1519/2967] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:38 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:38.994655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-856139369", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "key_name": "tempest-key-1054140117", "networks": [{"uuid": "0827ee4a-610f-48e2-8263-78e781630780"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:39.059928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] validate_networks() for [('0827ee4a-610f-48e2-8263-78e781630780', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:39.539262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:06:39.540258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:06:39.540748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:06:39.541177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:06:39.541791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:06:39.550832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:39.551331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:39.551895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:39.552638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:39.553112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:39.553554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:39.573812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:06:39.581499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for user 7dcd210e197347f8ad1622ee882bee92 and project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:06:39.595654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:06:39.597994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:06:39.645806 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-70981752-4d31-4bf0-83e2-13739b52e6cd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657095 Aug 06 21:06:39.646960 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1520/2968] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:06:39.652089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:39.652711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:39.660140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:39.660651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:39.661083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:39.661802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:39.662260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:39.662732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:39.836592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:39.847584 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-76244d90-0a38-4937-a322-2eda2ebae33f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1318 microversion: 2.1 time: 0.199684 Aug 06 21:06:39.848267 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1521/2969] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:39 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:39.855826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:39.857122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:39.864894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:39.865513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:39.866155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:39.867101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:39.868195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:39.869940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:39.964499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:39.975082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:39.976812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:39.978557 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d93b5be9-abf6-46f8-b598-2fb69159b526 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.128911 Aug 06 21:06:39.979140 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1522/2970] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:39 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:39.986945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c008d78b-246a-4caf-819f-5497dd9a4a01 req-f2677747-bece-47e6-beb8-0fb7a0589d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032e6b85-4ab1-4fed-818b-e3893ebc09c8", "name": "network-vif-plugged", "status": "completed", "tag": "700bbba7-9867-4e5a-b588-1da283ca9b16"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:40.006359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c008d78b-246a-4caf-819f-5497dd9a4a01 req-f2677747-bece-47e6-beb8-0fb7a0589d41 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.007297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c008d78b-246a-4caf-819f-5497dd9a4a01 req-f2677747-bece-47e6-beb8-0fb7a0589d41 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.008070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c008d78b-246a-4caf-819f-5497dd9a4a01 req-f2677747-bece-47e6-beb8-0fb7a0589d41 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:40.045656 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c008d78b-246a-4caf-819f-5497dd9a4a01 req-f2677747-bece-47e6-beb8-0fb7a0589d41 service nova] Creating event network-vif-plugged:700bbba7-9867-4e5a-b588-1da283ca9b16 for instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 on nch1-master-1 Aug 06 21:06:40.051862 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c008d78b-246a-4caf-819f-5497dd9a4a01 req-f2677747-bece-47e6-beb8-0fb7a0589d41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071014 Aug 06 21:06:40.053888 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1523/2971] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:40.061766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2b98bae1-c07a-47bd-90c2-1eea664a83ac tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:40.063016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2b98bae1-c07a-47bd-90c2-1eea664a83ac tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:40.160790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2b98bae1-c07a-47bd-90c2-1eea664a83ac tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:40.170281 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2b98bae1-c07a-47bd-90c2-1eea664a83ac tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1228 microversion: 2.1 time: 0.113777 Aug 06 21:06:40.171190 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1524/2972] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:40 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1228 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:40.176489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bc07300e-fadd-4bc4-9f18-a2067cca5347 req-ca17c9f3-5253-42aa-8103-0a4df464dfbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095c55d4-3b38-45e1-926a-bbbe858afa81", "tag": "d8267882-f6f3-4104-8ff2-28f22deca013"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:40.189706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bc07300e-fadd-4bc4-9f18-a2067cca5347 req-ca17c9f3-5253-42aa-8103-0a4df464dfbf service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.190299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bc07300e-fadd-4bc4-9f18-a2067cca5347 req-ca17c9f3-5253-42aa-8103-0a4df464dfbf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.190975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bc07300e-fadd-4bc4-9f18-a2067cca5347 req-ca17c9f3-5253-42aa-8103-0a4df464dfbf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:40.204746 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bc07300e-fadd-4bc4-9f18-a2067cca5347 req-ca17c9f3-5253-42aa-8103-0a4df464dfbf service nova] Creating event network-changed:d8267882-f6f3-4104-8ff2-28f22deca013 for instance 095c55d4-3b38-45e1-926a-bbbe858afa81 on nch1-master-1 Aug 06 21:06:40.215148 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bc07300e-fadd-4bc4-9f18-a2067cca5347 req-ca17c9f3-5253-42aa-8103-0a4df464dfbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037937 Aug 06 21:06:40.216979 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1525/2973] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:40.223592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:40.224411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:40.232307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.232930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.233440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:40.234231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.234850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.235355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:40.395072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:40.408285 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42408a14-7d7a-41b7-acde-3371d348e90e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1322 microversion: 2.1 time: 0.189128 Aug 06 21:06:40.409294 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1526/2974] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:40 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:40.414230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:40.415649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:40.425591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.426457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.427174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:40.428297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.428978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.429901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:40.565706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:40.574399 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-767b32d9-0d43-4d92-82a6-35afb0eaf8f1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1314 microversion: 2.1 time: 0.163754 Aug 06 21:06:40.575127 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1527/2975] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:40 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:40.597430 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b3e7037-14a8-4ad5-bd9d-c66a7deaeb33 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/759eded9-4d6d-440b-b912-b97a4306a2ad" status: 202 len: 0 microversion: 2.1 time: 1.869373 Aug 06 21:06:40.598025 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1449/2976] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:06:38 2022] DELETE /compute/v2.1/os-floating-ips/759eded9-4d6d-440b-b912-b97a4306a2ad => generated 0 bytes in 1871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:06:40.609526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.236"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:40.735583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:40.751902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.752420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.752849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:40.753570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.754030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.754462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:40.870192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:40.870855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:40.887678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.888173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.888815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:40.889769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:40.890407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:40.891074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:41.100069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:06:41.100507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquired lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:06:41.448446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:41.456381 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-726f3043-403f-4e28-9640-4d6aa89d841a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1318 microversion: 2.1 time: 0.591098 Aug 06 21:06:41.457232 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1450/2977] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:40 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:41.462911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:41.463891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:41.470295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:41.471094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:41.471769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:41.472734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:41.473397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:41.473895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:41.641329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:41.655515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:41.657074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:41.661318 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c83ff2e6-0091-4978-b9d0-2cedc6dceca1 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.202825 Aug 06 21:06:41.679595 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1451/2978] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:41 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:41.685778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:41.686826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:41.699846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:41.700869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:41.701799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:41.702817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:41.703504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:41.704150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:41.799025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:41.810018 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ee04495a-85ca-4588-a779-1e8f102cf9d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1298 microversion: 2.1 time: 0.128819 Aug 06 21:06:41.813964 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1452/2979] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:41 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:41.819463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:41.820338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:41.828010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:41.828833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:41.829519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:41.830491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:41.831227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:41.831868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:42.238875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:42.247242 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1e8667cf-a676-4518-a339-9a28748ecb86 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1322 microversion: 2.1 time: 0.431791 Aug 06 21:06:42.259149 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1453/2980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:41 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:42.266934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:42.267646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:42.275079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:42.275647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:42.276369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:42.277296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:42.277841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:42.278352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:42.407821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Building network info cache for instance {{(pid=142461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 06 21:06:42.730804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:42.773883 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6273d3eb-6fcc-4f60-9b76-cc0a8116b46a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1314 microversion: 2.1 time: 0.513111 Aug 06 21:06:42.788958 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1454/2981] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:42 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:42.794147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c98c5f13-b7c7-4f1b-8d6d-e5ccc1a07880 req-3e896745-005d-4641-91b4-a186168f35c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b66ce3-9ebf-4346-93e9-39e370d165ba", "name": "network-vif-plugged", "status": "completed", "tag": "d1dc8821-1ddb-4099-bc78-ac1cfb6b4170"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:42.803883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c98c5f13-b7c7-4f1b-8d6d-e5ccc1a07880 req-3e896745-005d-4641-91b4-a186168f35c7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:42.804626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c98c5f13-b7c7-4f1b-8d6d-e5ccc1a07880 req-3e896745-005d-4641-91b4-a186168f35c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:42.805662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c98c5f13-b7c7-4f1b-8d6d-e5ccc1a07880 req-3e896745-005d-4641-91b4-a186168f35c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:42.818954 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c98c5f13-b7c7-4f1b-8d6d-e5ccc1a07880 req-3e896745-005d-4641-91b4-a186168f35c7 service nova] Creating event network-vif-plugged:d1dc8821-1ddb-4099-bc78-ac1cfb6b4170 for instance 16b66ce3-9ebf-4346-93e9-39e370d165ba on nch2-master-1 Aug 06 21:06:42.825284 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c98c5f13-b7c7-4f1b-8d6d-e5ccc1a07880 req-3e896745-005d-4641-91b4-a186168f35c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034938 Aug 06 21:06:42.826443 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1455/2982] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:42.832611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-af563aa5-3fd6-4ecb-8f83-916b98543b73 req-3d6d7c46-2d61-4a32-a744-8a3c3f365d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be18f2f2-b05d-4311-b737-d8638166b755", "tag": "6c25cbbe-4c18-4a9c-985b-71b904cbe8a3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:42.843848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-af563aa5-3fd6-4ecb-8f83-916b98543b73 req-3d6d7c46-2d61-4a32-a744-8a3c3f365d92 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:42.844587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-af563aa5-3fd6-4ecb-8f83-916b98543b73 req-3d6d7c46-2d61-4a32-a744-8a3c3f365d92 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:42.845182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-af563aa5-3fd6-4ecb-8f83-916b98543b73 req-3d6d7c46-2d61-4a32-a744-8a3c3f365d92 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:42.857850 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-af563aa5-3fd6-4ecb-8f83-916b98543b73 req-3d6d7c46-2d61-4a32-a744-8a3c3f365d92 service nova] Creating event network-changed:6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 for instance be18f2f2-b05d-4311-b737-d8638166b755 on nch2-master-1 Aug 06 21:06:42.863853 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-af563aa5-3fd6-4ecb-8f83-916b98543b73 req-3d6d7c46-2d61-4a32-a744-8a3c3f365d92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035583 Aug 06 21:06:42.865155 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1456/2983] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:42.871692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:42.872675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:42.880217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:42.880998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:42.881597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:42.882481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:42.883779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:42.884379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:43.527392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:43.538642 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-76a6a088-69ef-452a-b7dd-cacd70c2fa37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1468 microversion: 2.1 time: 0.671793 Aug 06 21:06:43.540555 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1457/2984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:42 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1468 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:43.547409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:43.548173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:43.556025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:43.556874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:43.557824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:43.559127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:43.559872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:43.561512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:43.740922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:43.757919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:43.776257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Updating instance_info_cache with network_info: [{"id": "6c25cbbe-4c18-4a9c-985b-71b904cbe8a3", "address": "fa:16:3e:90:c4:83", "network": {"id": "eadfb3f4-cbb1-489a-b7c2-f9a2e9d81cb2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-528977055-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "64300b6685d7478f8bfa92c2d6eb91d6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6c25cbbe-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=142461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:06:43.794846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:43.797872 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-db60daea-5c87-457b-928e-c7606693e486 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.256179 Aug 06 21:06:43.800498 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1458/2985] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:43 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:43.818453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Releasing lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:06:43.823432 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b47e1b4-aaf7-40e6-90da-a3ff63866d32 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action" status: 202 len: 0 microversion: 2.1 time: 3.219454 Aug 06 21:06:43.826868 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1528/2986] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:06:40 2022] POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action => generated 0 bytes in 3225 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 06 21:06:43.842908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:43.843107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:43.843682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:43.844159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:43.851042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:43.851985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:43.853245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:43.854034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:43.854651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:43.855182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:43.871651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:43.872169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:43.872623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:43.878623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:43.879468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:43.880218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:44.454895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:44.468016 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-60dc0a7c-d61f-49a1-9f9e-298037480d2f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1328 microversion: 2.1 time: 0.654860 Aug 06 21:06:44.468636 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1459/2987] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:43 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1328 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:44.487605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:44.487945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:44.500240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:44.500742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:44.501198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:44.501948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:44.502416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:44.502888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:44.563591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:44.578049 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ab8fc15-d95a-48f7-930d-bcc78c8685d3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1322 microversion: 2.1 time: 0.749830 Aug 06 21:06:44.578689 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1529/2988] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:43 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1322 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:44.599099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:44.599559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:44.609364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:44.613146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:44.614291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:44.615380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:44.616009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:44.616693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:44.763174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:44.778197 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f43af16-5dc1-44f0-9a65-68716e1a35ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4" status: 200 len: 1465 microversion: 2.1 time: 0.295026 Aug 06 21:06:44.779135 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1460/2989] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:44 2022] GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 => generated 1465 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:44.783961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9778e80c-f5ca-4fdd-a03e-ca0025e5195f tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '.version_select at 0x7f729d359d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:45.100846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:45.128277 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e21a953-8e07-4a8f-bcbe-039163908580 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1314 microversion: 2.1 time: 0.532774 Aug 06 21:06:45.129747 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1530/2990] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:44 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:45.135384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-625b45e3-0157-48da-8edb-713d76d7ef99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-540802505"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:45.138636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-625b45e3-0157-48da-8edb-713d76d7ef99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:45.148183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625b45e3-0157-48da-8edb-713d76d7ef99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:45.150583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625b45e3-0157-48da-8edb-713d76d7ef99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:45.151295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625b45e3-0157-48da-8edb-713d76d7ef99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:45.152255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625b45e3-0157-48da-8edb-713d76d7ef99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:45.152923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625b45e3-0157-48da-8edb-713d76d7ef99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:45.153842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625b45e3-0157-48da-8edb-713d76d7ef99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:45.563113 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-625b45e3-0157-48da-8edb-713d76d7ef99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "POST /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4/action" status: 202 len: 0 microversion: 2.1 time: 0.431754 Aug 06 21:06:45.563811 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1531/2991] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:06:45 2022] POST /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 21:06:45.570399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:45.572016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:45.579547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:45.580320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:45.580956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:45.581923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:45.582617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:45.583406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:45.682023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:45.692869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:45.694581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:45.699187 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2b00125-7cc5-4bd2-8251-566d9ae9c37e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.134048 Aug 06 21:06:45.699771 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1532/2992] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:45 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:45.704866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-da89c6ae-1649-4a42-b2c8-fcada0e801e0 req-3d16e96c-b56b-42bc-9ac4-751e4455fb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095c55d4-3b38-45e1-926a-bbbe858afa81", "name": "network-vif-plugged", "status": "completed", "tag": "d8267882-f6f3-4104-8ff2-28f22deca013"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:45.714736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-da89c6ae-1649-4a42-b2c8-fcada0e801e0 req-3d16e96c-b56b-42bc-9ac4-751e4455fb70 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:45.715600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-da89c6ae-1649-4a42-b2c8-fcada0e801e0 req-3d16e96c-b56b-42bc-9ac4-751e4455fb70 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:45.716362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-da89c6ae-1649-4a42-b2c8-fcada0e801e0 req-3d16e96c-b56b-42bc-9ac4-751e4455fb70 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:45.728175 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-da89c6ae-1649-4a42-b2c8-fcada0e801e0 req-3d16e96c-b56b-42bc-9ac4-751e4455fb70 service nova] Creating event network-vif-plugged:d8267882-f6f3-4104-8ff2-28f22deca013 for instance 095c55d4-3b38-45e1-926a-bbbe858afa81 on nch1-master-1 Aug 06 21:06:45.734222 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-da89c6ae-1649-4a42-b2c8-fcada0e801e0 req-3d16e96c-b56b-42bc-9ac4-751e4455fb70 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033019 Aug 06 21:06:45.736056 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1533/2993] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:45.744166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:45.745223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:45.755648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:45.756244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:45.756789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:45.757580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:45.758801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:45.759585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.026626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:46.035483 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75f28a69-1751-4f2e-8c7d-1eb636198067 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1328 microversion: 2.1 time: 0.297720 Aug 06 21:06:46.035905 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1534/2994] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:45 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1328 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:46.041608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b20d1c98-c180-4a9d-a2de-4b8110e11a91 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dacf4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:46.098505 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b20d1c98-c180-4a9d-a2de-4b8110e11a91 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.061473 Aug 06 21:06:46.099362 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1535/2995] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:46 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:46.104949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:46.106318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:46.113166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:46.113976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:46.114667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.115594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:46.116227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:46.116834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.139368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:46.628009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:46.637991 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-23c10b8f-8679-4d5f-86a3-945e40629030 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1516 microversion: 2.1 time: 0.537339 Aug 06 21:06:46.638847 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1536/2996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:46 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1516 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:46.643610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-a38dbb7b-6f34-48c6-950e-ebc91e9220fa req-ecb8eb01-1745-401c-aa72-81f2a760eb2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d389375c-139a-4e55-8ddb-90459d2d0770", "tag": "94c79690-a24b-4c93-9c50-bf00ae8e50fa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:46.660065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a38dbb7b-6f34-48c6-950e-ebc91e9220fa req-ecb8eb01-1745-401c-aa72-81f2a760eb2a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:46.660790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a38dbb7b-6f34-48c6-950e-ebc91e9220fa req-ecb8eb01-1745-401c-aa72-81f2a760eb2a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:46.660985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a38dbb7b-6f34-48c6-950e-ebc91e9220fa req-ecb8eb01-1745-401c-aa72-81f2a760eb2a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.687186 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a38dbb7b-6f34-48c6-950e-ebc91e9220fa req-ecb8eb01-1745-401c-aa72-81f2a760eb2a service nova] Creating event network-changed:94c79690-a24b-4c93-9c50-bf00ae8e50fa for instance d389375c-139a-4e55-8ddb-90459d2d0770 on nch1-master-1 Aug 06 21:06:46.702979 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-a38dbb7b-6f34-48c6-950e-ebc91e9220fa req-ecb8eb01-1745-401c-aa72-81f2a760eb2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062494 Aug 06 21:06:46.704236 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1537/2997] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:46.709818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:46.710769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:46.719797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:46.720307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:46.720846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.721700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:46.722325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:46.723069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.839823 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9778e80c-f5ca-4fdd-a03e-ca0025e5195f tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/62d8218e-8edf-4b81-8244-f265cf51ce75" status: 202 len: 0 microversion: 2.1 time: 2.059420 Aug 06 21:06:46.844803 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1461/2998] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:06:44 2022] DELETE /compute/v2.1/os-floating-ips/62d8218e-8edf-4b81-8244-f265cf51ce75 => generated 0 bytes in 2061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:06:46.848501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:46.850832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:46.858623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:46.859122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:46.859564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.860267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:46.860724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:46.861151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.884750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lazy-loading 'flavor' on Instance uuid 16b66ce3-9ebf-4346-93e9-39e370d165ba {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:06:46.889108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:46.940273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:46.951275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e48d78ec-e09e-43d7-8aa2-c769c5bf7391 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1314 microversion: 2.1 time: 0.245582 Aug 06 21:06:46.952667 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1538/2999] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:46 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:46.959097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:46.960854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:46.969006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:46.969591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:46.970103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.971167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:46.971629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:46.972058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:46.980070 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dd7a0805-77ed-4e11-b983-041e08d3c97e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba/action" status: 200 len: 32 microversion: 2.1 time: 0.137559 Aug 06 21:06:46.981099 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1462/3000] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:06:46 2022] POST /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba/action => generated 32 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:06:46.988457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e44dfd62-7a5f-4c9a-801a-c0c135cca023 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e44dfd62-7a5f-4c9a-801a-c0c135cca023 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Request method failure captured: Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action HTTP/1.1 Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 34 Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te1XZpAHBkhTi6IwtpU8rJCdbwHhi3ZU1Txvs-Jd1t7mrwYS-sHLayZ9D_WzLNUaYQMbDQpdETErWMkZvHFiMych0GnW02yQFJKMqXXo30GtUgHntHIss5Kuc4p9f4vR-ztupWiRPPFwUsWtmEPiX2rRJTG_QiGHt6Sd_6o5EX9a8g Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:06:46.992665 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64300b6685d7478f8bfa92c2d6eb91d6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 10b30a7d1ce94193970bdc076d481578 Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: {"addFloatingIp": {"address": ""}} Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:06:46.994326 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'be18f2f2-b05d-4311-b737-d8638166b755', 'body': {'addFloatingIp': {'address': ''}}} Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi '' Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:46.995351 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:06:46.997099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:06:46.998529 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 06 21:06:46.998529 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:46.998529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e44dfd62-7a5f-4c9a-801a-c0c135cca023 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:46.998529 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e44dfd62-7a5f-4c9a-801a-c0c135cca023 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action" status: 400 len: 142 microversion: 2.1 time: 0.013492 Aug 06 21:06:47.002281 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1463/3001] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:06:46 2022] POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:06:47.007313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:47.008833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:47.017335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.019112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.019752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.020595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.021169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.021803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.138097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:47.154341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:47.155970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:47.157294 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ecb372c6-2ad2-42d0-90db-af7d90987c86 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.203249 Aug 06 21:06:47.158105 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1539/3002] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:46 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:47.162958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:47.165710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:47.181745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.182260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.182748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.184505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.185137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.185739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.229538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 21:06:47.230041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquired lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 21:06:47.237610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:47.246625 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c23b616a-6055-47a5-9a14-4a632027589d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.243103 Aug 06 21:06:47.247223 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1464/3003] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:47 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:47.252144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:47.252971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:47.259992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.260690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.261317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.262232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.262725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.263168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.368601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Releasing lock "refresh_cache-be18f2f2-b05d-4311-b737-d8638166b755" {{(pid=142461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 21:06:47.369315 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] HTTP exception thrown: floating IP not found Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Request method failure captured: Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action HTTP/1.1 Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 41 Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te1XZpAHBkhTi6IwtpU8rJCdbwHhi3ZU1Txvs-Jd1t7mrwYS-sHLayZ9D_WzLNUaYQMbDQpdETErWMkZvHFiMych0GnW02yQFJKMqXXo30GtUgHntHIss5Kuc4p9f4vR-ztupWiRPPFwUsWtmEPiX2rRJTG_QiGHt6Sd_6o5EX9a8g Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:06:47.371133 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64300b6685d7478f8bfa92c2d6eb91d6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 10b30a7d1ce94193970bdc076d481578 Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:06:47.372722 ncdv-master-1 devstack@n-api.service[142461]: exception: floating IP not found Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'be18f2f2-b05d-4311-b737-d8638166b755', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:47.373699 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 06 21:06:47.375169 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.377663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Returning 404 to user: floating IP not found {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:47.378834 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca136deb-13db-46de-ab16-2b67e9bcb863 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action" status: 404 len: 67 microversion: 2.1 time: 0.219469 Aug 06 21:06:47.385263 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1540/3004] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:06:47 2022] POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action => generated 67 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:06:47.391186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9cbfcd0e-d7f9-46e5-a030-70dc01eee63d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dacf1f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:47.425586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:47.440711 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99388379-0d76-447d-99bb-847f16d8b28f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1328 microversion: 2.1 time: 0.191664 Aug 06 21:06:47.461348 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9cbfcd0e-d7f9-46e5-a030-70dc01eee63d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.074393 Aug 06 21:06:47.461669 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1465/3005] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:47 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1328 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:47.463401 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1541/3006] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:47 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:47.467286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00018da2-fa19-452d-9fa3-a033ade4977a tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:47.518563 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-00018da2-fa19-452d-9fa3-a033ade4977a tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00018da2-fa19-452d-9fa3-a033ade4977a tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Request method failure captured: Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action HTTP/1.1 Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 44 Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te1XZpAHBkhTi6IwtpU8rJCdbwHhi3ZU1Txvs-Jd1t7mrwYS-sHLayZ9D_WzLNUaYQMbDQpdETErWMkZvHFiMych0GnW02yQFJKMqXXo30GtUgHntHIss5Kuc4p9f4vR-ztupWiRPPFwUsWtmEPiX2rRJTG_QiGHt6Sd_6o5EX9a8g Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:06:47.520186 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64300b6685d7478f8bfa92c2d6eb91d6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 10b30a7d1ce94193970bdc076d481578 Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:06:47.521715 ncdv-master-1 devstack@n-api.service[142462]: exception: Floating IP not found for address 0.0.0.0. Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'be18f2f2-b05d-4311-b737-d8638166b755', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:47.522744 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 06 21:06:47.524659 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:06:47.526155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00018da2-fa19-452d-9fa3-a033ade4977a tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:47.526155 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-00018da2-fa19-452d-9fa3-a033ade4977a tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action" status: 404 len: 88 microversion: 2.1 time: 0.058738 Aug 06 21:06:47.526155 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1466/3007] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:06:47 2022] POST /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755/action => generated 88 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:06:47.531464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:47.532058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:47.540760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.541393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.541925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.542908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.543457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.544089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.572875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:06:47.658487 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-33956d4f-47ab-441f-917d-351078590acf tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "DELETE /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 204 len: 0 microversion: 2.1 time: 0.130747 Aug 06 21:06:47.659124 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1542/3008] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:06:47 2022] DELETE /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:06:47.682634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:47.683500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:47.693422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.694188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.694819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.696463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.697206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.698370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.866287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:47.874915 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-116ff084-6f49-45ee-884c-32b8bcab6962 tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1540 microversion: 2.1 time: 0.210486 Aug 06 21:06:47.875498 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1467/3009] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:47 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1540 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:47.973811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:47.974772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:47.981719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.982278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.982658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:47.983363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:47.983990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:47.984478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:48.123078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:48.131443 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47298c6f-76fc-465a-a1e7-0f781c5b654c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1314 microversion: 2.1 time: 0.161990 Aug 06 21:06:48.132275 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1543/3010] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:47 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:48.181302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:48.182024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:48.189183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:48.189750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:48.190365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:48.191104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:48.191563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:48.191989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:48.216249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=36 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:48.269195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:48.269418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:48.269892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:48.278332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:48.278963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:48.281629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:48.283649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:48.285566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:48.286420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:48.287602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:48.289662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:48.291443 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-431bbaf6-40d5-4211-b519-4631b8901c4d tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.114862 Aug 06 21:06:48.292360 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1468/3011] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:48 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:48.462224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:48.462964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:48.471445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:48.471878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:48.472416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:48.473485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:48.474137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:48.474772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:48.665724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:48.673780 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3311211a-756a-4b59-8c2e-d86543f4f085 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.408287 Aug 06 21:06:48.677782 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1544/3012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:48 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:06:48.706955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6892338-5f28-4214-8105-1d6b24d267e3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729e3070d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:48.766145 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d6892338-5f28-4214-8105-1d6b24d267e3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.087137 Aug 06 21:06:48.766782 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1545/3013] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:48 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:48.796400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:48.804660 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-673fb712-d0f2-4630-ac77-70996489e191 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1328 microversion: 2.1 time: 0.347107 Aug 06 21:06:48.806918 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1469/3014] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:48 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1328 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:06:48.895641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:48.896389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:48.904821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:48.905406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:48.905929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:48.906880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:48.907439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:48.908203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:49.153340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:49.155420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:49.162339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:49.163825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:49.164606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:49.165621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:49.166537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:49.167208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:49.186322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:49.198699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eb2353b3-7e02-4828-963d-41e27b32f21e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1540 microversion: 2.1 time: 0.307334 Aug 06 21:06:49.202901 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1546/3015] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:48 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1540 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:49.318316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:49.319743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:49.334177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:49.334815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:49.335453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:49.336856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:49.337604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:49.338198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:49.412079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:49.421354 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f9599ddf-fcca-4053-bda0-22393c7e294c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1501 microversion: 2.1 time: 0.272511 Aug 06 21:06:49.422065 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1470/3016] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:49 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:06:49.489997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:49.521340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:49.528280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:49.533053 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7237356c-d8bc-4160-9793-3aeb97082f43 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.219406 Aug 06 21:06:49.543185 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1547/3017] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:49 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:06:49.703458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:49.704498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:49.713902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:49.718877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:49.719404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:49.720170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:49.720728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:49.721176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:49.780859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65afe85b-7e8a-4657-92d3-70171d3b988b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d956c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:49.796265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:49.888530 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65afe85b-7e8a-4657-92d3-70171d3b988b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.110964 Aug 06 21:06:49.891748 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1548/3018] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:49 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:06:49.902415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:49.903309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:49.912485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:49.913240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:49.923242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:49.931059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:49.933090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:49.934497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:50.118450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:50.129027 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f8bffdc6-b554-487b-b560-886fd2105124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.429909 Aug 06 21:06:50.143803 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1471/3019] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:49 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:50.168987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=16 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:50.221868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:50.223193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:50.236069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:50.238518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:50.239051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:50.239876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:50.243869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:50.244369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:50.313304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:50.335214 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65ed26e6-9865-4b7e-923a-46824f17272f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1328 microversion: 2.1 time: 0.441242 Aug 06 21:06:50.340274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1549/3020] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:49 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1328 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:50.407829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b30a7d1ce94193970bdc076d481578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64300b6685d7478f8bfa92c2d6eb91d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:50.423085 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-31856d30-204f-41ea-b88b-b44030ef489e tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 200 len: 1498 microversion: 2.1 time: 0.206263 Aug 06 21:06:50.425675 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1472/3021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:50 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 1498 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:06:50.572299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:50.572924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:50.582870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:50.583593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:50.584203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:50.585089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:50.585895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:50.586968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:50.599384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e510cea5-723e-4d9f-9278-80e8cf4cd710 req-4e7178a4-afa5-47aa-9d34-91179664670d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be18f2f2-b05d-4311-b737-d8638166b755", "name": "network-vif-deleted", "tag": "6c25cbbe-4c18-4a9c-985b-71b904cbe8a3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:50.619933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e510cea5-723e-4d9f-9278-80e8cf4cd710 req-4e7178a4-afa5-47aa-9d34-91179664670d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:50.634946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e510cea5-723e-4d9f-9278-80e8cf4cd710 req-4e7178a4-afa5-47aa-9d34-91179664670d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:50.638585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e510cea5-723e-4d9f-9278-80e8cf4cd710 req-4e7178a4-afa5-47aa-9d34-91179664670d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:50.690107 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e510cea5-723e-4d9f-9278-80e8cf4cd710 req-4e7178a4-afa5-47aa-9d34-91179664670d service nova] Creating event network-vif-deleted:6c25cbbe-4c18-4a9c-985b-71b904cbe8a3 for instance be18f2f2-b05d-4311-b737-d8638166b755 on nch2-master-1 Aug 06 21:06:50.706449 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e510cea5-723e-4d9f-9278-80e8cf4cd710 req-4e7178a4-afa5-47aa-9d34-91179664670d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109458 Aug 06 21:06:50.710015 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1473/3022] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:06:50.797043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:50.814432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:50.816005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:50.817223 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5fb7a4d8-db27-45f3-a244-1627aadcd8be tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.249036 Aug 06 21:06:50.830943 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1550/3023] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:50 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:50.906874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3a686e36-a033-425b-8e89-c8bc1660b59d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d23db80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:50.962341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5292415f-a295-4004-a24d-9bcdeb19795c req-38877f8a-16d4-4732-8d45-09f959481005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0926358-eed5-4b13-a285-2f56c382bce4", "name": "network-vif-plugged", "status": "completed", "tag": "5c0b2605-3a4d-45dd-876d-81e3e36ceb49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:50.988002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5292415f-a295-4004-a24d-9bcdeb19795c req-38877f8a-16d4-4732-8d45-09f959481005 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:50.993644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5292415f-a295-4004-a24d-9bcdeb19795c req-38877f8a-16d4-4732-8d45-09f959481005 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:50.994395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5292415f-a295-4004-a24d-9bcdeb19795c req-38877f8a-16d4-4732-8d45-09f959481005 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.018655 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5292415f-a295-4004-a24d-9bcdeb19795c req-38877f8a-16d4-4732-8d45-09f959481005 service nova] Creating event network-vif-plugged:5c0b2605-3a4d-45dd-876d-81e3e36ceb49 for instance e0926358-eed5-4b13-a285-2f56c382bce4 on nch2-master-1 Aug 06 21:06:51.027497 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3a686e36-a033-425b-8e89-c8bc1660b59d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.124851 Aug 06 21:06:51.034483 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1474/3024] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:50 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:51.034744 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5292415f-a295-4004-a24d-9bcdeb19795c req-38877f8a-16d4-4732-8d45-09f959481005 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074441 Aug 06 21:06:51.036924 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1551/3025] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:51.163204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:51.163969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:51.177568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.178059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.179647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.181599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.182246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.183032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.210382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6ea7076-822c-4b14-984a-9e1a1f380625"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:51.213492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:51.226415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.231101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.231830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.232750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.233531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.234130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.505047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:51.514513 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15113e83-ce83-4e4b-a778-144cfe5cde20 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.356349 Aug 06 21:06:51.517079 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1475/3026] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:51 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:51.536817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:51.537443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:51.570614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.571402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.571971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.572716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.573186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.575082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.691346 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492956 Aug 06 21:06:51.708963 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1552/3027] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:06:51 2022] POST /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:51.721120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:51.723274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] [instance: be18f2f2-b05d-4311-b737-d8638166b755] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:51.745614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.746457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.747114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.750856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.751281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.751779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.795669 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] HTTP exception thrown: Instance be18f2f2-b05d-4311-b737-d8638166b755 could not be found. Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Request method failure captured: Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 HTTP/1.1 Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te1XZpAHBkhTi6IwtpU8rJCdbwHhi3ZU1Txvs-Jd1t7mrwYS-sHLayZ9D_WzLNUaYQMbDQpdETErWMkZvHFiMych0GnW02yQFJKMqXXo30GtUgHntHIss5Kuc4p9f4vR-ztupWiRPPFwUsWtmEPiX2rRJTG_QiGHt6Sd_6o5EX9a8g Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:06:51.808728 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64300b6685d7478f8bfa92c2d6eb91d6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64300b6685d7478f8bfa92c2d6eb91d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 64300b6685d7478f8bfa92c2d6eb91d6 Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519 Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 10b30a7d1ce94193970bdc076d481578 Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:06:51.810222 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance be18f2f2-b05d-4311-b737-d8638166b755 could not be found. Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'be18f2f2-b05d-4311-b737-d8638166b755'} Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be18f2f2-b05d-4311-b737-d8638166b755 could not be found. Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:06:51.811026 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be18f2f2-b05d-4311-b737-d8638166b755 could not be found. Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be18f2f2-b05d-4311-b737-d8638166b755 could not be found. Aug 06 21:06:51.812317 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:06:51.813541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] Returning 404 to user: Instance be18f2f2-b05d-4311-b737-d8638166b755 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:06:51.813541 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a3bb8f2d-f49a-4e0a-b2a8-81c9c36077fc tempest-FloatingIPsAssociationNegativeTestJSON-538109519 tempest-FloatingIPsAssociationNegativeTestJSON-538109519-project] 10.222.0.33 "GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755" status: 404 len: 111 microversion: 2.1 time: 0.102352 Aug 06 21:06:51.816912 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1553/3028] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:51 2022] GET /compute/v2.1/servers/be18f2f2-b05d-4311-b737-d8638166b755 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:06:51.844737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:51.845640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:51.857260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:51.864066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.865024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.865681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.866812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:51.869675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:51.870352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:51.940144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:51.956310 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-74101e1d-667a-4272-a001-9004f4c71119 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1328 microversion: 2.1 time: 0.422911 Aug 06 21:06:51.962639 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1476/3029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:51 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1328 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:52.042915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-089d1818-e27b-457d-b8b7-e6b9bcf68ab4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d173430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:52.113422 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-089d1818-e27b-457d-b8b7-e6b9bcf68ab4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.075038 Aug 06 21:06:52.122295 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1477/3030] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:52 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:06:52.129028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:52.139463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:52.141842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:52.146865 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1fb3893a-7142-445d-bed2-1293fcda5391 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.306757 Aug 06 21:06:52.151600 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1554/3031] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:51 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:52.545152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:52.545830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:52.565686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:52.572147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:52.572881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:52.575942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:52.576667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:52.579120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:52.982293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:52.982940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:52.993995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:52.998964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:53.001348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:53.002337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:53.003896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:53.007206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:53.065073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:53.158484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:53.167619 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b397c309-3462-4bc9-bf53-a8e414b70501 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.632146 Aug 06 21:06:53.191512 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1478/3032] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:52 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:53.198012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ee6dc56a-90e8-4928-92c7-b2c9137dc4fb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d23d8b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:53.263238 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ee6dc56a-90e8-4928-92c7-b2c9137dc4fb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.070164 Aug 06 21:06:53.264217 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1479/3033] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:53 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:53.270796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-de7fbe94-b6fa-4a28-ad67-0372a1287e34 req-b589d71d-20cf-42f4-b39b-4cf3c8f492af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d389375c-139a-4e55-8ddb-90459d2d0770", "name": "network-vif-plugged", "status": "completed", "tag": "94c79690-a24b-4c93-9c50-bf00ae8e50fa"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:53.283248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-de7fbe94-b6fa-4a28-ad67-0372a1287e34 req-b589d71d-20cf-42f4-b39b-4cf3c8f492af service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:53.284112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-de7fbe94-b6fa-4a28-ad67-0372a1287e34 req-b589d71d-20cf-42f4-b39b-4cf3c8f492af service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:53.286514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-de7fbe94-b6fa-4a28-ad67-0372a1287e34 req-b589d71d-20cf-42f4-b39b-4cf3c8f492af service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:53.310780 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-de7fbe94-b6fa-4a28-ad67-0372a1287e34 req-b589d71d-20cf-42f4-b39b-4cf3c8f492af service nova] Creating event network-vif-plugged:94c79690-a24b-4c93-9c50-bf00ae8e50fa for instance d389375c-139a-4e55-8ddb-90459d2d0770 on nch1-master-1 Aug 06 21:06:53.324427 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-de7fbe94-b6fa-4a28-ad67-0372a1287e34 req-b589d71d-20cf-42f4-b39b-4cf3c8f492af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058238 Aug 06 21:06:53.325738 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1480/3034] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:06:53.339451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:53.346140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:53.369390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:53.371992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:53.373850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:53.375322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:53.377655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:53.380452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:53.491685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:53.500211 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4cc44907-d663-4622-8964-578015bca17e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1328 microversion: 2.1 time: 0.523497 Aug 06 21:06:53.504753 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1555/3035] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:52 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1328 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:53.527486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:53.542158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:53.546582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:53.552383 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-be802a6f-5868-459d-b5a4-096e2868057e tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.223869 Aug 06 21:06:53.559418 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1481/3036] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:53 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:54.200562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:54.201338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:54.215712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:54.216636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:54.217314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:54.221248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:54.222148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:54.224832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:54.280900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a978654-d864-4e1b-90e0-6a2e17de6b64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d173310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:54.384258 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2a978654-d864-4e1b-90e0-6a2e17de6b64 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.108011 Aug 06 21:06:54.385546 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1482/3037] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:54 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:54.528774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:54.530266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:54.544490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:54.547111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:54.548265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:54.550849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:54.552080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:54.556274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:54.714879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:54.725384 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4bc81d99-1ad4-4db7-8af5-c0b67016ea61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.530811 Aug 06 21:06:54.729137 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1556/3038] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:54 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:54.739722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:54.742500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:54.758004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:54.759592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:54.761936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:54.762967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:54.763655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:54.767169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:54.912016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:54.930185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:54.940132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:54.953232 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba86f2d4-2015-4acf-ac8b-28e7220c6da9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.211673 Aug 06 21:06:54.966667 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1557/3039] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:54 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:55.251635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:55.262251 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0c60557-285c-43fb-ba26-bcb96c65e6f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1328 microversion: 2.1 time: 0.739886 Aug 06 21:06:55.268093 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1483/3040] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:54 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1328 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:55.400178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dea442a8-7022-47a9-bfec-beebc16422c1 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d871700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:55.510389 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dea442a8-7022-47a9-bfec-beebc16422c1 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.114870 Aug 06 21:06:55.522024 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1558/3041] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:55 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:55.750302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:55.750974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:55.767824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:55.768327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:55.777142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:55.778348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:55.779043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:55.782039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:55.984294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:55.985184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:56.001029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:56.001854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:56.002319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:56.007559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:56.009250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:56.010088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:56.159962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:56.181925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:56.191141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:56.195045 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3cf7f7e-378d-42d1-ab22-0d20a0d41386 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.212795 Aug 06 21:06:56.198600 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1559/3042] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:55 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:56.290906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:56.292300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:56.307157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:56.310993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:56.311643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:56.313490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:56.317806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:56.318486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:56.389325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:06:56.447885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:56.452019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:56.471003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6a5d8fe6-5b43-445e-9add-1ba4c65e9741 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.723003 Aug 06 21:06:56.487824 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1484/3043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:55 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:56.493538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:56.516598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:56.561844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:56.566392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:56.572810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:56.578342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:56.586935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:56.590011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:56.725990 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dde429cc-2683-47bd-af77-5df3d003f0a7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 204 len: 0 microversion: 2.1 time: 0.444788 Aug 06 21:06:56.732818 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1560/3044] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:06:56 2022] DELETE /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:06:56.754264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e6a773a4-846a-436c-a6c9-72ded3d13621 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d956280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:56.874649 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e6a773a4-846a-436c-a6c9-72ded3d13621 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.137160 Aug 06 21:06:56.875437 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1561/3045] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:56 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:56.891016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:56.891779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:56.902881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:56.903648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:56.904124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:56.905763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:56.906253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:56.906726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:57.156522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:57.178211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d8b87a04-52c8-4540-8d17-319ea6e20625 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1509 microversion: 2.1 time: 0.686769 Aug 06 21:06:57.186570 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1485/3046] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:56 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:57.208026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:57.208856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:57.229994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:57.231030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:57.231499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:57.232271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:57.232746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:57.233190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:57.730277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:57.765127 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01821b9e-c3b2-4927-b448-1c6e25382b0f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1553 microversion: 2.1 time: 0.878680 Aug 06 21:06:57.770917 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1562/3047] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:56 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1553 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:57.820601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:57.821594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:57.829092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:57.830207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:57.830869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:57.831757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:57.832375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:57.832957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:57.861689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:57.874838 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9274f1a5-2933-4ed0-9fe8-a6c1a11fc907 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1509 microversion: 2.1 time: 0.673097 Aug 06 21:06:57.883660 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1486/3048] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:57 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1509 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:57.895196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:57.896080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:57.916073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:57.916571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:57.919474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:57.920550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:57.923932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:57.924860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:58.010177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:58.027957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:58.031835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:58.039847 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-021c736b-8adf-493e-9cb6-4687841208f3 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.262470 Aug 06 21:06:58.040730 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1563/3049] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:57 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:06:58.048883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9cc72294-34e7-4d36-933f-15fc5c8f0517 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dace670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:58.153275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9cc72294-34e7-4d36-933f-15fc5c8f0517 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.111076 Aug 06 21:06:58.162894 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1564/3050] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:58 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:58.169649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:58.170535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:58.177267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:58.178113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:58.178814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:58.180705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:58.181439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:58.182101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:58.197001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:58.211149 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-466658ad-be64-4a88-b8b8-4357733dfaef tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.324781 Aug 06 21:06:58.211766 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1487/3051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:57 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:58.235269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:06:58.461876 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-385ae573-afa8-4163-8d51-03adfd693eed tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 204 len: 0 microversion: 2.1 time: 0.296641 Aug 06 21:06:58.463212 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1565/3052] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:06:58 2022] DELETE /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:06:58.471769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:58.472641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:58.480153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:06:58.481982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:58.483040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:58.483824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:58.489058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:58.489903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:58.490604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:58.788667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:58.790197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:58.803828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:58.806791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:58.809873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:58.810983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:58.814480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:58.815209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:58.954452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:58.968247 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-978a15ba-2507-4315-b8f2-6b99a35d3bce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1515 microversion: 2.1 time: 0.500742 Aug 06 21:06:58.982830 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1488/3053] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:58 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1515 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:59.064488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:59.065117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:59.075290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:59.079128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:59.079599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:59.080410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:59.080892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:59.081333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:59.206723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:59.228035 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cbf0c4b8-6efb-45c4-8c7b-cd6356adad69 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1553 microversion: 2.1 time: 0.443734 Aug 06 21:06:59.228921 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1566/3054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:58 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1553 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:06:59.234055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-00a34073-230a-4d71-ba7e-9c7881651c4c tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729daf4ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:59.299273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:59.308434 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-00a34073-230a-4d71-ba7e-9c7881651c4c tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.078130 Aug 06 21:06:59.316733 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1567/3055] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:06:59 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:59.316951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:59.318832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:59.320066 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c360cd58-dda1-4ed1-9ed8-017d40693dd5 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.259629 Aug 06 21:06:59.323929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:59.324838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:06:59.333125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:59.334005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:59.334975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:59.336983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:06:59.337848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:06:59.338529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:06:59.356105 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1489/3056] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:06:59 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:06:59.706526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:06:59.717801 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ea8d62b4-933b-42fd-967e-0fc0d6ac0dff tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.399394 Aug 06 21:06:59.721846 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1568/3057] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:59 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:06:59.810474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1885910594", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "32c37c56-2241-4f10-99ac-2b13f68a1422"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:06:59.916441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] validate_networks() for [('32c37c56-2241-4f10-99ac-2b13f68a1422', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:06:59.991767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:06:59.992471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:00.009765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:00.011013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:00.012442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:00.013591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:00.014392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:00.015001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:00.381880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:00.396354 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-25db09f1-c246-4875-a0f2-1f95d834bb41 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1515 microversion: 2.1 time: 0.410699 Aug 06 21:07:00.397838 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1569/3058] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:06:59 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1515 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:00.415648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:00.416246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:00.436189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:00.436705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:00.437157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:00.437892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:00.438358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:00.438825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:00.865206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:00.882275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-455177e1-5d13-4a34-b5f6-465ecd53f85e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1553 microversion: 2.1 time: 0.481133 Aug 06 21:07:00.899361 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1570/3059] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:00 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1553 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:00.910733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-33cdb803-3b47-4dae-b019-7ff28133a7ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dc9bf70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:01.021787 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-33cdb803-3b47-4dae-b019-7ff28133a7ac tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.119496 Aug 06 21:07:01.029503 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1571/3060] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:00 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:01.044628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:01.045535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:01.066859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.069823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.071219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.073528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.074205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.075750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.176562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:07:01.177310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:07:01.177999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:07:01.178696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:07:01.179357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:07:01.204543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.206057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.206905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.208158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.208848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.209928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.245275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Getting quotas for project 162c0275fc334a30bbb857e86295550b. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:01.253722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Getting quotas for user 91c6b895ecbe442083862557052c0cc3 and project 162c0275fc334a30bbb857e86295550b. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:01.271610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:07:01.275246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:07:01.363699 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b22b9e2-9835-4c31-b124-1abb2debe3c1 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755129 Aug 06 21:07:01.371855 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1490/3061] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:07:01.383233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:01.385455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:01.408343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.409384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.410045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.413494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.418272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.419820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.452744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:01.475513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:01.493777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:01.498102 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-872b54e8-b278-41f7-a967-b008db019f89 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.472481 Aug 06 21:07:01.517063 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1572/3062] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:01 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:01.536884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-291370d4-00e6-47ec-bdc0-cf6e895ab903 req-b9199183-7d52-4eb3-a440-7e606d7354c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095c55d4-3b38-45e1-926a-bbbe858afa81", "name": "network-vif-deleted", "tag": "d8267882-f6f3-4104-8ff2-28f22deca013"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:01.589915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-291370d4-00e6-47ec-bdc0-cf6e895ab903 req-b9199183-7d52-4eb3-a440-7e606d7354c2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.590400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-291370d4-00e6-47ec-bdc0-cf6e895ab903 req-b9199183-7d52-4eb3-a440-7e606d7354c2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.594513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-291370d4-00e6-47ec-bdc0-cf6e895ab903 req-b9199183-7d52-4eb3-a440-7e606d7354c2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.691390 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-291370d4-00e6-47ec-bdc0-cf6e895ab903 req-b9199183-7d52-4eb3-a440-7e606d7354c2 service nova] Creating event network-vif-deleted:d8267882-f6f3-4104-8ff2-28f22deca013 for instance 095c55d4-3b38-45e1-926a-bbbe858afa81 on nch1-master-1 Aug 06 21:07:01.740892 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-291370d4-00e6-47ec-bdc0-cf6e895ab903 req-b9199183-7d52-4eb3-a440-7e606d7354c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221977 Aug 06 21:07:01.746334 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1573/3063] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:01.759012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b766b1b2-fe26-419c-97fe-d71fc332e4aa tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:01.770967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b766b1b2-fe26-419c-97fe-d71fc332e4aa tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:01.814965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:01.823886 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0fc5e29d-f1bf-4804-8e01-8d05a683b6b2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.452396 Aug 06 21:07:01.825653 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1491/3064] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:01 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:01.831486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:01.832105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:01.851218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.853880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.854335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.855105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.855564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.855993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.911381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:01.911935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:01.912728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:01.915965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lazy-loading 'fault' on Instance uuid d389375c-139a-4e55-8ddb-90459d2d0770 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:01.930758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b766b1b2-fe26-419c-97fe-d71fc332e4aa tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:01.943918 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b766b1b2-fe26-419c-97fe-d71fc332e4aa tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1225 microversion: 2.1 time: 0.194819 Aug 06 21:07:01.947332 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1574/3065] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:01 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:01.985581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-82cdb8ba-3b99-44cf-b31b-5861560821da req-e13ebf3b-73b7-4e9f-96e9-457d0b759811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d389375c-139a-4e55-8ddb-90459d2d0770", "name": "network-vif-deleted", "tag": "94c79690-a24b-4c93-9c50-bf00ae8e50fa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:02.034851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-82cdb8ba-3b99-44cf-b31b-5861560821da req-e13ebf3b-73b7-4e9f-96e9-457d0b759811 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:02.037124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-82cdb8ba-3b99-44cf-b31b-5861560821da req-e13ebf3b-73b7-4e9f-96e9-457d0b759811 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:02.042849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-82cdb8ba-3b99-44cf-b31b-5861560821da req-e13ebf3b-73b7-4e9f-96e9-457d0b759811 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:02.058808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:02.067666 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bc1c4ad2-81e0-4d1c-8988-5a975f850b74 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 200 len: 1318 microversion: 2.1 time: 0.240867 Aug 06 21:07:02.073619 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1492/3066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:01 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:02.088586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:02.094963 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-82cdb8ba-3b99-44cf-b31b-5861560821da req-e13ebf3b-73b7-4e9f-96e9-457d0b759811 service nova] Creating event network-vif-deleted:94c79690-a24b-4c93-9c50-bf00ae8e50fa for instance d389375c-139a-4e55-8ddb-90459d2d0770 on nch1-master-1 Aug 06 21:07:02.100657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:02.105293 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-82cdb8ba-3b99-44cf-b31b-5861560821da req-e13ebf3b-73b7-4e9f-96e9-457d0b759811 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156509 Aug 06 21:07:02.113056 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1575/3067] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:02.121668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-feec51bf-7716-4adf-baab-91220366dd99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d8e98b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:02.122051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:02.122896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:02.123860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:02.125189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:02.128782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:02.131650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:02.183649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:02.184897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:02.185648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:02.186268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lazy-loading 'fault' on Instance uuid 095c55d4-3b38-45e1-926a-bbbe858afa81 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:02.229642 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-feec51bf-7716-4adf-baab-91220366dd99 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.114051 Aug 06 21:07:02.231021 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1576/3068] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:02 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:02.295044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:02.314921 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e1747477-ee54-4aa5-ad14-4873c97d3145 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 200 len: 1350 microversion: 2.1 time: 0.239040 Aug 06 21:07:02.315955 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1493/3069] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:02 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 1350 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:02.531864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:02.532630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:02.556376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:02.556951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:02.559131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:02.563269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:02.567098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:02.572856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:02.588870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:02.715689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:02.728182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:02.731573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:02.733498 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12117e86-07fe-49d0-9ec7-d3c41e1d63d0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.208143 Aug 06 21:07:02.752066 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1577/3070] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:02 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:02.847858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:02.848836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:02.858963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:02.860116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:02.860761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:02.862061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:02.863078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:02.863937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:02.973416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:02.974045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:02.992613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:02.993630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:02.995055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:03.000692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:03.001734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:03.002489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:03.104592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:03.113177 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03a5fc0d-4e7d-49ca-a6b2-c239e5a8eb31 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.270640 Aug 06 21:07:03.137284 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1494/3071] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:02 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:03.145112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:03.146373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:03.152527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:03.159322 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dde85b99-092a-4217-b8b8-1bee8d94168a tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1277 microversion: 2.1 time: 0.190866 Aug 06 21:07:03.162910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:03.163588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:03.178573 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1578/3072] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:02 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:03.181173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:03.182775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:03.183844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:03.184931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:03.202540 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 HTTP/1.1 Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:03.204553 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:07:03.205879 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'd389375c-139a-4e55-8ddb-90459d2d0770'} Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:03.206833 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:07:03.208030 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.210627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:03.212341 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-977e2983-b05d-45e8-a06b-7956269491ca tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 404 len: 111 microversion: 2.1 time: 0.073964 Aug 06 21:07:03.213231 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1495/3073] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:03 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:03.223029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71a52726-ba72-4ee2-a38e-1f98f83c7efd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '.version_select at 0x7f729db19280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:03.245092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6c01f459-0457-4cce-a716-db64f470b016 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d1a5790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:03.291560 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71a52726-ba72-4ee2-a38e-1f98f83c7efd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-key-1054140117" status: 202 len: 0 microversion: 2.1 time: 0.074051 Aug 06 21:07:03.306173 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1579/3074] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Aug 6 21:07:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1054140117 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:07:03.340656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:03.341332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:03.358602 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6c01f459-0457-4cce-a716-db64f470b016 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.115708 Aug 06 21:07:03.359245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:03.360921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:03.361957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:03.364170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:03.366737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:03.368288 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1496/3075] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:03 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:03.370019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:03.407157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 HTTP/1.1 Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:03.411818 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.413135 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '095c55d4-3b38-45e1-926a-bbbe858afa81'} Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:03.414609 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.415888 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.417100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:03.417100 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d7591c87-20a0-4808-8c13-9def100e72d0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 404 len: 111 microversion: 2.1 time: 0.079787 Aug 06 21:07:03.425068 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1580/3076] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:03 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:03.650876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-856784927", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0827ee4a-610f-48e2-8263-78e781630780"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:03.735096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:03.737459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:03.758577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:03.760866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:03.761345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:03.762810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:03.763296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:03.768487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:03.788716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] validate_networks() for [('0827ee4a-610f-48e2-8263-78e781630780', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:07:03.795390 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81/os-volume_attachments HTTP/1.1 Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:03.798236 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.800036 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'server_id': '095c55d4-3b38-45e1-926a-bbbe858afa81'} Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:03.801451 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:07:03.803381 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:03.807469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:03.808711 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4cb33266-0cc8-4716-96b7-e5e7bb86e9f2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.078115 Aug 06 21:07:03.816082 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1581/3077] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:07:03 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81/os-volume_attachments => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:03.823243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:03.824071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:03.831056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:03.831828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:03.832461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:03.834409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:03.835262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:03.836476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:04.030646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:04.045869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:04.051082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:04.055628 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b429915-a40b-4097-92a4-eb1437a7a0fd tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1408 microversion: 2.54 time: 0.235611 Aug 06 21:07:04.057013 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1582/3078] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:03 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:04.116655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1116100187", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5c00ae50-9c12-446f-a3fc-256b5e473c43"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:04.220800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] validate_networks() for [('5c00ae50-9c12-446f-a3fc-256b5e473c43', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:07:04.844486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:07:04.845063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:07:04.845591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:07:04.846067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:07:04.846753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:07:04.872758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:04.879254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:04.880174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:04.885335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:04.886651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:04.887511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:04.945697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:04.964355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for user 7dcd210e197347f8ad1622ee882bee92 and project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:05.013645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:07:05.021846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:07:05.183094 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-63269a1b-82e0-45b3-94fd-0845ff6a550f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.540084 Aug 06 21:07:05.183844 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1497/3079] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:07:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:07:05.193140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:05.194199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:05.211425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:05.212474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:05.213288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:05.215110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:05.215782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:05.219197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:05.577959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:05.600656 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-08e32759-1004-48dc-97ea-b6e00a5a9ce6 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.414456 Aug 06 21:07:05.602423 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1498/3080] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:05 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:05.621641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:05.622811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:05.645213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:05.647296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:05.650858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:05.651974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:05.653638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:05.655382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:05.775846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:07:05.776423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:07:05.776772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:07:05.777306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:07:05.777714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:07:05.799718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:05.801912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:05.802316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:05.803854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:05.806441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:05.810409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:05.883638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:05.900624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for user bdf1b5180a814cf39234892c6c1f26df and project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:05.940646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:07:05.946692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:07:06.146389 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6d26cceb-b0ed-40fb-86e3-d505ca634af0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.033932 Aug 06 21:07:06.158990 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1583/3081] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:07:06.170422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78df42a7-cd70-4690-bffb-3719662be6c9 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d8691f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:06.312722 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78df42a7-cd70-4690-bffb-3719662be6c9 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.152414 Aug 06 21:07:06.313417 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1584/3082] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:06 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:06.332637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:06.335199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:06.366042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:06.367669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:06.369121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:06.373112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:06.376819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:06.380759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:07.041255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:07.056026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:07.060068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:07.065107 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1a4e0951-36b4-4bf3-89f9-871a1687ed3b tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1414 microversion: 2.54 time: 0.748362 Aug 06 21:07:07.066986 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1585/3083] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:06 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1414 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:07.073372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:07.078321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:07.096838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:07.097486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:07.099148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:07.100155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:07.102192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:07.103187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:07.230880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:07.245981 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9747332c-a92c-4786-b523-6d458c9cabc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1204 microversion: 2.1 time: 0.175510 Aug 06 21:07:07.247022 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1586/3084] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:07 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1204 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:07.257180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8c302c12-8f09-498d-bde7-bc5a42927392 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:07.261508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8c302c12-8f09-498d-bde7-bc5a42927392 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:07.404571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8c302c12-8f09-498d-bde7-bc5a42927392 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:07.427684 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8c302c12-8f09-498d-bde7-bc5a42927392 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1215 microversion: 2.1 time: 0.165601 Aug 06 21:07:07.431266 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1587/3085] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:07 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:07.463168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:07.466018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:07.481210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:07.482058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:07.483782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:07.485079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:07.487900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:07.488682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:07.680848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:07.691672 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d78dfa91-b83f-4ef1-a5da-ec2c739387eb tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1325 microversion: 2.1 time: 2.083159 Aug 06 21:07:07.700518 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1499/3086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:05 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1325 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:07.715778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-343d38a4-3cb9-4848-99b4-352898662306 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d1a0280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:07.842933 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-343d38a4-3cb9-4848-99b4-352898662306 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.130848 Aug 06 21:07:07.843809 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1500/3087] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:07 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:07.857436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:07.871122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:07.887911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:07.892881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:07.895263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:07.896292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:07.898227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:07.900096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:07.983115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:07:07.983526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:08.000820 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f44f2bc-3302-4842-be15-9c07704a47d5 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.564900 Aug 06 21:07:08.002042 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1588/3088] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:07 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:08.027286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:08.028750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:08.031956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:08.093474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:08.094465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:08.102884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lazy-loading 'flavor' on Instance uuid a74b595a-db9a-40e0-9a72-2a164c7f5d53 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:08.109121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:08.118137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:08.120555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:08.121902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:08.126718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:08.127502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:08.157634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lazy-loading 'system_metadata' on Instance uuid a74b595a-db9a-40e0-9a72-2a164c7f5d53 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:08.323383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lazy-loading 'metadata' on Instance uuid a74b595a-db9a-40e0-9a72-2a164c7f5d53 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:08.325055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:08.346250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:08.355117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:08.365458 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4b9a9563-d6e8-4ed0-afd6-15af4068f412 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1414 microversion: 2.54 time: 0.276882 Aug 06 21:07:08.371253 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1589/3089] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:08 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1414 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:08.379593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:08.381007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:08.405544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:08.416355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:08.417203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:08.418182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:08.420024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:08.421817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:08.615223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:08.640748 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-76562652-f48c-470a-bb05-0b15aba8c8ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1266 microversion: 2.1 time: 0.267457 Aug 06 21:07:08.644310 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1590/3090] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:08 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:08.701043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:08.705752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:08.706848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:08.730189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:08.730782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:08.761197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:08.769601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:08.772479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:08.773773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:08.776904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:08.778913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:08.780678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.167804 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-81c1202c-8422-4adb-b0ca-5ec3c647aeb1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 204 len: 0 microversion: 2.1 time: 1.316540 Aug 06 21:07:09.172708 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1501/3091] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:07:07 2022] DELETE /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 0 bytes in 1328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:07:09.203453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7375c101-97fc-408b-b7d7-065f24f9ee50 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d1a2430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:09.221308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:09.233335 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5712fbc4-d830-4b35-ab7b-fd5e26d292ca tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1325 microversion: 2.1 time: 0.510270 Aug 06 21:07:09.236107 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1591/3092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:08 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1325 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:09.250746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:09.252797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:09.298428 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7375c101-97fc-408b-b7d7-065f24f9ee50 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.122651 Aug 06 21:07:09.301554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:09.302639 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1502/3093] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:09 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:09.305937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:09.306955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.308394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:09.310296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:09.311289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.325005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-0fad9345-a394-4818-b483-a8b60e13ed44 req-f71d2385-84d6-43a9-99aa-258cb7f1a92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb337ae-06f7-467c-ba29-576c91432b19", "tag": "21720249-ba93-4942-9704-5ab41bd4ea9a"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:09.343728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0fad9345-a394-4818-b483-a8b60e13ed44 req-f71d2385-84d6-43a9-99aa-258cb7f1a92e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:09.344407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0fad9345-a394-4818-b483-a8b60e13ed44 req-f71d2385-84d6-43a9-99aa-258cb7f1a92e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:09.344994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0fad9345-a394-4818-b483-a8b60e13ed44 req-f71d2385-84d6-43a9-99aa-258cb7f1a92e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.362014 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-0fad9345-a394-4818-b483-a8b60e13ed44 req-f71d2385-84d6-43a9-99aa-258cb7f1a92e service nova] Creating event network-changed:21720249-ba93-4942-9704-5ab41bd4ea9a for instance 0bb337ae-06f7-467c-ba29-576c91432b19 on nch2-master-1 Aug 06 21:07:09.371712 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-0fad9345-a394-4818-b483-a8b60e13ed44 req-f71d2385-84d6-43a9-99aa-258cb7f1a92e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067474 Aug 06 21:07:09.376454 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1503/3094] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:09.382892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:09.383906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:09.401562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:09.406612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:09.407800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.408683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:09.409189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:09.409729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.632301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:09.665810 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5a626140-8cfe-43c2-83ca-67c715affbff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1273 microversion: 2.1 time: 0.273590 Aug 06 21:07:09.673593 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1504/3095] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:09 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:09.700225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:09.701464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:09.705314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:09.724550 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-30adec07-f8e7-4298-91cf-e7c90563f30d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.487009 Aug 06 21:07:09.725756 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1592/3096] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:09 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:09.732201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:09.732981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:09.740410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:09.741502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:09.742365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.743287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:09.743908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:09.744517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.750449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:09.751376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:09.753250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.755689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:09.762397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:09.763076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:09.928902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:09.940073 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6a6db99f-df46-4200-92bf-9b7b6fbfe6b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1266 microversion: 2.1 time: 0.212385 Aug 06 21:07:09.943986 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1593/3097] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:09 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:10.130752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:10.141120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:10.144335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:10.146073 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f97b82c3-532d-477c-86ee-92079e4311d9 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1399 microversion: 2.54 time: 0.470250 Aug 06 21:07:10.159658 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1505/3098] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:09 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1399 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:10.173261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98a36afd-e3f6-40cd-9f94-8c4608529e70 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '.version_select at 0x7f729da9d4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:10.225612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:10.247040 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-98a36afd-e3f6-40cd-9f94-8c4608529e70 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2093719221" status: 204 len: 0 microversion: 2.54 time: 0.078019 Aug 06 21:07:10.250532 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1594/3099] 10.222.0.33 () {60 vars in 1319 bytes} [Sat Aug 6 21:07:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2093719221 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:07:10.268292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:10.268771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:10.278801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:10.286991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:10.287586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:10.290803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:10.291454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:10.293945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:10.296411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:10.297048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:10.310874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:10.315202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:10.315980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:10.317028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:10.317735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:10.318355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:10.372271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:07:10.542089 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b315b99e-f847-4c56-92cf-33b0309f4254 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 204 len: 0 microversion: 2.54 time: 0.269843 Aug 06 21:07:10.543310 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1595/3100] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:07:10 2022] DELETE /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:07:10.549514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a92e3d09-e8ff-44dd-9dcc-920a3b5bdcbc tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d7d9a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:10.622464 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a92e3d09-e8ff-44dd-9dcc-920a3b5bdcbc tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.077613 Aug 06 21:07:10.623649 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1596/3101] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:10 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:10.629549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:10.630523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:10.652935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:10.653744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:10.654363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:10.658395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:10.659146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:10.659813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:10.822689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:10.841433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:10.843311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:10.847604 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-59e757c3-a683-4810-8124-1d3bf7431576 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1405 microversion: 2.54 time: 0.219696 Aug 06 21:07:10.850582 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1597/3102] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:10 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:10.863034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:10.863927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:10.881092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:10.881965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:10.884918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:10.887645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:10.888452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:10.891033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:11.144753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:11.160284 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-742c2ddd-fd7d-4237-bff6-29f119a50088 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1273 microversion: 2.1 time: 0.306956 Aug 06 21:07:11.176605 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1598/3103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:10 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:11.183999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:11.185030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:11.192108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:11.192929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:11.193792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:11.196595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:11.197535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:11.199782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:11.238777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:11.285820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:11.302636 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c6a7e729-ca11-4676-b45c-e05e366eee1d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1325 microversion: 2.1 time: 1.031533 Aug 06 21:07:11.305094 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1506/3104] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:10 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1325 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:11.310787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:11.329298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:11.360625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:11.361066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:11.361689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:11.365469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:11.367489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:11.371826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:11.517776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:11.531023 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e2edd83f-e468-4358-b828-737f0a6b115d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.352691 Aug 06 21:07:11.534496 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1599/3105] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:11 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:11.607584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:11.620760 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b8b6f5bd-56d0-45e8-8d4c-da14b2cddd61 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1266 microversion: 2.1 time: 0.310246 Aug 06 21:07:11.637405 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1507/3106] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:11 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:11.640486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5240d7f0-7fd7-4ea9-8917-6a5c29e9072d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d776af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:11.716164 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5240d7f0-7fd7-4ea9-8917-6a5c29e9072d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.081632 Aug 06 21:07:11.717272 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1600/3107] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:11 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:11.874449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:11.875517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:11.892139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:11.892968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:11.893584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:11.894687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:11.895321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:11.899347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:12.078076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:12.097560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:12.106829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:12.109766 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b052c814-9026-4913-9c38-2ea2de4ff47c tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1405 microversion: 2.54 time: 0.238978 Aug 06 21:07:12.128313 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1508/3108] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:11 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:12.184832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:12.188708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:12.204636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:12.209177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:12.209812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:12.212952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:12.212952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:12.215542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:12.327462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:12.328314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:12.337216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:12.337718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:12.340255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:12.343185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:12.343678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:12.345297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:12.571454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:12.595951 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2c0b3ee1-ca3c-4f35-920d-571e490be5ae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.417719 Aug 06 21:07:12.596796 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1601/3109] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:12 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:12.603217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:12.604100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:12.612174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:12.612924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:12.613539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:12.614577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:12.615221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:12.615812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:12.851628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:12.861493 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5da7621-7dd9-4ca2-a5e1-c979cf377991 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.263404 Aug 06 21:07:12.865904 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1602/3110] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:12 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:12.872539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:12.886723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:12.894341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:12.903313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:12.903942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:12.904821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:12.905391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:12.905958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:13.182969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:13.207461 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-54f44e06-fc65-44db-909d-5e3ca322a00d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1325 microversion: 2.1 time: 0.881598 Aug 06 21:07:13.208490 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1509/3111] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:12 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1325 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:13.219079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bcad9505-e8b2-4fc3-a2cf-8dcc79786c96 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d27f940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:13.264631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:13.279015 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-26813f4f-8238-4042-a4ac-ab300ac514f4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.405680 Aug 06 21:07:13.283275 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1603/3112] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:12 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:13.290095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:13.293161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:13.307778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:13.308616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:13.309268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:13.310886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:13.311453 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bcad9505-e8b2-4fc3-a2cf-8dcc79786c96 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1454 microversion: 2.1 time: 0.098984 Aug 06 21:07:13.311711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:13.312541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:13.313093 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1510/3113] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:13 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:13.424569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:13.425792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:13.426692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:13.431232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lazy-loading 'fault' on Instance uuid 8323136d-1380-490b-a30a-16278d2f8c2b {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:13.498809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:13.517144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:13.519210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4b581ed648446a59900f2d275de4bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95da58be1d84408098e2cf3513db3846', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:13.520964 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-483a438b-8cfe-4020-9aac-ff0d036564c2 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 200 len: 1410 microversion: 2.54 time: 0.236315 Aug 06 21:07:13.536660 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1604/3114] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:13 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 1410 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:13.620214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:13.621443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:13.634266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:13.635204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:13.635831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:13.636798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:13.637431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:13.638045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:13.896019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:13.897449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:13.904955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:13.905997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:13.906975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:13.907959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:13.908701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:13.909426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.071524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:14.080120 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-56b6971b-c004-4600-9349-611dfeb3ccbd tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.188351 Aug 06 21:07:14.080990 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1605/3115] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:13 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:14.231996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:14.233099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:14.241142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.243332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.244147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.245233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.245770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.246389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.398381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:14.417565 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b0e97ce-fe96-4d38-ad4f-96375aae7a50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.803835 Aug 06 21:07:14.418197 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1511/3116] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:13 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:14.422747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:14.423796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:14.433984 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e0bf663-10e7-42f5-8eba-5a48e3594b0b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1325 microversion: 2.1 time: 0.208452 Aug 06 21:07:14.434578 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1606/3117] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:14 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1325 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:14.445862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c29a7fe5-64da-4eab-a1d7-222d0f35174b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d941b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:14.447139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:14.468773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.469486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.469939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.470756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.471409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.472029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.525313 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c29a7fe5-64da-4eab-a1d7-222d0f35174b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1463 microversion: 2.1 time: 0.087446 Aug 06 21:07:14.525879 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1607/3118] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:14 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1463 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:14.545905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-44a557fa-0d35-4261-a3df-12b8300a21ef tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d88f160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:14.602585 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-44a557fa-0d35-4261-a3df-12b8300a21ef tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 200 len: 1463 microversion: 2.1 time: 0.063394 Aug 06 21:07:14.603471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1608/3119] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:14 2022] GET /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 1463 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:14.610470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:14.611136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] [instance: 8323136d-1380-490b-a30a-16278d2f8c2b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:14.624128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.624682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.625216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.626052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.627147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.627671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.644869 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] HTTP exception thrown: Instance 8323136d-1380-490b-a30a-16278d2f8c2b could not be found. Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Request method failure captured: Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b HTTP/1.1 Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tfSSREFfGe9RxBPL25aj6_yLKMwL-suVttKDNN3IqLCa2OTm3pkC4wLT4RKU_02qJ9D2MnGwI66UdMTSZQp1aQ2p6inUQOu3gyCZ5IyfPyhg7s3DAe6C2arXwwfWtIMzMk51pWG9I00z-lDgu_Vh22pZM2kQfyxryon2cW_08yFE2U Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.54 Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 95da58be1d84408098e2cf3513db3846 Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerShowV254Test-916911235 Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:14.648754 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/95da58be1d84408098e2cf3513db3846"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_95da58be1d84408098e2cf3513db3846", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/95da58be1d84408098e2cf3513db3846"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/95da58be1d84408098e2cf3513db3846"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerShowV254Test-916911235 Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 95da58be1d84408098e2cf3513db3846 Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerShowV254Test-916911235 Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerShowV254Test-916911235-project Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: d4b581ed648446a59900f2d275de4bf4 Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerShowV254Test-916911235-project Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 8323136d-1380-490b-a30a-16278d2f8c2b could not be found. Aug 06 21:07:14.651016 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '8323136d-1380-490b-a30a-16278d2f8c2b'} Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8323136d-1380-490b-a30a-16278d2f8c2b could not be found. Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:14.652601 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8323136d-1380-490b-a30a-16278d2f8c2b could not be found. Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8323136d-1380-490b-a30a-16278d2f8c2b could not be found. Aug 06 21:07:14.654304 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:14.656104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] Returning 404 to user: Instance 8323136d-1380-490b-a30a-16278d2f8c2b could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:14.656104 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-285c0715-ce85-4b0b-9c50-8e37ac1085c0 tempest-ServerShowV254Test-916911235 tempest-ServerShowV254Test-916911235-project] 10.222.0.33 "GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b" status: 404 len: 111 microversion: 2.54 time: 0.046011 Aug 06 21:07:14.656779 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1609/3120] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:14 2022] GET /compute/v2.1/servers/8323136d-1380-490b-a30a-16278d2f8c2b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:07:14.665386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:14.666259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:14.674404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.675399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.676103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.677009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.677644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.678949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.906867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:14.911109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:14.924411 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c336833a-8a3e-4b05-a7f0-f90b1e9baaa3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4" status: 200 len: 1465 microversion: 2.1 time: 0.264244 Aug 06 21:07:14.926764 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1610/3121] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:14 2022] GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 => generated 1465 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:14.952389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6838e837-81ce-4c4a-9b33-8ea3bc3fc969 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1814859740"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:14.955062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6838e837-81ce-4c4a-9b33-8ea3bc3fc969 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:14.964788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6838e837-81ce-4c4a-9b33-8ea3bc3fc969 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.965482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6838e837-81ce-4c4a-9b33-8ea3bc3fc969 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.966098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6838e837-81ce-4c4a-9b33-8ea3bc3fc969 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.967013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6838e837-81ce-4c4a-9b33-8ea3bc3fc969 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:14.967629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6838e837-81ce-4c4a-9b33-8ea3bc3fc969 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:14.968258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6838e837-81ce-4c4a-9b33-8ea3bc3fc969 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:14.969802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:14.981620 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3f1782aa-2b26-4e71-bf77-db7b129eebc8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.562068 Aug 06 21:07:14.996500 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1512/3122] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:14 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:15.104186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:15.114951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:15.118248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=12 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:15.124193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:15.124823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:15.126232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:15.127219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:15.129008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:15.129476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:15.300940 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6838e837-81ce-4c4a-9b33-8ea3bc3fc969 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "POST /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8/action" status: 202 len: 0 microversion: 2.1 time: 0.353312 Aug 06 21:07:15.310765 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1611/3123] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:07:14 2022] POST /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 06 21:07:15.316305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02eeeca1-c566-40fe-8ff5-c796b4001ab3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729db19ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:15.377478 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02eeeca1-c566-40fe-8ff5-c796b4001ab3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.065300 Aug 06 21:07:15.381328 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1612/3124] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:15 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:15.443467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:15.443467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:15.451352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:15.452104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:15.452728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:15.453608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:15.454248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:15.454865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:15.594204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:15.612340 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b8c5049-f02b-4008-9cad-e2a361aa5ff8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.513135 Aug 06 21:07:15.628207 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1513/3125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:15 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:15.636118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:15.638500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:15.662008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:15.663835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:15.664570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:15.665601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:15.666346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:15.667313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:15.807119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:15.837043 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-faa90b88-1c31-4a48-8be3-15c5d25126d9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.396051 Aug 06 21:07:15.838065 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1613/3126] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:15 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:15.848143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:15.865624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c1e6969c-04bc-479e-abec-1c38b877d0f4 req-07aedbbe-8da3-46d0-b521-51a566e6637e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b1d8f6-c200-4f9d-958c-d3594e12be88", "tag": "440d60a3-310f-4bcf-a43b-36f69b1a3105"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:15.913007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1e6969c-04bc-479e-abec-1c38b877d0f4 req-07aedbbe-8da3-46d0-b521-51a566e6637e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:15.922267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1e6969c-04bc-479e-abec-1c38b877d0f4 req-07aedbbe-8da3-46d0-b521-51a566e6637e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:15.923142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1e6969c-04bc-479e-abec-1c38b877d0f4 req-07aedbbe-8da3-46d0-b521-51a566e6637e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:15.957330 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c1e6969c-04bc-479e-abec-1c38b877d0f4 req-07aedbbe-8da3-46d0-b521-51a566e6637e service nova] Creating event network-changed:440d60a3-310f-4bcf-a43b-36f69b1a3105 for instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 on nch2-master-1 Aug 06 21:07:15.966574 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c1e6969c-04bc-479e-abec-1c38b877d0f4 req-07aedbbe-8da3-46d0-b521-51a566e6637e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124683 Aug 06 21:07:15.969401 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1614/3127] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:16.014189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:16.015467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:16.027254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:16.028152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:16.029422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:16.030493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:16.031313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:16.031995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:16.094011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:16.108181 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-871990bf-efbb-472b-9370-8780df499051 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1325 microversion: 2.1 time: 0.477125 Aug 06 21:07:16.109038 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1514/3128] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:15 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1325 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:16.394659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1f166a7c-0108-4976-af23-c58e894b3b82 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d1a0160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:16.430453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:16.468119 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1f166a7c-0108-4976-af23-c58e894b3b82 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.079025 Aug 06 21:07:16.469230 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1515/3129] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:16 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:16.482889 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d72481f-10aa-41e2-aeff-0b7566e98516 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.462396 Aug 06 21:07:16.485232 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1615/3130] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:16 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:16.506455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-007caba6-ff92-4a80-9329-f80645ddeb03 req-f02b7912-27f9-48b5-81cf-95f3a85b060d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb337ae-06f7-467c-ba29-576c91432b19", "name": "network-vif-plugged", "status": "completed", "tag": "21720249-ba93-4942-9704-5ab41bd4ea9a"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:16.527659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-007caba6-ff92-4a80-9329-f80645ddeb03 req-f02b7912-27f9-48b5-81cf-95f3a85b060d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:16.528154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-007caba6-ff92-4a80-9329-f80645ddeb03 req-f02b7912-27f9-48b5-81cf-95f3a85b060d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:16.528615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-007caba6-ff92-4a80-9329-f80645ddeb03 req-f02b7912-27f9-48b5-81cf-95f3a85b060d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:16.554821 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-007caba6-ff92-4a80-9329-f80645ddeb03 req-f02b7912-27f9-48b5-81cf-95f3a85b060d service nova] Creating event network-vif-plugged:21720249-ba93-4942-9704-5ab41bd4ea9a for instance 0bb337ae-06f7-467c-ba29-576c91432b19 on nch2-master-1 Aug 06 21:07:16.568114 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-007caba6-ff92-4a80-9329-f80645ddeb03 req-f02b7912-27f9-48b5-81cf-95f3a85b060d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065945 Aug 06 21:07:16.569031 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1516/3131] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:16.638791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:16.640345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:16.649345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:16.663414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:16.664490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:16.665473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:16.666130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:16.666598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:16.863092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:16.864904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:16.879200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:16.880330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:16.881980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:16.885050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:16.886247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:16.888250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:17.031107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:17.042882 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d5aeed2-00e4-4dda-8069-9c87145d0573 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.409286 Aug 06 21:07:17.044339 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1616/3132] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:16 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:17.139114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:17.140011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:17.146173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:17.156484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:17.158982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:17.159619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:17.161291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:17.164581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:17.165324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:17.166331 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e63017ee-3c85-40ea-84bb-563474e84faa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.306595 Aug 06 21:07:17.177409 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1517/3133] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:16 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:17.410322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:17.464542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:17.474779 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6142df9c-2fb4-4063-9998-c178419ba18b tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1325 microversion: 2.1 time: 0.346734 Aug 06 21:07:17.475653 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1617/3134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:17 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1325 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:17.489367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0ce2faf-0174-43d1-8a39-31aaed92a076 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d1cb040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:17.505582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:17.506493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:17.521219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:17.523619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:17.527630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:17.529647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:17.531837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:17.532853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:17.546397 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0ce2faf-0174-43d1-8a39-31aaed92a076 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.060708 Aug 06 21:07:17.547024 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1518/3135] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:17 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:17.717409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-403417241", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": "none"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:17.782281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:07:17.783017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:07:17.783799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:07:17.784373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:07:17.784891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:07:17.795213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:17.795864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:17.797349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:17.798794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:17.799516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:17.800189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:17.822692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Getting quotas for project 251bd93dd4924a7790ed5313975d90a9. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:17.825445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:17.833499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Getting quotas for user 6887aa30a0584334a58d8cab1e8cb4c3 and project 251bd93dd4924a7790ed5313975d90a9. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:17.851657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:07:17.854504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:07:17.903768 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d41e249a-d113-4fd0-ba25-7121ad3bd57b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.355675 Aug 06 21:07:17.904620 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1519/3136] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 21:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 357 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:07:17.916427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2c6f58f7-713d-412f-8783-c714484b0562 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:17.916965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2c6f58f7-713d-412f-8783-c714484b0562 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:17.995941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2c6f58f7-713d-412f-8783-c714484b0562 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:18.004208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2c6f58f7-713d-412f-8783-c714484b0562 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:18.006821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2c6f58f7-713d-412f-8783-c714484b0562 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:18.009149 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2c6f58f7-713d-412f-8783-c714484b0562 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1277 microversion: 2.57 time: 0.097500 Aug 06 21:07:18.010238 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1520/3137] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:17 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:18.015162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5cb220ef-e5d7-4533-a74d-b84021543abc req-8f51336a-2f80-428b-9453-bbb6fe69e5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74b595a-db9a-40e0-9a72-2a164c7f5d53", "tag": "7f455bb7-e8f8-4307-967c-5849a7c26693"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:18.029729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5cb220ef-e5d7-4533-a74d-b84021543abc req-8f51336a-2f80-428b-9453-bbb6fe69e5ab service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:18.030493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5cb220ef-e5d7-4533-a74d-b84021543abc req-8f51336a-2f80-428b-9453-bbb6fe69e5ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:18.031190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5cb220ef-e5d7-4533-a74d-b84021543abc req-8f51336a-2f80-428b-9453-bbb6fe69e5ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:18.049452 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-5cb220ef-e5d7-4533-a74d-b84021543abc req-8f51336a-2f80-428b-9453-bbb6fe69e5ab service nova] Creating event network-changed:7f455bb7-e8f8-4307-967c-5849a7c26693 for instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 on nch2-master-1 Aug 06 21:07:18.056600 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5cb220ef-e5d7-4533-a74d-b84021543abc req-8f51336a-2f80-428b-9453-bbb6fe69e5ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043904 Aug 06 21:07:18.057776 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1521/3138] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:18.062500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:18.073628 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8a30ddc1-2acb-4b09-a3a7-ef58dfecb53a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.572213 Aug 06 21:07:18.074234 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1618/3139] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:17 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:18.103483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:18.104195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:18.111922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:18.112598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:18.112861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:18.113577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:18.114029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:18.114687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:18.191594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:18.193866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:18.207290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:18.207800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:18.215109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:18.216700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:18.217360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:18.217993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:18.248355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:18.322169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:18.333652 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-32e6e1c0-88c5-48b7-9e29-da1ef8ac8b0e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.234520 Aug 06 21:07:18.353008 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1522/3140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:18 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:18.448348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:18.464251 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-98ec774b-c493-436d-b260-c37e41e9b19c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.279235 Aug 06 21:07:18.482024 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1619/3141] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:18 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:18.502927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:18.505032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:18.514739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:18.515432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:18.516305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:18.517700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:18.520018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:18.521905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:18.563686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5ac8979-4f96-4090-8923-a0eb144ab8cd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729daf0040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:18.670059 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5ac8979-4f96-4090-8923-a0eb144ab8cd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.112114 Aug 06 21:07:18.677172 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1620/3142] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:18 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:18.682879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5fef2a18-272f-4a29-ba14-6d3db4dff14a req-b4b2d781-32f9-49b3-b17b-dbb5158a59e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0926358-eed5-4b13-a285-2f56c382bce4", "name": "network-vif-unplugged", "status": "completed", "tag": "5c0b2605-3a4d-45dd-876d-81e3e36ceb49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:18.724705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5fef2a18-272f-4a29-ba14-6d3db4dff14a req-b4b2d781-32f9-49b3-b17b-dbb5158a59e7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:18.737491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5fef2a18-272f-4a29-ba14-6d3db4dff14a req-b4b2d781-32f9-49b3-b17b-dbb5158a59e7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:18.747041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5fef2a18-272f-4a29-ba14-6d3db4dff14a req-b4b2d781-32f9-49b3-b17b-dbb5158a59e7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:18.784048 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5fef2a18-272f-4a29-ba14-6d3db4dff14a req-b4b2d781-32f9-49b3-b17b-dbb5158a59e7 service nova] Creating event network-vif-unplugged:5c0b2605-3a4d-45dd-876d-81e3e36ceb49 for instance e0926358-eed5-4b13-a285-2f56c382bce4 on nch2-master-1 Aug 06 21:07:18.800160 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5fef2a18-272f-4a29-ba14-6d3db4dff14a req-b4b2d781-32f9-49b3-b17b-dbb5158a59e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121272 Aug 06 21:07:18.802915 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1621/3143] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:19.034934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:19.036383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:19.049889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:19.050396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:19.052125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:19.054474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:19.057934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:19.058825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:19.117028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:19.142372 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f70974a-3bd3-4336-94d8-a5415cab4008 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1325 microversion: 2.1 time: 0.649591 Aug 06 21:07:19.148388 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1523/3144] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:18 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1325 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:19.165968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:19.166603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:19.183331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:19.183745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:19.184201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:19.184927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:19.185394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:19.185835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:19.206845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:19.263983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:19.275029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:19.276630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:19.277851 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f4572e6c-361f-4a6d-a6d8-b62781811f3c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1329 microversion: 2.57 time: 0.248260 Aug 06 21:07:19.286765 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1622/3145] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:19 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1329 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:07:19.371239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-797a7862-62ad-4739-bac9-ee6009038fc9 tempest-FloatingIPDetailsNegativeTestJSON-2072052443 tempest-FloatingIPDetailsNegativeTestJSON-2072052443-project] Calling method '.version_select at 0x7f729d778820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:19.401944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:19.418100 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5c3d287a-41b9-4c8e-a0a0-35f635c6a58b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.265210 Aug 06 21:07:19.418715 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1524/3146] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:19 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:19.423525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:19.424145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:19.440171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:19.440597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:19.441042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:19.445574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:19.447065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:19.447817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:19.453544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG neutronclient.v2_0.client [None req-797a7862-62ad-4739-bac9-ee6009038fc9 tempest-FloatingIPDetailsNegativeTestJSON-2072052443 tempest-FloatingIPDetailsNegativeTestJSON-2072052443-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d6adca76-cbbc-49aa-9446-7e8768fff696 could not be found", "detail": ""}} {{(pid=142461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 06 21:07:19.454252 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-797a7862-62ad-4739-bac9-ee6009038fc9 tempest-FloatingIPDetailsNegativeTestJSON-2072052443 tempest-FloatingIPDetailsNegativeTestJSON-2072052443-project] HTTP exception thrown: Floating IP not found for ID d6adca76-cbbc-49aa-9446-7e8768fff696 Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-797a7862-62ad-4739-bac9-ee6009038fc9 tempest-FloatingIPDetailsNegativeTestJSON-2072052443 tempest-FloatingIPDetailsNegativeTestJSON-2072052443-project] Request method failure captured: Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-floating-ips/d6adca76-cbbc-49aa-9446-7e8768fff696 HTTP/1.1 Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tgHmtIPuBoHBsqE_4pZ6msstncx3xqC7x3pjowOI5Zs-nftPtOP3B-SCbfTih1UGEssJ07gVDD9F7Li7Geofc-q_wogGIR1LbcNnDs8mxUeGAOgbQpywjXF4_7xZfH6UPqF7deeVwwoBp-QXER_YPU1l4W_mipXutFN-kXc_yngk1g Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 25f2ce52da0f43a5b70a00759931805c Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2072052443 Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:19.456229 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/25f2ce52da0f43a5b70a00759931805c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_25f2ce52da0f43a5b70a00759931805c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25f2ce52da0f43a5b70a00759931805c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25f2ce52da0f43a5b70a00759931805c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2072052443 Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 25f2ce52da0f43a5b70a00759931805c Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2072052443 Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2072052443-project Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f0f7bfd0aa3c440e9a525037066b70a0 Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2072052443-project Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: exception: Floating IP not found for ID d6adca76-cbbc-49aa-9446-7e8768fff696 Aug 06 21:07:19.457873 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'd6adca76-cbbc-49aa-9446-7e8768fff696'} Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:07:19.458856 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d6adca76-cbbc-49aa-9446-7e8768fff696 could not be found Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7dda2928-e6d8-42d0-a8ef-07b005c45a07'] Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d6adca76-cbbc-49aa-9446-7e8768fff696. Aug 06 21:07:19.460909 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d6adca76-cbbc-49aa-9446-7e8768fff696 Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:19.463530 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:19.465121 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:19.465121 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d6adca76-cbbc-49aa-9446-7e8768fff696 Aug 06 21:07:19.465121 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:19.465121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-797a7862-62ad-4739-bac9-ee6009038fc9 tempest-FloatingIPDetailsNegativeTestJSON-2072052443 tempest-FloatingIPDetailsNegativeTestJSON-2072052443-project] Returning 404 to user: Floating IP not found for ID d6adca76-cbbc-49aa-9446-7e8768fff696 {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:19.465121 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-797a7862-62ad-4739-bac9-ee6009038fc9 tempest-FloatingIPDetailsNegativeTestJSON-2072052443 tempest-FloatingIPDetailsNegativeTestJSON-2072052443-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/d6adca76-cbbc-49aa-9446-7e8768fff696" status: 404 len: 111 microversion: 2.1 time: 0.177882 Aug 06 21:07:19.465121 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1623/3147] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:07:19 2022] GET /compute/v2.1/os-floating-ips/d6adca76-cbbc-49aa-9446-7e8768fff696 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:19.493191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:19.494109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:19.520459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:19.525862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:19.527014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:19.527978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:19.528626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:19.529936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:19.784207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:19.795020 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d01d2a0f-2026-4909-bf09-52f08f7fc8a3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 0.374893 Aug 06 21:07:19.796243 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1525/3148] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:19 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:19.805178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-473646ed-2458-47b4-860c-3ff7c8adad7f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d216310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:19.866355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:19.883925 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0cc952a0-bde0-4e79-9eb4-a9f0e37b1670 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.399588 Aug 06 21:07:19.884572 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1624/3149] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:19 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:19.886460 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-473646ed-2458-47b4-860c-3ff7c8adad7f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.088824 Aug 06 21:07:19.887410 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1526/3150] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:19 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:20.170695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:20.171614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:20.182015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:20.183242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:20.184551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:20.185679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:20.186389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:20.187372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:20.305128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:20.306279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:20.319193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:20.320210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:20.321384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:20.322517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:20.323255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:20.324070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:20.411790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:20.426661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:20.428652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:20.430889 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-29ca9f5c-d2dc-4edd-9de7-64244cfef8a4 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1335 microversion: 2.57 time: 0.131417 Aug 06 21:07:20.446798 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1527/3151] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:20 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1335 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:07:20.455905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:20.457406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:20.464853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:20.466157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:20.466947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:20.467903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:20.468604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:20.469278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:20.502732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:20.512670 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0e1cdc6c-c5c4-4e88-8d39-e6a353064964 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1325 microversion: 2.1 time: 0.345956 Aug 06 21:07:20.526610 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1625/3152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:20 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:20.816677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:20.817313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:20.841130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:20.849490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:20.850043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:20.862085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:20.863160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:20.863525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:21.088524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:21.103441 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9241c323-510e-49b8-8c42-44bc2f093b9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.655194 Aug 06 21:07:21.123253 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1528/3153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:20 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:21.133755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-80047b64-a094-4c3c-9cc0-a0e0e728a157 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d1a51f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:21.242943 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-80047b64-a094-4c3c-9cc0-a0e0e728a157 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.117102 Aug 06 21:07:21.248734 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1529/3154] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:21 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:21.280617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:21.285555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:21.311431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:21.314270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:21.315007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:21.320561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:21.324243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:21.324963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:21.641755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:21.657156 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ef201c48-8bf8-4050-a0e2-9fc074b3c287 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.403058 Aug 06 21:07:21.658642 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1530/3155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:21 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:21.682153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:21.682823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:21.696295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:21.697011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:21.697390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:21.698350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:21.699013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:21.699477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:21.801002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:21.812561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:21.814481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:21.816139 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aeff1f91-c81a-48f5-a160-89c261774ca3 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1335 microversion: 2.57 time: 0.155405 Aug 06 21:07:21.817196 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1531/3156] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:21 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1335 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:21.854899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:21.856568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:21.864501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:21.865407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:21.866235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:21.868857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:21.869507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:21.870112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.052480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:22.063308 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d35ab2f0-c3da-40cc-bfb4-ee3ac3a0d9d0 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1523 microversion: 2.1 time: 0.243844 Aug 06 21:07:22.064055 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1532/3157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:21 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:22.068924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7ef315b5-50d3-4a9b-ba6f-5e6054456036 req-556279f1-cc18-4133-8c9f-aa6040576f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032e6b85-4ab1-4fed-818b-e3893ebc09c8", "name": "network-vif-plugged", "status": "completed", "tag": "700bbba7-9867-4e5a-b588-1da283ca9b16"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:22.082894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7ef315b5-50d3-4a9b-ba6f-5e6054456036 req-556279f1-cc18-4133-8c9f-aa6040576f8d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.083566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7ef315b5-50d3-4a9b-ba6f-5e6054456036 req-556279f1-cc18-4133-8c9f-aa6040576f8d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.084258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7ef315b5-50d3-4a9b-ba6f-5e6054456036 req-556279f1-cc18-4133-8c9f-aa6040576f8d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.099042 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7ef315b5-50d3-4a9b-ba6f-5e6054456036 req-556279f1-cc18-4133-8c9f-aa6040576f8d service nova] Creating event network-vif-plugged:700bbba7-9867-4e5a-b588-1da283ca9b16 for instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 on nch1-master-1 Aug 06 21:07:22.106298 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7ef315b5-50d3-4a9b-ba6f-5e6054456036 req-556279f1-cc18-4133-8c9f-aa6040576f8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040446 Aug 06 21:07:22.107175 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1533/3158] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:22.113278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:22.113922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:22.122036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.122629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.123083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.123817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.124334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.124813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.170722 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] HTTP exception thrown: Action 999 not found Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Request method failure captured: Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19/os-instance-actions/999 HTTP/1.1 Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tfzsFroq0JHs1bFa9vdqFLVSo2H5ollFRAfa0Bkj0QWO6LsiCjHNvGdvUrWvpmNidYTTwP0G3NrxfgUyodJJl8Mg528e4aa8NeDBN_g2o-kzj5UKU9wgZHIbhUtTj_7nAizj2gDqsA1e0VGN1WezgCKlxJ6m3mbAMbfx5LQpVNmtn0 Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 162c0275fc334a30bbb857e86295550b Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-855585368 Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:22.183544 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/162c0275fc334a30bbb857e86295550b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_162c0275fc334a30bbb857e86295550b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/162c0275fc334a30bbb857e86295550b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/162c0275fc334a30bbb857e86295550b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-855585368 Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 162c0275fc334a30bbb857e86295550b Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-855585368 Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-InstanceActionsNegativeTestJSON-855585368-project Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 91c6b895ecbe442083862557052c0cc3 Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-855585368-project Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: exception: Action 999 not found Aug 06 21:07:22.185254 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'server_id': '0bb337ae-06f7-467c-ba29-576c91432b19', 'id': '999'} Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 06 21:07:22.186178 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:22.191897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Returning 404 to user: Action 999 not found {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:22.191897 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f2fc433-aa76-4e28-8509-4f8ccc74042d tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.077619 Aug 06 21:07:22.191897 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1534/3159] 10.222.0.33 () {58 vars in 1308 bytes} [Sat Aug 6 21:07:22 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19/os-instance-actions/999 => generated 66 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:07:22.193714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:22.194566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:22.204679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.205213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.205674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.206415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.206929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.207473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.418128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:22.419613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:22.431669 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f5253cc2-ec64-4456-bbec-ff012d99025a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.242459 Aug 06 21:07:22.432375 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1535/3160] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:22 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:22.437038 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7a2abc06-c573-4a5f-af5b-4cf9bb070d02 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1522 microversion: 2.1 time: 1.623519 Aug 06 21:07:22.441288 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1626/3161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:20 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1522 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:22.451548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb1165d4-983b-49ba-8922-e02d1254e279 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '.version_select at 0x7f729d1a5c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:22.455929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb1165d4-983b-49ba-8922-e02d1254e279 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 96d0c16f-bfec-4e1c-8eb6-88aa8327a437] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:22.466952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-398d1c6a-774d-470f-bfca-d3a84507a153 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dae8700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:22.469093 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-fb1165d4-983b-49ba-8922-e02d1254e279 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] HTTP exception thrown: Instance 96d0c16f-bfec-4e1c-8eb6-88aa8327a437 could not be found. Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb1165d4-983b-49ba-8922-e02d1254e279 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Request method failure captured: Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/96d0c16f-bfec-4e1c-8eb6-88aa8327a437/os-instance-actions HTTP/1.1 Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tfzsFroq0JHs1bFa9vdqFLVSo2H5ollFRAfa0Bkj0QWO6LsiCjHNvGdvUrWvpmNidYTTwP0G3NrxfgUyodJJl8Mg528e4aa8NeDBN_g2o-kzj5UKU9wgZHIbhUtTj_7nAizj2gDqsA1e0VGN1WezgCKlxJ6m3mbAMbfx5LQpVNmtn0 Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 162c0275fc334a30bbb857e86295550b Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-855585368 Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:22.472842 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/162c0275fc334a30bbb857e86295550b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_162c0275fc334a30bbb857e86295550b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/162c0275fc334a30bbb857e86295550b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/162c0275fc334a30bbb857e86295550b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-855585368 Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 162c0275fc334a30bbb857e86295550b Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-855585368 Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-InstanceActionsNegativeTestJSON-855585368-project Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 91c6b895ecbe442083862557052c0cc3 Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-855585368-project Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 96d0c16f-bfec-4e1c-8eb6-88aa8327a437 could not be found. Aug 06 21:07:22.474275 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'server_id': '96d0c16f-bfec-4e1c-8eb6-88aa8327a437'} Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d0c16f-bfec-4e1c-8eb6-88aa8327a437 could not be found. Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:22.475209 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d0c16f-bfec-4e1c-8eb6-88aa8327a437 could not be found. Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d0c16f-bfec-4e1c-8eb6-88aa8327a437 could not be found. Aug 06 21:07:22.476479 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:22.478914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb1165d4-983b-49ba-8922-e02d1254e279 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Returning 404 to user: Instance 96d0c16f-bfec-4e1c-8eb6-88aa8327a437 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:22.479975 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb1165d4-983b-49ba-8922-e02d1254e279 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/96d0c16f-bfec-4e1c-8eb6-88aa8327a437/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.046536 Aug 06 21:07:22.480739 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1536/3162] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Aug 6 21:07:22 2022] GET /compute/v2.1/servers/96d0c16f-bfec-4e1c-8eb6-88aa8327a437/os-instance-actions => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:22.492212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:22.493213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:22.502956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.503724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.504226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.505079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.505615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.506126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.536345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:07:22.548824 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-398d1c6a-774d-470f-bfca-d3a84507a153 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.097251 Aug 06 21:07:22.557556 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1627/3163] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:22 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:22.693377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:22.694917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:22.704367 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f8d48947-5b00-4588-82fb-ed2c33faadfd tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 204 len: 0 microversion: 2.1 time: 0.217706 Aug 06 21:07:22.705051 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1537/3164] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:07:22 2022] DELETE /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:07:22.724124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.724344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:22.725032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.725407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:22.728456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.729416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.730065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.730747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.737151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.737960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.738976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.739872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:22.740613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:22.741364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:22.953289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:22.970954 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bcf33d8d-e396-40e9-9ee6-a70db1dd1089 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1529 microversion: 2.1 time: 0.259307 Aug 06 21:07:22.972185 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1538/3165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:22 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1529 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:22.978370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:22.983057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:22.995770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.002935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.003541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.004402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.004970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.005489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.132865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:23.146537 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d58f8fed-163f-47a0-9b90-ef2670b97b22 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.464850 Aug 06 21:07:23.170025 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1628/3166] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:22 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:23.172656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:23.187027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:23.188975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:23.190426 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a4e4d538-e3ff-4252-b853-5f714b80ff5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1356 microversion: 2.57 time: 0.217180 Aug 06 21:07:23.191687 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1539/3167] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:22 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1356 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:23.219280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:23.223195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:23.233614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.234940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.235691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.236740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.237581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.238285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.359523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:07:23.360304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:07:23.360802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:07:23.361224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:07:23.361650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:07:23.453752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:23.454257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:23.485894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.486327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.486814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.493205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.493723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.502344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:23.516633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.517874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.519868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.525039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.528718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.529356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.530174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.605303 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6a013ba-dc77-4206-b1e8-b1a276bfeb98 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "POST /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7/action" status: 202 len: 1137 microversion: 2.57 time: 0.390098 Aug 06 21:07:23.606403 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1629/3168] 10.222.0.33 () {62 vars in 1320 bytes} [Sat Aug 6 21:07:23 2022] POST /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7/action => generated 1137 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 06 21:07:23.622850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:23.624067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:23.637864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.639004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.640309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.641225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.643603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.644256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:23.887591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:23.899816 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-24609686-de26-4dba-b131-41a2490cd2eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.450565 Aug 06 21:07:23.900502 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1540/3169] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:23 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:23.905702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1fb76738-8b20-4be8-a58a-23ceb9233a5f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d07e790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:23.980212 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1fb76738-8b20-4be8-a58a-23ceb9233a5f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.077707 Aug 06 21:07:23.981381 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1541/3170] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:23 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:23.986385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:23.987377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:23.996547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:23.997471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:23.998157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:24.000025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:24.001055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:24.002260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:24.152390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:24.164508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:24.167595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:24.169095 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d01ccead-c8b2-4964-868f-b9916c554570 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.186565 Aug 06 21:07:24.181581 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1542/3171] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:23 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:24.196438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:24.197270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:24.214471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:24.214748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:24.215099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:24.215856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:24.219498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:24.220006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:24.598135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:24.609542 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-be4a315a-9ea6-4dcc-8dc0-48317090abad tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1529 microversion: 2.1 time: 0.426532 Aug 06 21:07:24.610145 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1543/3172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:24 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1529 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:24.634855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:24.635622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:24.649931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:24.651132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:24.651613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:24.652383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:24.652859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:24.653301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:24.705327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:24.940524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:24.957738 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-447ce772-3ebe-4b2e-b0c8-78e6e965bbdb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.330843 Aug 06 21:07:24.958798 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1544/3173] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:24 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:24.968956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-769a8639-3de5-48f2-91b3-bf0272c96aca req-de3d2813-d830-4cb1-80bc-4d9e6cb4cd08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1d8f6-c200-4f9d-958c-d3594e12be88", "name": "network-vif-plugged", "status": "completed", "tag": "440d60a3-310f-4bcf-a43b-36f69b1a3105"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:24.995962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:25.016214 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-643ecc1e-6951-4d8a-8378-2cc3defcfa65 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1502 microversion: 2.1 time: 1.406102 Aug 06 21:07:25.023080 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1630/3174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:23 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1502 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:25.036075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:25.039726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-769a8639-3de5-48f2-91b3-bf0272c96aca req-de3d2813-d830-4cb1-80bc-4d9e6cb4cd08 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.040541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-769a8639-3de5-48f2-91b3-bf0272c96aca req-de3d2813-d830-4cb1-80bc-4d9e6cb4cd08 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.042354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:25.043930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-769a8639-3de5-48f2-91b3-bf0272c96aca req-de3d2813-d830-4cb1-80bc-4d9e6cb4cd08 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.056946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.060055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.060712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.062276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.063057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.063781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.102295 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-769a8639-3de5-48f2-91b3-bf0272c96aca req-de3d2813-d830-4cb1-80bc-4d9e6cb4cd08 service nova] Creating event network-vif-plugged:440d60a3-310f-4bcf-a43b-36f69b1a3105 for instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 on nch2-master-1 Aug 06 21:07:25.130328 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-769a8639-3de5-48f2-91b3-bf0272c96aca req-de3d2813-d830-4cb1-80bc-4d9e6cb4cd08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170648 Aug 06 21:07:25.158675 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1545/3175] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:25.203896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f03652a8-d676-4d46-b8be-19f22bad7e7e tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d2568b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:25.313044 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f03652a8-d676-4d46-b8be-19f22bad7e7e tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.145965 Aug 06 21:07:25.325692 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1546/3176] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:25 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:25.337005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:25.343894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:25.363140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.364049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.364390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.369907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.373767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.375234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.633977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:25.648367 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-76a2a0ae-8892-4ebf-983c-917777414213 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.623901 Aug 06 21:07:25.649438 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1631/3177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:25 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:25.655579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bd3980dc-b83e-4acc-b6fa-ee855a08a190 req-3fda7b62-f3a1-4481-bb34-42a23069c5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb337ae-06f7-467c-ba29-576c91432b19", "name": "network-vif-deleted", "tag": "21720249-ba93-4942-9704-5ab41bd4ea9a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:25.676119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:25.684904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bd3980dc-b83e-4acc-b6fa-ee855a08a190 req-3fda7b62-f3a1-4481-bb34-42a23069c5d4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.691379 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-938cfef1-6516-42c4-be87-1f4108d27147 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1515 microversion: 2.1 time: 0.370201 Aug 06 21:07:25.692734 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1547/3178] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:25 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1515 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:25.699410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bd3980dc-b83e-4acc-b6fa-ee855a08a190 req-3fda7b62-f3a1-4481-bb34-42a23069c5d4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.699761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:25.699981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bd3980dc-b83e-4acc-b6fa-ee855a08a190 req-3fda7b62-f3a1-4481-bb34-42a23069c5d4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.700760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:25.711187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.712052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.713055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.714369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.715125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.715930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.729358 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bd3980dc-b83e-4acc-b6fa-ee855a08a190 req-3fda7b62-f3a1-4481-bb34-42a23069c5d4 service nova] Creating event network-vif-deleted:21720249-ba93-4942-9704-5ab41bd4ea9a for instance 0bb337ae-06f7-467c-ba29-576c91432b19 on nch2-master-1 Aug 06 21:07:25.736745 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bd3980dc-b83e-4acc-b6fa-ee855a08a190 req-3fda7b62-f3a1-4481-bb34-42a23069c5d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085853 Aug 06 21:07:25.738253 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1632/3179] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:25.744906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:25.745624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:25.752355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.753096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.753727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.754646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.755270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.755869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.790277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.791094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.791822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.792446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lazy-loading 'fault' on Instance uuid 0bb337ae-06f7-467c-ba29-576c91432b19 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:25.828762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:25.837816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:25.847660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:25.852069 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-09a3105d-641a-45a8-a20e-bf7bd9427530 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.157794 Aug 06 21:07:25.852887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c6b895ecbe442083862557052c0cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162c0275fc334a30bbb857e86295550b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:25.853704 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1548/3180] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:25 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:25.873222 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66b842d7-5468-4982-9dd4-f11adb337b66 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 200 len: 1315 microversion: 2.1 time: 0.132914 Aug 06 21:07:25.874539 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1633/3181] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:25 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 1315 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:25.878596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e681ad6c-758e-4cff-8493-b66461464124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:25.882149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e681ad6c-758e-4cff-8493-b66461464124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 3d41270c-bd30-40b5-a7cd-6b5439a307f1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:25.917088 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-e681ad6c-758e-4cff-8493-b66461464124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] HTTP exception thrown: Instance 3d41270c-bd30-40b5-a7cd-6b5439a307f1 could not be found. Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e681ad6c-758e-4cff-8493-b66461464124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Request method failure captured: Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/3d41270c-bd30-40b5-a7cd-6b5439a307f1/action HTTP/1.1 Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 14 Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tfLEawbHpN6jMURxdzK2EbJF4VOuu9Oa5UpiLUmKBNlhjCkr9kH_MmWQvt1hNGSGmL37UKnTYuWQ1qLqZpSKaucQe-XZMrOo54Rzzy38O3wJqXN2UfBzSzmpVXWUazExIacv2EKUyLKBOIK69QkSvDLfRUnPsiYAPeIlk26rmd3IhA Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:25.924677 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8046f1ab9c004060965dced02db4b7c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: f7cf258df10248d0bdcf64fa075c132c Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: {"rescue": {}} Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:07:25.926168 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 3d41270c-bd30-40b5-a7cd-6b5439a307f1 could not be found. Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '3d41270c-bd30-40b5-a7cd-6b5439a307f1', 'body': {'rescue': {}}} Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d41270c-bd30-40b5-a7cd-6b5439a307f1 could not be found. Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:25.931621 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d41270c-bd30-40b5-a7cd-6b5439a307f1 could not be found. Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d41270c-bd30-40b5-a7cd-6b5439a307f1 could not be found. Aug 06 21:07:25.932890 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:25.934339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e681ad6c-758e-4cff-8493-b66461464124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Returning 404 to user: Instance 3d41270c-bd30-40b5-a7cd-6b5439a307f1 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:25.934339 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e681ad6c-758e-4cff-8493-b66461464124 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/3d41270c-bd30-40b5-a7cd-6b5439a307f1/action" status: 404 len: 111 microversion: 2.1 time: 0.065011 Aug 06 21:07:25.934339 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1549/3182] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:07:25 2022] POST /compute/v2.1/servers/3d41270c-bd30-40b5-a7cd-6b5439a307f1/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:25.949831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca6ae94e-a29b-4123-90a8-0e060e1d73e3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:25.952082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca6ae94e-a29b-4123-90a8-0e060e1d73e3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:25.963474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca6ae94e-a29b-4123-90a8-0e060e1d73e3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.963975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca6ae94e-a29b-4123-90a8-0e060e1d73e3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.964413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca6ae94e-a29b-4123-90a8-0e060e1d73e3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:25.965134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca6ae94e-a29b-4123-90a8-0e060e1d73e3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:25.965593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca6ae94e-a29b-4123-90a8-0e060e1d73e3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:25.966024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca6ae94e-a29b-4123-90a8-0e060e1d73e3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:26.031444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:26.031444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:26.041209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:26.041713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:26.042173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:26.042934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:26.043399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:26.043837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:26.108972 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca6ae94e-a29b-4123-90a8-0e060e1d73e3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action" status: 202 len: 0 microversion: 2.1 time: 0.169258 Aug 06 21:07:26.112976 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1634/3183] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:07:25 2022] POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:07:26.130264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:26.130966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:26.137833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:26.138432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:26.139439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:26.140407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:26.140872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:26.141423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:26.341833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:26.350103 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4cb118f3-0aa6-4495-8225-6526a439d868 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.367488 Aug 06 21:07:26.352499 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1550/3184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:25 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:26.374482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e8b20bf3-462d-4ef0-ad91-b95b6fe0c3ab tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d07e670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:26.428004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:26.440074 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e789db63-4cbd-42a8-9328-747b89a65442 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1520 microversion: 2.1 time: 0.318959 Aug 06 21:07:26.443539 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1635/3185] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:26 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:26.481983 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e8b20bf3-462d-4ef0-ad91-b95b6fe0c3ab tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.127547 Aug 06 21:07:26.483162 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1551/3186] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:26 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:26.676772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:26.677429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:26.696467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:26.703409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:26.704448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:26.707754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:26.708297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:26.708825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:26.878584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:26.879232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:26.894617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:26.895483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:26.896144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:26.897091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:26.898726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:26.899467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.001211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:27.011462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:27.018381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:27.026966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bdaa3dcf-391c-44fd-98cb-c4fca1c0f2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.153016 Aug 06 21:07:27.027567 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1552/3187] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:26 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:07:27.032525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:27.039112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] [instance: 0bb337ae-06f7-467c-ba29-576c91432b19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:27.050997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.051506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.051957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.061988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.063461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:27.064023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.065024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.075588 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47c8a01c-4a77-416f-9727-37c6eb915e29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1308 microversion: 2.1 time: 0.409651 Aug 06 21:07:27.082284 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1636/3188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:26 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1308 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:27.111571 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] HTTP exception thrown: Instance 0bb337ae-06f7-467c-ba29-576c91432b19 could not be found. Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Request method failure captured: Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 HTTP/1.1 Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tfzsFroq0JHs1bFa9vdqFLVSo2H5ollFRAfa0Bkj0QWO6LsiCjHNvGdvUrWvpmNidYTTwP0G3NrxfgUyodJJl8Mg528e4aa8NeDBN_g2o-kzj5UKU9wgZHIbhUtTj_7nAizj2gDqsA1e0VGN1WezgCKlxJ6m3mbAMbfx5LQpVNmtn0 Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 162c0275fc334a30bbb857e86295550b Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-855585368 Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:27.114815 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/162c0275fc334a30bbb857e86295550b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_162c0275fc334a30bbb857e86295550b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/162c0275fc334a30bbb857e86295550b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/162c0275fc334a30bbb857e86295550b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-855585368 Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 162c0275fc334a30bbb857e86295550b Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-855585368 Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-InstanceActionsNegativeTestJSON-855585368-project Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 91c6b895ecbe442083862557052c0cc3 Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-855585368-project Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 0bb337ae-06f7-467c-ba29-576c91432b19 could not be found. Aug 06 21:07:27.118108 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '0bb337ae-06f7-467c-ba29-576c91432b19'} Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb337ae-06f7-467c-ba29-576c91432b19 could not be found. Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:27.119331 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb337ae-06f7-467c-ba29-576c91432b19 could not be found. Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb337ae-06f7-467c-ba29-576c91432b19 could not be found. Aug 06 21:07:27.121320 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.125933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] Returning 404 to user: Instance 0bb337ae-06f7-467c-ba29-576c91432b19 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:27.127186 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6ed7fc7f-70d1-4e7c-9ec5-2fb61778c244 tempest-InstanceActionsNegativeTestJSON-855585368 tempest-InstanceActionsNegativeTestJSON-855585368-project] 10.222.0.33 "GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19" status: 404 len: 111 microversion: 2.1 time: 0.098244 Aug 06 21:07:27.128323 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1553/3189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:27 2022] GET /compute/v2.1/servers/0bb337ae-06f7-467c-ba29-576c91432b19 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:27.236195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-9cc4c06e-c6cd-4e33-be18-fcfac2a7f195 req-4a64b391-a601-454d-aefd-22e85f5eaa4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74b595a-db9a-40e0-9a72-2a164c7f5d53", "name": "network-vif-plugged", "status": "completed", "tag": "7f455bb7-e8f8-4307-967c-5849a7c26693"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:27.248860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9cc4c06e-c6cd-4e33-be18-fcfac2a7f195 req-4a64b391-a601-454d-aefd-22e85f5eaa4a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.249662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9cc4c06e-c6cd-4e33-be18-fcfac2a7f195 req-4a64b391-a601-454d-aefd-22e85f5eaa4a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.250363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9cc4c06e-c6cd-4e33-be18-fcfac2a7f195 req-4a64b391-a601-454d-aefd-22e85f5eaa4a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.254709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:27.264742 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-9cc4c06e-c6cd-4e33-be18-fcfac2a7f195 req-4a64b391-a601-454d-aefd-22e85f5eaa4a service nova] Creating event network-vif-plugged:7f455bb7-e8f8-4307-967c-5849a7c26693 for instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 on nch2-master-1 Aug 06 21:07:27.270177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-9cc4c06e-c6cd-4e33-be18-fcfac2a7f195 req-4a64b391-a601-454d-aefd-22e85f5eaa4a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038329 Aug 06 21:07:27.271506 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1637/3190] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:07:27.373687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:27.374243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:27.391414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.391937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.392398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.394703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.394703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.394703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.466221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:27.466979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:27.480529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.481025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.481467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.482188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.482684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.483298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.713400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:27.731764 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7ed29fd9-9cbd-4ccb-aba9-8918e6c8501c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1500 microversion: 2.1 time: 0.269876 Aug 06 21:07:27.732673 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1638/3191] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:27 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1500 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:27.738094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d23e981-5ba2-4e85-9b51-16c7514f1ba6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d550ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:27.812486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:27.818941 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d23e981-5ba2-4e85-9b51-16c7514f1ba6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.082924 Aug 06 21:07:27.819913 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1639/3192] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:27 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:27.830602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:27.839087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:27.856301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.860912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.861605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.862744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.863366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.863959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.916543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lazy-loading 'flavor' on Instance uuid 13d43d45-c3b6-44b0-8241-b8ff218d15d4 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:27.948896 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] HTTP exception thrown: Cannot 'rescue' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state paused Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Request method failure captured: Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action HTTP/1.1 Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 14 Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tfLEawbHpN6jMURxdzK2EbJF4VOuu9Oa5UpiLUmKBNlhjCkr9kH_MmWQvt1hNGSGmL37UKnTYuWQ1qLqZpSKaucQe-XZMrOo54Rzzy38O3wJqXN2UfBzSzmpVXWUazExIacv2EKUyLKBOIK69QkSvDLfRUnPsiYAPeIlk26rmd3IhA Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:27.951161 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8046f1ab9c004060965dced02db4b7c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f7cf258df10248d0bdcf64fa075c132c Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: {"rescue": {}} Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:07:27.952852 ncdv-master-1 devstack@n-api.service[142461]: exception: Cannot 'rescue' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state paused Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '13d43d45-c3b6-44b0-8241-b8ff218d15d4', 'body': {'rescue': {}}} Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 in vm_state paused. Cannot rescue while the instance is in this state. Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:27.953810 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state paused Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state paused Aug 06 21:07:27.955367 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:27.957907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Returning 409 to user: Cannot 'rescue' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state paused {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:27.959217 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-50cb30fb-7734-4aa3-94e3-09a6ba7b82e4 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action" status: 409 len: 144 microversion: 2.1 time: 0.137829 Aug 06 21:07:27.960690 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1640/3193] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:07:27 2022] POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action => generated 144 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:07:27.969306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-29ee20a2-b84c-4c7c-9bc8-0f16ad0a9138 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:27.969841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-29ee20a2-b84c-4c7c-9bc8-0f16ad0a9138 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:27.978933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ee20a2-b84c-4c7c-9bc8-0f16ad0a9138 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.979690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ee20a2-b84c-4c7c-9bc8-0f16ad0a9138 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.980340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ee20a2-b84c-4c7c-9bc8-0f16ad0a9138 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:27.981224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ee20a2-b84c-4c7c-9bc8-0f16ad0a9138 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:27.981843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ee20a2-b84c-4c7c-9bc8-0f16ad0a9138 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:27.982646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29ee20a2-b84c-4c7c-9bc8-0f16ad0a9138 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:28.000387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:28.081082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:28.094010 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f34579c-5532-4a58-9261-526088ead717 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.723021 Aug 06 21:07:28.096319 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1554/3194] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:27 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:28.104724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:28.105665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:28.108072 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-29ee20a2-b84c-4c7c-9bc8-0f16ad0a9138 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action" status: 202 len: 0 microversion: 2.1 time: 0.142116 Aug 06 21:07:28.112269 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1641/3195] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:07:27 2022] POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:07:28.126731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:28.129978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:28.134450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:28.135145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:28.135477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:28.136422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:28.138938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:28.139551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:28.149218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:28.151267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:28.151910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:28.159553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:28.160050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:28.160682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:28.263007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:28.274080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:28.276274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:28.278078 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-51f1df54-455d-402b-94cd-c20aeef5a5b9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.178349 Aug 06 21:07:28.287081 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1555/3196] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:28 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:28.303623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:28.305457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:28.314904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:28.315634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:28.316446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:28.317406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:28.319142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:28.319983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:28.393446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:28.409086 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca22fca1-11e6-44b3-9020-f99f10cd579a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1488 microversion: 2.1 time: 0.295355 Aug 06 21:07:28.409995 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1642/3197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:28 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1488 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:28.616624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-856784927", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0827ee4a-610f-48e2-8263-78e781630780"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:28.695916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:28.706897 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f45c0a63-8dc5-4170-ac5a-e3d0fe2103ce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1507 microversion: 2.1 time: 0.417051 Aug 06 21:07:28.707688 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1556/3198] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:28 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1507 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:28.728973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] validate_networks() for [('0827ee4a-610f-48e2-8263-78e781630780', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:07:28.836153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cdf15e57-352a-40cf-9c9f-6310d43872e3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d1c3ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:28.920526 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cdf15e57-352a-40cf-9c9f-6310d43872e3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.090707 Aug 06 21:07:28.922995 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1557/3199] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:28 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:29.118099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:29.119488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:29.132232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:29.132955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:29.133572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:29.134471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:29.135517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:29.136725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:29.381714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:07:29.383355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:07:29.383839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:07:29.384531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:07:29.385013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:07:29.399724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:29.400387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:29.400775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:29.401693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:29.402337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:29.402948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:29.430787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:29.436828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:29.438896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for user 7dcd210e197347f8ad1622ee882bee92 and project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:29.468160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:07:29.470792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:07:29.531818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:29.550710 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e610c86c-db2f-47c0-a2b8-2fec3b516c45 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938505 Aug 06 21:07:29.551636 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1643/3200] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:07:29.556633 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-35387793-00dc-4608-870a-6fccd666e542 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1315 microversion: 2.1 time: 0.429868 Aug 06 21:07:29.560805 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1558/3201] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:29 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:29.562427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:29.563902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:29.572801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:29.573540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:29.574150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:29.575039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:29.576086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:29.590695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:29.736448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:29.751000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:29.754255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:29.756085 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32224f96-4a1f-49ea-9c0f-55b69b441c4d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.199378 Aug 06 21:07:29.773235 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1644/3202] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:29 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:29.788239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b8ce0d30-2d94-423d-8b82-e332ebbede21 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:29.789036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b8ce0d30-2d94-423d-8b82-e332ebbede21 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:29.887706 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-11fcae30-927c-4b1a-97cf-dc3ee7f9e851 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] 10.222.0.33 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.325502 Aug 06 21:07:29.891183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b8ce0d30-2d94-423d-8b82-e332ebbede21 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:29.893996 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1559/3203] 10.222.0.33 () {58 vars in 1128 bytes} [Sat Aug 6 21:07:29 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 21:07:29.903837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:29.904108 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b8ce0d30-2d94-423d-8b82-e332ebbede21 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1208 microversion: 2.1 time: 0.129661 Aug 06 21:07:29.904703 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1645/3204] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:29 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1208 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:29.906258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:29.914419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:29.915274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:29.916030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:29.916675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7121ed99-516c-4d09-8242-bbfbb290cda0 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Calling method '.version_select at 0x7f72a362bee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:29.917106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:29.917709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:29.918298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:29.966399 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7121ed99-516c-4d09-8242-bbfbb290cda0 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] HTTP exception thrown: Image not found. Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7121ed99-516c-4d09-8242-bbfbb290cda0 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Request method failure captured: Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tgRcgQphsHwRKJCoiy9__aJboYtXiLaPQEMbAXA8b_Pa57dF0nnbLMrV8n3rprc-EwwRQtlaMV-542-sw9sytF3JIpSOOGJDXLRoo_z_YYg-Dhp__ghaOgHaUOHLcvVh2d8I_BjxuxbNDOnCPqMbpQmHi78sg-SxX7t6MnT-ZjOL_U Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:29.968393 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_46174b291ccf4b98bff3fd99bbe207b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 975674971c944823a47fce804a1c848c Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '-1'} Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:29.969961 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:29.971005 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:29.972797 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7121ed99-516c-4d09-8242-bbfbb290cda0 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:29.974243 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7121ed99-516c-4d09-8242-bbfbb290cda0 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] 10.222.0.33 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.064183 Aug 06 21:07:29.975894 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1646/3205] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Aug 6 21:07:29 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:07:29.982656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d9819938-a904-4d87-bdf5-e872dc4ca419 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d869a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:30.051404 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d9819938-a904-4d87-bdf5-e872dc4ca419 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.074309 Aug 06 21:07:30.052192 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1647/3206] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:29 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:30.065058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ae09d91-4436-4187-a758-5c2aed310d93 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Calling method '.version_select at 0x7f729d550f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:30.116661 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5ae09d91-4436-4187-a758-5c2aed310d93 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] HTTP exception thrown: Image not found. Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ae09d91-4436-4187-a758-5c2aed310d93 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Request method failure captured: Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/images/c68700a2-c451-471d-8b7d-33d0e9b92faj HTTP/1.1 Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tgRcgQphsHwRKJCoiy9__aJboYtXiLaPQEMbAXA8b_Pa57dF0nnbLMrV8n3rprc-EwwRQtlaMV-542-sw9sytF3JIpSOOGJDXLRoo_z_YYg-Dhp__ghaOgHaUOHLcvVh2d8I_BjxuxbNDOnCPqMbpQmHi78sg-SxX7t6MnT-ZjOL_U Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:30.123474 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_46174b291ccf4b98bff3fd99bbe207b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 975674971c944823a47fce804a1c848c Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'c68700a2-c451-471d-8b7d-33d0e9b92faj'} Aug 06 21:07:30.125764 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c68700a2-c451-471d-8b7d-33d0e9b92faj to delete Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.127255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c68700a2-c451-471d-8b7d-33d0e9b92faj could not be found. Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:30.129922 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:07:30.138941 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.144601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ae09d91-4436-4187-a758-5c2aed310d93 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:30.145789 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ae09d91-4436-4187-a758-5c2aed310d93 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] 10.222.0.33 "DELETE /compute/v2.1/images/c68700a2-c451-471d-8b7d-33d0e9b92faj" status: 404 len: 62 microversion: 2.1 time: 0.092374 Aug 06 21:07:30.146472 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1648/3207] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:30 2022] DELETE /compute/v2.1/images/c68700a2-c451-471d-8b7d-33d0e9b92faj => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:07:30.165127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d87f3b1-0c91-4134-a7b1-07b6b935f19a tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Calling method '.version_select at 0x7f729db09670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:30.188041 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-4d87f3b1-0c91-4134-a7b1-07b6b935f19a tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] HTTP exception thrown: Image not found. Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d87f3b1-0c91-4134-a7b1-07b6b935f19a tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Request method failure captured: Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/images/7ab1d5f7-c1c6-47fa-9452-bf722ae065421 HTTP/1.1 Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tgRcgQphsHwRKJCoiy9__aJboYtXiLaPQEMbAXA8b_Pa57dF0nnbLMrV8n3rprc-EwwRQtlaMV-542-sw9sytF3JIpSOOGJDXLRoo_z_YYg-Dhp__ghaOgHaUOHLcvVh2d8I_BjxuxbNDOnCPqMbpQmHi78sg-SxX7t6MnT-ZjOL_U Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:30.190184 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_46174b291ccf4b98bff3fd99bbe207b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 975674971c944823a47fce804a1c848c Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7ab1d5f7-c1c6-47fa-9452-bf722ae065421'} Aug 06 21:07:30.191553 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7ab1d5f7-c1c6-47fa-9452-bf722ae065421 to delete Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.192690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7ab1d5f7-c1c6-47fa-9452-bf722ae065421 could not be found. Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:30.193873 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:07:30.200250 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.204705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d87f3b1-0c91-4134-a7b1-07b6b935f19a tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:30.205818 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d87f3b1-0c91-4134-a7b1-07b6b935f19a tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] 10.222.0.33 "DELETE /compute/v2.1/images/7ab1d5f7-c1c6-47fa-9452-bf722ae065421" status: 404 len: 62 microversion: 2.1 time: 0.050413 Aug 06 21:07:30.206624 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1649/3208] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:07:30 2022] DELETE /compute/v2.1/images/7ab1d5f7-c1c6-47fa-9452-bf722ae065421 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:07:30.217685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f56066aa-1a82-4574-b336-74466f47aa38 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Calling method '.version_select at 0x7f729d550040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:30.255499 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-f56066aa-1a82-4574-b336-74466f47aa38 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] HTTP exception thrown: Image not found. Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f56066aa-1a82-4574-b336-74466f47aa38 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Request method failure captured: Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/images/tempest-invalid-966452573 HTTP/1.1 Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tgRcgQphsHwRKJCoiy9__aJboYtXiLaPQEMbAXA8b_Pa57dF0nnbLMrV8n3rprc-EwwRQtlaMV-542-sw9sytF3JIpSOOGJDXLRoo_z_YYg-Dhp__ghaOgHaUOHLcvVh2d8I_BjxuxbNDOnCPqMbpQmHi78sg-SxX7t6MnT-ZjOL_U Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:30.257522 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_46174b291ccf4b98bff3fd99bbe207b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 975674971c944823a47fce804a1c848c Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'tempest-invalid-966452573'} Aug 06 21:07:30.259623 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-966452573 to delete Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.260900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-966452573 could not be found. Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:30.263883 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f56066aa-1a82-4574-b336-74466f47aa38 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:30.267063 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f56066aa-1a82-4574-b336-74466f47aa38 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] 10.222.0.33 "DELETE /compute/v2.1/images/tempest-invalid-966452573" status: 404 len: 62 microversion: 2.1 time: 0.046144 Aug 06 21:07:30.271350 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1650/3209] 10.222.0.33 () {58 vars in 1203 bytes} [Sat Aug 6 21:07:30 2022] DELETE /compute/v2.1/images/tempest-invalid-966452573 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:07:30.278031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1a4e22f5-11bc-4d90-b0ed-19c2f383f888 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Calling method '.version_select at 0x7f729dc9b9d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:30.352759 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-1a4e22f5-11bc-4d90-b0ed-19c2f383f888 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] HTTP exception thrown: Image not found. Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1a4e22f5-11bc-4d90-b0ed-19c2f383f888 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Request method failure captured: Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/images/96ccb9f1-f442-4769-a518-d0e8b6ef306b HTTP/1.1 Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tgRcgQphsHwRKJCoiy9__aJboYtXiLaPQEMbAXA8b_Pa57dF0nnbLMrV8n3rprc-EwwRQtlaMV-542-sw9sytF3JIpSOOGJDXLRoo_z_YYg-Dhp__ghaOgHaUOHLcvVh2d8I_BjxuxbNDOnCPqMbpQmHi78sg-SxX7t6MnT-ZjOL_U Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:30.355314 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_46174b291ccf4b98bff3fd99bbe207b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/46174b291ccf4b98bff3fd99bbe207b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 46174b291ccf4b98bff3fd99bbe207b0 Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-441122432 Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 975674971c944823a47fce804a1c848c Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-441122432-project Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: exception: Image not found. Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '96ccb9f1-f442-4769-a518-d0e8b6ef306b'} Aug 06 21:07:30.356848 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 96ccb9f1-f442-4769-a518-d0e8b6ef306b to delete Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.357684 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 96ccb9f1-f442-4769-a518-d0e8b6ef306b could not be found. Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:30.358921 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 06 21:07:30.360113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:30.363981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1a4e22f5-11bc-4d90-b0ed-19c2f383f888 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] Returning 404 to user: Image not found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:30.365065 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1a4e22f5-11bc-4d90-b0ed-19c2f383f888 tempest-ImagesDeleteNegativeTestJSON-441122432 tempest-ImagesDeleteNegativeTestJSON-441122432-project] 10.222.0.33 "DELETE /compute/v2.1/images/96ccb9f1-f442-4769-a518-d0e8b6ef306b" status: 404 len: 62 microversion: 2.1 time: 0.092583 Aug 06 21:07:30.376673 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1651/3210] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:30 2022] DELETE /compute/v2.1/images/96ccb9f1-f442-4769-a518-d0e8b6ef306b => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:07:30.585732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:30.587356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:30.609735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:30.610171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:30.611679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:30.612938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:30.613754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:30.614862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:30.703818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:30.722387 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bfa3ba93-167e-404f-979d-0056441d4019 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1515 microversion: 2.1 time: 0.825434 Aug 06 21:07:30.725310 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1560/3211] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:29 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1515 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:30.793596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:30.794517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:30.809111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:30.812315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:30.814123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:30.817926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:30.818876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:30.820105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:30.973020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:30.991430 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a468255b-2571-462f-a678-f316d47b0014 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1502 microversion: 2.1 time: 0.411136 Aug 06 21:07:30.993873 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1652/3212] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:30 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1502 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:31.003419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:31.004283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:31.016473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:31.016974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:31.017594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:31.018473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:31.019629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:31.020290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:31.020736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:31.038686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:31.041707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:31.043434 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-db2b30be-0125-4a50-b2bd-1ca52b3cfee9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.263275 Aug 06 21:07:31.062075 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1561/3213] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:30 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:31.082901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2fde72ef-394e-49e5-9e9a-72b10a277457 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d2169d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:31.157813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:31.171571 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d4305c2e-40f2-4b70-a54c-36d3f39dfb8a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1260 microversion: 2.1 time: 0.174826 Aug 06 21:07:31.174060 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1653/3214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:30 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:31.178442 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2fde72ef-394e-49e5-9e9a-72b10a277457 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.109010 Aug 06 21:07:31.186802 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1562/3215] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:31 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:32.045217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:32.047041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:32.061507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:32.086645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:32.088717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:32.108104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:32.110100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:32.118588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:32.132233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:32.132702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:32.214392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:32.229811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:32.230468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:32.232857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:32.247158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:32.247704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:32.523896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:32.542375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:32.546462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:32.550373 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-84f77ae3-f1de-4ea0-ab68-b47624ebf623 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.454704 Aug 06 21:07:32.553354 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1563/3216] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:32 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:32.564326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:32.568629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:32.581353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:32.581860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:32.582302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:32.587527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:32.590042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:32.596314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:32.701019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:32.719344 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c62a95b3-72bf-4055-93df-c91a57a35948 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1502 microversion: 2.1 time: 0.708436 Aug 06 21:07:32.730686 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1654/3217] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:32 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1502 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:32.730686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-caee5875-27e0-4aa9-a351-43d1076938f7 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dacee50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:32.832273 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-caee5875-27e0-4aa9-a351-43d1076938f7 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.111140 Aug 06 21:07:32.833720 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1655/3218] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:32 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:32.863205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:32.871828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:32.890488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:32.893145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:32.895871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:32.899246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:32.899997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:32.901092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:32.974530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lazy-loading 'flavor' on Instance uuid 13d43d45-c3b6-44b0-8241-b8ff218d15d4 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:33.187039 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-70416a0c-41b7-4064-8fd7-1793728ac0cf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action" status: 200 len: 32 microversion: 2.1 time: 0.351240 Aug 06 21:07:33.203473 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1656/3219] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:07:32 2022] POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:07:33.225966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:33.227918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:33.245240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:33.246148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:33.247600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:33.250854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:33.251558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:33.254752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:33.890160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:33.898501 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bd5f883e-888a-47cf-91ba-b223632d6a97 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1308 microversion: 2.1 time: 1.342738 Aug 06 21:07:33.911023 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1564/3220] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:32 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1308 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:33.928112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:33.929309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:33.948839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:33.950810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:33.951285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:33.952032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:33.955400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:33.956158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:34.103600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:34.109808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:34.119731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:34.120067 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ebcaf1e1-bda8-4c12-bcd7-76795e7e6f8e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.913338 Aug 06 21:07:34.120865 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1657/3221] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:33 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:34.134508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:34.135381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:34.140665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:34.142332 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0bb4805b-c189-4f44-b50e-ed41108ef1c6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.230219 Aug 06 21:07:34.143452 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1565/3222] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:33 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:34.149283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:34.149783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:34.150231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:34.156449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:34.157165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:34.157834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:34.375258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f936636f-df9b-492e-b01e-8a790ce87a9e tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Action: 'create', calling method: .version_select at 0x7f729d23a8b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ9/mtqLlMj09X9GokaWiGYUKCcG0GRO4axu9nk7Umax4SSdKA1jPH0hKdVwCgGO9ppGxM+j3UGXCCVHG9KwcVLe+0GbSPQDz5pesUtZkwUbZwT0hZHmfnwQNGYkl3IOQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f936636f-df9b-492e-b01e-8a790ce87a9e tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Request method failure captured: Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 257 Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tgVcdoNR8pkMSvtH9Pcx9Zo887MEbDb7IhBX_2cVF6Gz2oWDYhJsDVd3LLq3XPqHCREBIrjFoeHlu5xfkWZyVfHtQOrSOfiYA3YGUfTdomQxIT9ur21UztPJNCJPVOohRPB5Ra1Y57n1w4IbsKmLzO3ZBs7yrX-PT5dla2isIP6JAc Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:34.379737 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_adb095f83ef34d36bbb3604853edc50a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:07:34.381130 ncdv-master-1 devstack@n-api.service[142462]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ9/mtqLlMj09X9GokaWiGYUKCcG0GRO4axu9nk7Umax4SSdKA1jPH0hKdVwCgGO9ppGxM+j3UGXCCVHG9KwcVLe+0GbSPQDz5pesUtZkwUbZwT0hZHmfnwQNGYkl3IOQ=="}} Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ9/mtqLlMj09X9GokaWiGYUKCcG0GRO4axu9nk7Umax4SSdKA1jPH0hKdVwCgGO9ppGxM+j3UGXCCVHG9KwcVLe+0GbSPQDz5pesUtZkwUbZwT0hZHmfnwQNGYkl3IOQ=='}}} Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.382504 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:34.383841 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:07:34.385345 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:07:34.391262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 06 21:07:34.391262 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.393519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f936636f-df9b-492e-b01e-8a790ce87a9e tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:34.394711 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f936636f-df9b-492e-b01e-8a790ce87a9e tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.249962 Aug 06 21:07:34.395503 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1566/3223] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:07:34 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:07:34.401172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdd46e72-e11a-4185-a8ba-11dffbd55c63 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d23db80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:34.483238 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fdd46e72-e11a-4185-a8ba-11dffbd55c63 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.086395 Aug 06 21:07:34.483821 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1567/3224] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:34 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:34.499986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8602f75f-254c-42c7-ab59-18b59dab9692 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Action: 'create', calling method: .version_select at 0x7f729d07e0d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-853467545", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:34.535776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-8602f75f-254c-42c7-ab59-18b59dab9692 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:34.544282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-8602f75f-254c-42c7-ab59-18b59dab9692 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for user e8ee2d63b9e142bcb53571239367c1f4 and project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:34.547852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:34.569481 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-8602f75f-254c-42c7-ab59-18b59dab9692 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8602f75f-254c-42c7-ab59-18b59dab9692 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Request method failure captured: Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 2166 Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tgVcdoNR8pkMSvtH9Pcx9Zo887MEbDb7IhBX_2cVF6Gz2oWDYhJsDVd3LLq3XPqHCREBIrjFoeHlu5xfkWZyVfHtQOrSOfiYA3YGUfTdomQxIT9ur21UztPJNCJPVOohRPB5Ra1Y57n1w4IbsKmLzO3ZBs7yrX-PT5dla2isIP6JAc Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_adb095f83ef34d36bbb3604853edc50a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-853467545", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:07:34.598061 ncdv-master-1 devstack@n-api.service[142462]: exception: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-853467545', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:34.600717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:34.604869 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.606685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:34.614502 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-baa9f5f9-350b-4d83-817e-f25a97b2c394 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 200 len: 1502 microversion: 2.1 time: 0.480927 Aug 06 21:07:34.615552 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1658/3225] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:34 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 1502 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:34.623319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8602f75f-254c-42c7-ab59-18b59dab9692 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:34.628648 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8602f75f-254c-42c7-ab59-18b59dab9692 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.138941 Aug 06 21:07:34.631313 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1568/3226] 10.222.0.33 () {60 vars in 1160 bytes} [Sat Aug 6 21:07:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:34.653898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98d25814-3f68-4058-a7e0-4e05519e9dda tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Action: 'create', calling method: .version_select at 0x7f729d5a4940>, body: {"keypair": {"name": "tempest-keypair-1455340818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6jMIn6hXHfidiPW8Fs/wPDEwg95ynTUyUaVj2dJyqUWVOOQPjjvcaj3C19kSnFQ5vMbmAG/T0uYaq0ye2/03u90MbWABoOihzrwTXPxTC/9WYmZ7m7etP/qhCxoxTS8A=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:34.723732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-98d25814-3f68-4058-a7e0-4e05519e9dda tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:34.734431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-98d25814-3f68-4058-a7e0-4e05519e9dda tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for user e8ee2d63b9e142bcb53571239367c1f4 and project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:34.797509 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-98d25814-3f68-4058-a7e0-4e05519e9dda tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155889 Aug 06 21:07:34.798442 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1659/3227] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:07:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:34.812683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7e187a3d-de33-4c90-8d04-63e5a41386e4 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Action: 'create', calling method: .version_select at 0x7f729d23ddc0>, body: {"keypair": {"name": "tempest-keypair-1455340818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLDce/ytuqyZJCbLR785ergcWiOOuybKXw39PekhBtU2AENJwgxZ1SINocD5DFfqrYAAzJCZmRzX+hM8QGyXZYlmuWpqQcOtjkCWp+u/jwvZ8SpK3vADyFB4VtDPa0kEQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:34.854949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7e187a3d-de33-4c90-8d04-63e5a41386e4 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:34.875971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7e187a3d-de33-4c90-8d04-63e5a41386e4 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for user e8ee2d63b9e142bcb53571239367c1f4 and project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:34.929619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:34.931429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:34.940993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:34.942701 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-7e187a3d-de33-4c90-8d04-63e5a41386e4 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] HTTP exception thrown: Key pair 'tempest-keypair-1455340818' already exists. Aug 06 21:07:34.945710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:34.946414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:34.947438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:34.948171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:34.948827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7e187a3d-de33-4c90-8d04-63e5a41386e4 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Request method failure captured: Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 273 Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tgVcdoNR8pkMSvtH9Pcx9Zo887MEbDb7IhBX_2cVF6Gz2oWDYhJsDVd3LLq3XPqHCREBIrjFoeHlu5xfkWZyVfHtQOrSOfiYA3YGUfTdomQxIT9ur21UztPJNCJPVOohRPB5Ra1Y57n1w4IbsKmLzO3ZBs7yrX-PT5dla2isIP6JAc Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_adb095f83ef34d36bbb3604853edc50a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: {"keypair": {"name": "tempest-keypair-1455340818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLDce/ytuqyZJCbLR785ergcWiOOuybKXw39PekhBtU2AENJwgxZ1SINocD5DFfqrYAAzJCZmRzX+hM8QGyXZYlmuWpqQcOtjkCWp+u/jwvZ8SpK3vADyFB4VtDPa0kEQ=="}} Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: exception: Key pair 'tempest-keypair-1455340818' already exists. Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1455340818', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLDce/ytuqyZJCbLR785ergcWiOOuybKXw39PekhBtU2AENJwgxZ1SINocD5DFfqrYAAzJCZmRzX+hM8QGyXZYlmuWpqQcOtjkCWp+u/jwvZ8SpK3vADyFB4VtDPa0kEQ=='}}} Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result.read() Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'e8ee2d63b9e142bcb53571239367c1f4-tempest-keypair-1455340818' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 06 21:07:34.958073 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi session.flush() Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result.read() Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 06 21:07:34.965004 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'e8ee2d63b9e142bcb53571239367c1f4-tempest-keypair-1455340818' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 6, 21, 7, 34, 911504), 'updated_at': None, 'name': 'tempest-keypair-1455340818', 'user_id': 'e8ee2d63b9e142bcb53571239367c1f4', 'fingerprint': '92:02:27:92:32:2a:f8:2a:37:b0:6a:11:14:50:c1:75', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLDce/ytuqyZJCbLR785ergcWiOOuybKXw39PekhBtU2AENJwgxZ1SINocD5DFfqrYAAzJCZmRzX+hM8QGyXZYlmuWpqQcOtjkCWp+u/jwvZ8SpK3vADyFB4VtDPa0kEQ==', 'type': 'ssh'}] Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi keypair.create() Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._create() Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1455340818' already exists. Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 06 21:07:34.973029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1455340818' already exists. Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1455340818' already exists. Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:34.983936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7e187a3d-de33-4c90-8d04-63e5a41386e4 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Returning 409 to user: Key pair 'tempest-keypair-1455340818' already exists. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:34.986980 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7e187a3d-de33-4c90-8d04-63e5a41386e4 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.170315 Aug 06 21:07:34.987910 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1569/3228] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:07:34 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:07:35.004251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-44680114-a4a3-4d82-a144-f323456b66b3 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Calling method '.version_select at 0x7f729d23d820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:35.047584 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-44680114-a4a3-4d82-a144-f323456b66b3 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455340818" status: 202 len: 0 microversion: 2.1 time: 0.055387 Aug 06 21:07:35.048732 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1570/3229] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455340818 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:07:35.062027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c220f50f-6f6d-478c-94fa-dd6652ed2b67 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Action: 'create', calling method: .version_select at 0x7f729d31c3a0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHcSP4SO753u0zwVunk4jAUnPBmiBK2wRZ3+QK17amdcdveqnwwyQow7gNw+lkCVoISUA+FS5fKmSJhys2PrmxZhm2D54hW/pOMCu7rO+DLocLEMFIfPqaaYDY2PIMnQw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c220f50f-6f6d-478c-94fa-dd6652ed2b67 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Request method failure captured: Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 247 Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tgVcdoNR8pkMSvtH9Pcx9Zo887MEbDb7IhBX_2cVF6Gz2oWDYhJsDVd3LLq3XPqHCREBIrjFoeHlu5xfkWZyVfHtQOrSOfiYA3YGUfTdomQxIT9ur21UztPJNCJPVOohRPB5Ra1Y57n1w4IbsKmLzO3ZBs7yrX-PT5dla2isIP6JAc Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_adb095f83ef34d36bbb3604853edc50a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHcSP4SO753u0zwVunk4jAUnPBmiBK2wRZ3+QK17amdcdveqnwwyQow7gNw+lkCVoISUA+FS5fKmSJhys2PrmxZhm2D54hW/pOMCu7rO+DLocLEMFIfPqaaYDY2PIMnQw=="}} Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHcSP4SO753u0zwVunk4jAUnPBmiBK2wRZ3+QK17amdcdveqnwwyQow7gNw+lkCVoISUA+FS5fKmSJhys2PrmxZhm2D54hW/pOMCu7rO+DLocLEMFIfPqaaYDY2PIMnQw=='}}} Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi '' Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:07:35.073057 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c220f50f-6f6d-478c-94fa-dd6652ed2b67 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c220f50f-6f6d-478c-94fa-dd6652ed2b67 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016438 Aug 06 21:07:35.077223 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1571/3230] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:07:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:07:35.085780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f45b55ca-9ad6-40b5-a625-931dd3027d91 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Action: 'create', calling method: .version_select at 0x7f729d204af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1503248391", "public_key": " "}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:35.105597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f45b55ca-9ad6-40b5-a625-931dd3027d91 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:35.113702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f45b55ca-9ad6-40b5-a625-931dd3027d91 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for user e8ee2d63b9e142bcb53571239367c1f4 and project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:35.167548 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-f45b55ca-9ad6-40b5-a625-931dd3027d91 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f45b55ca-9ad6-40b5-a625-931dd3027d91 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Request method failure captured: Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 95 Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tgVcdoNR8pkMSvtH9Pcx9Zo887MEbDb7IhBX_2cVF6Gz2oWDYhJsDVd3LLq3XPqHCREBIrjFoeHlu5xfkWZyVfHtQOrSOfiYA3YGUfTdomQxIT9ur21UztPJNCJPVOohRPB5Ra1Y57n1w4IbsKmLzO3ZBs7yrX-PT5dla2isIP6JAc Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_adb095f83ef34d36bbb3604853edc50a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1503248391", "public_key": " "}} Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: exception: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1503248391', 'public_key': ' '}}} Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:35.169982 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f45b55ca-9ad6-40b5-a625-931dd3027d91 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f45b55ca-9ad6-40b5-a625-931dd3027d91 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.091367 Aug 06 21:07:35.174119 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1572/3231] 10.222.0.33 () {60 vars in 1158 bytes} [Sat Aug 6 21:07:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:35.183141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:35.184990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:35.195447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:35.196241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:35.196913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:35.198032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:35.198784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:35.199396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:35.551101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:35.560348 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-be38e165-e6f9-4cca-8a36-499af698fbab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.384573 Aug 06 21:07:35.560939 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1573/3232] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:35 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:35.576695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-217107b0-fb1d-4750-8938-2ffc30532b71 req-b9c11e03-5aa9-4826-984a-ff2bba6a2a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74b595a-db9a-40e0-9a72-2a164c7f5d53", "name": "network-vif-deleted", "tag": "7f455bb7-e8f8-4307-967c-5849a7c26693"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:35.590576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-217107b0-fb1d-4750-8938-2ffc30532b71 req-b9c11e03-5aa9-4826-984a-ff2bba6a2a68 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:35.591085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-217107b0-fb1d-4750-8938-2ffc30532b71 req-b9c11e03-5aa9-4826-984a-ff2bba6a2a68 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:35.591532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-217107b0-fb1d-4750-8938-2ffc30532b71 req-b9c11e03-5aa9-4826-984a-ff2bba6a2a68 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:35.605403 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-217107b0-fb1d-4750-8938-2ffc30532b71 req-b9c11e03-5aa9-4826-984a-ff2bba6a2a68 service nova] Creating event network-vif-deleted:7f455bb7-e8f8-4307-967c-5849a7c26693 for instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 on nch2-master-1 Aug 06 21:07:35.612604 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-217107b0-fb1d-4750-8938-2ffc30532b71 req-b9c11e03-5aa9-4826-984a-ff2bba6a2a68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050364 Aug 06 21:07:35.618231 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1574/3233] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:35.623507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:35.624385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:35.632542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:35.635002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:35.635002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:35.635002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:35.635002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:35.635404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:35.753883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:35.757485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:35.769615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:35.772084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:35.775298 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c3f8c1bc-a2f1-4367-b681-d842d2c94f0d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.156017 Aug 06 21:07:35.790892 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1575/3234] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:35 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:35.798807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2720da84-a028-4f8b-9e33-f0a9c7a44842 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Action: 'create', calling method: .version_select at 0x7f729d23d280>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQAWAxrPId97V+j98ytT27CGWd/VyXjMJblSvnJ1rJi3XFS5bzhHWhJFkZu6xFcIsVaMg7xtLrAzk+nHpSHq5bkH/G6bLCx03RpFdT0q+mi5A1lDarEA7S4l41qCZN1EA=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2720da84-a028-4f8b-9e33-f0a9c7a44842 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Request method failure captured: Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 507 Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tgVcdoNR8pkMSvtH9Pcx9Zo887MEbDb7IhBX_2cVF6Gz2oWDYhJsDVd3LLq3XPqHCREBIrjFoeHlu5xfkWZyVfHtQOrSOfiYA3YGUfTdomQxIT9ur21UztPJNCJPVOohRPB5Ra1Y57n1w4IbsKmLzO3ZBs7yrX-PT5dla2isIP6JAc Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_adb095f83ef34d36bbb3604853edc50a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQAWAxrPId97V+j98ytT27CGWd/VyXjMJblSvnJ1rJi3XFS5bzhHWhJFkZu6xFcIsVaMg7xtLrAzk+nHpSHq5bkH/G6bLCx03RpFdT0q+mi5A1lDarEA7S4l41qCZN1EA=="}} Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQAWAxrPId97V+j98ytT27CGWd/VyXjMJblSvnJ1rJi3XFS5bzhHWhJFkZu6xFcIsVaMg7xtLrAzk+nHpSHq5bkH/G6bLCx03RpFdT0q+mi5A1lDarEA7S4l41qCZN1EA=='}}} Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 06 21:07:35.804922 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 06 21:07:35.807972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:35.812506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2720da84-a028-4f8b-9e33-f0a9c7a44842 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:35.813998 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2720da84-a028-4f8b-9e33-f0a9c7a44842 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.024814 Aug 06 21:07:35.816451 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1576/3235] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:07:35 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:07:35.822468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8ea1cd68-c9cc-4454-b197-b664a1b1f171 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d1c35e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:35.917789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:35.941013 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6ef5be34-d188-4243-9d36-99610f5ef7a8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1308 microversion: 2.1 time: 1.017397 Aug 06 21:07:35.941651 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1660/3236] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:34 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1308 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:35.968489 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8ea1cd68-c9cc-4454-b197-b664a1b1f171 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.144523 Aug 06 21:07:35.969184 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1577/3237] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:35 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:35.983709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:35.984341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:35.994435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14930f1a-68ca-4c1d-bd75-404cf4a4b4c3 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Action: 'create', calling method: .version_select at 0x7f729d1a5af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-427337287", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:36.011118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:36.011614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:36.011971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:36.018747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:36.019876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:36.021415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:36.044707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-14930f1a-68ca-4c1d-bd75-404cf4a4b4c3 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:36.054129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-14930f1a-68ca-4c1d-bd75-404cf4a4b4c3 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Getting quotas for user e8ee2d63b9e142bcb53571239367c1f4 and project adb095f83ef34d36bbb3604853edc50a. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:36.057860 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 HTTP/1.1 Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'a74b595a-db9a-40e0-9a72-2a164c7f5d53'} Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:36.061940 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.067690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.067690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:36.067690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:36.067690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:36.067690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:36.067690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:07:36.067690 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.072003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:36.073202 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-60f4f745-f7e8-49b6-81c5-15c1064fd1e5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 404 len: 111 microversion: 2.1 time: 0.123491 Aug 06 21:07:36.078107 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1661/3238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:35 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:36.083495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-af451d21-ba6a-4d90-8985-a499b9aab9bf req-f9e030be-0b56-4c80-952f-08a58326ee91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cbd6244-6ccb-4ab4-9291-4b0cb23369d2", "tag": "533c8f7a-31e3-43e3-847a-d4fab91f391b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:36.127857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-af451d21-ba6a-4d90-8985-a499b9aab9bf req-f9e030be-0b56-4c80-952f-08a58326ee91 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:36.133296 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-14930f1a-68ca-4c1d-bd75-404cf4a4b4c3 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:36.134288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-af451d21-ba6a-4d90-8985-a499b9aab9bf req-f9e030be-0b56-4c80-952f-08a58326ee91 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:36.134858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-af451d21-ba6a-4d90-8985-a499b9aab9bf req-f9e030be-0b56-4c80-952f-08a58326ee91 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14930f1a-68ca-4c1d-bd75-404cf4a4b4c3 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Request method failure captured: Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 117 Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tgVcdoNR8pkMSvtH9Pcx9Zo887MEbDb7IhBX_2cVF6Gz2oWDYhJsDVd3LLq3XPqHCREBIrjFoeHlu5xfkWZyVfHtQOrSOfiYA3YGUfTdomQxIT9ur21UztPJNCJPVOohRPB5Ra1Y57n1w4IbsKmLzO3ZBs7yrX-PT5dla2isIP6JAc Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_adb095f83ef34d36bbb3604853edc50a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-427337287", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: exception: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-427337287', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 06 21:07:36.149550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.153779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14930f1a-68ca-4c1d-bd75-404cf4a4b4c3 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:36.158926 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-14930f1a-68ca-4c1d-bd75-404cf4a4b4c3 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.175656 Aug 06 21:07:36.161791 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1578/3239] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:07:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 21:07:36.184347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f993ee7a-521a-468b-9d93-4b214641ca56 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Calling method '.version_select at 0x7f729d1c3d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:36.187283 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-af451d21-ba6a-4d90-8985-a499b9aab9bf req-f9e030be-0b56-4c80-952f-08a58326ee91 service nova] Creating event network-changed:533c8f7a-31e3-43e3-847a-d4fab91f391b for instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 on nch1-master-1 Aug 06 21:07:36.203427 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-af451d21-ba6a-4d90-8985-a499b9aab9bf req-f9e030be-0b56-4c80-952f-08a58326ee91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122617 Aug 06 21:07:36.206044 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1662/3240] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:36.236974 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-f993ee7a-521a-468b-9d93-4b214641ca56 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1542497187 not found for user e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f993ee7a-521a-468b-9d93-4b214641ca56 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Request method failure captured: Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1542497187 HTTP/1.1 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tgVcdoNR8pkMSvtH9Pcx9Zo887MEbDb7IhBX_2cVF6Gz2oWDYhJsDVd3LLq3XPqHCREBIrjFoeHlu5xfkWZyVfHtQOrSOfiYA3YGUfTdomQxIT9ur21UztPJNCJPVOohRPB5Ra1Y57n1w4IbsKmLzO3ZBs7yrX-PT5dla2isIP6JAc Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_adb095f83ef34d36bbb3604853edc50a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/adb095f83ef34d36bbb3604853edc50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: adb095f83ef34d36bbb3604853edc50a Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-748961130 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-748961130-project Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: exception: Keypair tempest-keypair-non-existent-1542497187 not found for user e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'tempest-keypair-non-existent-1542497187'} Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise self.value Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1542497187 not found for user e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.240632 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1542497187 not found for user e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1542497187 not found for user e8ee2d63b9e142bcb53571239367c1f4 Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:36.245230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f993ee7a-521a-468b-9d93-4b214641ca56 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1542497187 not found for user e8ee2d63b9e142bcb53571239367c1f4 {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:36.260397 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f993ee7a-521a-468b-9d93-4b214641ca56 tempest-KeyPairsNegativeTestJSON-748961130 tempest-KeyPairsNegativeTestJSON-748961130-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1542497187" status: 404 len: 145 microversion: 2.1 time: 0.076223 Aug 06 21:07:36.261070 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1579/3241] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:07:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1542497187 => generated 145 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:36.329991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-315794522", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5c00ae50-9c12-446f-a3fc-256b5e473c43"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:36.502059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] validate_networks() for [('5c00ae50-9c12-446f-a3fc-256b5e473c43', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:07:36.582688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:36.583887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:36.598212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:36.602983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:36.603930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:36.605133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:36.605822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:36.608349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:36.920046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:36.941058 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dc9fcce8-8e45-4dae-9cfb-c6f6a00fb33f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.363377 Aug 06 21:07:36.956718 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1580/3242] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:36 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:36.964450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:36.980356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:37.008833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:37.010369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:37.011029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:37.012000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:37.012664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:37.013327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:37.122047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:37.131405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:37.133649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:37.135162 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a1afd34e-f87a-45f6-926a-e59cade397a2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.177330 Aug 06 21:07:37.137028 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1581/3243] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:36 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:37.160318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:37.162081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:37.171849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:37.172791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:37.173450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:37.175280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:37.175965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:37.177132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:37.494108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:37.502502 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e465aad3-c3fd-492c-a7a7-d8899a4137ee tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1308 microversion: 2.1 time: 0.346793 Aug 06 21:07:37.511438 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1582/3244] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:37 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:37.516053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-54e1e7c3-164a-4f80-8ce3-a394785553b3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d23a550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:37.581728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:07:37.583933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:07:37.586200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:07:37.587755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:07:37.589191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:07:37.599934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:37.604172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:37.604906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:37.605024 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-54e1e7c3-164a-4f80-8ce3-a394785553b3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.092307 Aug 06 21:07:37.606023 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1583/3245] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:37 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:37.606316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:37.606995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:37.607582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:37.636167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:37.644970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for user bdf1b5180a814cf39234892c6c1f26df and project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:37.673797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:07:37.676675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:07:37.752735 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-330c5cda-c3b3-4d83-b5e0-46e0c9c13d99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427072 Aug 06 21:07:37.762194 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1663/3246] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:07:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:07:37.766601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a046d2b0-6260-47aa-9a71-55d1b75f8c74 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:37.767197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a046d2b0-6260-47aa-9a71-55d1b75f8c74 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:37.890586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a046d2b0-6260-47aa-9a71-55d1b75f8c74 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:37.922409 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a046d2b0-6260-47aa-9a71-55d1b75f8c74 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1214 microversion: 2.1 time: 0.159689 Aug 06 21:07:37.943711 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1584/3247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:37 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:37.968285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:37.968903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:37.996193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:38.000483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:38.001379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:38.008088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:38.008817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:38.009582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:38.019483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:38.160461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:38.161094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:38.180860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:38.181371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:38.181819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:38.182581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:38.189685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:38.190156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:38.221798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:38.232708 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a7ff1bc4-fc5e-436e-9250-3d1b78a12123 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.267854 Aug 06 21:07:38.234094 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1664/3248] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:37 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:38.371708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:38.398451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:38.402664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:38.406926 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-95783fbc-de74-4ff3-a55c-18d19e05cabd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.248935 Aug 06 21:07:38.422574 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1585/3249] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:38 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:38.531448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:38.532065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:38.541252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:38.541734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:38.542173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:38.543945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:38.544411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:38.544847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:38.623940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ba780aa0-6608-4adb-b2f6-187bbd0d31a6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d23d790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:38.733802 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ba780aa0-6608-4adb-b2f6-187bbd0d31a6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.115940 Aug 06 21:07:38.735251 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1586/3250] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:38 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:38.920586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:38.940686 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65fcf07f-59fb-44b7-bd3d-41624612c246 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1308 microversion: 2.1 time: 0.412036 Aug 06 21:07:38.964562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:38.965620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:38.972986 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1665/3251] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:38 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:38.979605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:38.980983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:38.981901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:38.983302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:38.984961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:38.985665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:39.145482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:39.158860 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3ee04ae1-c0a4-4dd4-b1aa-e4214fbb803c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1210 microversion: 2.1 time: 0.200434 Aug 06 21:07:39.163320 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1587/3252] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:38 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1210 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:39.257067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:39.257789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:39.268432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:39.269605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:39.270258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:39.275762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:39.276279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:39.276741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:39.465369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1962863090", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": "none"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:39.579585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:39.590781 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99df6e57-8181-4a7b-ba07-a1ac458a77f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.337813 Aug 06 21:07:39.604141 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1588/3253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:39 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:39.604360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:07:39.604360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:07:39.604360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:07:39.604360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:07:39.604360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:07:39.604758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:39.604758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:39.606615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:39.607738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:39.608358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:39.609512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:39.610191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:39.610803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:39.629126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:39.629971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:39.630426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:39.631204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:39.631699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:39.635578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:39.676909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Getting quotas for project a6d936b54a5842938a3efb3f6aec12aa. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:39.692716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Getting quotas for user 202b371f27b1434184f9be6970abe9db and project a6d936b54a5842938a3efb3f6aec12aa. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:39.729096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:07:39.732759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:07:39.824499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:39.837234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:39.837757 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3664e87f-37a9-4a42-9a1c-a7484e7e3832 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.639122 Aug 06 21:07:39.838937 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1666/3254] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 21:07:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:07:39.842831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:39.845605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6e94043-a382-4e16-9724-c0ea3a995bcb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d58edc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:39.847639 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-66212160-0ff6-4353-a55d-c2fa50f56ea6 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.253940 Aug 06 21:07:39.866343 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1589/3255] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:39 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:39.877392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bc55262-e7cc-42f6-b400-a2d299ac626c tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:39.878293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2bc55262-e7cc-42f6-b400-a2d299ac626c tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:39.904262 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d6e94043-a382-4e16-9724-c0ea3a995bcb tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1455 microversion: 2.1 time: 0.063967 Aug 06 21:07:39.905125 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1667/3256] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:39 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:40.090742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-641f651a-7d5f-4aff-b51b-f723956a4b34 tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Calling method '.version_select at 0x7f72a367d550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:40.124779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-641f651a-7d5f-4aff-b51b-f723956a4b34 tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:40.134298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-641f651a-7d5f-4aff-b51b-f723956a4b34 tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:40.135950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-641f651a-7d5f-4aff-b51b-f723956a4b34 tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:40.136863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-641f651a-7d5f-4aff-b51b-f723956a4b34 tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:40.137372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-641f651a-7d5f-4aff-b51b-f723956a4b34 tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:40.137793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-641f651a-7d5f-4aff-b51b-f723956a4b34 tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:40.159444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2bc55262-e7cc-42f6-b400-a2d299ac626c tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:40.170344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2bc55262-e7cc-42f6-b400-a2d299ac626c tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:40.177460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2bc55262-e7cc-42f6-b400-a2d299ac626c tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:40.181011 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2bc55262-e7cc-42f6-b400-a2d299ac626c tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 200 len: 1281 microversion: 2.47 time: 0.311896 Aug 06 21:07:40.183181 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1590/3257] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:39 2022] GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 1281 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:40.190041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:40.196212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:40.201419 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-641f651a-7d5f-4aff-b51b-f723956a4b34 tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.295020 Aug 06 21:07:40.213898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:40.214403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:40.217853 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1668/3258] 10.222.0.33 () {58 vars in 1122 bytes} [Sat Aug 6 21:07:39 2022] GET /compute/v2.1/limits => generated 511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:40.223679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:40.224318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:40.232439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:40.234504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:40.235404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:40.236016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:40.237543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:40.238530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:40.238740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:40.239349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:40.239662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:40.247836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:40.373142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:40.395993 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e84be73-67d5-43a1-8df8-e237154e790a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1272 microversion: 2.1 time: 0.175143 Aug 06 21:07:40.404705 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1669/3259] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:40 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:40.415958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0475ffa-dc59-47e0-b581-a3625b10c7af tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-716694785", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:40.530942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-b0475ffa-dc59-47e0-b581-a3625b10c7af tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:07:40.639410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:40.682974 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c41a644-7e10-4258-be78-bf1e38198d1e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1308 microversion: 2.1 time: 0.498219 Aug 06 21:07:40.683914 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1591/3260] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:40 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:40.713697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:40.719674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:40.733232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:40.736016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:40.737593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:40.740893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:40.741545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:40.742102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.019938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b0475ffa-dc59-47e0-b581-a3625b10c7af tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Getting quotas for project 2d3e740659b544daa4c0c148d11d3c20. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:41.027819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b0475ffa-dc59-47e0-b581-a3625b10c7af tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Getting quotas for user 8da2a3ff79cb443fb55f0ad75fe1023b and project 2d3e740659b544daa4c0c148d11d3c20. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:41.057680 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-b0475ffa-dc59-47e0-b581-a3625b10c7af tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0475ffa-dc59-47e0-b581-a3625b10c7af tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Request method failure captured: Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 1751 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tgbXl9WhfY4TTcfnJAPEF6_QaTsi0t0Qvw2NqxfTWr0zF_12yel4loitVjzub2h6AUCISu5jZZGStn2_51K0JjHuNd-RJlqLHuVspCqqz6Jkoi4zSHve_oxfnqysUaiTdygxperv4xJHoycUhT5oxuWfVR0FhFTkddq5z8LiPoMPm8 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 2d3e740659b544daa4c0c148d11d3c20 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1416428846 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2d3e740659b544daa4c0c148d11d3c20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2d3e740659b544daa4c0c148d11d3c20", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d3e740659b544daa4c0c148d11d3c20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2d3e740659b544daa4c0c148d11d3c20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1416428846 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 2d3e740659b544daa4c0c148d11d3c20 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1416428846 Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 8da2a3ff79cb443fb55f0ad75fe1023b Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-716694785", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:07:41.062304 ncdv-master-1 devstack@n-api.service[142461]: exception: Maximum number of metadata items exceeds 128 Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-716694785', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:41.064793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 06 21:07:41.067880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:41.070352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0475ffa-dc59-47e0-b581-a3625b10c7af tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:41.071411 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b0475ffa-dc59-47e0-b581-a3625b10c7af tempest-AbsoluteLimitsNegativeTestJSON-1416428846 tempest-AbsoluteLimitsNegativeTestJSON-1416428846-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.665374 Aug 06 21:07:41.072186 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1670/3261] 10.222.0.33 () {60 vars in 1148 bytes} [Sat Aug 6 21:07:40 2022] POST /compute/v2.1/servers => generated 87 bytes in 667 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:07:41.077900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:41.080282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:41.085387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:41.092402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.101583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.102765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.103473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.103961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.104523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.230299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:41.252994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:41.254856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:41.256100 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-823d1968-7c96-41e1-9d98-89f1fceaecb5 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.182722 Aug 06 21:07:41.257264 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1671/3262] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:41 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:41.264960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e7eebc5e-a5f7-413c-9020-8f00e970dd7d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d7789d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:41.334297 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e7eebc5e-a5f7-413c-9020-8f00e970dd7d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1464 microversion: 2.1 time: 0.075743 Aug 06 21:07:41.335503 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1672/3263] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:41 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1464 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:41.340180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:41.340802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:41.363441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.364099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.364569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.365441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.365955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.367170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.460705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:41.474002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:41.476375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:41.477927 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7c31cb05-ab9f-476a-a9fb-87f1b97d9e22 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 200 len: 1333 microversion: 2.47 time: 0.141236 Aug 06 21:07:41.478894 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1673/3264] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:41 2022] GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 1333 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:41.500685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d1306442-702f-46b3-b9f9-545c47056d2e tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d7c9310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:41.577912 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d1306442-702f-46b3-b9f9-545c47056d2e tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 200 len: 1464 microversion: 2.1 time: 0.097419 Aug 06 21:07:41.581910 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1674/3265] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:41 2022] GET /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 1464 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:41.598158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:41.598583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:41.601269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:41.609242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.611459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.611601 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-075322ed-aa30-444c-9d69-f1bfe3460d04 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.910238 Aug 06 21:07:41.611933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.612109 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1592/3266] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:40 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:41.613107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.613703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.614132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.640843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:41.641698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:41.660827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.661346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.661802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.662612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.663758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.664173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.868899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:41.879166 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c79b050a-9266-4966-9d3e-3b6cc6e83856 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.294644 Aug 06 21:07:41.899374 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1675/3267] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:41 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:41.905749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:41.906657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:41.915384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.916307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.917059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:41.918108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:41.919688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:41.920390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.063305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:42.074987 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bb3eeb25-094a-4a24-9a4b-a3c58aba9a03 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1481 microversion: 2.1 time: 0.453375 Aug 06 21:07:42.076438 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1593/3268] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:41 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1481 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:42.177613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:42.186826 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d17e982a-dfe4-4940-a965-30f6656da95a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1308 microversion: 2.1 time: 0.285890 Aug 06 21:07:42.199103 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1676/3269] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:41 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:42.280956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:42.282770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:42.290100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.290643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.291094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.292423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.292905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.293519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.377401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:42.386444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:42.388010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:42.389257 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3d22ed5e-d986-4db0-b392-ac5d5b1be04a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.112243 Aug 06 21:07:42.390004 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1594/3270] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:42 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:42.502492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:42.503138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:42.510612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.511375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.512045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.512962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.514286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.515660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.594116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:42.603177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:42.604632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:42.605790 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d64270d7-084d-4982-b5f2-b4cd734cc4fa tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 200 len: 1339 microversion: 2.47 time: 0.107141 Aug 06 21:07:42.606356 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1677/3271] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:42 2022] GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:42.637983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:42.639011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:42.651698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.652229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.652680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.653413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.653878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.654446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.763297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-82830fe0-9988-4885-9f06-aada87b07f68 req-758b72a4-05e0-4395-aed3-3f0352e1c945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e56ce1b1-ff27-4907-bc44-ccdc01f940bb", "tag": "a8b53510-3e4f-4ce0-a771-3c32a6c6ea78"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:42.780652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-82830fe0-9988-4885-9f06-aada87b07f68 req-758b72a4-05e0-4395-aed3-3f0352e1c945 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.781723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-82830fe0-9988-4885-9f06-aada87b07f68 req-758b72a4-05e0-4395-aed3-3f0352e1c945 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.786732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-82830fe0-9988-4885-9f06-aada87b07f68 req-758b72a4-05e0-4395-aed3-3f0352e1c945 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.801895 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-82830fe0-9988-4885-9f06-aada87b07f68 req-758b72a4-05e0-4395-aed3-3f0352e1c945 service nova] Creating event network-changed:a8b53510-3e4f-4ce0-a771-3c32a6c6ea78 for instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb on nch2-master-1 Aug 06 21:07:42.809753 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-82830fe0-9988-4885-9f06-aada87b07f68 req-758b72a4-05e0-4395-aed3-3f0352e1c945 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051309 Aug 06 21:07:42.811030 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1678/3272] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:42.862682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:42.877204 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d2ae2752-0522-4147-994e-59b2231176bf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.243424 Aug 06 21:07:42.890576 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1595/3273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:42 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:42.904152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:42.905122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:42.912087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.912674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.913279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.914164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.914656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.915085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:42.958377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c4154a7a-96cf-4d58-9574-aeddaa45a2ee req-27b5d580-8992-4e10-bbf5-8f8d444b53d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbd6244-6ccb-4ab4-9291-4b0cb23369d2", "name": "network-vif-plugged", "status": "completed", "tag": "533c8f7a-31e3-43e3-847a-d4fab91f391b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:42.974534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c4154a7a-96cf-4d58-9574-aeddaa45a2ee req-27b5d580-8992-4e10-bbf5-8f8d444b53d6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:42.976511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c4154a7a-96cf-4d58-9574-aeddaa45a2ee req-27b5d580-8992-4e10-bbf5-8f8d444b53d6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:42.977164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c4154a7a-96cf-4d58-9574-aeddaa45a2ee req-27b5d580-8992-4e10-bbf5-8f8d444b53d6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.014319 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c4154a7a-96cf-4d58-9574-aeddaa45a2ee req-27b5d580-8992-4e10-bbf5-8f8d444b53d6 service nova] Creating event network-vif-plugged:533c8f7a-31e3-43e3-847a-d4fab91f391b for instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 on nch1-master-1 Aug 06 21:07:43.021285 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c4154a7a-96cf-4d58-9574-aeddaa45a2ee req-27b5d580-8992-4e10-bbf5-8f8d444b53d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066535 Aug 06 21:07:43.022691 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1596/3274] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:43.077957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:43.087312 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6ed03bf7-1299-401b-a8d6-e82e90ec7655 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.187783 Aug 06 21:07:43.088224 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1679/3275] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:42 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:43.101490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:43.102696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:43.111025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.111672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.112744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.113902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.114664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.115212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.211319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:43.212839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:43.222937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.223699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.224255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.225693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.226324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.227125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.320305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:43.328297 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1a06a003-5e8d-4c4c-9519-0740ca46d097 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1468 microversion: 2.1 time: 0.232187 Aug 06 21:07:43.328892 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1597/3276] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:43 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1468 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:43.349487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7111db8d-58b5-47cd-87f4-d4718cd88599 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1671133343"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:43.352831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7111db8d-58b5-47cd-87f4-d4718cd88599 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:43.359545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7111db8d-58b5-47cd-87f4-d4718cd88599 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.360319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7111db8d-58b5-47cd-87f4-d4718cd88599 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.361042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7111db8d-58b5-47cd-87f4-d4718cd88599 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.361952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7111db8d-58b5-47cd-87f4-d4718cd88599 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.362608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7111db8d-58b5-47cd-87f4-d4718cd88599 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.363388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7111db8d-58b5-47cd-87f4-d4718cd88599 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.445682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:43.456374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6c3af299-0097-4697-b85a-a85eebfcf71c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1308 microversion: 2.1 time: 0.250690 Aug 06 21:07:43.457898 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1680/3277] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:43 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:43.471511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:43.474319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:43.487476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.495330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.495801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.496555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.497019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.497447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.624113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:43.629873 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7111db8d-58b5-47cd-87f4-d4718cd88599 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "POST /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4/action" status: 202 len: 0 microversion: 2.1 time: 0.274942 Aug 06 21:07:43.631960 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1598/3278] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:07:43 2022] POST /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 21:07:43.641802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:43.643690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:43.644729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:43.645198 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-44a813bb-8a1a-4707-8746-31a198cf488b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.186040 Aug 06 21:07:43.646641 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1681/3279] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:43 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:43.653882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-21d9013d-811a-4b11-ad1a-7c8751ca6034 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d58ef70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:43.655484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:43.663964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.665228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.665868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.666730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.667411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.668943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.721992 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-21d9013d-811a-4b11-ad1a-7c8751ca6034 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.073233 Aug 06 21:07:43.731538 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1682/3280] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:43 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:43.804660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:43.812147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:43.816440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:43.820149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:43.821556 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf9e5782-c32a-4bfc-bb6d-1add65a120e9 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 200 len: 1339 microversion: 2.47 time: 0.187824 Aug 06 21:07:43.822899 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1599/3281] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:43 2022] GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:43.900317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:43.900931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:43.907080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.907566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.908138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:43.908795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:43.909472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:43.909952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:44.109777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:44.110830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:44.119843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:44.120569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:44.121174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:44.122114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:44.122607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:44.123054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:44.158896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:44.183629 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e36db757-49e3-48c5-b337-b9b7fc00de61 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.286543 Aug 06 21:07:44.186734 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1683/3282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:43 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:44.370780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:44.381063 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f07a1b5f-7c65-4665-a1a1-7984c6ea8fc0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.275925 Aug 06 21:07:44.383666 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1600/3283] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:44 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:44.486351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:44.487035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:44.494393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:44.495532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:44.495532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:44.496103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:44.496700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:44.497134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:44.639414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:44.649919 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-00a5195a-1234-4753-9163-9965c0ef8b9e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1308 microversion: 2.1 time: 0.168283 Aug 06 21:07:44.650926 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1684/3284] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:44 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:44.684142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:44.685368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:44.693390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:44.694861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:44.695661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:44.696600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:44.697575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:44.698229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:44.741069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f6db43d-2d4e-4089-8a16-3b9c5655516a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d63f940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:44.795042 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f6db43d-2d4e-4089-8a16-3b9c5655516a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.058996 Aug 06 21:07:44.805456 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1685/3285] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:44 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:44.806049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:44.819525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:44.821486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:44.822999 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-74eba520-f0fb-4dd0-915d-95f63f11938b tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.145188 Aug 06 21:07:44.824266 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1601/3286] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:44 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:44.850852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:44.852126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:44.860346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:44.860951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:44.861500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:44.862293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:44.862875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:44.863659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:44.960747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:44.973974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:44.977082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:44.978626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e37d7d3-f2e7-4b67-98ee-b49ebe536431 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 200 len: 1360 microversion: 2.47 time: 0.134104 Aug 06 21:07:44.979741 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1686/3287] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:44 2022] GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 1360 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:45.005684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-321d540b-c27b-4df9-9a78-62bb6ad7ac43 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1252299967"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:45.009410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-321d540b-c27b-4df9-9a78-62bb6ad7ac43 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:45.020449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-321d540b-c27b-4df9-9a78-62bb6ad7ac43 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.021324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-321d540b-c27b-4df9-9a78-62bb6ad7ac43 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.022462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-321d540b-c27b-4df9-9a78-62bb6ad7ac43 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.023517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-321d540b-c27b-4df9-9a78-62bb6ad7ac43 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.024273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-321d540b-c27b-4df9-9a78-62bb6ad7ac43 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.024905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-321d540b-c27b-4df9-9a78-62bb6ad7ac43 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.208281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:45.209036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:45.219180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.220677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.223033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.225041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.227301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.227943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.308292 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-321d540b-c27b-4df9-9a78-62bb6ad7ac43 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "POST /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a/action" status: 202 len: 52 microversion: 2.47 time: 0.306321 Aug 06 21:07:45.309933 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1602/3288] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 21:07:44 2022] POST /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a/action => generated 52 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 06 21:07:45.323761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:45.330468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:45.343526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.344824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.345283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.347398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.348206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.349028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.384276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:07:45.418665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:45.426966 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a306e0f4-efd1-43b0-81d7-996e2ba012fe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.222872 Aug 06 21:07:45.438638 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1687/3289] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:45 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:45.447996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:45.449337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:45.462905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.464063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.464936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.466243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.467497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.468842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.494902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:45.504545 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-831cdc1f-122a-4e6f-a943-037fa8f81c0d tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 204 len: 0 microversion: 2.47 time: 0.184971 Aug 06 21:07:45.506030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1603/3290] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:07:45 2022] DELETE /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:07:45.516320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:45.517125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:45.528037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.528587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.529073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.529806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.530273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.530777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.639352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:45.652299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:45.654062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:45.655787 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f5b004ea-8498-41a0-8ab3-6683050dda17 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 200 len: 1366 microversion: 2.47 time: 0.144120 Aug 06 21:07:45.656996 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1604/3291] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:45 2022] GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:45.685395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:45.686016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:45.692349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.692862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.693305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.694601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.695088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.695622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.713315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:45.717763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:45.722627 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e7faf737-a4d7-4dae-9dc0-2a9903db6108 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.289317 Aug 06 21:07:45.735070 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1688/3292] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:45 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:45.833763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84605462-c89d-4dac-82fa-37e84f1792e0 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d5500d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:45.895584 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-84605462-c89d-4dac-82fa-37e84f1792e0 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.087138 Aug 06 21:07:45.896146 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1689/3293] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:45 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:45.900892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:45.901500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:45.907896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.908395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.909450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.910185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:45.910751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:45.911240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:45.980453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:45.988297 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36dbb3fe-edc0-48b7-8cda-1b16f4f38a3e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1489 microversion: 2.1 time: 0.306719 Aug 06 21:07:45.989094 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1605/3294] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:45 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1489 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:45.991958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:46.002885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:46.005537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:46.008182 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2493f8cb-d902-4eea-b05b-45904ce1e69a tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.110800 Aug 06 21:07:46.008959 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1690/3295] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:45 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:46.011831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:46.012449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:46.019745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.020226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.020667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.021383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.021896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.022331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.263917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:46.272112 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3ad82d02-f34b-4a10-b282-042ffcda6e10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1488 microversion: 2.1 time: 0.263770 Aug 06 21:07:46.272504 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1606/3296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:46 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1488 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:46.292191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:46.293154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:46.299243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.299847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.300384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.301181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.301761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.302299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.450390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:46.451140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:46.461556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.465116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.465653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.468657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.469230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.470451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.490476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:46.508009 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4998129d-1ccd-43f3-9f75-2f7713fe4650 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1489 microversion: 2.1 time: 0.220124 Aug 06 21:07:46.508624 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1691/3297] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:46 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1489 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:46.531750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:46.532198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:46.552578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.552942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.553442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.554240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.566804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.567618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.620855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:07:46.755867 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bdc5b796-e75c-4842-8d29-ba5ca32d2f9c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 204 len: 0 microversion: 2.1 time: 0.226507 Aug 06 21:07:46.757528 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1692/3298] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:07:46 2022] DELETE /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:07:46.770511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:46.772232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:46.783206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.784075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.784868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.786235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.787304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.788344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.819551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:46.830277 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f24f6437-3f48-4c78-b80a-cd00e82c31cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.384541 Aug 06 21:07:46.846582 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1607/3299] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:46 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:46.846582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:46.846582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:46.861354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.862283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.863060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.864852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.869394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.870386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.947027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:46.956646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:46.961835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:46.963837 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dfaecd2a-793c-4e7a-8218-cbb651d13783 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 200 len: 1366 microversion: 2.47 time: 0.205096 Aug 06 21:07:46.964959 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1693/3300] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:46 2022] GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:46.970171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:46.971083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:46.988553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.989551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.990234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:46.991350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:46.992051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:46.994026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:47.210976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:47.218713 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6fd18f5d-3a34-4ea3-9e38-19a6ac96bf94 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1495 microversion: 2.1 time: 0.252443 Aug 06 21:07:47.219301 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1694/3301] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:46 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1495 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:47.236163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5825a552-c9c0-4c0e-9751-77ea9b77aec6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a3468820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:47.264412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:47.279541 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-97a670bb-067e-4819-b285-b1e1a44294c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.444287 Aug 06 21:07:47.280434 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1608/3302] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:46 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:47.290722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:47.294039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:47.307498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:47.307998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:47.308443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:47.308936 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5825a552-c9c0-4c0e-9751-77ea9b77aec6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.087366 Aug 06 21:07:47.309160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:47.309519 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1695/3303] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:47 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:47.316818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:47.317283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:47.320539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-81be8d89-71f8-4b53-af6c-b94a3567b90d req-05b2f327-e679-4dad-badf-605d59c4014c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032e6b85-4ab1-4fed-818b-e3893ebc09c8", "name": "network-vif-unplugged", "status": "completed", "tag": "700bbba7-9867-4e5a-b588-1da283ca9b16"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:47.335797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-81be8d89-71f8-4b53-af6c-b94a3567b90d req-05b2f327-e679-4dad-badf-605d59c4014c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:47.337563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-81be8d89-71f8-4b53-af6c-b94a3567b90d req-05b2f327-e679-4dad-badf-605d59c4014c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:47.339589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-81be8d89-71f8-4b53-af6c-b94a3567b90d req-05b2f327-e679-4dad-badf-605d59c4014c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:47.367941 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-81be8d89-71f8-4b53-af6c-b94a3567b90d req-05b2f327-e679-4dad-badf-605d59c4014c service nova] Creating event network-vif-unplugged:700bbba7-9867-4e5a-b588-1da283ca9b16 for instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 on nch1-master-1 Aug 06 21:07:47.376277 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-81be8d89-71f8-4b53-af6c-b94a3567b90d req-05b2f327-e679-4dad-badf-605d59c4014c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065142 Aug 06 21:07:47.377045 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1696/3304] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:47.425339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:47.435851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:47.437625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:47.439077 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ebab8c9f-22a7-4973-a9c0-a427101d4ec9 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.157518 Aug 06 21:07:47.439869 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1609/3305] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:47 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:47.876901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:47.879197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:47.889896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:47.890709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:47.891848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:47.892801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:47.893442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:47.894146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:48.009896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:48.010537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:48.022256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:48.029481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:48.030224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:48.031206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:48.031831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:48.032467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:48.112269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:48.122243 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d44b2688-4f50-41a8-816d-eec6100dec28 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.250800 Aug 06 21:07:48.124007 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1697/3306] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:47 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:48.158739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:48.174515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:48.176093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202b371f27b1434184f9be6970abe9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d936b54a5842938a3efb3f6aec12aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:48.177388 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9e71a5ac-fa1e-4d69-a977-3252dd7813f3 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 200 len: 1366 microversion: 2.47 time: 0.174443 Aug 06 21:07:48.179185 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1610/3307] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:48 2022] GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:48.240255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:48.241441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:48.249135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:48.249903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:48.250619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:48.251544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:48.252084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:48.258516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:48.302321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:48.304101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:48.315413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:48.317305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:48.318006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:48.319951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:48.325882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:48.326744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:48.517921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:48.527823 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eb0bd2ed-7b54-4300-a9d0-0daaceca622d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1495 microversion: 2.1 time: 0.291792 Aug 06 21:07:48.541945 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1698/3308] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:48 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1495 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:48.554948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0208a007-2f13-4eb6-a98e-4bd680af6a40 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d785a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:48.613829 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0208a007-2f13-4eb6-a98e-4bd680af6a40 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.083641 Aug 06 21:07:48.615100 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1699/3309] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:48 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:48.660210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:48.665551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:48.677345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:48.679249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:48.681739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:48.687479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:48.694616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:48.697048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:48.807011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:48.822691 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eb119de4-e007-4000-8b59-55d13fe3d0e2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.521571 Aug 06 21:07:48.836115 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1611/3310] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:48 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:48.873375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:48.897714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:48.900639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:48.902581 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a1cf32ca-158b-4167-b72a-babe634ff2ef tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.285832 Aug 06 21:07:48.919826 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1700/3311] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:48 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:49.146070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:49.147743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:49.155683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:49.156425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:49.157133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:49.158026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:49.158692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:49.159290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:49.210189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:49.210868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] [instance: b989f968-8752-4d8a-9454-ee59ac99f32a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:49.244336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:49.246006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:49.248070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:49.251946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:49.259211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:49.260385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:49.294016 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] HTTP exception thrown: Instance b989f968-8752-4d8a-9454-ee59ac99f32a could not be found. Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Request method failure captured: Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a HTTP/1.1 Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tgaf-wqL6BD6SO7ScdJ44VnSFcweXgP5pkaluCL-8ROiCar_NI1nTkf366lJKQm7UjnD-JKdkIhduFrXcIOHTG-qyCL2POKBThl86vugUhOjvIpEmAmWbgdgeV5-9c9-ub-9duEPTAlLOY-_ZZwW4sQFeeVpUQsnNxbSFuQ3428ARY Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.47 Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: a6d936b54a5842938a3efb3f6aec12aa Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersAaction247Test-1530646271 Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6d936b54a5842938a3efb3f6aec12aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6d936b54a5842938a3efb3f6aec12aa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6d936b54a5842938a3efb3f6aec12aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6d936b54a5842938a3efb3f6aec12aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersAaction247Test-1530646271 Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: a6d936b54a5842938a3efb3f6aec12aa Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersAaction247Test-1530646271 Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersAaction247Test-1530646271-project Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 202b371f27b1434184f9be6970abe9db Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersAaction247Test-1530646271-project Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance b989f968-8752-4d8a-9454-ee59ac99f32a could not be found. Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'b989f968-8752-4d8a-9454-ee59ac99f32a'} Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b989f968-8752-4d8a-9454-ee59ac99f32a could not be found. Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b989f968-8752-4d8a-9454-ee59ac99f32a could not be found. Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:49.297255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:49.303805 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:49.303805 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:49.303805 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:49.303805 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:49.303805 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:49.303805 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:49.303805 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b989f968-8752-4d8a-9454-ee59ac99f32a could not be found. Aug 06 21:07:49.303805 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:07:49.306684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] Returning 404 to user: Instance b989f968-8752-4d8a-9454-ee59ac99f32a could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:49.308265 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0c8406ce-e592-4bae-a0a7-7054cded5cb4 tempest-ServersAaction247Test-1530646271 tempest-ServersAaction247Test-1530646271-project] 10.222.0.33 "GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a" status: 404 len: 111 microversion: 2.47 time: 0.108585 Aug 06 21:07:49.309800 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1701/3312] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:49 2022] GET /compute/v2.1/servers/b989f968-8752-4d8a-9454-ee59ac99f32a => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:07:49.403572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:49.412744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dcd0f6c5-a74b-4ca2-bc84-8229cc7d71f1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.271124 Aug 06 21:07:49.413814 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1612/3313] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:49 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:49.550498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:49.551887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:49.564333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:49.566995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:49.568713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:49.569511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:49.569993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:49.570433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:49.643240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:49.871073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:49.883452 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2700b92e-729b-4a61-8ff3-87b7ec64cfd6 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1495 microversion: 2.1 time: 0.337864 Aug 06 21:07:49.884947 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1613/3314] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:49 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1495 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:49.890826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8e07f998-4d8c-4c03-8874-8824ed12e5b8 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d357700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:49.906820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40327703-3ffb-4eb4-935a-53ff8bcb9e5c tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Action: 'create', calling method: .version_select at 0x7f72a344cca0>, body: {"keypair": {"name": "tempest-keypair-1462970590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3l2Ah9m+578vhsZd9VDNo6+s6fOUusYdg7cuV59iB66pE2bBxdcdcLaWEuy7pdMRZm8b+DqCPF4GmXWn9hc2x6Z4Pp2rF3oW+cKoUXGLXPDOUy0YS6UyimxspZFJSygw=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:49.944998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-40327703-3ffb-4eb4-935a-53ff8bcb9e5c tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Getting quotas for project 3389d5492b224ef9963f6305139ae9b8. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:49.958435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-40327703-3ffb-4eb4-935a-53ff8bcb9e5c tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Getting quotas for user 469d18e4c7db4b0d989f7c5b72e744f7 and project 3389d5492b224ef9963f6305139ae9b8. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:49.964815 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8e07f998-4d8c-4c03-8874-8824ed12e5b8 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.077735 Aug 06 21:07:49.968041 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1614/3315] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:49 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:49.987319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:49.989513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:50.009433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.012430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.013082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:50.014981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.019138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.019609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:50.038903 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40327703-3ffb-4eb4-935a-53ff8bcb9e5c tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.607359 Aug 06 21:07:50.040121 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1702/3316] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:07:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:50.049864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:50.050769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:50.067309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.069572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.070459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:50.071407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.075129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.075759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:50.161870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:50.169507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=20 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:50.241155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:50.258012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:50.259892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:50.268216 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a03766aa-ccbc-4977-9be1-621304cc47a7 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.219646 Aug 06 21:07:50.269254 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1703/3317] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:50 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:50.278301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5f0fdc9f-e06f-4588-b3c5-c0c3c20080f4 req-8a8615f1-438e-4fe3-8444-248046d09e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0926358-eed5-4b13-a285-2f56c382bce4", "name": "network-vif-plugged", "status": "completed", "tag": "5c0b2605-3a4d-45dd-876d-81e3e36ceb49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:50.309443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5f0fdc9f-e06f-4588-b3c5-c0c3c20080f4 req-8a8615f1-438e-4fe3-8444-248046d09e27 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.310031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5f0fdc9f-e06f-4588-b3c5-c0c3c20080f4 req-8a8615f1-438e-4fe3-8444-248046d09e27 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.310489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5f0fdc9f-e06f-4588-b3c5-c0c3c20080f4 req-8a8615f1-438e-4fe3-8444-248046d09e27 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:50.331620 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5f0fdc9f-e06f-4588-b3c5-c0c3c20080f4 req-8a8615f1-438e-4fe3-8444-248046d09e27 service nova] Creating event network-vif-plugged:5c0b2605-3a4d-45dd-876d-81e3e36ceb49 for instance e0926358-eed5-4b13-a285-2f56c382bce4 on nch2-master-1 Aug 06 21:07:50.346765 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5f0fdc9f-e06f-4588-b3c5-c0c3c20080f4 req-8a8615f1-438e-4fe3-8444-248046d09e27 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074210 Aug 06 21:07:50.349590 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1704/3318] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:50.444687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:50.446103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:50.455756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.456624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.457281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:50.458845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.459627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.461078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:50.510294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:50.555545 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ba3ffd32-f2b4-40db-a0e0-3620d40aba65 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.582368 Aug 06 21:07:50.558222 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1615/3319] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:49 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:50.759947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1af001d5-076a-4c87-b33f-99b5c632d926 req-05e0f01d-418f-4a6b-8f41-29dab92b81e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbd6244-6ccb-4ab4-9291-4b0cb23369d2", "name": "network-vif-deleted", "tag": "533c8f7a-31e3-43e3-847a-d4fab91f391b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:50.815994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1af001d5-076a-4c87-b33f-99b5c632d926 req-05e0f01d-418f-4a6b-8f41-29dab92b81e3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.822160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1af001d5-076a-4c87-b33f-99b5c632d926 req-05e0f01d-418f-4a6b-8f41-29dab92b81e3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.822751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1af001d5-076a-4c87-b33f-99b5c632d926 req-05e0f01d-418f-4a6b-8f41-29dab92b81e3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:50.896833 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1af001d5-076a-4c87-b33f-99b5c632d926 req-05e0f01d-418f-4a6b-8f41-29dab92b81e3 service nova] Creating event network-vif-deleted:533c8f7a-31e3-43e3-847a-d4fab91f391b for instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 on nch1-master-1 Aug 06 21:07:50.915627 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1af001d5-076a-4c87-b33f-99b5c632d926 req-05e0f01d-418f-4a6b-8f41-29dab92b81e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159751 Aug 06 21:07:50.917539 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1616/3320] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:50.938597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:50.940381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:50.959902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.961848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.962715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:50.965191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:50.967588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:50.969377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:51.061286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:51.064854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:51.069725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:51.070458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lazy-loading 'fault' on Instance uuid 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:51.103353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:51.113813 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-827575d5-5c4a-47e6-aeea-9f5cf6bd0d0b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.673686 Aug 06 21:07:51.127667 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1705/3321] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:50 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:51.141826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e9dfd6f0-2587-4109-bf5b-a45aeb3686d2 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d7788b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:51.265156 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e9dfd6f0-2587-4109-bf5b-a45aeb3686d2 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.133016 Aug 06 21:07:51.265968 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1706/3322] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:51 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:51.282462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:51.299053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:51.303717 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-34e83995-60db-413e-8eed-50ef4e0ce943 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 200 len: 1298 microversion: 2.1 time: 0.382449 Aug 06 21:07:51.307360 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1617/3323] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:50 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 1298 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:51.307542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:51.336346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:51.337233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:51.338883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:51.342014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:51.344938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:51.345756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:51.483209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:51.497738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:51.500249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:51.503276 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0fe57593-88a3-41d9-897d-0ff9dde12cdd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.213729 Aug 06 21:07:51.504571 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1707/3324] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:51 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:07:51.584019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:51.584979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:51.598740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:51.599191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:51.603335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:51.606152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:51.609490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:51.610626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:51.898091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:51.908848 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8729711e-8141-4e05-86df-225d2a000df3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.332401 Aug 06 21:07:51.924087 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1618/3325] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:51 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:52.136051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:52.138857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:52.149782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.150695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.151378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.152434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.153635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.154346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.281533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75db40fe-0760-48cc-a277-490af7e23dff tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d34d670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:52.383170 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-75db40fe-0760-48cc-a277-490af7e23dff tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.105392 Aug 06 21:07:52.384588 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1619/3326] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:52 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:52.402138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:52.402913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:52.421219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.432668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:52.434497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.438148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.439349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.443227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.446703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.448653 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5dbd6929-8df4-4d00-81b9-f73b35e4437e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.316822 Aug 06 21:07:52.464320 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1708/3327] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:52 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:52.476130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-14419417-700a-4511-bec0-079bd3121654 req-d100a73c-4768-46dc-ab75-0f9b381c286d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56ce1b1-ff27-4907-bc44-ccdc01f940bb", "name": "network-vif-plugged", "status": "completed", "tag": "a8b53510-3e4f-4ce0-a771-3c32a6c6ea78"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:52.497931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-14419417-700a-4511-bec0-079bd3121654 req-d100a73c-4768-46dc-ab75-0f9b381c286d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.498430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-14419417-700a-4511-bec0-079bd3121654 req-d100a73c-4768-46dc-ab75-0f9b381c286d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.502012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-14419417-700a-4511-bec0-079bd3121654 req-d100a73c-4768-46dc-ab75-0f9b381c286d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.508424 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 HTTP/1.1 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '9cbd6244-6ccb-4ab4-9291-4b0cb23369d2'} Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:52.511514 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:52.517401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:52.517401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:52.517401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:52.517401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:52.517401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:07:52.517401 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:52.517401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:52.517401 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dbc48f11-c236-4542-b199-7d3c9f459cbf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 404 len: 111 microversion: 2.1 time: 0.127383 Aug 06 21:07:52.523948 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1620/3328] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:52 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:52.532263 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-14419417-700a-4511-bec0-079bd3121654 req-d100a73c-4768-46dc-ab75-0f9b381c286d service nova] Creating event network-vif-plugged:a8b53510-3e4f-4ce0-a771-3c32a6c6ea78 for instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb on nch2-master-1 Aug 06 21:07:52.537002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:52.538172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:52.541646 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-14419417-700a-4511-bec0-079bd3121654 req-d100a73c-4768-46dc-ab75-0f9b381c286d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076044 Aug 06 21:07:52.542514 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1709/3329] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:52.555635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:52.557873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:52.565703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.567121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.570194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.571436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.574002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.574811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.575644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.579818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.580604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.582059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.583679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.587706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.656148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:07:52.810263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:52.820037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:52.821940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:52.832030 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e567a849-deb1-4284-b9be-2e1a10af8a8d tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.281033 Aug 06 21:07:52.835870 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1710/3330] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:52 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:52.889403 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-936d4fe5-085e-4404-8692-8a147fcaa47b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 204 len: 0 microversion: 2.1 time: 0.361113 Aug 06 21:07:52.891158 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1621/3331] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:07:52 2022] DELETE /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:07:52.900304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:52.901043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:52.919319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.920706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.921417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.922888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.923666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.924805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.935389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:52.937578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:52.957008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.963489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.963942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.964864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:52.965189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:52.965675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:52.994946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:53.229054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:53.242174 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-76c33641-c245-4673-82e0-cf44aed7c648 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.314509 Aug 06 21:07:53.258428 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1622/3332] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:52 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:53.397866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b6ed6e0-22a1-438d-9dfe-394f1fa8c9c3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d3570d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:53.454037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:53.463199 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1eade9a7-6fbf-4abc-83ef-0e7cabd3d0bd tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1494 microversion: 2.1 time: 0.567386 Aug 06 21:07:53.467247 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1711/3333] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:52 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1494 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:53.502719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:53.509636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:53.531683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:53.534069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:53.534789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:53.539033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:53.540460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:53.541108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:53.583654 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b6ed6e0-22a1-438d-9dfe-394f1fa8c9c3 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.189887 Aug 06 21:07:53.588028 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1623/3334] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:53 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:53.859305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:53.864605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:53.866045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:53.870408 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4cd86d85-c188-4c58-8580-50e3b887a8c3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.394649 Aug 06 21:07:53.873262 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1712/3335] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:53 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:53.888552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:53.889326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:53.889940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:53.890922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:53.891568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:53.892176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:54.265779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:54.266801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:54.279438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:54.280783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:54.281567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:54.283701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:54.284540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:54.285375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:54.338944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:54.349013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:54.355501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:54.356756 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-14714eb7-3ca5-4dd7-b402-6eafa8bc78dd tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.496195 Aug 06 21:07:54.366028 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1624/3336] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:53 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:07:54.492682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:54.493530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:54.510219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:54.517000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:54.517000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:54.521883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:54.522685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:54.524261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:54.569262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:54.582991 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3a7c86e4-f985-41c3-b213-1bab8580c5e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1314 microversion: 2.1 time: 0.318235 Aug 06 21:07:54.598789 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1713/3337] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:54 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:54.606064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4c94bb4e-1fee-4493-8df5-598bd6c0caca tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d88f940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:54.757068 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4c94bb4e-1fee-4493-8df5-598bd6c0caca tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.154924 Aug 06 21:07:54.760568 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1714/3338] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:54 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:54.901697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:54.902745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:54.924410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:54.931256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:54.932125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:54.933276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:54.938038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:54.939415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:55.079210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:55.109670 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ef894e5e-4531-4730-b9a8-ab03fa662018 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1494 microversion: 2.1 time: 0.616870 Aug 06 21:07:55.112899 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1625/3339] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:54 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1494 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:07:55.383909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:55.384579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:55.400008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:55.401028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:55.401722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:55.402742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:55.403432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:55.404330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:55.573815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:55.592020 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2db981d8-084b-49c9-9427-8fed75f34974 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.703054 Aug 06 21:07:55.593703 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1715/3340] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:54 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:55.610096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:55.611064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:55.621841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:55.626110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:55.626852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:55.628511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:55.631000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:55.638576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:55.956039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:55.992548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:55.994188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:56.008370 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-37bcbc27-8c14-418c-98dd-b7e4d8273498 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1365 microversion: 2.57 time: 0.629556 Aug 06 21:07:56.047643 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1626/3341] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:55 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1365 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:07:56.055633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f6d12c3c-4047-4ef8-9ccc-ef2b7c3d3a40 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dcf8430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:56.119077 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f6d12c3c-4047-4ef8-9ccc-ef2b7c3d3a40 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.068768 Aug 06 21:07:56.120103 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1627/3342] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:56 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:56.142314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:56.144043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:56.161624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:56.162507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:56.163259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:56.165951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:56.166753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:56.167560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:56.354312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:56.366167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:56.384407 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7790ee8f-9c54-4441-8d3f-980fac78aaea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1452 microversion: 2.1 time: 0.250914 Aug 06 21:07:56.407551 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1628/3343] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:56 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1452 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:56.410638 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e6be7ba-1f2e-4479-9a7c-f39c2dc1218b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1501 microversion: 2.1 time: 0.799646 Aug 06 21:07:56.418384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-79bb563a-a2fd-4da1-ac27-2c25f8c20a3c req-16bfb865-1578-4ee7-b9f3-381ef45a8705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b1d8f6-c200-4f9d-958c-d3594e12be88", "name": "network-vif-deleted", "tag": "440d60a3-310f-4bcf-a43b-36f69b1a3105"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:56.434313 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1716/3344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:55 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1501 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:56.435039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-79bb563a-a2fd-4da1-ac27-2c25f8c20a3c req-16bfb865-1578-4ee7-b9f3-381ef45a8705 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:56.435990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-79bb563a-a2fd-4da1-ac27-2c25f8c20a3c req-16bfb865-1578-4ee7-b9f3-381ef45a8705 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:56.437114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-79bb563a-a2fd-4da1-ac27-2c25f8c20a3c req-16bfb865-1578-4ee7-b9f3-381ef45a8705 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:56.452012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b7bbaeaa-b227-4f2a-9ab8-e773ed96c7b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:56.456591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b7bbaeaa-b227-4f2a-9ab8-e773ed96c7b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:56.458840 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-79bb563a-a2fd-4da1-ac27-2c25f8c20a3c req-16bfb865-1578-4ee7-b9f3-381ef45a8705 service nova] Creating event network-vif-deleted:440d60a3-310f-4bcf-a43b-36f69b1a3105 for instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 on nch2-master-1 Aug 06 21:07:56.465628 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-79bb563a-a2fd-4da1-ac27-2c25f8c20a3c req-16bfb865-1578-4ee7-b9f3-381ef45a8705 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056306 Aug 06 21:07:56.473231 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1629/3345] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:07:56.500044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7bbaeaa-b227-4f2a-9ab8-e773ed96c7b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:56.502807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7bbaeaa-b227-4f2a-9ab8-e773ed96c7b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:56.503628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7bbaeaa-b227-4f2a-9ab8-e773ed96c7b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:56.504804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7bbaeaa-b227-4f2a-9ab8-e773ed96c7b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:56.507021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7bbaeaa-b227-4f2a-9ab8-e773ed96c7b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:56.510046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7bbaeaa-b227-4f2a-9ab8-e773ed96c7b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:56.621880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1733077368", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f662e265-d07f-49d4-b3f0-1a180bfecccf"}], "security_groups": [{"name": "tempest-securitygroup--665919459"}], "key_name": "tempest-keypair-1462970590", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "01cb2a8d-b4b3-4606-91b2-8f969ffe983b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:07:56.735438 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b7bbaeaa-b227-4f2a-9ab8-e773ed96c7b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb/action" status: 202 len: 0 microversion: 2.1 time: 0.299649 Aug 06 21:07:56.739024 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1717/3346] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:07:56 2022] POST /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:07:56.751530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:56.753177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:56.772533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:56.772934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:56.773385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:56.774855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:56.778691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:56.780842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:56.947072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] validate_networks() for [('f662e265-d07f-49d4-b3f0-1a180bfecccf', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:07:57.325996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:57.340433 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-efb04187-a27b-41c9-832b-ae81bb7cbe35 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.598267 Aug 06 21:07:57.342753 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1718/3347] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:56 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:57.364607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:57.366034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:57.386691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:57.387271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:57.387729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:57.388475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:57.388947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:57.389387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:57.771283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Getting quotas for project 3389d5492b224ef9963f6305139ae9b8. Resources: dict_keys(['metadata_items']) {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:57.783099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Getting quotas for user 469d18e4c7db4b0d989f7c5b72e744f7 and project 3389d5492b224ef9963f6305139ae9b8. Resources: dict_keys(['metadata_items']) {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:57.805982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:07:57.807223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:07:57.808033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:07:57.808625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:07:57.809328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:07:57.828064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:57.829644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:57.830341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:57.832471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:57.833218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:57.834965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:57.861959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Getting quotas for project 3389d5492b224ef9963f6305139ae9b8. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:07:57.869628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Getting quotas for user 469d18e4c7db4b0d989f7c5b72e744f7 and project 3389d5492b224ef9963f6305139ae9b8. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:07:57.944713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:57.956183 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aa2278c5-ac24-4ad6-8410-a9dd245e1eff tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1506 microversion: 2.1 time: 0.601173 Aug 06 21:07:57.958953 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1719/3348] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:57 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:57.979790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:57.981623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:57.992500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:57.993125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:57.993576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:57.994448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:57.995045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:57.995500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:58.006898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:07:58.013719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01cb2a8d-b4b3-4606-91b2-8f969ffe983b',volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:07:58.135170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:58.147586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:58.149339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:58.153835 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-30ff7897-3c7e-4bf1-8f99-e5658ea8d8d0 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1371 microversion: 2.57 time: 0.192118 Aug 06 21:07:58.155673 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1720/3349] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:57 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:07:58.166931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7335ee90-2b02-4c5c-af78-964f41bd3285 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729cec0820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:58.239101 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7335ee90-2b02-4c5c-af78-964f41bd3285 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.080079 Aug 06 21:07:58.240130 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1721/3350] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:58 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:58.256338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:58.258261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:58.265258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:58.266117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:58.266655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:58.267577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:58.268890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:58.271050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:58.314605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:58.322532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:58.323211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:58.324080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:58.326324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lazy-loading 'fault' on Instance uuid e0b1d8f6-c200-4f9d-958c-d3594e12be88 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:07:58.347533 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.732121 Aug 06 21:07:58.358108 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1630/3351] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:07:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:07:58.367839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac957d32-6b67-45b0-bf05-7cc47caf1b54 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:58.369891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ac957d32-6b67-45b0-bf05-7cc47caf1b54 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:58.547439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ac957d32-6b67-45b0-bf05-7cc47caf1b54 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:58.577143 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac957d32-6b67-45b0-bf05-7cc47caf1b54 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1122 microversion: 2.1 time: 0.216429 Aug 06 21:07:58.578036 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1631/3352] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:58 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1122 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:58.599609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:58.599609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:58.627595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:58.634757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:58.635592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:58.636430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:58.645286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:58.649808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:58.689978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:58.700527 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75c48198-bc6e-477f-8b79-5c2c3617b62d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 200 len: 1298 microversion: 2.1 time: 0.458976 Aug 06 21:07:58.713588 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1722/3353] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:58 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 1298 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:58.979940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:58.980843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:59.003448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.003953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.004403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.005123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.005587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.007295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:59.018434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.021096 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4843aa55-6361-4f1f-8c77-0c2bd6cf2fca tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.441904 Aug 06 21:07:59.044682 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1632/3354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:58 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:59.185926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:59.187005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:59.204998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.207580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.208280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.210062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.213837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.214514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.276185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:59.289710 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa6ef264-0265-4516-834e-007dad4bea87 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1486 microversion: 2.1 time: 0.312984 Aug 06 21:07:59.294606 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1723/3355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:58 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1486 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:59.312009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c7daaf2e-6d42-43d8-81a5-ac9a3359c6cf tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a367dc10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:59.390188 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c7daaf2e-6d42-43d8-81a5-ac9a3359c6cf tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.098222 Aug 06 21:07:59.399382 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1724/3356] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:07:59 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:07:59.404617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:59.405444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:59.414926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.415849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.416502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.417879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.418685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.419639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.425264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:59.454391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:59.455997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:07:59.456685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:07:59.467614 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fcb7ccfd-d3d1-473a-be6e-44f9fed6cc05 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1356 microversion: 2.57 time: 0.277628 Aug 06 21:07:59.468572 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1633/3357] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:07:59 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1356 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:07:59.500244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:59.500815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:59.508841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.509443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.509967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.514057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.514719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.515187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.577387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:07:59.648781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:07:59.743612 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-353f10cf-338d-46f0-a097-983e4049d5bb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 204 len: 0 microversion: 2.1 time: 0.342460 Aug 06 21:07:59.749265 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1725/3358] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:07:59 2022] DELETE /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:07:59.765364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:59.766118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:59.781359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.783875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.784975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.787570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.788250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.790760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.847124 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d5d8623b-53fd-48a9-bfd0-731bdaf2a2b2 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 204 len: 0 microversion: 2.57 time: 0.351486 Aug 06 21:07:59.852890 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1634/3359] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:07:59 2022] DELETE /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:07:59.858833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:59.859593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:59.871643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.871643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.872084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.872729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.873519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.873967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.906949 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 HTTP/1.1 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'e0b1d8f6-c200-4f9d-958c-d3594e12be88'} Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:59.911569 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:07:59.916135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:07:59.916135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:07:59.916135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:07:59.916135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:07:59.916135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:07:59.916135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:07:59.916135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:07:59.916135 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-70140a7e-ade0-482a-9744-0714ef2810b3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 404 len: 111 microversion: 2.1 time: 0.059028 Aug 06 21:07:59.927353 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1635/3360] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:59 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:07:59.942964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:07:59.944340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:07:59.974470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.975638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.975755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.976433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:07:59.976932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:07:59.977316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:07:59.997792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=34 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:00.041541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:00.055975 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a306edaa-3cae-47db-895b-99275244afd9 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1220 microversion: 2.1 time: 0.304928 Aug 06 21:08:00.070148 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1726/3361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:59 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1220 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:00.075568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:00.076752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:00.095904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:00.097607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:00.098229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:00.099167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:00.099864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:00.100537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:00.238803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:00.249670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:00.257171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:00.258409 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d64225ab-3a4f-4d81-b622-a4948c83fa5c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1362 microversion: 2.57 time: 0.186754 Aug 06 21:08:00.260869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1727/3362] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:00 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:00.273125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:00.273989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:00.288997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:00.289502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:00.289941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:00.295007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:00.296539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:00.302044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:00.320113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:00.685450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:00.699286 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-15c404aa-9308-4182-b8b3-3919de43cf34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1501 microversion: 2.1 time: 0.435527 Aug 06 21:08:00.704803 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1728/3363] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:00 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1501 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:00.713031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1848969505", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0827ee4a-610f-48e2-8263-78e781630780"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:00.823101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] validate_networks() for [('0827ee4a-610f-48e2-8263-78e781630780', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:08:00.839803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:00.856838 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1f9d18f8-020a-469a-b721-d211b22880c8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1492 microversion: 2.1 time: 0.928101 Aug 06 21:08:00.858053 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1636/3364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:07:59 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1492 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:00.868742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f9cb2d18-696e-448a-8e2c-460811a863b2 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a347e550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:00.955540 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f9cb2d18-696e-448a-8e2c-460811a863b2 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.095206 Aug 06 21:08:00.957502 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1637/3365] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:00 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:00.963444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05b97652-8690-49da-8129-7f7b2bc838b6"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:00.985933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:00.991641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:00.999142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:00.999900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.001080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.002004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.002703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.003821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.052485 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] HTTP exception thrown: Cannot 'attach_volume' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state rescued Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Request method failure captured: Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/os-volume_attachments HTTP/1.1 Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 74 Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tfLEawbHpN6jMURxdzK2EbJF4VOuu9Oa5UpiLUmKBNlhjCkr9kH_MmWQvt1hNGSGmL37UKnTYuWQ1qLqZpSKaucQe-XZMrOo54Rzzy38O3wJqXN2UfBzSzmpVXWUazExIacv2EKUyLKBOIK69QkSvDLfRUnPsiYAPeIlk26rmd3IhA Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8046f1ab9c004060965dced02db4b7c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: f7cf258df10248d0bdcf64fa075c132c Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: {"volumeAttachment": {"volumeId": "05b97652-8690-49da-8129-7f7b2bc838b6"}} Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: exception: Cannot 'attach_volume' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state rescued Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'server_id': '13d43d45-c3b6-44b0-8241-b8ff218d15d4', 'body': {'volumeAttachment': {'volumeId': '05b97652-8690-49da-8129-7f7b2bc838b6'}}} Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 06 21:08:01.056570 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state rescued Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state rescued Aug 06 21:08:01.061357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:01.063595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Returning 409 to user: Cannot 'attach_volume' instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 while it is in vm_state rescued {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:01.064657 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f65f2598-caaa-41ce-994a-fa3f78a40af7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.105922 Aug 06 21:08:01.075899 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1638/3366] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:08:00 2022] POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/os-volume_attachments => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:08:01.081185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:01.082026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:01.090728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.091491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.092105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.093013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.093663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.094262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.292694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:01.312170 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b7c13e18-a3b6-450c-b9c2-e09ff03b8dbf tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1238 microversion: 2.1 time: 0.234159 Aug 06 21:08:01.314488 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1639/3367] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:01 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1238 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:01.328774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-735c3979-4e51-43f9-a4ad-677fbca72a38 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:01.330888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-735c3979-4e51-43f9-a4ad-677fbca72a38 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:01.355095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-735c3979-4e51-43f9-a4ad-677fbca72a38 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.357780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-735c3979-4e51-43f9-a4ad-677fbca72a38 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.358357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-735c3979-4e51-43f9-a4ad-677fbca72a38 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.361026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-735c3979-4e51-43f9-a4ad-677fbca72a38 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.363587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-735c3979-4e51-43f9-a4ad-677fbca72a38 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.364318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-735c3979-4e51-43f9-a4ad-677fbca72a38 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.551188 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-735c3979-4e51-43f9-a4ad-677fbca72a38 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action" status: 202 len: 0 microversion: 2.1 time: 0.234684 Aug 06 21:08:01.565184 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1640/3368] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:08:01 2022] POST /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:08:01.593874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:01.596622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:01.612314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.612829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.613286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.614029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.614498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.614963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.789397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:01.798347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:01.811431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6887aa30a0584334a58d8cab1e8cb4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251bd93dd4924a7790ed5313975d90a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:01.813453 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-26f79685-56bf-4868-9aa2-24da4f49697c tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 200 len: 1362 microversion: 2.57 time: 0.239956 Aug 06 21:08:01.814449 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1641/3369] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:01 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:01.820731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:01.821054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:01.827137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.827729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.828283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.829063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.829615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.830121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.957375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:08:01.957884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:08:01.958329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:08:01.960281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:08:01.960727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:08:01.980789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.981408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.992940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:01.994033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:01.998750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:01.999222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:02.068258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:08:02.095836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for user 7dcd210e197347f8ad1622ee882bee92 and project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:08:02.139139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:08:02.142046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:08:02.248866 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab2f387b-cc8b-4ce3-95a4-493b28c31277 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541756 Aug 06 21:08:02.251769 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1729/3370] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:08:02.256848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:02.264998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:02.286730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:02.292585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:02.300848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:02.305825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:02.306669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:02.307286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:02.568963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:02.582257 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c3102b54-a700-4a1a-89db-3f2576d9451d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1509 microversion: 2.1 time: 0.764770 Aug 06 21:08:02.600184 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1642/3371] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:01 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1509 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:02.609976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22e7fcc8-1914-413e-9a39-79fdef1ab723 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a36a8040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:02.730358 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-22e7fcc8-1914-413e-9a39-79fdef1ab723 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.128809 Aug 06 21:08:02.738739 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1643/3372] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:02 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:02.745386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-49f1518e-1953-4299-a94a-3f81e2f4715f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:02.757262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-49f1518e-1953-4299-a94a-3f81e2f4715f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:02.916903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:02.932210 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c227252d-f8d2-4adc-b008-707c1fca718f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1492 microversion: 2.1 time: 0.673455 Aug 06 21:08:02.933148 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1730/3373] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:02 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1492 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:02.959554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:02.960458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:02.975049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:02.975675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:02.977697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:02.978440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:02.981864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:02.985095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:03.077859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-49f1518e-1953-4299-a94a-3f81e2f4715f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:03.094675 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-49f1518e-1953-4299-a94a-3f81e2f4715f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1209 microversion: 2.1 time: 0.348615 Aug 06 21:08:03.096271 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1644/3374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:02 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1209 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:03.118007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:03.118689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] [instance: cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:03.151922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:03.154755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:03.155229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:03.164304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:03.166331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:03.169764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:03.180311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:03.189782 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e3e5796f-ea30-4f38-83ef-0ed8400ed9b5 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1238 microversion: 2.1 time: 0.236217 Aug 06 21:08:03.203282 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1731/3375] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:02 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1238 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:03.228360 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] HTTP exception thrown: Instance cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 could not be found. Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Request method failure captured: Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 HTTP/1.1 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tgFjvgxovvxPHU9B9Vg0m49Dko5f0fKLeuZtOoBeDrsNPU-TGzj9-85FCsdQzXc8iru0yMFg24AKRo8bXA_QhLvRpNZtlb53wN_eDaPtvY1azbUF4MB7aGBPnt0ofMkbaoyuRnpxupZVv_f7mwonYfoIyimdFaD_AgcWODRZc9mEUQ Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.57 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 251bd93dd4924a7790ed5313975d90a9 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerShowV257Test-1688952013 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/251bd93dd4924a7790ed5313975d90a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_251bd93dd4924a7790ed5313975d90a9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/251bd93dd4924a7790ed5313975d90a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/251bd93dd4924a7790ed5313975d90a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerShowV257Test-1688952013 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 251bd93dd4924a7790ed5313975d90a9 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerShowV257Test-1688952013 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerShowV257Test-1688952013-project Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 6887aa30a0584334a58d8cab1e8cb4c3 Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerShowV257Test-1688952013-project Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 could not be found. Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7'} Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 could not be found. Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 could not be found. Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:03.234391 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:03.239710 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:03.239710 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:03.239710 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:03.239710 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:03.239710 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:03.239710 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 could not be found. Aug 06 21:08:03.239710 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:03.243695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] Returning 404 to user: Instance cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:03.246466 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-484efb9f-7eff-47dc-95c5-7051e709d792 tempest-ServerShowV257Test-1688952013 tempest-ServerShowV257Test-1688952013-project] 10.222.0.33 "GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7" status: 404 len: 111 microversion: 2.57 time: 0.143543 Aug 06 21:08:03.248082 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1645/3376] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:03 2022] GET /compute/v2.1/servers/cc2e7923-5d06-4c21-a3dc-d5c06b11f4d7 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:08:03.613510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:03.614237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:03.644266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:03.648957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:03.650692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:03.651478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:03.651957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:03.652396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:03.747130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab26fe65-50ed-40d8-a6c7-fa5c62ee2aa2 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a36a8700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:03.827886 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab26fe65-50ed-40d8-a6c7-fa5c62ee2aa2 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.085508 Aug 06 21:08:03.828475 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1646/3377] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:03 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:03.957695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:03.958473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:03.967756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:03.979975 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e5809dae-a55f-4add-8a82-61944f5b778e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1509 microversion: 2.1 time: 0.375017 Aug 06 21:08:03.980253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:03.994341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:03.994341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:03.994341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:03.994341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:03.994341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:03.996462 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1732/3378] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:03 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:04.119308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:04.120119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:04.140044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:04.145690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:04.149946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:04.152881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:04.155078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:04.158245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:04.245072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:04.257183 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c52cb800-1b0c-4a9d-95ce-4f7ac8372e33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1450 microversion: 2.1 time: 0.304338 Aug 06 21:08:04.270972 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1647/3379] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:03 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1450 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:04.276310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:04.276945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:04.283044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:04.283538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:04.283986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:04.293192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:04.293764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:04.294251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:04.504842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:04.518036 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ea64661d-742f-4e0b-929a-e35c145d8232 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1238 microversion: 2.1 time: 0.242623 Aug 06 21:08:04.520133 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1648/3380] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:04 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1238 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:04.533066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-b238e9db-f7da-450f-80a2-815482bcedc9 req-8036b625-b6b9-48ac-8b10-bd84c79086a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e56ce1b1-ff27-4907-bc44-ccdc01f940bb", "name": "network-vif-deleted", "tag": "a8b53510-3e4f-4ce0-a771-3c32a6c6ea78"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:04.566683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b238e9db-f7da-450f-80a2-815482bcedc9 req-8036b625-b6b9-48ac-8b10-bd84c79086a2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:04.569191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b238e9db-f7da-450f-80a2-815482bcedc9 req-8036b625-b6b9-48ac-8b10-bd84c79086a2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:04.571641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b238e9db-f7da-450f-80a2-815482bcedc9 req-8036b625-b6b9-48ac-8b10-bd84c79086a2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:04.620539 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-b238e9db-f7da-450f-80a2-815482bcedc9 req-8036b625-b6b9-48ac-8b10-bd84c79086a2 service nova] Creating event network-vif-deleted:a8b53510-3e4f-4ce0-a771-3c32a6c6ea78 for instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb on nch2-master-1 Aug 06 21:08:04.632044 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-b238e9db-f7da-450f-80a2-815482bcedc9 req-8036b625-b6b9-48ac-8b10-bd84c79086a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108432 Aug 06 21:08:04.632676 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1649/3381] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:04.845328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e63d10cb-9658-4c8d-88bc-e3eac3b69a55 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a36a8af0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:05.061507 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e63d10cb-9658-4c8d-88bc-e3eac3b69a55 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.218842 Aug 06 21:08:05.063774 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1650/3382] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:04 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:05.114054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:05.114975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:05.137434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:05.140775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:05.143038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:05.144076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:05.148137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:05.148934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:05.215022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:05.226011 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-982681c5-8a63-4d3c-8326-1f33560e4098 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1269 microversion: 2.1 time: 1.110008 Aug 06 21:08:05.240736 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1733/3383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:04 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1269 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:05.282717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:05.283613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:05.315521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:05.319707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:05.322140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:05.325285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:05.325879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:05.327919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:05.483517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:05.483917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:05.495126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:05.497081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lazy-loading 'fault' on Instance uuid e56ce1b1-ff27-4907-bc44-ccdc01f940bb {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:08:05.750330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:05.760282 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7492004e-f03f-4e84-8af6-5de49b19a505 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 200 len: 1304 microversion: 2.1 time: 0.482694 Aug 06 21:08:05.780592 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1734/3384] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:05 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 1304 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:05.797303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:05.806991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:05.814643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:05.823802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:05.824665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:05.825688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:05.826655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:05.835392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:06.184090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:06.196535 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f578afb0-c6c0-4f4a-b2b3-7c1277ae10f3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1515 microversion: 2.1 time: 1.123273 Aug 06 21:08:06.200479 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1651/3385] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:05 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1515 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:06.219437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:06.222392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c6dcd809-714f-4a88-8171-0d6624297ed2 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d07eaf0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:06.247779 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2a124cda-e1f8-4ffa-b14b-eb0ae64d962b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1293 microversion: 2.1 time: 0.461885 Aug 06 21:08:06.251702 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1735/3386] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:05 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1293 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:06.262490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:06.264516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:06.275919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:06.281797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:06.286186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:06.287198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:06.288150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:06.288916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:06.311676 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c6dcd809-714f-4a88-8171-0d6624297ed2 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.105315 Aug 06 21:08:06.313339 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1652/3387] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:06 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:06.433517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:06.449256 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f7dd254-1151-44a9-94a7-4e5f811e9321 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1267 microversion: 2.1 time: 0.196149 Aug 06 21:08:06.453471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1736/3388] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:06 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:06.788979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:06.789876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:06.805321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:06.807471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:06.810270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:06.811566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:06.812961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:06.812961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:06.872670 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb HTTP/1.1 Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'e56ce1b1-ff27-4907-bc44-ccdc01f940bb'} Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:06.882536 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:06.888425 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:06.888425 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:06.888425 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:06.888425 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:06.888425 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:06.888425 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:08:06.888425 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:06.891768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:06.901907 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-441c22d5-d9d4-48e1-a204-d6da36917e08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 404 len: 111 microversion: 2.1 time: 0.114390 Aug 06 21:08:06.908287 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1653/3389] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:06 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:08:07.172298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1510949062", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5c00ae50-9c12-446f-a3fc-256b5e473c43"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:07.280011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:07.280592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:07.299134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:07.318975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:07.319570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:07.326122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] validate_networks() for [('5c00ae50-9c12-446f-a3fc-256b5e473c43', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:08:07.347563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:07.348190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:07.348656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:07.847238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:07.979699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:07.990876 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ff1361df-31ba-4bb9-979e-31501b51c077 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1293 microversion: 2.1 time: 0.715240 Aug 06 21:08:07.992530 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1654/3390] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:07 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1293 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:07.998056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9134ffa8-003f-4e47-9dbd-1e66d0c273cc tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d31ca60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:08.075377 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9134ffa8-003f-4e47-9dbd-1e66d0c273cc tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.081157 Aug 06 21:08:08.095352 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1655/3391] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:07 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:08.110611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:08.111276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:08.130207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:08.131296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:08.131842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:08.136400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:08.138847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:08.139304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:08.751845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:08.764719 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8f6a39d4-e5f1-465c-8ef5-619894fb6dd4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1309 microversion: 2.1 time: 0.668211 Aug 06 21:08:08.765701 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1656/3392] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:08 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1309 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:08.788884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7fd4a168-7268-45d9-b9b9-3340b6e19aee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'create', calling method: .version_select at 0x7f729d92c5e0>, body: {"keypair": {"name": "tempest-keypair-913635642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK04QtP9hyGwT2N9UriFANgMdXWL1qJFpRuOP88FcPpqUxm5PW59a63x/hUIKuk9Z6PMXaJb3UBSaaVquMDx8OpfU9Dd0tqB4i2qVGTZW6uvo/TXKc3wKFP0dWktaItwGw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:08.812775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7fd4a168-7268-45d9-b9b9-3340b6e19aee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Getting quotas for project 8046f1ab9c004060965dced02db4b7c4. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:08:08.820546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7fd4a168-7268-45d9-b9b9-3340b6e19aee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Getting quotas for user f7cf258df10248d0bdcf64fa075c132c and project 8046f1ab9c004060965dced02db4b7c4. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:08:08.867538 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7fd4a168-7268-45d9-b9b9-3340b6e19aee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085632 Aug 06 21:08:08.870383 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1657/3393] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:08:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:09.118461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1041823847", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "521e7abc-33e6-4868-b094-f93ea3ef3543"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:09.242587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] validate_networks() for [('521e7abc-33e6-4868-b094-f93ea3ef3543', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:08:09.290936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:08:09.291388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:08:09.291654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:08:09.292797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:08:09.293181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:08:09.323168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:09.323812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:09.324283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:09.325090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:09.325558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:09.325994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:09.417456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:08:09.456378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for user bdf1b5180a814cf39234892c6c1f26df and project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:08:09.496052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:08:09.498262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:08:09.621685 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-04dabecf-570e-4d56-a2b6-208242eabeeb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.453166 Aug 06 21:08:09.622358 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1737/3394] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:08:09.965464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:09.966482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:09.980911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:09.981526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:09.981875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:09.987021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:09.987547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:09.988003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:10.087359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:08:10.296730 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 204 len: 0 microversion: 2.32 time: 0.669209 Aug 06 21:08:10.298367 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1738/3395] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:08:09 2022] DELETE /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:08:10.306529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2bf46f7d-5858-4758-a0b8-c790f1eb23a0 req-ea37da8b-2a69-4d22-a782-296c0fc6ab15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a81b975-f91b-4df1-8618-3c3d6f2b2282", "tag": "52a237f9-d2cb-46f2-a85a-442708aca2b1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:10.320058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2bf46f7d-5858-4758-a0b8-c790f1eb23a0 req-ea37da8b-2a69-4d22-a782-296c0fc6ab15 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:10.320839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2bf46f7d-5858-4758-a0b8-c790f1eb23a0 req-ea37da8b-2a69-4d22-a782-296c0fc6ab15 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:10.321444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2bf46f7d-5858-4758-a0b8-c790f1eb23a0 req-ea37da8b-2a69-4d22-a782-296c0fc6ab15 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:10.337396 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2bf46f7d-5858-4758-a0b8-c790f1eb23a0 req-ea37da8b-2a69-4d22-a782-296c0fc6ab15 service nova] Creating event network-changed:52a237f9-d2cb-46f2-a85a-442708aca2b1 for instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 on nch1-master-1 Aug 06 21:08:10.344949 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2bf46f7d-5858-4758-a0b8-c790f1eb23a0 req-ea37da8b-2a69-4d22-a782-296c0fc6ab15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044316 Aug 06 21:08:10.346695 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1739/3396] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:10.354455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:10.355606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:10.364553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:10.365567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:10.366391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:10.367643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:10.368406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:10.369764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:10.887719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:10.889544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:08:10.890799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:08:10.891554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:08:10.892211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:08:10.892881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:08:10.906254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:10.907307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:10.907981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:10.908949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:10.909695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:10.910919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:10.911062 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb7525da-31cb-4182-bc70-8ba17b0a3f5d tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1293 microversion: 2.1 time: 0.562685 Aug 06 21:08:10.912284 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1740/3397] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:10 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1293 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:10.931763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e600d2e5-ad70-4886-81c7-255eb1a517ff tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729ce87430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:10.951133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Getting quotas for project 980210caadb14685afa7afb9bbf6c651. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:08:10.966288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Getting quotas for user a6955ef07c6f447187f1ad99c2a7b7b9 and project 980210caadb14685afa7afb9bbf6c651. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:08:10.984480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:08:10.987260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:08:11.055104 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e600d2e5-ad70-4886-81c7-255eb1a517ff tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.139405 Aug 06 21:08:11.066869 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b2fc6274-df36-44eb-8787-d5657729fe7b tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.184160 Aug 06 21:08:11.066869 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1658/3398] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:08:11.072633 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1741/3399] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:10 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:11.075197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c650e406-aee1-4019-8169-6252599fd978 req-e4440a59-4e09-4920-8d60-1ac4cf9dd337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3229247f-828a-4c89-8986-792f56e6c1c7", "tag": "de4bacaa-010d-443c-8d6d-95f754443cd7"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:11.078208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:11.079085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:11.087347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:11.088464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:11.089117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:11.090644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:11.091274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:11.091864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:11.095089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c650e406-aee1-4019-8169-6252599fd978 req-e4440a59-4e09-4920-8d60-1ac4cf9dd337 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:11.095598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c650e406-aee1-4019-8169-6252599fd978 req-e4440a59-4e09-4920-8d60-1ac4cf9dd337 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:11.096043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c650e406-aee1-4019-8169-6252599fd978 req-e4440a59-4e09-4920-8d60-1ac4cf9dd337 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:11.165817 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c650e406-aee1-4019-8169-6252599fd978 req-e4440a59-4e09-4920-8d60-1ac4cf9dd337 service nova] Creating event network-changed:de4bacaa-010d-443c-8d6d-95f754443cd7 for instance 3229247f-828a-4c89-8986-792f56e6c1c7 on nch1-master-1 Aug 06 21:08:11.188066 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c650e406-aee1-4019-8169-6252599fd978 req-e4440a59-4e09-4920-8d60-1ac4cf9dd337 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123991 Aug 06 21:08:11.193135 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1659/3400] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:11.229821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:11.230686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:11.230825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:11.256835 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc0e58c8-ba64-42da-8f27-15b0e6d82e3a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1267 microversion: 2.1 time: 0.181552 Aug 06 21:08:11.258661 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1742/3401] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:11 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:11.272862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f608def-fed7-4269-ad25-c1ef451f3e53 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f72a34688b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:11.277910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:11.282069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:11.282831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:11.286420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:11.289249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:11.289743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:11.415200 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4f608def-fed7-4269-ad25-c1ef451f3e53 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fcc64e14-d1d4-4460-bb5d-5ef822044936" status: 200 len: 344 microversion: 2.1 time: 0.155237 Aug 06 21:08:11.416316 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1743/3402] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:08:11 2022] GET /compute/v2.1/os-volumes/fcc64e14-d1d4-4460-bb5d-5ef822044936 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:11.421895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:11.422514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:11.438118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:11.438770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:11.439680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:11.440714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:11.441334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:11.441770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:11.923219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:11.947310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:11.953766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:11.956528 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e994911-7ece-4253-b2c2-87bdd50f8ba1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2956 microversion: 2.32 time: 0.538009 Aug 06 21:08:11.958003 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1744/3403] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:11 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2956 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:11.971118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2de6eea8-3e28-492b-8056-8f27b352b1cd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:11.971118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2de6eea8-3e28-492b-8056-8f27b352b1cd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:12.044765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2de6eea8-3e28-492b-8056-8f27b352b1cd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:12.056623 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2de6eea8-3e28-492b-8056-8f27b352b1cd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1216 microversion: 2.1 time: 0.093882 Aug 06 21:08:12.070849 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1745/3404] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:11 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:12.070849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:12.070849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:12.071314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:12.071513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:12.072290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:12.080598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:12.082038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:12.082769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:12.172351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:12.199462 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-51497263-6d54-4be8-b686-32dd67ecc1ae tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1309 microversion: 2.1 time: 1.001941 Aug 06 21:08:12.200070 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1660/3405] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:11 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1309 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:12.260040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a688011-1abf-47ce-bc77-ba8571762411 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dc26940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:12.369490 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a688011-1abf-47ce-bc77-ba8571762411 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.142487 Aug 06 21:08:12.370105 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1661/3406] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:12 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:12.380023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:12.382615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:12.397800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:12.398851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:12.399201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:12.399960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:12.400458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:12.406078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:12.501340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:12.516487 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7752db0e-5885-4450-bd4a-736fff8251a2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1293 microversion: 2.1 time: 0.457461 Aug 06 21:08:12.520670 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1746/3407] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:12 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1293 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:12.673482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:12.694268 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab2f5c6f-c997-4a41-b4e6-14c3e3745155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1273 microversion: 2.1 time: 0.322422 Aug 06 21:08:12.694949 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1662/3408] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:12 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:12.986121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:12.987634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:13.001149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:13.001811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:13.003306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:13.005945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:13.006641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:13.007532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:13.090937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:13.095294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:13.125345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:13.130068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:13.131950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:13.138038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:13.139023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:13.144504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:13.179571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:13.545276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:13.548866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:13.563400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:13.565342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:13.566849 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d76a27c3-ba0d-485b-84c7-aa7b9612c59b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2956 microversion: 2.32 time: 0.585779 Aug 06 21:08:13.582578 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1747/3409] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:12 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2956 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:13.582578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:13.582578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:13.628868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:13.629468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:13.629812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:13.631201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:13.631659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:13.632087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:13.792580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:13.802855 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ca500839-9ada-41af-a176-47f665ef8e20 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1268 microversion: 2.1 time: 0.717543 Aug 06 21:08:13.809310 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1663/3410] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:13 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1268 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:13.818190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-102043bc-f817-4a35-b33a-18a0aa6cd482 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f72a36a8790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:13.903195 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-102043bc-f817-4a35-b33a-18a0aa6cd482 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3785f13e-1fa3-4bc0-8cc8-f2a3c1254403" status: 200 len: 344 microversion: 2.1 time: 0.089438 Aug 06 21:08:13.910599 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1664/3411] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:08:13 2022] GET /compute/v2.1/os-volumes/3785f13e-1fa3-4bc0-8cc8-f2a3c1254403 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:13.910599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f4cabec-4bcc-4e87-a0f5-645f3c5495d4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a353aa60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:14.063840 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f4cabec-4bcc-4e87-a0f5-645f3c5495d4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.158149 Aug 06 21:08:14.065639 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1665/3412] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:13 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:14.074280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:14.076526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:14.085189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:14.086908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:14.087812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:14.089857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:14.090868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:14.091993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:14.137223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:14.148273 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-38e79a69-1597-48a0-9002-e96d13207b22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1309 microversion: 2.1 time: 0.571219 Aug 06 21:08:14.152274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1748/3413] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:13 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1309 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:14.163189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:14.175632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:14.208538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:14.209461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:14.210068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:14.211037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:14.212006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:14.215098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:14.473441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:14.487668 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-906a8db3-af24-4384-bad1-f65c533a3f45 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1293 microversion: 2.1 time: 0.418736 Aug 06 21:08:14.503501 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1666/3414] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:14 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1293 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:14.601119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:14.602041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:14.613839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:14.614337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:14.617085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:14.617879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:14.618375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:14.621867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:15.040805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:15.049000 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d74e98d-7926-458c-b0ea-57fe824665ed tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1315 microversion: 2.1 time: 0.895397 Aug 06 21:08:15.049616 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1749/3415] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:14 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:15.059349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:15.061205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:15.076720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:15.087467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:15.087841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:15.088602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:15.089072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:15.089714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:15.249812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:15.261378 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d584fd2-9ed5-4e08-a078-dfcc075c3595 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1274 microversion: 2.1 time: 0.205733 Aug 06 21:08:15.267437 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1750/3416] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:15 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:15.277838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0681c554-6c7f-4d1f-bf34-19c96d1fa881 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729ce99dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:15.358508 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0681c554-6c7f-4d1f-bf34-19c96d1fa881 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1455 microversion: 2.1 time: 0.089556 Aug 06 21:08:15.366371 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1751/3417] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:15 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:15.366371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f1eac7ae-796f-439b-936e-3cf2e3c88996 req-b7d00584-61a0-41f6-9fe3-a990d818a9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3229247f-828a-4c89-8986-792f56e6c1c7", "name": "network-vif-plugged", "status": "completed", "tag": "de4bacaa-010d-443c-8d6d-95f754443cd7"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:15.386054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f1eac7ae-796f-439b-936e-3cf2e3c88996 req-b7d00584-61a0-41f6-9fe3-a990d818a9b2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:15.386894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f1eac7ae-796f-439b-936e-3cf2e3c88996 req-b7d00584-61a0-41f6-9fe3-a990d818a9b2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:15.388326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f1eac7ae-796f-439b-936e-3cf2e3c88996 req-b7d00584-61a0-41f6-9fe3-a990d818a9b2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:15.406219 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f1eac7ae-796f-439b-936e-3cf2e3c88996 req-b7d00584-61a0-41f6-9fe3-a990d818a9b2 service nova] Creating event network-vif-plugged:de4bacaa-010d-443c-8d6d-95f754443cd7 for instance 3229247f-828a-4c89-8986-792f56e6c1c7 on nch1-master-1 Aug 06 21:08:15.416958 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f1eac7ae-796f-439b-936e-3cf2e3c88996 req-b7d00584-61a0-41f6-9fe3-a990d818a9b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056257 Aug 06 21:08:15.419452 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1752/3418] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:15.428835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:15.430406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:15.438057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:15.441666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:15.442368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:15.443379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:15.444026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:15.444705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:15.774109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:15.786882 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eba31204-3f06-4f70-afa9-3c7f97b9013a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1309 microversion: 2.1 time: 0.365814 Aug 06 21:08:15.807430 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1753/3419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:15 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1309 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:15.815455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:15.816341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:15.826032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:15.828220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:15.829087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:15.829771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:15.830944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:15.831614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:15.832413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:16.180685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:16.189876 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab544e17-2315-44b3-9eb3-4508892385a7 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1293 microversion: 2.1 time: 0.380409 Aug 06 21:08:16.191818 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1754/3420] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:15 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1293 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:16.197941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d7fe1c7-8aec-4161-bd85-34b28664969e tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f729d6e2dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:16.298076 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d7fe1c7-8aec-4161-bd85-34b28664969e tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fdaaf046-23a1-4673-a41d-cfde13fd77e7" status: 200 len: 344 microversion: 2.1 time: 0.104957 Aug 06 21:08:16.298693 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1755/3421] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:08:16 2022] GET /compute/v2.1/os-volumes/fdaaf046-23a1-4673-a41d-cfde13fd77e7 => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:16.305809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-149553155", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd0495d3-ebe3-46a8-845b-41c3f0fc9a67"}], "security_groups": [{"name": "tempest-securitygroup--1414025012"}], "key_name": "tempest-keypair-913635642", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:16.377358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:16.428939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:16.438890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:16.440211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a2925956-b426-47a7-8439-4f3c2aaf83db tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2956 microversion: 2.32 time: 1.843139 Aug 06 21:08:16.447670 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1667/3422] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:14 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2956 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:16.470951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:16.471900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:16.479320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:16.480110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:16.480729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:16.481637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:16.482249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:16.482872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:16.733768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] validate_networks() for [('bd0495d3-ebe3-46a8-845b-41c3f0fc9a67', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:08:16.961408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:16.971074 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6d13d599-c488-4471-b1d2-6640d36f8f7d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1315 microversion: 2.1 time: 0.507054 Aug 06 21:08:16.972829 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1668/3423] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:16 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:16.982219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:16.983072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:16.992861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:16.994974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:16.995772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:16.996692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:16.997319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:16.998463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:17.323148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:17.334243 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4d0fd7f6-47a9-4ca5-a3fa-4b983531fd24 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1316 microversion: 2.1 time: 0.359571 Aug 06 21:08:17.336153 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1669/3424] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:16 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:17.341565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23260a20-1c67-49ba-a9f4-992e3f1787ed tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f729d88e9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:17.447163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:08:17.447742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:08:17.448336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:08:17.448751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:08:17.449259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:08:17.461790 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23260a20-1c67-49ba-a9f4-992e3f1787ed tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1015 microversion: 2.1 time: 0.124312 Aug 06 21:08:17.462390 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1670/3425] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Aug 6 21:08:17 2022] GET /compute/v2.1/os-volumes => generated 1015 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:17.466921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33f52c77-043f-4e53-9fcc-2eb1f8511ca8 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d34dca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:17.472281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:17.472725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:17.476511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:17.477546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:17.479425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:17.480137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:17.532036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Getting quotas for project 8046f1ab9c004060965dced02db4b7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:08:17.546827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Getting quotas for user f7cf258df10248d0bdcf64fa075c132c and project 8046f1ab9c004060965dced02db4b7c4. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:08:17.575695 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33f52c77-043f-4e53-9fcc-2eb1f8511ca8 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1464 microversion: 2.1 time: 0.112045 Aug 06 21:08:17.576297 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1671/3426] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:17 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1464 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:17.586032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:17.589165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:08:17.592339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:17.595623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:08:17.602738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:17.604704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:17.605327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:17.606432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:17.608165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:17.608811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:17.670699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa3f0ecd-33f8-4251-a542-4bf6879a334c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.370795 Aug 06 21:08:17.684340 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1756/3427] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:08:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:08:17.690847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:17.696905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:17.705357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:17.705863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:17.706312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:17.707062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:17.707522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:17.708145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:17.993605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:18.003715 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-205fe06e-b861-43e8-bfca-f7176729e7f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1293 microversion: 2.1 time: 0.317824 Aug 06 21:08:18.004168 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1757/3428] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:17 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1293 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:18.010183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:18.010838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:18.017492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.018240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.018902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.019988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.021444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.022178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.047093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:18.063090 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8c8bb32-1ad8-47ac-bcbe-504168d138d3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1490 microversion: 2.1 time: 0.483177 Aug 06 21:08:18.063689 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1672/3429] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:17 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1490 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:18.068914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-203ab32b-cb31-4429-adc6-ec3b5676fdde tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f729d31ca60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:18.170094 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-203ab32b-cb31-4429-adc6-ec3b5676fdde tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.105260 Aug 06 21:08:18.171041 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1673/3430] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 681 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:18.177545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-08ecfd1e-f9d5-4735-b741-5ea62d0bdef6 req-ecd0c219-38da-4736-ad06-f8c8e7482fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51422ace-16be-4c73-a47b-fef4706c040f", "tag": "648f1909-7a3d-44f5-a174-4763c3fa4039"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:18.192483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-08ecfd1e-f9d5-4735-b741-5ea62d0bdef6 req-ecd0c219-38da-4736-ad06-f8c8e7482fbd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.193341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-08ecfd1e-f9d5-4735-b741-5ea62d0bdef6 req-ecd0c219-38da-4736-ad06-f8c8e7482fbd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.194011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-08ecfd1e-f9d5-4735-b741-5ea62d0bdef6 req-ecd0c219-38da-4736-ad06-f8c8e7482fbd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.210018 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-08ecfd1e-f9d5-4735-b741-5ea62d0bdef6 req-ecd0c219-38da-4736-ad06-f8c8e7482fbd service nova] Creating event network-changed:648f1909-7a3d-44f5-a174-4763c3fa4039 for instance 51422ace-16be-4c73-a47b-fef4706c040f on nch2-master-1 Aug 06 21:08:18.217757 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-08ecfd1e-f9d5-4735-b741-5ea62d0bdef6 req-ecd0c219-38da-4736-ad06-f8c8e7482fbd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044781 Aug 06 21:08:18.219266 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1674/3431] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:18.227525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ca30f18-b666-4656-bb63-4e42c1524783 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d30baf0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:18.271940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:18.290531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:18.292469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:18.293974 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eb1466f2-2cb5-4d0d-bb9e-cbaf2af886c1 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2935 microversion: 2.32 time: 0.288686 Aug 06 21:08:18.295219 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1758/3432] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2935 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:18.298086 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1ca30f18-b666-4656-bb63-4e42c1524783 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 200 len: 1464 microversion: 2.1 time: 0.076618 Aug 06 21:08:18.300505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-076b0e05-f177-4d09-b8a4-0712b408b151 req-5ae05987-b292-4528-b5e8-bf2b47d7803a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3b8b1b6-b2ef-4d11-a546-09fe700c8384", "tag": "4798e7f2-3abc-4038-a9ae-a60827e2b1c9"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:18.309294 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1675/3433] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:18.311437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-076b0e05-f177-4d09-b8a4-0712b408b151 req-5ae05987-b292-4528-b5e8-bf2b47d7803a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.312166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-076b0e05-f177-4d09-b8a4-0712b408b151 req-5ae05987-b292-4528-b5e8-bf2b47d7803a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.312815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-076b0e05-f177-4d09-b8a4-0712b408b151 req-5ae05987-b292-4528-b5e8-bf2b47d7803a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.315869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:18.316828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:18.328425 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-076b0e05-f177-4d09-b8a4-0712b408b151 req-5ae05987-b292-4528-b5e8-bf2b47d7803a service nova] Creating event network-changed:4798e7f2-3abc-4038-a9ae-a60827e2b1c9 for instance b3b8b1b6-b2ef-4d11-a546-09fe700c8384 on nch2-master-1 Aug 06 21:08:18.334290 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-076b0e05-f177-4d09-b8a4-0712b408b151 req-5ae05987-b292-4528-b5e8-bf2b47d7803a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036949 Aug 06 21:08:18.335433 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1759/3434] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:18.340937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:18.341879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:18.350339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.351189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.351879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.352951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.353568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.354209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.355415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.361560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.362290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.363168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.365234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.369176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.510290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:18.529509 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d6517ddd-7663-4f43-abd9-56dcfce0dae1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1248 microversion: 2.1 time: 0.218074 Aug 06 21:08:18.530439 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1676/3435] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1248 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:18.535953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-282df45a-2b13-48ae-bc94-3a34defcde80 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:18.539185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-282df45a-2b13-48ae-bc94-3a34defcde80 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:18.545818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282df45a-2b13-48ae-bc94-3a34defcde80 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.546318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282df45a-2b13-48ae-bc94-3a34defcde80 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.547255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282df45a-2b13-48ae-bc94-3a34defcde80 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.547989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282df45a-2b13-48ae-bc94-3a34defcde80 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.548555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282df45a-2b13-48ae-bc94-3a34defcde80 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.549419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-282df45a-2b13-48ae-bc94-3a34defcde80 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.575794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:18.588099 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ec8f5503-6bc3-4f93-bca3-dd80750b1fe8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1315 microversion: 2.1 time: 0.250982 Aug 06 21:08:18.589343 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1760/3436] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:18.594382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e7485cb-2a53-4914-b6c3-abeeece7f203 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f729d6e23a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:18.648307 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-282df45a-2b13-48ae-bc94-3a34defcde80 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "PUT /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1085 microversion: 2.1 time: 0.116432 Aug 06 21:08:18.649160 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1677/3437] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:08:18 2022] PUT /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1085 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:18.655991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:18.657379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:18.667315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.667877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.668335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.669066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.669536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.670041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.696180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e7485cb-2a53-4914-b6c3-abeeece7f203 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1015 microversion: 2.1 time: 0.105312 Aug 06 21:08:18.697128 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1761/3438] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/os-volumes => generated 1015 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:18.702435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:18.703604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:18.712289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.713027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.713464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.714167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.714713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.715140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.856000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:18.875082 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d04fe757-1996-4291-bcf0-79477b8dcae4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1316 microversion: 2.1 time: 0.176586 Aug 06 21:08:18.875676 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1762/3439] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:18.880387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:18.880992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:18.893517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.894244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.894899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.895620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:18.896887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:18.897776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:18.907789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:18.918051 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a136e5b3-44f5-4bc6-8d77-3166fe3d487a tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4" status: 200 len: 1465 microversion: 2.1 time: 0.267737 Aug 06 21:08:18.918872 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1678/3440] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 => generated 1465 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:18.924078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6dfb9648-6493-4d4b-866f-cb8a60890697 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f729d359f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.023340 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6dfb9648-6493-4d4b-866f-cb8a60890697 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.103566 Aug 06 21:08:19.027145 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1679/3441] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:19.030311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3d8c8444-cf72-4707-aa99-8c478cf0b161 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d07eee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.067130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:19.075913 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-90dd35b0-1d56-4dca-bd3e-7fd1917d32ef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1511 microversion: 2.1 time: 0.199044 Aug 06 21:08:19.076717 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1763/3442] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:18 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:19.082046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.083036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:19.090889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:19.091625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:19.092246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:19.093117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:19.093719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:19.094585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:19.256830 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3d8c8444-cf72-4707-aa99-8c478cf0b161 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images?changes-since=2022-08-06T21%3A06%3A13Z" status: 200 len: 2374 microversion: 2.1 time: 0.231633 Aug 06 21:08:19.257893 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1680/3443] 10.222.0.33 () {58 vars in 1199 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/images?changes-since=2022-08-06T21%3A06%3A13Z => generated 2374 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:19.263212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b40463a8-0ac0-4852-8c01-999aa0ee8c09 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f729d92c3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.287445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:19.296633 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5e3c92d8-2a2b-4e3c-9087-320df403e8d2 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1293 microversion: 2.1 time: 0.218167 Aug 06 21:08:19.311958 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1764/3444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1293 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:19.316846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.318344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:19.325601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:19.326190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:19.326696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:19.327594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:19.328218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:19.328805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:19.373266 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b40463a8-0ac0-4852-8c01-999aa0ee8c09 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.114084 Aug 06 21:08:19.373995 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1681/3445] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 681 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:19.380949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d7062e4c-74c7-46eb-ab3c-c53a69c340f0 req-0b4710e7-a96b-48d9-a539-1aa49bd10b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a81b975-f91b-4df1-8618-3c3d6f2b2282", "name": "network-vif-plugged", "status": "completed", "tag": "52a237f9-d2cb-46f2-a85a-442708aca2b1"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:19.404194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7062e4c-74c7-46eb-ab3c-c53a69c340f0 req-0b4710e7-a96b-48d9-a539-1aa49bd10b99 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:19.405196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7062e4c-74c7-46eb-ab3c-c53a69c340f0 req-0b4710e7-a96b-48d9-a539-1aa49bd10b99 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:19.406363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d7062e4c-74c7-46eb-ab3c-c53a69c340f0 req-0b4710e7-a96b-48d9-a539-1aa49bd10b99 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:19.434823 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d7062e4c-74c7-46eb-ab3c-c53a69c340f0 req-0b4710e7-a96b-48d9-a539-1aa49bd10b99 service nova] Creating event network-vif-plugged:52a237f9-d2cb-46f2-a85a-442708aca2b1 for instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 on nch1-master-1 Aug 06 21:08:19.443756 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d7062e4c-74c7-46eb-ab3c-c53a69c340f0 req-0b4710e7-a96b-48d9-a539-1aa49bd10b99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067745 Aug 06 21:08:19.445589 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1682/3446] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:19.453222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d9a8d1bc-6480-45b0-8570-8522575359f9 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d357700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.571055 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d9a8d1bc-6480-45b0-8570-8522575359f9 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-192538689" status: 200 len: 484 microversion: 2.1 time: 0.123527 Aug 06 21:08:19.580268 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1683/3447] 10.222.0.33 () {58 vars in 1229 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-192538689 => generated 484 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:19.588376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.590343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:19.601512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:19.602487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:19.602938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:19.603768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:19.605265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:19.606071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:19.606995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:19.624374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-81c75909-9e87-4f90-84f2-5590f235ea01 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1511 microversion: 2.1 time: 0.309631 Aug 06 21:08:19.627489 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1765/3448] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:19.641543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-708a2dbe-cf3f-4714-9127-bf629fa1de0f tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f729ce7a5e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.755320 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-708a2dbe-cf3f-4714-9127-bf629fa1de0f tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1015 microversion: 2.1 time: 0.125487 Aug 06 21:08:19.764314 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1766/3449] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1015 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:19.769362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.770441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:19.777605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:19.778319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:19.779401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:19.780296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:19.780919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:19.781498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:19.854596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:19.863340 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a4057ec9-9e4c-4b64-a2ee-fbc5cf8f2891 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1302 microversion: 2.1 time: 0.097300 Aug 06 21:08:19.863941 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1767/3450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:19.877197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fd79f18-4dd8-47d5-8c75-4c758377eacf tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729ce7aee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.984956 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3fd79f18-4dd8-47d5-8c75-4c758377eacf tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images?server=e0926358-eed5-4b13-a285-2f56c382bce4" status: 200 len: 957 microversion: 2.1 time: 0.116695 Aug 06 21:08:19.986092 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1768/3451] 10.222.0.33 () {58 vars in 1209 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/images?server=e0926358-eed5-4b13-a285-2f56c382bce4 => generated 957 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:19.993342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:19.994292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:19.997109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:20.002149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.003496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.004449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.005295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.005992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.006763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.016269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:20.025273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:20.027373 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-448b49ac-8212-4590-84f8-6ef423af1adf tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2914 microversion: 2.32 time: 0.445329 Aug 06 21:08:20.029565 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1684/3452] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2914 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:20.038290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:20.039878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:20.066854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.067381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.067903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.069028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.069513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.069951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.116291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:08:20.225890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:20.237169 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22d5f05a-6a48-4a74-ba4f-0886835f2423 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1315 microversion: 2.1 time: 0.248478 Aug 06 21:08:20.252047 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1769/3453] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:19 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:20.258830 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eeee4cc7-3b05-4c74-8111-e88908923619 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 204 len: 0 microversion: 2.1 time: 0.227210 Aug 06 21:08:20.259581 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1685/3454] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:08:20 2022] DELETE /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:20.260179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-456e4735-f33b-4e19-8f5d-c7cc9d240a23 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f729d76dd30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:20.271782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:20.272938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:20.284200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.284719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.285533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.287957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.288480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.288937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.383068 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-456e4735-f33b-4e19-8f5d-c7cc9d240a23 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.129417 Aug 06 21:08:20.392191 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1770/3455] 10.222.0.33 () {58 vars in 1188 bytes} [Sat Aug 6 21:08:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:20.392191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-86b19292-d9a1-41a8-a385-9097e4ebd53f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729ce99a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:20.449658 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-86b19292-d9a1-41a8-a385-9097e4ebd53f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 485 microversion: 2.1 time: 0.064411 Aug 06 21:08:20.450246 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1771/3456] 10.222.0.33 () {58 vars in 1317 bytes} [Sat Aug 6 21:08:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 485 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:20.455560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:20.456515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:20.463815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.464752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.465382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.466318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.466826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.467258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.729446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:20.740796 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-72d204e7-6516-40c3-9533-670b4fd566ea tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1517 microversion: 2.1 time: 0.288881 Aug 06 21:08:20.746717 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1772/3457] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:20 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:20.751738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7df7584d-0b9b-4cd4-b2a9-0d54bbc64d84 req-651cfd76-2b72-4bf1-9aab-f576fbae37b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-deleted", "tag": "dc2f2a9e-e294-4e5e-bc40-3584c6c59c89"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:20.763833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7df7584d-0b9b-4cd4-b2a9-0d54bbc64d84 req-651cfd76-2b72-4bf1-9aab-f576fbae37b7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.764296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7df7584d-0b9b-4cd4-b2a9-0d54bbc64d84 req-651cfd76-2b72-4bf1-9aab-f576fbae37b7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.764738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7df7584d-0b9b-4cd4-b2a9-0d54bbc64d84 req-651cfd76-2b72-4bf1-9aab-f576fbae37b7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.782068 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7df7584d-0b9b-4cd4-b2a9-0d54bbc64d84 req-651cfd76-2b72-4bf1-9aab-f576fbae37b7 service nova] Creating event network-vif-deleted:dc2f2a9e-e294-4e5e-bc40-3584c6c59c89 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:20.788758 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7df7584d-0b9b-4cd4-b2a9-0d54bbc64d84 req-651cfd76-2b72-4bf1-9aab-f576fbae37b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040448 Aug 06 21:08:20.789823 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1773/3458] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:20.795117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:20.796204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:20.804383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.805160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.805609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.806333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:20.806829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:20.807778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:20.813342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:20.922091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:20.979744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=24 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:21.042695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:21.051350 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-26c215e0-4e9b-4d31-ad4d-cceaae53f24f tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1293 microversion: 2.1 time: 0.259810 Aug 06 21:08:21.052786 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1774/3459] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:20 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1293 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:21.058158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb3bea12-b11a-46cd-a5da-2b944e3de089 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] Calling method '.version_select at 0x7f729d6ceca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:21.147542 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb3bea12-b11a-46cd-a5da-2b944e3de089 tempest-VolumesTestJSON-438187184 tempest-VolumesTestJSON-438187184-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1015 microversion: 2.1 time: 0.093668 Aug 06 21:08:21.148626 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1775/3460] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1015 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:21.153230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c5e42376-b80b-4493-ae61-4b7605ecc774 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d785790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:21.173390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:21.183967 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8ad5ff68-25d2-4b3a-a990-f02e5bc77837 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1316 microversion: 2.1 time: 0.922849 Aug 06 21:08:21.198655 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1686/3461] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:20 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1316 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:21.203492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:21.204119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:21.211244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:21.211754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:21.212273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:21.213016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:21.213455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:21.213913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:21.216462 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c5e42376-b80b-4493-ae61-4b7605ecc774 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 485 microversion: 2.1 time: 0.066794 Aug 06 21:08:21.217653 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1776/3462] 10.222.0.33 () {58 vars in 1303 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 485 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:21.225768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:21.226652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:21.235672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:21.236310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:21.236771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:21.237496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:21.238007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:21.238391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:21.352527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:21.368554 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-88468023-7e3f-43c4-828a-3139bffb423b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1302 microversion: 2.1 time: 0.168285 Aug 06 21:08:21.370909 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1687/3463] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1302 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:21.382230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f3d08b9-e641-4f12-b983-acce20c1f8c7 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dbe1af0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:21.473448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:21.501994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:21.505670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:21.507562 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-51275c05-ec72-47a3-a4fb-c836b64989c9 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2867 microversion: 2.32 time: 0.286586 Aug 06 21:08:21.515149 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1777/3464] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2867 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:21.518612 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f3d08b9-e641-4f12-b983-acce20c1f8c7 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.144506 Aug 06 21:08:21.529743 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1688/3465] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:21.536320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:21.536647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-unplugged", "status": "completed", "tag": "704b305d-9ef8-4035-989e-bd611601a7f3"}, {"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-unplugged", "status": "completed", "tag": "dc2f2a9e-e294-4e5e-bc40-3584c6c59c89"}, {"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-unplugged", "status": "completed", "tag": "a0f07aff-5b47-47bb-b63d-3dff727efe2d"}, {"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-unplugged", "status": "completed", "tag": "74538f9f-74be-4eb8-a576-48c3c9114977"}, {"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-unplugged", "status": "completed", "tag": "3767dba4-c6b1-4af4-9bad-afbb01fd063a"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:21.537444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:21.545649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:21.552402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:21.553549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:21.558326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:21.558884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:21.559575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:21.565012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:21.566189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:21.567971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:21.568745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:21.575755 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] Creating event network-vif-unplugged:704b305d-9ef8-4035-989e-bd611601a7f3 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:21.577987 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] Creating event network-vif-unplugged:dc2f2a9e-e294-4e5e-bc40-3584c6c59c89 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:21.577987 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] Creating event network-vif-unplugged:a0f07aff-5b47-47bb-b63d-3dff727efe2d for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:21.577987 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] Creating event network-vif-unplugged:74538f9f-74be-4eb8-a576-48c3c9114977 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:21.579066 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] Creating event network-vif-unplugged:3767dba4-c6b1-4af4-9bad-afbb01fd063a for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:21.586633 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e87d776d-bc85-46d2-8b83-b1f709ff19b8 req-b44dba10-9842-4607-ba7e-439bc68a4fa7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.065289 Aug 06 21:08:21.587525 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1689/3466] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:21.595859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3a1c55f0-4a64-4747-a430-15278fd0a614 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d88ee50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:21.736014 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3a1c55f0-4a64-4747-a430-15278fd0a614 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.147225 Aug 06 21:08:21.739357 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1690/3467] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:21.765770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf335c14-7fa5-4461-9bbf-5b7c58e23af8 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d357940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:21.914074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:21.924373 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf335c14-7fa5-4461-9bbf-5b7c58e23af8 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.175555 Aug 06 21:08:21.926365 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1691/3468] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:21.938267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:21.939380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:21.947234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:21.948140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:21.948836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:21.949788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:21.950475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:21.955022 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e6f7c23a-272d-43ed-97d6-e436421845af tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1315 microversion: 2.1 time: 0.434707 Aug 06 21:08:21.956173 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1778/3469] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:21.963986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:21.965941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-986d0fa9-20ce-466d-a0cc-a880292eeb46 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729ce99dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:22.010266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:22.159307 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-986d0fa9-20ce-466d-a0cc-a880292eeb46 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/detail?changes-since=2022-08-06T21%3A06%3A08Z" status: 200 len: 6332 microversion: 2.1 time: 0.200469 Aug 06 21:08:22.176257 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1779/3470] 10.222.0.33 () {58 vars in 1220 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-06T21%3A06%3A08Z => generated 6332 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:22.182654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:22.183576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:22.194904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:22.195666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:22.196575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:22.197468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:22.198533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:22.199172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:22.441616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:22.451877 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ef709c9-5eb1-404e-ad01-0c46f24c4bec tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1484 microversion: 2.1 time: 0.274224 Aug 06 21:08:22.452899 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1780/3471] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:22 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1484 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:22.458248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a2ca0377-cf09-4e4f-af49-0ee5bccf177d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729ce99280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:22.572977 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a2ca0377-cf09-4e4f-af49-0ee5bccf177d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-192538689" status: 200 len: 664 microversion: 2.1 time: 0.116053 Aug 06 21:08:22.573759 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1781/3472] 10.222.0.33 () {58 vars in 1250 bytes} [Sat Aug 6 21:08:22 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-192538689 => generated 664 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:22.593859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:22.595258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:22.610396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:22.611396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:22.611839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:22.612576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:22.613051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:22.613489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:22.785582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:22.797129 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-657683d3-63ba-4ca0-a529-33df400223e9 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1316 microversion: 2.1 time: 0.218580 Aug 06 21:08:22.797726 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1782/3473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:22 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:22.814793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:22.818147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:22.832733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:22.835024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:22.835698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:22.836793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:22.837893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:22.839037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:22.918636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:22.932296 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7aa7f47-36d7-42b8-a091-f2506d3af6f3 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1517 microversion: 2.1 time: 1.003771 Aug 06 21:08:22.932983 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1692/3474] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:21 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1517 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:22.947236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b95e2c5a-0b66-449b-a514-c29108c4ff01 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:22.948215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b95e2c5a-0b66-449b-a514-c29108c4ff01 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:22.955788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b95e2c5a-0b66-449b-a514-c29108c4ff01 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:22.956536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b95e2c5a-0b66-449b-a514-c29108c4ff01 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:22.957197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b95e2c5a-0b66-449b-a514-c29108c4ff01 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:22.958620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b95e2c5a-0b66-449b-a514-c29108c4ff01 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:22.959317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b95e2c5a-0b66-449b-a514-c29108c4ff01 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:22.960123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b95e2c5a-0b66-449b-a514-c29108c4ff01 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:23.025868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:23.034426 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e05f4616-c190-40d8-ad08-315d7f8ee088 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1370 microversion: 2.1 time: 0.229998 Aug 06 21:08:23.035129 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1783/3475] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:22 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:23.040971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:23.041661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:23.048399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:23.049215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:23.049881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:23.050817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:23.051282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:23.051716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:23.206437 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b95e2c5a-0b66-449b-a514-c29108c4ff01 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272518 Aug 06 21:08:23.207103 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1693/3476] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:08:22 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282/os-interface => generated 284 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:23.212008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd3eaf49-a984-4bbd-884f-021d00b7554f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a347e820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:23.289122 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dd3eaf49-a984-4bbd-884f-021d00b7554f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1467 microversion: 2.1 time: 0.080598 Aug 06 21:08:23.289716 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1694/3477] 10.222.0.33 () {58 vars in 1338 bytes} [Sat Aug 6 21:08:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1467 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:23.299427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f3473646-669b-4965-8ef6-4e0f2b751646 req-257c45e1-22a8-4947-8029-ee0400570cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-deleted", "tag": "704b305d-9ef8-4035-989e-bd611601a7f3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:23.332533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f3473646-669b-4965-8ef6-4e0f2b751646 req-257c45e1-22a8-4947-8029-ee0400570cf5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:23.333604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f3473646-669b-4965-8ef6-4e0f2b751646 req-257c45e1-22a8-4947-8029-ee0400570cf5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:23.334619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f3473646-669b-4965-8ef6-4e0f2b751646 req-257c45e1-22a8-4947-8029-ee0400570cf5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:23.338081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:23.356995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:23.357921 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f3473646-669b-4965-8ef6-4e0f2b751646 req-257c45e1-22a8-4947-8029-ee0400570cf5 service nova] Creating event network-vif-deleted:704b305d-9ef8-4035-989e-bd611601a7f3 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:23.358708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:23.360307 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0894e464-f73c-48fe-aede-0adf07ba7919 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2706 microversion: 2.32 time: 0.323896 Aug 06 21:08:23.361955 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1784/3478] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:23 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2706 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:23.368547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:23.369168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:23.377953 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f3473646-669b-4965-8ef6-4e0f2b751646 req-257c45e1-22a8-4947-8029-ee0400570cf5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086105 Aug 06 21:08:23.378919 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1695/3479] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:23.384248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2aa8b9c3-a06a-4f80-bb90-4045252a7d1e tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dc26dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:23.408708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:23.409216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:23.409738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:23.410464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:23.413883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:23.414610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:23.472013 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2aa8b9c3-a06a-4f80-bb90-4045252a7d1e tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1467 microversion: 2.1 time: 0.091837 Aug 06 21:08:23.472904 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1696/3480] 10.222.0.33 () {58 vars in 1324 bytes} [Sat Aug 6 21:08:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1467 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:23.493451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1168c05-bf60-4024-ae1c-d9312d84f3d0 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a347e8b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:23.651103 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d1168c05-bf60-4024-ae1c-d9312d84f3d0 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.166101 Aug 06 21:08:23.662750 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1697/3481] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Aug 6 21:08:23 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:23.662750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-cabdcafc-6e57-4904-ab48-5ee3850b60f1 req-7077f440-833b-43ca-b730-c4a63da5e202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0926358-eed5-4b13-a285-2f56c382bce4", "name": "network-vif-unplugged", "status": "completed", "tag": "5c0b2605-3a4d-45dd-876d-81e3e36ceb49"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:23.670859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cabdcafc-6e57-4904-ab48-5ee3850b60f1 req-7077f440-833b-43ca-b730-c4a63da5e202 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:23.671519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cabdcafc-6e57-4904-ab48-5ee3850b60f1 req-7077f440-833b-43ca-b730-c4a63da5e202 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:23.671968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cabdcafc-6e57-4904-ab48-5ee3850b60f1 req-7077f440-833b-43ca-b730-c4a63da5e202 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:23.703552 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-cabdcafc-6e57-4904-ab48-5ee3850b60f1 req-7077f440-833b-43ca-b730-c4a63da5e202 service nova] Creating event network-vif-unplugged:5c0b2605-3a4d-45dd-876d-81e3e36ceb49 for instance e0926358-eed5-4b13-a285-2f56c382bce4 on nch2-master-1 Aug 06 21:08:23.712218 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-cabdcafc-6e57-4904-ab48-5ee3850b60f1 req-7077f440-833b-43ca-b730-c4a63da5e202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057980 Aug 06 21:08:23.716934 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1698/3482] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:23.723800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a47c0e92-8811-4fa0-afb0-a90acf96f425 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dd4f820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:23.787460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:23.796916 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e02e8cf2-7da8-4ee9-91e8-728fa7d0809e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1315 microversion: 2.1 time: 0.432651 Aug 06 21:08:23.802363 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1785/3483] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:23 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:23.834205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:23.835427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:23.844459 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a47c0e92-8811-4fa0-afb0-a90acf96f425 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.125621 Aug 06 21:08:23.851192 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1699/3484] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Aug 6 21:08:23 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:23.868362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:23.868975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:23.869948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:23.871009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:23.871977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:23.872767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:23.881430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1bf542bb-31b3-450c-8948-1cdc308e7212 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d07edc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:24.001644 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1bf542bb-31b3-450c-8948-1cdc308e7212 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/5135514a-af3f-4057-893c-38dd4d85e4cd" status: 200 len: 784 microversion: 2.1 time: 0.123531 Aug 06 21:08:24.003600 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1700/3485] 10.222.0.33 () {58 vars in 1233 bytes} [Sat Aug 6 21:08:23 2022] GET /compute/v2.1/images/5135514a-af3f-4057-893c-38dd4d85e4cd => generated 784 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:24.022654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:24.024304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:24.054120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:24.059194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:24.059756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:24.060952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:24.061658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:24.062310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:24.235146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:24.246871 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47a7e941-6ad0-4089-b1fe-38d9886ea829 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1316 microversion: 2.1 time: 0.429392 Aug 06 21:08:24.247799 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1786/3486] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:23 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:24.260900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fecb8802-1435-47f2-8337-dc85fb6f463d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f72a344c310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:24.286696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:24.312275 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb72b775-1da0-4e95-864a-e3c62de359fe tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 200 len: 1475 microversion: 2.1 time: 0.307151 Aug 06 21:08:24.315670 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1701/3487] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:24 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 1475 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:24.329819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:24.331443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:24.353144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:24.353617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:24.354529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:24.354899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:24.361743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:24.362159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:24.531366 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fecb8802-1435-47f2-8337-dc85fb6f463d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.282245 Aug 06 21:08:24.532296 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1787/3488] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 21:08:24 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:24.546510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:24.547178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:24.562220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:24.562765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:24.563220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:24.563944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:24.564418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:24.564855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:24.806229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:24.823908 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9c73e605-025f-4b09-abb7-757fa8ed4579 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1370 microversion: 2.1 time: 0.506775 Aug 06 21:08:24.825252 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1702/3489] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:24 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1370 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:24.842598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28c4bb7c-eed8-4e1b-9920-32933325eb1e tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729de21ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:24.912656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:24.938524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:24.944939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:24.952793 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3ea45f55-80da-487d-8def-65a44572511e tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2545 microversion: 2.32 time: 0.407975 Aug 06 21:08:24.954478 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1788/3490] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:24 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2545 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:24.964708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:24.981130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:25.000484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:25.002785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:25.003518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:25.005457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:25.013003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:25.014211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:25.668893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:25.713312 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0f656ea6-5966-46a8-af64-481d43339429 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1315 microversion: 2.1 time: 0.754250 Aug 06 21:08:25.716770 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1789/3491] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:24 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:25.741151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:25.742193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:25.746855 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28c4bb7c-eed8-4e1b-9920-32933325eb1e tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "DELETE /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929" status: 204 len: 0 microversion: 2.1 time: 0.919862 Aug 06 21:08:25.747464 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1703/3492] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:24 2022] DELETE /compute/v2.1/images/dcb5a1dc-16a7-4648-8af0-026048d5b929 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:25.756469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:25.757261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:25.762505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:25.764005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:25.764585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:25.767175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:25.767782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:25.770075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:25.770240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:25.775089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:25.775772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:25.776763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:25.777437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:25.778082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:25.813921 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 HTTP/1.1 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '3229247f-828a-4c89-8986-792f56e6c1c7'} Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:25.816333 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:25.822126 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:25.822126 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:25.822126 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:25.822126 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:25.822126 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:08:25.822126 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:25.823812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:25.825141 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a9441176-d630-4436-8dd3-6c44a40f6d93 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 404 len: 111 microversion: 2.1 time: 0.073399 Aug 06 21:08:25.840568 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1704/3493] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:25 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:08:25.855687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ba5ae30d-8723-446e-8c8e-84024ef096c1 req-90816238-49d7-4f23-bc35-3a2154b8b694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-deleted", "tag": "a0f07aff-5b47-47bb-b63d-3dff727efe2d"}, {"server_uuid": "3229247f-828a-4c89-8986-792f56e6c1c7", "name": "network-vif-deleted", "tag": "de4bacaa-010d-443c-8d6d-95f754443cd7"}, {"name": "network-changed", "server_uuid": "d6e52696-5e64-4d90-a90c-69d78aad14e8", "tag": "26a07487-037f-4b16-b6ce-e506fe5ccc79"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:25.870209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ba5ae30d-8723-446e-8c8e-84024ef096c1 req-90816238-49d7-4f23-bc35-3a2154b8b694 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:25.870758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ba5ae30d-8723-446e-8c8e-84024ef096c1 req-90816238-49d7-4f23-bc35-3a2154b8b694 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:25.871507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ba5ae30d-8723-446e-8c8e-84024ef096c1 req-90816238-49d7-4f23-bc35-3a2154b8b694 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:25.893868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ba5ae30d-8723-446e-8c8e-84024ef096c1 req-90816238-49d7-4f23-bc35-3a2154b8b694 service nova] Creating event network-vif-deleted:a0f07aff-5b47-47bb-b63d-3dff727efe2d for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:25.894399 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ba5ae30d-8723-446e-8c8e-84024ef096c1 req-90816238-49d7-4f23-bc35-3a2154b8b694 service nova] Creating event network-vif-deleted:de4bacaa-010d-443c-8d6d-95f754443cd7 for instance 3229247f-828a-4c89-8986-792f56e6c1c7 on nch1-master-1 Aug 06 21:08:25.894945 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ba5ae30d-8723-446e-8c8e-84024ef096c1 req-90816238-49d7-4f23-bc35-3a2154b8b694 service nova] Creating event network-changed:26a07487-037f-4b16-b6ce-e506fe5ccc79 for instance d6e52696-5e64-4d90-a90c-69d78aad14e8 on nch1-master-1 Aug 06 21:08:25.917091 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ba5ae30d-8723-446e-8c8e-84024ef096c1 req-90816238-49d7-4f23-bc35-3a2154b8b694 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.074834 Aug 06 21:08:25.918673 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1705/3494] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:25.924600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:25.925637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:25.939851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:25.941363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:25.942427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:25.945446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:25.946362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:25.947395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:26.126640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:26.136349 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-19579665-6959-42c8-94a4-97215e3daa7d tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1316 microversion: 2.1 time: 0.409047 Aug 06 21:08:26.137972 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1790/3495] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:25 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:26.143364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ab544a78-a211-43e9-8df2-de9b8518768f req-334f3e0d-cafc-489a-9f9f-6ac41a2eda2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a81b975-f91b-4df1-8618-3c3d6f2b2282", "tag": "52a237f9-d2cb-46f2-a85a-442708aca2b1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:26.154232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ab544a78-a211-43e9-8df2-de9b8518768f req-334f3e0d-cafc-489a-9f9f-6ac41a2eda2c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:26.155005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ab544a78-a211-43e9-8df2-de9b8518768f req-334f3e0d-cafc-489a-9f9f-6ac41a2eda2c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:26.155603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ab544a78-a211-43e9-8df2-de9b8518768f req-334f3e0d-cafc-489a-9f9f-6ac41a2eda2c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:26.178142 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ab544a78-a211-43e9-8df2-de9b8518768f req-334f3e0d-cafc-489a-9f9f-6ac41a2eda2c service nova] Creating event network-changed:52a237f9-d2cb-46f2-a85a-442708aca2b1 for instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 on nch1-master-1 Aug 06 21:08:26.218080 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ab544a78-a211-43e9-8df2-de9b8518768f req-334f3e0d-cafc-489a-9f9f-6ac41a2eda2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057590 Aug 06 21:08:26.221624 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1791/3496] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:26.249650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-8cd97eb6-f8e4-4506-9378-e04815a21bc3 req-47ad0fc4-e019-474d-8b12-987bb1ed69ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b8b1b6-b2ef-4d11-a546-09fe700c8384", "name": "network-vif-plugged", "status": "completed", "tag": "4798e7f2-3abc-4038-a9ae-a60827e2b1c9"}, {"server_uuid": "51422ace-16be-4c73-a47b-fef4706c040f", "name": "network-vif-plugged", "status": "completed", "tag": "648f1909-7a3d-44f5-a174-4763c3fa4039"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:26.275295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8cd97eb6-f8e4-4506-9378-e04815a21bc3 req-47ad0fc4-e019-474d-8b12-987bb1ed69ab service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:26.276205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8cd97eb6-f8e4-4506-9378-e04815a21bc3 req-47ad0fc4-e019-474d-8b12-987bb1ed69ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:26.277594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8cd97eb6-f8e4-4506-9378-e04815a21bc3 req-47ad0fc4-e019-474d-8b12-987bb1ed69ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:26.304470 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-8cd97eb6-f8e4-4506-9378-e04815a21bc3 req-47ad0fc4-e019-474d-8b12-987bb1ed69ab service nova] Creating event network-vif-plugged:4798e7f2-3abc-4038-a9ae-a60827e2b1c9 for instance b3b8b1b6-b2ef-4d11-a546-09fe700c8384 on nch2-master-1 Aug 06 21:08:26.306272 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-8cd97eb6-f8e4-4506-9378-e04815a21bc3 req-47ad0fc4-e019-474d-8b12-987bb1ed69ab service nova] Creating event network-vif-plugged:648f1909-7a3d-44f5-a174-4763c3fa4039 for instance 51422ace-16be-4c73-a47b-fef4706c040f on nch2-master-1 Aug 06 21:08:26.317004 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-8cd97eb6-f8e4-4506-9378-e04815a21bc3 req-47ad0fc4-e019-474d-8b12-987bb1ed69ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091328 Aug 06 21:08:26.320251 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1792/3497] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:26.328993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c198802-89b2-4dc9-95ce-747515493d5f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729ce4a670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:26.333536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:26.342423 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a75c83cb-c992-42a3-80eb-45729a95e708 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1484 microversion: 2.1 time: 0.422219 Aug 06 21:08:26.347878 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1706/3498] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:25 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1484 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:26.356044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:26.363361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:26.376764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:26.377541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:26.377998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:26.378852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:26.379233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:26.381187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:27.214293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:27.222866 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f97eb5e2-29a8-48d0-9722-72b49854dc46 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1370 microversion: 2.1 time: 0.872821 Aug 06 21:08:27.223310 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1707/3499] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:26 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1370 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:27.229067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:27.229997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:27.236468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:27.237155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:27.237835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:27.238780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:27.240015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:27.240867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:27.421552 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1c198802-89b2-4dc9-95ce-747515493d5f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "DELETE /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4" status: 204 len: 0 microversion: 2.1 time: 1.099199 Aug 06 21:08:27.422130 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1793/3500] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:26 2022] DELETE /compute/v2.1/images/9ef567c4-6472-475a-9e7e-ca9644a71ed4 => generated 0 bytes in 1101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:27.429302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1817224974", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0827ee4a-610f-48e2-8263-78e781630780"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:27.459815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:27.469740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:27.477290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:27.480274 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1430c5bc-47da-4050-ac60-a12d3be182a8 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2341 microversion: 2.32 time: 0.254130 Aug 06 21:08:27.495047 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1708/3501] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:27 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2341 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:27.503171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:27.504008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:27.509677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:27.512074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:27.512571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:27.513327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:27.514488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:27.515150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:27.515769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:27.523751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] validate_networks() for [('0827ee4a-610f-48e2-8263-78e781630780', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:08:27.567735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=20 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:27.740452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:27.750043 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c115d36f-6072-4b4e-b443-cbcd7880d61a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1315 microversion: 2.1 time: 0.253872 Aug 06 21:08:27.750926 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1709/3502] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:27 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:27.758996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:27.759826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:27.768081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:27.768847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:27.769315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:27.770514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:27.771164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:27.771848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:28.013356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:28.027604 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e2c97efa-e62a-4beb-b7fd-106edfd24611 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1316 microversion: 2.1 time: 0.273714 Aug 06 21:08:28.028882 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1710/3503] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:27 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:28.035785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-51813403-cd98-424d-abed-cdc065b3bb37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d88e790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:28.161150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:08:28.161810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:08:28.162509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:08:28.162988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:08:28.163415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:08:28.183649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:28.184086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:28.184536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:28.185280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:28.188985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:28.189496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:28.240500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:08:28.246127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Getting quotas for user 7dcd210e197347f8ad1622ee882bee92 and project dbbbe30122a7461ea225294728dc8af7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:08:28.261395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:08:28.263739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:08:28.335011 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-293242fa-8f02-469d-8fe1-912a4a4eade9 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909133 Aug 06 21:08:28.335935 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1794/3504] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:08:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:08:28.341928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-00844f6f-8f61-4adc-876e-9f1b11bc237b req-1f3cd93c-e40e-4633-9dcb-c1b1c665993b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-deleted", "tag": "74538f9f-74be-4eb8-a576-48c3c9114977"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:28.357895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-00844f6f-8f61-4adc-876e-9f1b11bc237b req-1f3cd93c-e40e-4633-9dcb-c1b1c665993b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:28.358938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-00844f6f-8f61-4adc-876e-9f1b11bc237b req-1f3cd93c-e40e-4633-9dcb-c1b1c665993b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:28.361128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-00844f6f-8f61-4adc-876e-9f1b11bc237b req-1f3cd93c-e40e-4633-9dcb-c1b1c665993b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:28.383041 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-00844f6f-8f61-4adc-876e-9f1b11bc237b req-1f3cd93c-e40e-4633-9dcb-c1b1c665993b service nova] Creating event network-vif-deleted:74538f9f-74be-4eb8-a576-48c3c9114977 for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:28.396681 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-00844f6f-8f61-4adc-876e-9f1b11bc237b req-1f3cd93c-e40e-4633-9dcb-c1b1c665993b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058344 Aug 06 21:08:28.399104 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1795/3505] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:28.415961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:28.421922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:28.450884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:28.451893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:28.453760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:28.460225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:28.467244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:28.470375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:28.788752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:28.820997 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b7c8625-7f39-4e7c-9a60-f5b3477c648a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1370 microversion: 2.1 time: 0.420277 Aug 06 21:08:28.830697 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1796/3506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:28 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1370 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:28.853260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6bc5035-3275-46aa-936a-27a76571ef5c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:28.855136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6bc5035-3275-46aa-936a-27a76571ef5c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:29.033131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6bc5035-3275-46aa-936a-27a76571ef5c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:29.041798 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6bc5035-3275-46aa-936a-27a76571ef5c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1209 microversion: 2.1 time: 0.207464 Aug 06 21:08:29.042443 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1797/3507] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:28 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1209 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:29.047712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:29.048797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:29.057043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.057944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.058680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.059778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.060471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.061300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.373963 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-51813403-cd98-424d-abed-cdc065b3bb37 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "DELETE /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d" status: 204 len: 0 microversion: 2.1 time: 1.342745 Aug 06 21:08:29.375373 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1711/3508] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:28 2022] DELETE /compute/v2.1/images/6b5215e6-7825-4bc5-b200-7edc0158c54d => generated 0 bytes in 1346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:29.387317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:29.389414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:29.407476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.408905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.409543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.410514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.412337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.413297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.444574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:29.464044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:29.466830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:29.469343 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6dba5918-c834-41f3-bdde-e8805024ae95 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 2055 microversion: 2.32 time: 0.425839 Aug 06 21:08:29.471992 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1798/3509] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:29 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 2055 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:29.493448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:29.497860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:29.529871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.530848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.531589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.534896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.535683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.536952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.780111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:29.803918 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f2a4b7d8-989b-48ef-ad70-9bca1aaca3dd tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1503 microversion: 2.1 time: 0.422106 Aug 06 21:08:29.804741 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1712/3510] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:29 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:29.812183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:29.812919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:29.816329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:29.827165 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d3a2ea00-b0d0-4b0e-b36a-8a0e78d33233 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1504 microversion: 2.1 time: 0.353421 Aug 06 21:08:29.831554 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1799/3511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:29 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:29.855615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.856561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.857513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:29.858392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.859252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.860023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:29.860662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.863415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.867686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:29.870029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.870701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.871284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.872421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:29.872980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:29.873507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:29.908635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:29.909783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:08:29.916481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lazy-loading 'flavor' on Instance uuid 51422ace-16be-4c73-a47b-fef4706c040f {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:08:30.106385 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9be4dc0c-4b4c-48f2-9559-f935475820ed tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 204 len: 0 microversion: 2.1 time: 0.298896 Aug 06 21:08:30.106890 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1713/3512] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:08:29 2022] DELETE /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:30.113457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:30.115077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:30.122405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.122953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.123389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.124110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.124577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.125273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.228198 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e798c44-978d-4fe5-bf70-bf49df615657 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f/action" status: 202 len: 0 microversion: 2.1 time: 0.381327 Aug 06 21:08:30.229206 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1800/3513] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:08:29 2022] POST /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:08:30.238679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-051f20fa-0dd7-4dd3-aee7-ac0a718d7b8e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:30.240106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-051f20fa-0dd7-4dd3-aee7-ac0a718d7b8e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:30.251766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051f20fa-0dd7-4dd3-aee7-ac0a718d7b8e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.252554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051f20fa-0dd7-4dd3-aee7-ac0a718d7b8e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.253167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051f20fa-0dd7-4dd3-aee7-ac0a718d7b8e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.254083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051f20fa-0dd7-4dd3-aee7-ac0a718d7b8e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.254952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051f20fa-0dd7-4dd3-aee7-ac0a718d7b8e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.256123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051f20fa-0dd7-4dd3-aee7-ac0a718d7b8e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.295417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:30.305708 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8f07cd5-94e7-4391-8638-781543c1216f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1370 microversion: 2.1 time: 0.196569 Aug 06 21:08:30.307308 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1714/3514] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:30 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:30.313908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:30.315932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:30.325903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.326484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.326956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.327672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.328251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.328768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.364996 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-051f20fa-0dd7-4dd3-aee7-ac0a718d7b8e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.132801 Aug 06 21:08:30.370844 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1801/3515] 10.222.0.33 () {58 vars in 1296 bytes} [Sat Aug 6 21:08:30 2022] DELETE /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384/os-server-password => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:30.375705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:30.376338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:30.383856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.384354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.384803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.385686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.386149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.386594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.413569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:30.421357 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1e00f14a-3fdd-4862-bacd-cb16aefe563b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1269 microversion: 2.1 time: 0.112446 Aug 06 21:08:30.422679 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1715/3516] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:30 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1269 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:30.427767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:30.428589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:30.437225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.438318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.438318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.439286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.439849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.440440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.541492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:30.551483 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-259ffe8b-e9bd-475e-944d-bc78f77ed47b tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1474 microversion: 2.1 time: 0.180047 Aug 06 21:08:30.552189 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1802/3517] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:30 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1474 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:30.565387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-470c08a2-3ce5-474e-bea5-0dad0148ddcd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:30.565387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-470c08a2-3ce5-474e-bea5-0dad0148ddcd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:30.568873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470c08a2-3ce5-474e-bea5-0dad0148ddcd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.569612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470c08a2-3ce5-474e-bea5-0dad0148ddcd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.570054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470c08a2-3ce5-474e-bea5-0dad0148ddcd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.570806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470c08a2-3ce5-474e-bea5-0dad0148ddcd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.571261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470c08a2-3ce5-474e-bea5-0dad0148ddcd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.571847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470c08a2-3ce5-474e-bea5-0dad0148ddcd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.614447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:30.616279 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-470c08a2-3ce5-474e-bea5-0dad0148ddcd tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.062378 Aug 06 21:08:30.616771 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1803/3518] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 21:08:30 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384/os-server-password => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:08:30.623226 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df744af0-94dd-4220-be7e-84a6f4e367e3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.199221 Aug 06 21:08:30.623818 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1716/3519] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:30 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:30.624476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-062044f9-7c9d-4247-a92c-42f687e5b66b req-91855a70-d801-471c-a161-bbfaaa02a175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd05586-c6ea-4ceb-8cb2-74b3c677d322", "name": "network-vif-deleted", "tag": "3767dba4-c6b1-4af4-9bad-afbb01fd063a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:30.629502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:30.630659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:30.636350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-062044f9-7c9d-4247-a92c-42f687e5b66b req-91855a70-d801-471c-a161-bbfaaa02a175 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.636830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-062044f9-7c9d-4247-a92c-42f687e5b66b req-91855a70-d801-471c-a161-bbfaaa02a175 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.637259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-062044f9-7c9d-4247-a92c-42f687e5b66b req-91855a70-d801-471c-a161-bbfaaa02a175 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.638238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.638798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.639248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.639968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.640436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.640875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.649876 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-062044f9-7c9d-4247-a92c-42f687e5b66b req-91855a70-d801-471c-a161-bbfaaa02a175 service nova] Creating event network-vif-deleted:3767dba4-c6b1-4af4-9bad-afbb01fd063a for instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 on nch1-master-1 Aug 06 21:08:30.655178 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-062044f9-7c9d-4247-a92c-42f687e5b66b req-91855a70-d801-471c-a161-bbfaaa02a175 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036987 Aug 06 21:08:30.655814 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1804/3520] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:30.659830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:30.661282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:30.662105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:30.669960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.669960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.670515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.671469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.672200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.672874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.708865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:08:30.717193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:30.730508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:30.732537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:30.733934 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e9042abe-4078-4d2f-93be-2e834a950d55 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1604 microversion: 2.32 time: 0.108349 Aug 06 21:08:30.738947 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1717/3521] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:30 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1604 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:30.794607 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-87687871-224b-4242-9611-86a61e77dc6e tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 204 len: 0 microversion: 2.1 time: 0.137141 Aug 06 21:08:30.795209 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1805/3522] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:08:30 2022] DELETE /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:30.804567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:30.805446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:30.811624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.812107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.812550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.813358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:30.813834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:30.814262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:30.955591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:30.965252 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-365eb78f-3cb0-43a1-891b-a4cbf52522c4 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1510 microversion: 2.1 time: 0.165569 Aug 06 21:08:30.966364 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1718/3523] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:30 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:31.133445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-cbabbac4-69b3-4ace-be57-81b5037c2873 req-20a406b4-fd18-4972-8e86-dd7d5f7d610e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e52696-5e64-4d90-a90c-69d78aad14e8", "name": "network-vif-plugged", "status": "completed", "tag": "26a07487-037f-4b16-b6ce-e506fe5ccc79"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:31.144184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cbabbac4-69b3-4ace-be57-81b5037c2873 req-20a406b4-fd18-4972-8e86-dd7d5f7d610e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.144685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cbabbac4-69b3-4ace-be57-81b5037c2873 req-20a406b4-fd18-4972-8e86-dd7d5f7d610e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.145125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cbabbac4-69b3-4ace-be57-81b5037c2873 req-20a406b4-fd18-4972-8e86-dd7d5f7d610e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.158342 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-cbabbac4-69b3-4ace-be57-81b5037c2873 req-20a406b4-fd18-4972-8e86-dd7d5f7d610e service nova] Creating event network-vif-plugged:26a07487-037f-4b16-b6ce-e506fe5ccc79 for instance d6e52696-5e64-4d90-a90c-69d78aad14e8 on nch1-master-1 Aug 06 21:08:31.164729 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-cbabbac4-69b3-4ace-be57-81b5037c2873 req-20a406b4-fd18-4972-8e86-dd7d5f7d610e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035411 Aug 06 21:08:31.165596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1806/3524] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:31.329427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:31.330050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:31.337678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.338582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.339417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.340491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.341286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.342185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.448365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:31.449550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:31.459750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.460481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.461215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.462362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.463066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.463669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.576280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:31.585931 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-149e2129-83bb-492e-8544-b00ccad98d91 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1269 microversion: 2.1 time: 0.144147 Aug 06 21:08:31.587756 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1807/3525] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:31 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1269 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:31.593744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:31.594767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:31.606976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.608204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.609351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.610372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.612226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.612960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.656365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:31.687322 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df36b6a7-721a-416d-b52e-6bef548ad1bb tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1370 microversion: 2.1 time: 0.359036 Aug 06 21:08:31.698903 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1719/3526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:31 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:31.704597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:31.706412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:31.711908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.712403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.712839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.713547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.714002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.714430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.790836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:31.800383 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e768b49-2ead-4d13-8ea2-7f0e5db31e42 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1474 microversion: 2.1 time: 0.211003 Aug 06 21:08:31.801324 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1808/3527] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:31 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1474 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:31.808311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:31.809039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:31.815160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.815984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.816653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.817728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.818676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.819337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.858465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.859119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.859668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.860246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lazy-loading 'fault' on Instance uuid 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:08:31.867068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:31.888193 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1908034b-5439-4d98-915a-e23c0c0c9ce9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.187666 Aug 06 21:08:31.888720 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1720/3528] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:31 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:31.910453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:31.921491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:31.923539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78f7a58ae0b24b6a9aca96713dfe99b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ed29bedd5e4f4788958bad354166f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:31.924927 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fcd6e29f-c9ec-410f-b2c6-ac2ed216d132 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 200 len: 1609 microversion: 2.32 time: 0.121653 Aug 06 21:08:31.925718 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1809/3529] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:31 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 1609 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:08:31.987930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:31.988821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:31.996765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.997625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:31.998312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:31.999312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:31.999996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:32.000643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:32.256094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:32.264319 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f72c43a3-ff70-4688-a596-123be4bcce21 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1510 microversion: 2.1 time: 0.280913 Aug 06 21:08:32.265225 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1721/3530] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:31 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1510 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:32.608451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:32.609079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:32.617775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:32.618608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:32.619337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:32.620365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:32.621011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:32.621757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:32.713840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:32.714476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:32.731405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:32.733455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:32.733788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:32.734559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:32.736156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:32.738330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:32.796944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:32.809250 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a0ccb5f6-13fa-4eb9-81b7-360db2fccad8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1267 microversion: 2.1 time: 0.205709 Aug 06 21:08:32.810663 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1810/3531] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:32 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:32.825068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:32.827780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:32.837698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:32.838752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:32.839634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:32.840487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:32.841271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:32.841984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:33.010863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:33.019787 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12a5ac5e-3948-41bf-bc31-e1955fc2544f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1474 microversion: 2.1 time: 0.199832 Aug 06 21:08:33.020507 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1811/3532] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:32 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1474 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:33.034972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:33.037010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:33.044030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:33.044522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:33.044962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:33.045826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:33.046277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:33.046754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:33.219334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:33.235161 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-801a7c4f-301e-4e2e-8431-df214e3292cc tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1370 microversion: 2.1 time: 0.528144 Aug 06 21:08:33.236070 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1722/3533] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:32 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1370 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:33.241427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:33.242225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:33.246840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:33.256049 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bdd85333-2037-40e4-8a20-9072b63abab4 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.234489 Aug 06 21:08:33.256858 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1812/3534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:33 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:33.257822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:33.258485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:33.263728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:33.264739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:33.265369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:33.265970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:33.299022 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] HTTP exception thrown: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:33.299718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Request method failure captured: Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 HTTP/1.1 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tbo5IfPZT87i_JklSZzmj343J-mNsvB2fzqvZJPjWApscDJsiigzVyvEZ1p5uc9973IBf37OkHHNOjTug1_sJfGAMrovA2uZBD6LuuHi-y2kG0C-YloxR1O9tJERYgFWvBCQIzaafObXLsHwJBbkhlUNuLtt-mo0IkrcdyJq3ZFLac Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.32 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: e1ed29bedd5e4f4788958bad354166f3 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TaggedBootDevicesTest-335631018 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1ed29bedd5e4f4788958bad354166f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1ed29bedd5e4f4788958bad354166f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1ed29bedd5e4f4788958bad354166f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1ed29bedd5e4f4788958bad354166f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TaggedBootDevicesTest-335631018 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: e1ed29bedd5e4f4788958bad354166f3 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TaggedBootDevicesTest-335631018 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TaggedBootDevicesTest-335631018-project Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 78f7a58ae0b24b6a9aca96713dfe99b4 Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TaggedBootDevicesTest-335631018-project Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4fd05586-c6ea-4ceb-8cb2-74b3c677d322'} Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:33.300863 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:33.306078 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:33.306078 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:33.306078 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:33.306078 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:33.306078 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:33.306078 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:33.306078 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:33.306078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Returning 404 to user: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:33.306078 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-db0535c7-7de9-4277-80b8-c442a4f7806b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 404 len: 111 microversion: 2.32 time: 0.066122 Aug 06 21:08:33.309324 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1723/3535] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:33 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:08:33.309802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:33.315080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b92867e-0155-46b8-b1e9-9258651c9ab0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '.version_select at 0x7f729de221f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:33.319498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:33.320333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:33.321073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:33.323047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:33.323804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:33.324525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:33.351575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:33.365683 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b92867e-0155-46b8-b1e9-9258651c9ab0 tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886386052" status: 204 len: 0 microversion: 2.32 time: 0.054911 Aug 06 21:08:33.366539 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1724/3536] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:08:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886386052 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:08:33.504226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:33.516060 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c6a8ca14-1eb0-43e1-986c-d14c202335e1 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1510 microversion: 2.1 time: 0.223269 Aug 06 21:08:33.531306 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1813/3537] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:33 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:33.836752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:33.838228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:33.851819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:33.852374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:33.853087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:33.854206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:33.854883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:33.855519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.056313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:34.059811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:34.077344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.078358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.079132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.080152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.080847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.081923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.350299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:34.359862 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc75ec82-3da2-4521-b14b-172ada12c627 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 200 len: 1432 microversion: 2.1 time: 0.319975 Aug 06 21:08:34.361404 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1814/3538] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:34 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 1432 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:34.397765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d264e297-44b3-4752-a65b-d29f1384e6bb req-d72579fa-0fd7-4723-9614-881f68e00168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032e6b85-4ab1-4fed-818b-e3893ebc09c8", "name": "network-vif-deleted", "tag": "700bbba7-9867-4e5a-b588-1da283ca9b16"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:34.443287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d264e297-44b3-4752-a65b-d29f1384e6bb req-d72579fa-0fd7-4723-9614-881f68e00168 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.444224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d264e297-44b3-4752-a65b-d29f1384e6bb req-d72579fa-0fd7-4723-9614-881f68e00168 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.444762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d264e297-44b3-4752-a65b-d29f1384e6bb req-d72579fa-0fd7-4723-9614-881f68e00168 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.477609 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d264e297-44b3-4752-a65b-d29f1384e6bb req-d72579fa-0fd7-4723-9614-881f68e00168 service nova] Creating event network-vif-deleted:700bbba7-9867-4e5a-b588-1da283ca9b16 for instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 on nch1-master-1 Aug 06 21:08:34.491202 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d264e297-44b3-4752-a65b-d29f1384e6bb req-d72579fa-0fd7-4723-9614-881f68e00168 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127841 Aug 06 21:08:34.491984 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1815/3539] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:34.506053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:34.508245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:34.529474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.529989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.530434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.531377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.533802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.535889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.606459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:34.618832 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-10602c36-bab3-4046-836b-335ae7e937eb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1309 microversion: 2.1 time: 0.787264 Aug 06 21:08:34.630596 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1725/3540] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:33 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1309 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:34.630596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:34.631162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:34.672447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.673147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.673614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.674384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.674886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.676283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.807301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:34.820833 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7959d4e7-81b9-493a-99c0-4d72dc1d2d13 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1564 microversion: 2.1 time: 0.325190 Aug 06 21:08:34.822121 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1816/3541] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:34 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1564 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:34.843542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:34.844453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:34.852765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.853383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.854180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.854778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.855316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.856077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.896468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:34.896966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:34.898152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:34.898652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lazy-loading 'fault' on Instance uuid b3b8b1b6-b2ef-4d11-a546-09fe700c8384 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:08:34.966938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6955ef07c6f447187f1ad99c2a7b7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980210caadb14685afa7afb9bbf6c651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:34.984293 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ac46a381-c39f-4707-b2b1-0fa017a50592 tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 200 len: 1306 microversion: 2.1 time: 0.160714 Aug 06 21:08:34.988639 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1817/3542] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:34 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 1306 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:34.995272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e259278-9710-4f17-acd5-25eadf78fe18 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:34.995695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1e259278-9710-4f17-acd5-25eadf78fe18 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:35.001694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e259278-9710-4f17-acd5-25eadf78fe18 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.002194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e259278-9710-4f17-acd5-25eadf78fe18 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.002732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e259278-9710-4f17-acd5-25eadf78fe18 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.003448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e259278-9710-4f17-acd5-25eadf78fe18 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.003920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e259278-9710-4f17-acd5-25eadf78fe18 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.004345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e259278-9710-4f17-acd5-25eadf78fe18 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.087153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:35.101565 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-604a8d58-7480-4140-9ec8-22dd2498d8ac tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.479449 Aug 06 21:08:35.103459 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1726/3543] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:34 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:35.174517 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e259278-9710-4f17-acd5-25eadf78fe18 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183869 Aug 06 21:08:35.177052 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1818/3544] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:08:34 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:35.385672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:35.386301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: 032e6b85-4ab1-4fed-818b-e3893ebc09c8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:35.392666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.393374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.394163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.396322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.397016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.397907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.414222 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] HTTP exception thrown: Instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 could not be found. Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Request method failure captured: Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 HTTP/1.1 Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te_6CLckLvp7TjesPkNQ0Uyx1qhVI7UCIx4t-ccWvb6vAkOgDg-WgNQiwmX16KXwqGFW8F5TkdT0aJ2byzm0k3bKsW881W9kxaCDEQlUWsaoH-SbDzcwFqIQXweyRAKvrufnxbZj43c0IiuliW2zHLGYZLnf-tiBhxgtKPePWQ_Uxc Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 6b68ddb3badb454dac41733610ea2b71 Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ListImageFiltersTestJSON-1269094081 Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b68ddb3badb454dac41733610ea2b71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b68ddb3badb454dac41733610ea2b71", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b68ddb3badb454dac41733610ea2b71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b68ddb3badb454dac41733610ea2b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ListImageFiltersTestJSON-1269094081 Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 6b68ddb3badb454dac41733610ea2b71 Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1269094081 Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ListImageFiltersTestJSON-1269094081-project Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 55a4c0dae0d04e55b786ca572769bf8c Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ListImageFiltersTestJSON-1269094081-project Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 could not be found. Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '032e6b85-4ab1-4fed-818b-e3893ebc09c8'} Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 could not be found. Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 could not be found. Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:35.417181 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:35.422309 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:35.422309 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:35.422309 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:35.422309 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:35.422309 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:35.422309 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 could not be found. Aug 06 21:08:35.422309 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:35.424538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Returning 404 to user: Instance 032e6b85-4ab1-4fed-818b-e3893ebc09c8 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:35.432465 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-84371866-6c2e-44d1-acb3-6f1810731926 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8" status: 404 len: 111 microversion: 2.1 time: 0.044095 Aug 06 21:08:35.441317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:35.441813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:35.444776 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1727/3545] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:35 2022] GET /compute/v2.1/servers/032e6b85-4ab1-4fed-818b-e3893ebc09c8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:08:35.448371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.449138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.449812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.450797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.451554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.452242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.492444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:08:35.632638 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02ff04ab-e8d4-4e99-b093-60bd5b029f0f tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4" status: 204 len: 0 microversion: 2.1 time: 0.194206 Aug 06 21:08:35.635263 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1819/3546] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:08:35 2022] DELETE /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:35.644361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:35.645819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:35.647612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:35.649734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:35.671630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.673958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.674857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.675901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.676565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.677222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.683635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.684226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.684740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.685693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:35.686359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:35.687004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:35.951044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:35.960961 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-07f3a652-c626-478f-8b99-dd5c04c13385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1309 microversion: 2.1 time: 0.320804 Aug 06 21:08:35.961699 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1728/3547] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:35 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1309 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:36.018745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:36.020789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] [instance: b3b8b1b6-b2ef-4d11-a546-09fe700c8384] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:36.029735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:36.031089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:36.031730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:36.032459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:36.032920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:36.033350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:36.051060 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] HTTP exception thrown: Instance b3b8b1b6-b2ef-4d11-a546-09fe700c8384 could not be found. Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Request method failure captured: Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 HTTP/1.1 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tg4pGIvo2GXZsZk2zhW9IrW13klFT0uFeJwv0b9u7pcWrVOzAvCvdGMqRZHEhCzjEFfyqQNwB9eFG2rSHpIDm5Hzt-NL-fOsHevTq7QSnGuiqp_oO8NJ9ftFbi4RROd2sOBT04IHmC4kwVyGDFblIQXT8et9Y5IJl7Y-RzM_8nqY88 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 980210caadb14685afa7afb9bbf6c651 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerPasswordTestJSON-1922105155 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/980210caadb14685afa7afb9bbf6c651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_980210caadb14685afa7afb9bbf6c651", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/980210caadb14685afa7afb9bbf6c651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/980210caadb14685afa7afb9bbf6c651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerPasswordTestJSON-1922105155 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 980210caadb14685afa7afb9bbf6c651 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1922105155 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerPasswordTestJSON-1922105155-project Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6955ef07c6f447187f1ad99c2a7b7b9 Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerPasswordTestJSON-1922105155-project Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance b3b8b1b6-b2ef-4d11-a546-09fe700c8384 could not be found. Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'b3b8b1b6-b2ef-4d11-a546-09fe700c8384'} Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3b8b1b6-b2ef-4d11-a546-09fe700c8384 could not be found. Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3b8b1b6-b2ef-4d11-a546-09fe700c8384 could not be found. Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:36.053555 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3b8b1b6-b2ef-4d11-a546-09fe700c8384 could not be found. Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] Returning 404 to user: Instance b3b8b1b6-b2ef-4d11-a546-09fe700c8384 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5cf15e1f-5668-4133-8271-e61cf968662f tempest-ServerPasswordTestJSON-1922105155 tempest-ServerPasswordTestJSON-1922105155-project] 10.222.0.33 "GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384" status: 404 len: 111 microversion: 2.1 time: 0.045339 Aug 06 21:08:36.065491 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1729/3548] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:36 2022] GET /compute/v2.1/servers/b3b8b1b6-b2ef-4d11-a546-09fe700c8384 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:08:36.123839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:36.124525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:36.131818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:36.132308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:36.132758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:36.133555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:36.134030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:36.134468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:36.167225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:36.175947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-daf8e804-e903-42c5-ae56-64f5508e7f4d tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4" status: 200 len: 1471 microversion: 2.1 time: 0.535978 Aug 06 21:08:36.178019 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1820/3549] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:35 2022] GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 => generated 1471 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:36.306008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:36.314145 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a83f1b2b-e940-4513-81cc-f13d8ed4148e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.194189 Aug 06 21:08:36.314757 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1730/3550] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:36 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:36.575685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0b8fa334-2d97-4469-bd52-3418e2ee1cd2 req-4706064b-9648-44bd-81c7-c9201e37b876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b8b1b6-b2ef-4d11-a546-09fe700c8384", "name": "network-vif-deleted", "tag": "4798e7f2-3abc-4038-a9ae-a60827e2b1c9"}, {"name": "network-changed", "server_uuid": "342ecaee-7b6f-4f86-a681-97c31d3a313b", "tag": "60a9a881-0e7f-4904-b75e-bcc8b7e9a53d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:36.588758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0b8fa334-2d97-4469-bd52-3418e2ee1cd2 req-4706064b-9648-44bd-81c7-c9201e37b876 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:36.589490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0b8fa334-2d97-4469-bd52-3418e2ee1cd2 req-4706064b-9648-44bd-81c7-c9201e37b876 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:36.590268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0b8fa334-2d97-4469-bd52-3418e2ee1cd2 req-4706064b-9648-44bd-81c7-c9201e37b876 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:36.605113 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0b8fa334-2d97-4469-bd52-3418e2ee1cd2 req-4706064b-9648-44bd-81c7-c9201e37b876 service nova] Creating event network-vif-deleted:4798e7f2-3abc-4038-a9ae-a60827e2b1c9 for instance b3b8b1b6-b2ef-4d11-a546-09fe700c8384 on nch2-master-1 Aug 06 21:08:36.605902 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0b8fa334-2d97-4469-bd52-3418e2ee1cd2 req-4706064b-9648-44bd-81c7-c9201e37b876 service nova] Creating event network-changed:60a9a881-0e7f-4904-b75e-bcc8b7e9a53d for instance 342ecaee-7b6f-4f86-a681-97c31d3a313b on nch1-master-1 Aug 06 21:08:36.614113 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0b8fa334-2d97-4469-bd52-3418e2ee1cd2 req-4706064b-9648-44bd-81c7-c9201e37b876 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042013 Aug 06 21:08:36.614934 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1821/3551] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:36.984728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:36.984728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:36.993537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:36.995327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:36.995974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:36.996882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:36.997503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:36.998104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:37.199235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:37.204730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:37.206118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:37.222017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:37.224611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:37.225379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:37.226331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:37.227146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:37.227919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:37.230035 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fd8dcd74-edcd-4fa8-b7fa-5a743f5ec2ad tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1309 microversion: 2.1 time: 0.250158 Aug 06 21:08:37.244856 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1731/3552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:36 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1309 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:37.335279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:37.336080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:37.342786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:37.343716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:37.344492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:37.345430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:37.346035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:37.346729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:37.722128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:37.731211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0d6fec27-dbb4-490f-803e-5560c0829f10 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.399983 Aug 06 21:08:37.738173 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1732/3553] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:37 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:37.778063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:37.792498 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-69899d4c-b09f-4994-937a-b969f2534714 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4" status: 200 len: 1471 microversion: 2.1 time: 0.594968 Aug 06 21:08:37.794779 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1822/3554] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:37 2022] GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 => generated 1471 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:38.108763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f4a47603-f38c-4635-ad48-f826e39f1b9a req-88dfc8da-b22f-484e-905f-31ade133c09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e52696-5e64-4d90-a90c-69d78aad14e8", "tag": "26a07487-037f-4b16-b6ce-e506fe5ccc79"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:38.153854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f4a47603-f38c-4635-ad48-f826e39f1b9a req-88dfc8da-b22f-484e-905f-31ade133c09d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:38.161598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f4a47603-f38c-4635-ad48-f826e39f1b9a req-88dfc8da-b22f-484e-905f-31ade133c09d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:38.164272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f4a47603-f38c-4635-ad48-f826e39f1b9a req-88dfc8da-b22f-484e-905f-31ade133c09d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:38.197453 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f4a47603-f38c-4635-ad48-f826e39f1b9a req-88dfc8da-b22f-484e-905f-31ade133c09d service nova] Creating event network-changed:26a07487-037f-4b16-b6ce-e506fe5ccc79 for instance d6e52696-5e64-4d90-a90c-69d78aad14e8 on nch1-master-1 Aug 06 21:08:38.204605 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f4a47603-f38c-4635-ad48-f826e39f1b9a req-88dfc8da-b22f-484e-905f-31ade133c09d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101750 Aug 06 21:08:38.206490 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1733/3555] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:38.261878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:38.262441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:38.265539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:38.281745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:38.287293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:38.288195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:38.291235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:38.292050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:38.292933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:38.757246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:38.757979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:38.768791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:38.769300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:38.769753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:38.770535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:38.775285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:38.776060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:38.903645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:38.913859 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b13a0984-047c-4018-a0aa-b878cda173bc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1309 microversion: 2.1 time: 0.658536 Aug 06 21:08:38.923396 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1823/3556] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:38 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1309 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:38.935115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:38.935895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:38.949929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:38.950424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:38.955530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:38.956582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:38.957229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:38.958133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:39.039007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:39.159359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:39.193682 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e9f9c0a-9199-41ac-92bb-92ed4fbc7cfd tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4" status: 200 len: 1429 microversion: 2.1 time: 0.267276 Aug 06 21:08:39.194716 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1824/3557] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:38 2022] GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 => generated 1429 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:39.560612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3ee17fd2-9d16-4236-a3fa-13a779108b04 req-ce6d059f-9da5-47db-9654-28f1a10ef735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0926358-eed5-4b13-a285-2f56c382bce4", "name": "network-vif-deleted", "tag": "5c0b2605-3a4d-45dd-876d-81e3e36ceb49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:39.625360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3ee17fd2-9d16-4236-a3fa-13a779108b04 req-ce6d059f-9da5-47db-9654-28f1a10ef735 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:39.628157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3ee17fd2-9d16-4236-a3fa-13a779108b04 req-ce6d059f-9da5-47db-9654-28f1a10ef735 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:39.628627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3ee17fd2-9d16-4236-a3fa-13a779108b04 req-ce6d059f-9da5-47db-9654-28f1a10ef735 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:39.696282 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3ee17fd2-9d16-4236-a3fa-13a779108b04 req-ce6d059f-9da5-47db-9654-28f1a10ef735 service nova] Creating event network-vif-deleted:5c0b2605-3a4d-45dd-876d-81e3e36ceb49 for instance e0926358-eed5-4b13-a285-2f56c382bce4 on nch2-master-1 Aug 06 21:08:39.704512 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3ee17fd2-9d16-4236-a3fa-13a779108b04 req-ce6d059f-9da5-47db-9654-28f1a10ef735 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153866 Aug 06 21:08:39.705421 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1825/3558] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:08:39.843619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:39.860054 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3c880c46-cb82-4095-bab6-e23eaa5bfd16 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 1.106059 Aug 06 21:08:39.861661 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1734/3559] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:38 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:39.965439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:39.975595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:40.000446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:40.001192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:40.004285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:40.005292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:40.005979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:40.006685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:40.219007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:40.223827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:40.244270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:40.248087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:40.250032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:40.251208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:40.257868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:40.258820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:40.347583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:40.351295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:40.352556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:40.353530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lazy-loading 'fault' on Instance uuid e0926358-eed5-4b13-a285-2f56c382bce4 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:08:40.433502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a4c0dae0d04e55b786ca572769bf8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b68ddb3badb454dac41733610ea2b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:40.447133 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a0622a26-775c-4d83-8a8f-259406138ce4 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4" status: 200 len: 1306 microversion: 2.1 time: 0.233411 Aug 06 21:08:40.458856 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1735/3560] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:40 2022] GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 => generated 1306 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:40.888334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:40.889845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:40.898222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:40.899103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:40.900197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:40.902195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:40.902904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:40.903566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:40.942816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:40.964958 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4c9f9389-9508-423f-aaf4-80cd4021cc1d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1309 microversion: 2.1 time: 1.013914 Aug 06 21:08:40.968809 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1826/3561] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:39 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1309 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:41.121417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:41.134242 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-60e45fd3-d0c2-4635-b071-7ce0d7f22046 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.250018 Aug 06 21:08:41.135438 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1736/3562] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:40 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:41.337904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-9acf0121-d093-4e44-9693-f9c83c760f21 req-36bae02a-8f28-43e2-8b55-35b95d50fd5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342ecaee-7b6f-4f86-a681-97c31d3a313b", "name": "network-vif-plugged", "status": "completed", "tag": "60a9a881-0e7f-4904-b75e-bcc8b7e9a53d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:41.359889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9acf0121-d093-4e44-9693-f9c83c760f21 req-36bae02a-8f28-43e2-8b55-35b95d50fd5a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:41.360381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9acf0121-d093-4e44-9693-f9c83c760f21 req-36bae02a-8f28-43e2-8b55-35b95d50fd5a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:41.360817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9acf0121-d093-4e44-9693-f9c83c760f21 req-36bae02a-8f28-43e2-8b55-35b95d50fd5a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:41.387463 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-9acf0121-d093-4e44-9693-f9c83c760f21 req-36bae02a-8f28-43e2-8b55-35b95d50fd5a service nova] Creating event network-vif-plugged:60a9a881-0e7f-4904-b75e-bcc8b7e9a53d for instance 342ecaee-7b6f-4f86-a681-97c31d3a313b on nch1-master-1 Aug 06 21:08:41.405804 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-9acf0121-d093-4e44-9693-f9c83c760f21 req-36bae02a-8f28-43e2-8b55-35b95d50fd5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071004 Aug 06 21:08:41.406571 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1827/3563] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:08:41.469763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:41.470734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] [instance: e0926358-eed5-4b13-a285-2f56c382bce4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:41.484514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:41.485241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:41.485876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:41.495677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:41.496457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:41.496919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:41.521537 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] HTTP exception thrown: Instance e0926358-eed5-4b13-a285-2f56c382bce4 could not be found. Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Request method failure captured: Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 HTTP/1.1 Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te_6CLckLvp7TjesPkNQ0Uyx1qhVI7UCIx4t-ccWvb6vAkOgDg-WgNQiwmX16KXwqGFW8F5TkdT0aJ2byzm0k3bKsW881W9kxaCDEQlUWsaoH-SbDzcwFqIQXweyRAKvrufnxbZj43c0IiuliW2zHLGYZLnf-tiBhxgtKPePWQ_Uxc Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 6b68ddb3badb454dac41733610ea2b71 Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ListImageFiltersTestJSON-1269094081 Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6b68ddb3badb454dac41733610ea2b71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6b68ddb3badb454dac41733610ea2b71", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b68ddb3badb454dac41733610ea2b71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6b68ddb3badb454dac41733610ea2b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ListImageFiltersTestJSON-1269094081 Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 6b68ddb3badb454dac41733610ea2b71 Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1269094081 Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ListImageFiltersTestJSON-1269094081-project Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 55a4c0dae0d04e55b786ca572769bf8c Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ListImageFiltersTestJSON-1269094081-project Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance e0926358-eed5-4b13-a285-2f56c382bce4 could not be found. Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'e0926358-eed5-4b13-a285-2f56c382bce4'} Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0926358-eed5-4b13-a285-2f56c382bce4 could not be found. Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0926358-eed5-4b13-a285-2f56c382bce4 could not be found. Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:41.523560 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:41.530831 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:41.530831 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:41.530831 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:41.530831 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:41.530831 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:41.530831 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0926358-eed5-4b13-a285-2f56c382bce4 could not be found. Aug 06 21:08:41.530831 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:08:41.530831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Returning 404 to user: Instance e0926358-eed5-4b13-a285-2f56c382bce4 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:41.530831 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f60c316-45a1-4997-b35c-b2efd3f36b73 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4" status: 404 len: 111 microversion: 2.1 time: 0.059180 Aug 06 21:08:41.534744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9acd9e04-2395-4884-a1cd-63018575df1c tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d8698b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:41.544356 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1737/3564] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:41 2022] GET /compute/v2.1/servers/e0926358-eed5-4b13-a285-2f56c382bce4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:08:41.995367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:41.997323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:42.008272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:42.009142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:42.009822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:42.010940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:42.011784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:42.012484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:42.018278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:42.251497 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9acd9e04-2395-4884-a1cd-63018575df1c tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "DELETE /compute/v2.1/images/a13e406a-a765-4cc0-b007-a53adcfa4ac9" status: 204 len: 0 microversion: 2.1 time: 0.720824 Aug 06 21:08:42.256578 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1828/3565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:41 2022] DELETE /compute/v2.1/images/a13e406a-a765-4cc0-b007-a53adcfa4ac9 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:42.263719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:42.264733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:42.273251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:42.274244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:42.275088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:42.276131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:42.277113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:42.277747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:42.298741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:42.310718 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-043c2e85-acc7-4332-8c67-bc005ff35948 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1309 microversion: 2.1 time: 0.321254 Aug 06 21:08:42.311430 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1738/3566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:41 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1309 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:42.322781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce3a3231-1e9b-44ce-a973-66c5e18ff9c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729dccaca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:42.655986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:42.671434 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bcbb02af-f66e-4bfd-9fd0-24a7c4d8ab2b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.411851 Aug 06 21:08:42.672582 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1829/3567] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:42 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:42.687944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:42.689228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:42.707929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:42.710020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:42.710781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:42.716469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:42.724701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:42.724942 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce3a3231-1e9b-44ce-a973-66c5e18ff9c6 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "DELETE /compute/v2.1/images/3b93a2d0-75ff-4704-8b69-2047382c30d9" status: 204 len: 0 microversion: 2.1 time: 0.408292 Aug 06 21:08:42.725724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:42.725987 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1739/3568] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:42 2022] DELETE /compute/v2.1/images/3b93a2d0-75ff-4704-8b69-2047382c30d9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:08:42.736154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ba0708d1-59e9-4f07-b741-d59b884a1155 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] Calling method '.version_select at 0x7f729d9ea9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:42.746632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] HTTP exception thrown: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Request method failure captured: Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 HTTP/1.1 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tbo5IfPZT87i_JklSZzmj343J-mNsvB2fzqvZJPjWApscDJsiigzVyvEZ1p5uc9973IBf37OkHHNOjTug1_sJfGAMrovA2uZBD6LuuHi-y2kG0C-YloxR1O9tJERYgFWvBCQIzaafObXLsHwJBbkhlUNuLtt-mo0IkrcdyJq3ZFLac Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.32 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: e1ed29bedd5e4f4788958bad354166f3 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TaggedBootDevicesTest-335631018 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1ed29bedd5e4f4788958bad354166f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1ed29bedd5e4f4788958bad354166f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1ed29bedd5e4f4788958bad354166f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1ed29bedd5e4f4788958bad354166f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TaggedBootDevicesTest-335631018 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: e1ed29bedd5e4f4788958bad354166f3 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TaggedBootDevicesTest-335631018 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TaggedBootDevicesTest-335631018-project Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 78f7a58ae0b24b6a9aca96713dfe99b4 Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TaggedBootDevicesTest-335631018-project Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4fd05586-c6ea-4ceb-8cb2-74b3c677d322'} Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:08:42.768455 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.775183 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.777888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Returning 404 to user: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:42.782328 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3834361a-fb29-4a30-8acd-f9570234b38c tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 404 len: 111 microversion: 2.32 time: 0.106046 Aug 06 21:08:42.791514 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1830/3569] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:08:42 2022] DELETE /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:08:42.808971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:42.810734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] [instance: 4fd05586-c6ea-4ceb-8cb2-74b3c677d322] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:42.825540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:42.826768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:42.828365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:42.830800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:42.832014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:42.833022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:42.861147 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] HTTP exception thrown: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Request method failure captured: Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 HTTP/1.1 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tbo5IfPZT87i_JklSZzmj343J-mNsvB2fzqvZJPjWApscDJsiigzVyvEZ1p5uc9973IBf37OkHHNOjTug1_sJfGAMrovA2uZBD6LuuHi-y2kG0C-YloxR1O9tJERYgFWvBCQIzaafObXLsHwJBbkhlUNuLtt-mo0IkrcdyJq3ZFLac Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.32 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: e1ed29bedd5e4f4788958bad354166f3 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TaggedBootDevicesTest-335631018 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1ed29bedd5e4f4788958bad354166f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1ed29bedd5e4f4788958bad354166f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1ed29bedd5e4f4788958bad354166f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1ed29bedd5e4f4788958bad354166f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TaggedBootDevicesTest-335631018 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: e1ed29bedd5e4f4788958bad354166f3 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TaggedBootDevicesTest-335631018 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TaggedBootDevicesTest-335631018-project Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 78f7a58ae0b24b6a9aca96713dfe99b4 Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TaggedBootDevicesTest-335631018-project Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4fd05586-c6ea-4ceb-8cb2-74b3c677d322'} Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:08:42.863582 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] Returning 404 to user: Instance 4fd05586-c6ea-4ceb-8cb2-74b3c677d322 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4acd3a9a-2c5e-4df0-a0dd-52c8d02c7f2b tempest-TaggedBootDevicesTest-335631018 tempest-TaggedBootDevicesTest-335631018-project] 10.222.0.33 "GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322" status: 404 len: 111 microversion: 2.32 time: 0.073377 Aug 06 21:08:42.870321 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1831/3570] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:08:42 2022] GET /compute/v2.1/servers/4fd05586-c6ea-4ceb-8cb2-74b3c677d322 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:08:43.339184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:43.339856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:43.351020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:43.352230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:43.353969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:43.359818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:43.360670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:43.361337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:43.438483 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ba0708d1-59e9-4f07-b741-d59b884a1155 tempest-ListImageFiltersTestJSON-1269094081 tempest-ListImageFiltersTestJSON-1269094081-project] 10.222.0.33 "DELETE /compute/v2.1/images/18bc3e4f-1152-4f19-9f0f-f15b858a0ac5" status: 204 len: 0 microversion: 2.1 time: 0.708039 Aug 06 21:08:43.439475 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1740/3571] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:42 2022] DELETE /compute/v2.1/images/18bc3e4f-1152-4f19-9f0f-f15b858a0ac5 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:08:43.611037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:43.623188 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e032e5e-e41d-4eea-b9c3-9e95ccec08b2 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1489 microversion: 2.1 time: 0.294726 Aug 06 21:08:43.637344 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1832/3572] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:43 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1489 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:43.663517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a5cbe05-ba40-427f-b722-29c8fc9e6818 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2083419000"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:43.669734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0a5cbe05-ba40-427f-b722-29c8fc9e6818 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:43.689635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a5cbe05-ba40-427f-b722-29c8fc9e6818 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:43.690665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a5cbe05-ba40-427f-b722-29c8fc9e6818 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:43.691411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a5cbe05-ba40-427f-b722-29c8fc9e6818 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:43.700206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:43.700674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a5cbe05-ba40-427f-b722-29c8fc9e6818 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:43.701477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:43.701765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a5cbe05-ba40-427f-b722-29c8fc9e6818 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:43.703748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a5cbe05-ba40-427f-b722-29c8fc9e6818 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:43.715815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:43.716991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:43.719120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:43.722328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:43.725888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:43.726773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:43.793216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:43.920922 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a5cbe05-ba40-427f-b722-29c8fc9e6818 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "PUT /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1074 microversion: 2.1 time: 0.266550 Aug 06 21:08:43.923171 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1741/3573] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:08:43 2022] PUT /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1074 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:43.943936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:43.945229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:43.955052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:43.955754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:43.956287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:43.958215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:43.959218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:43.959952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:44.043397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:44.058639 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e0d49a2-958b-4f4d-9dcb-125bc638c5c9 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.368855 Aug 06 21:08:44.074723 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1833/3574] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:43 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:44.426791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:44.437566 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5568c37d-bb16-4f3c-9d0d-a9a05c28bf05 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1500 microversion: 2.1 time: 0.499438 Aug 06 21:08:44.444155 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1742/3575] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:43 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1500 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:44.468110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:44.468964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:44.478465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:44.479405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:44.480159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:44.481092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:44.481592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:44.482197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:44.691236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:44.707569 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-448907c7-abe7-4721-94bf-76d27a741f4d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1500 microversion: 2.1 time: 0.244539 Aug 06 21:08:44.723982 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1834/3576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:44 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1500 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:44.736077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28a5459f-bebd-473e-bdda-29910a24d387 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:08:44.749254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28a5459f-bebd-473e-bdda-29910a24d387 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:44.749863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28a5459f-bebd-473e-bdda-29910a24d387 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:44.750324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28a5459f-bebd-473e-bdda-29910a24d387 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:44.860701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-28a5459f-bebd-473e-bdda-29910a24d387 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Going to try to stop instance {{(pid=142462) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 21:08:44.936900 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28a5459f-bebd-473e-bdda-29910a24d387 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "POST /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b/action" status: 202 len: 0 microversion: 2.1 time: 0.208743 Aug 06 21:08:44.937563 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1743/3577] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:08:44 2022] POST /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:08:44.947046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:44.947669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:44.959890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:44.960541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:44.961112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:44.964493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:44.969759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:44.970625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:45.090280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:45.091325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:45.107079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:45.107602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:45.108080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:45.108874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:45.109403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:45.109934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:45.396915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:45.409694 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-07d54b3f-6ef5-4015-84cc-4ac5643e31b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.466588 Aug 06 21:08:45.411953 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1835/3578] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:44 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:45.480836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:45.498214 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-762fd8a7-8aa5-46be-b1f8-8dd1a69f275e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.409975 Aug 06 21:08:45.501729 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1744/3579] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:45 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:46.436976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:46.437542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:46.450116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:46.451071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:46.451800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:46.453247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:46.453879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:46.454752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:46.528234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:46.528234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:46.536153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:46.542526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:46.547694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:46.549406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:46.550234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:46.550815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:46.551899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:46.663400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:46.682385 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b4b5d658-f937-43d1-85a8-051f5a79dcfa tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.252891 Aug 06 21:08:46.683573 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1836/3580] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:46 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:47.197319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:47.208070 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4e7c42a2-816e-46d7-a063-202d3149d487 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.684054 Aug 06 21:08:47.223096 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1745/3581] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:46 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:47.709339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:47.709973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:47.725126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:47.725625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:47.726069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:47.726802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:47.727794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:47.728396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:48.133813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:48.149088 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ebac35d1-ec52-4cf4-8972-0e00d212104b tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.444444 Aug 06 21:08:48.164888 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1837/3582] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:47 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:48.232007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:48.233359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:48.252442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:48.253408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:48.254503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:48.256483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:48.257935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:48.260205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:48.852287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:48.862476 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6405a4e6-e62a-44bf-9d33-0b415d3cb91b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.635548 Aug 06 21:08:48.866648 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1746/3583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:48 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:49.175595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:49.177246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:49.193910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:49.194678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:49.195353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:49.196150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:49.196698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:49.197199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:49.781774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:49.808954 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-10820c41-4b4d-4385-b3aa-721da3780b07 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.636143 Aug 06 21:08:49.824659 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1838/3584] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:49 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:49.891019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:49.891713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:49.907342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:49.908584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:49.908584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:49.909094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:49.909608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:49.910039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:50.836992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:50.837772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:50.868019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:50.876746 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f159c574-db3d-4d58-bfaf-1db5010fbfda tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.990300 Aug 06 21:08:50.878680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:50.884503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:50.887934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:50.888443 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1747/3585] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:49 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:50.889456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:50.890873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:50.892164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:51.236663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:51.246947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f0512e34-9980-4319-bc24-9f1c4c3050cb tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.413169 Aug 06 21:08:51.249326 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1839/3586] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:50 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:51.909645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:51.910931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:51.926340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:51.926499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:51.926967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:51.927708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:51.928168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:51.928598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:52.281040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:52.286942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:52.299341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:52.303768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:52.305327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:52.306770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:52.307828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:52.309241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:52.867179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:52.881451 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f606ae9-985a-4c2f-b974-bae585a6813a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.612822 Aug 06 21:08:52.885458 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1840/3587] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:52 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:52.938184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:52.961638 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aee1f49c-c555-45b9-b6e7-8960439393e6 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 1.055781 Aug 06 21:08:52.968133 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1748/3588] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:51 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:53.916176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:53.916870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:53.937502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:53.938008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:53.938428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:53.948587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:53.949247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:53.949854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:53.987186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:53.987712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:53.997547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:53.997962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:53.998406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:53.999170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:54.000002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:54.000161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:54.331772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:54.344003 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c4a64a9e-03b2-46cf-9dc8-36f27202da18 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.440960 Aug 06 21:08:54.345312 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1841/3589] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:53 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:54.501297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:54.512862 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac5e6806-1dec-4816-a71f-9a80827a9cae tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.529852 Aug 06 21:08:54.528925 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1749/3590] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:53 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:55.369179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:55.370331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:55.382860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:55.384923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:55.385617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:55.388079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:55.390342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:55.391398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:55.539767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:55.541486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:55.555135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:55.555750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:55.556293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:55.558253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:55.559195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:55.559914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:55.763185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:55.773959 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f31c2fe0-bead-459c-af04-88aa47b4f385 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.409487 Aug 06 21:08:55.776896 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1842/3591] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:55 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:56.293801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:56.304199 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8f715bcd-5c49-4f76-aea5-e90e51d45a06 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1509 microversion: 2.1 time: 0.769707 Aug 06 21:08:56.305456 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1750/3592] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:55 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1509 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:08:56.799186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:56.802007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:56.813848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:08:56.818962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:56.822010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:56.822769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:56.826312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:56.827944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:56.836851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:57.073427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:57.083480 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-736d7c57-4b18-4d35-9fdc-30f0e94e089a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.293234 Aug 06 21:08:57.084470 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1843/3593] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:56 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:57.327039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:57.328387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:57.340969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:57.342279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:57.343346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:57.344303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:57.344988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:57.345743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:57.880799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:57.893909 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4864106c-0b9f-4570-b227-40772c068b8b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1530 microversion: 2.1 time: 0.571316 Aug 06 21:08:57.894598 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1751/3594] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:57 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1530 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:58.107899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:58.111204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:58.126209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:58.127870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:58.129242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:58.131255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:58.131999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:58.133028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:58.537018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:58.570895 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0e148a3d-4e87-4d2c-82fe-e2bd12e33e55 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.468156 Aug 06 21:08:58.578724 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1844/3595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:58 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:08:58.934913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:58.936253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:58.962876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:58.963509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:58.964038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:58.964896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:58.967749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:58.968556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:59.601648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:08:59.602965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:08:59.614483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:59.615004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:59.615523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:59.616261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:08:59.627582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:08:59.628658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:08:59.960117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:08:59.991575 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-06eb828c-9d59-4ded-989b-9dda37957f22 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.391505 Aug 06 21:08:59.993024 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1845/3596] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:59 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:00.412672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-461c8f3d-254c-4f66-b41b-9e6a4de645f2 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Action: 'create', calling method: .version_select at 0x7f729ced5e50>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:00.442929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:00.451626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-461c8f3d-254c-4f66-b41b-9e6a4de645f2 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Getting quotas for project 1b06f18250f34f7db9b0bcf9de3dc999. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:09:00.477340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-461c8f3d-254c-4f66-b41b-9e6a4de645f2 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Getting quotas for user 76ea7215906c4ab7b48a9f8c204cbd72 and project 1b06f18250f34f7db9b0bcf9de3dc999. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:09:00.479251 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-89b97bdd-f387-468a-b549-014fd59fc29e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 1.556802 Aug 06 21:09:00.479934 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1752/3597] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:08:58 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:00.573875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-461c8f3d-254c-4f66-b41b-9e6a4de645f2 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Getting quotas for project 1b06f18250f34f7db9b0bcf9de3dc999. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:09:00.595589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-461c8f3d-254c-4f66-b41b-9e6a4de645f2 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Getting quotas for user 76ea7215906c4ab7b48a9f8c204cbd72 and project 1b06f18250f34f7db9b0bcf9de3dc999. Resources: {'server_groups'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:09:00.639220 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-461c8f3d-254c-4f66-b41b-9e6a4de645f2 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.475597 Aug 06 21:09:00.649964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d17dfb6-1524-4cb3-b101-944ae61a06ac tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:00.654651 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1846/3598] 10.222.0.33 () {62 vars in 1214 bytes} [Sat Aug 6 21:09:00 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 21:09:00.708346 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4d17dfb6-1524-4cb3-b101-944ae61a06ac tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.062142 Aug 06 21:09:00.708942 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1753/3599] 10.222.0.33 () {60 vars in 1193 bytes} [Sat Aug 6 21:09:00 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:09:00.723056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-00fe4f7b-1e5e-487e-a862-a0159ba654c2 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:00.737716 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-00fe4f7b-1e5e-487e-a862-a0159ba654c2 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/b4de5b03-ec11-4e42-bc05-5ca4825b9f55" status: 200 len: 235 microversion: 2.64 time: 0.019030 Aug 06 21:09:00.747181 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1847/3600] 10.222.0.33 () {60 vars in 1304 bytes} [Sat Aug 6 21:09:00 2022] GET /compute/v2.1/os-server-groups/b4de5b03-ec11-4e42-bc05-5ca4825b9f55 => generated 235 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:09:00.767843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e843c0c2-7a13-4814-baef-d29c68247d45 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:00.825967 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e843c0c2-7a13-4814-baef-d29c68247d45 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/b4de5b03-ec11-4e42-bc05-5ca4825b9f55" status: 204 len: 0 microversion: 2.64 time: 0.078756 Aug 06 21:09:00.842647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b354854c-edd8-4505-b617-0f52d4fb8cd0 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:00.848694 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1754/3601] 10.222.0.33 () {60 vars in 1307 bytes} [Sat Aug 6 21:09:00 2022] DELETE /compute/v2.1/os-server-groups/b4de5b03-ec11-4e42-bc05-5ca4825b9f55 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:09:00.852078 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-b354854c-edd8-4505-b617-0f52d4fb8cd0 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] HTTP exception thrown: Instance group b4de5b03-ec11-4e42-bc05-5ca4825b9f55 could not be found. Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b354854c-edd8-4505-b617-0f52d4fb8cd0 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Request method failure captured: Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-server-groups/b4de5b03-ec11-4e42-bc05-5ca4825b9f55 HTTP/1.1 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7thrZfA_m6BWVuFxjBqdNqZu1lqMhUEIq4IMu4aFHjPcIS4pT6NJb_pC_SG1QXRcXy-djM2Ulebjx0D51f3iK_uHZVHNUHgAk6xJzVrHQ1Ea-WI3yzF0IDL3aB9qu6Qp1GD9nZVFcHwiBBdWR2RM5TETfXGgEG4xdOV3y6qhHX3Y6zU Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.64 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 1b06f18250f34f7db9b0bcf9de3dc999 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerGroup264TestJSON-779798605 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1b06f18250f34f7db9b0bcf9de3dc999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1b06f18250f34f7db9b0bcf9de3dc999", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b06f18250f34f7db9b0bcf9de3dc999"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1b06f18250f34f7db9b0bcf9de3dc999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerGroup264TestJSON-779798605 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 1b06f18250f34f7db9b0bcf9de3dc999 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerGroup264TestJSON-779798605 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerGroup264TestJSON-779798605-project Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 76ea7215906c4ab7b48a9f8c204cbd72 Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerGroup264TestJSON-779798605-project Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance group b4de5b03-ec11-4e42-bc05-5ca4825b9f55 could not be found. Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'b4de5b03-ec11-4e42-bc05-5ca4825b9f55'} Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b4de5b03-ec11-4e42-bc05-5ca4825b9f55 could not be found. Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b4de5b03-ec11-4e42-bc05-5ca4825b9f55 could not be found. Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:00.855319 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:00.860950 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:00.860950 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:00.860950 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:00.860950 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:00.860950 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b4de5b03-ec11-4e42-bc05-5ca4825b9f55 could not be found. Aug 06 21:09:00.860950 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:00.864082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b354854c-edd8-4505-b617-0f52d4fb8cd0 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] Returning 404 to user: Instance group b4de5b03-ec11-4e42-bc05-5ca4825b9f55 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:00.865743 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b354854c-edd8-4505-b617-0f52d4fb8cd0 tempest-ServerGroup264TestJSON-779798605 tempest-ServerGroup264TestJSON-779798605-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/b4de5b03-ec11-4e42-bc05-5ca4825b9f55" status: 404 len: 117 microversion: 2.64 time: 0.030109 Aug 06 21:09:00.870936 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1848/3602] 10.222.0.33 () {60 vars in 1307 bytes} [Sat Aug 6 21:09:00 2022] DELETE /compute/v2.1/os-server-groups/b4de5b03-ec11-4e42-bc05-5ca4825b9f55 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:09:01.015193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:01.015912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:01.072839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:01.073336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:01.073787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:01.074510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:01.074999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:01.077894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:01.277548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-66962095-4cd2-4375-8b3b-bf975b276096 req-b1d39b10-2194-4eda-890a-89952aec2286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51422ace-16be-4c73-a47b-fef4706c040f", "name": "network-vif-plugged", "status": "completed", "tag": "648f1909-7a3d-44f5-a174-4763c3fa4039"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:01.307402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-66962095-4cd2-4375-8b3b-bf975b276096 req-b1d39b10-2194-4eda-890a-89952aec2286 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:01.309494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-66962095-4cd2-4375-8b3b-bf975b276096 req-b1d39b10-2194-4eda-890a-89952aec2286 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:01.320734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-66962095-4cd2-4375-8b3b-bf975b276096 req-b1d39b10-2194-4eda-890a-89952aec2286 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:01.366411 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-66962095-4cd2-4375-8b3b-bf975b276096 req-b1d39b10-2194-4eda-890a-89952aec2286 service nova] Creating event network-vif-plugged:648f1909-7a3d-44f5-a174-4763c3fa4039 for instance 51422ace-16be-4c73-a47b-fef4706c040f on nch2-master-1 Aug 06 21:09:01.389153 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-66962095-4cd2-4375-8b3b-bf975b276096 req-b1d39b10-2194-4eda-890a-89952aec2286 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118934 Aug 06 21:09:01.391282 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1849/3603] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:09:01.505947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:01.507130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:01.525055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:01.531315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:01.532320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:01.536927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:01.537577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:01.538042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:01.842498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:01.853460 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8acc27a2-09d6-456b-836c-159df2e52864 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.355405 Aug 06 21:09:01.859511 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1850/3604] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:01 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:02.048351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:02.074375 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a4b07736-a9c4-4ee0-9db7-58662acbbe73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 1.062963 Aug 06 21:09:02.075760 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1755/3605] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:01 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:02.881643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:02.883363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:02.951216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:02.952370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:02.952959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:02.956289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:02.959317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:02.960374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:03.099888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:03.100502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:03.120421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:03.120902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:03.123814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:03.126164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:03.134432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:03.135071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:03.572930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:03.586061 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2d99244f-6f92-4b16-9eab-d755ebce167b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.708774 Aug 06 21:09:03.595278 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1851/3606] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:02 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:03.684542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:03.706202 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c08dbbf-3fe5-4f39-bf00-32b753c0d12e tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.613297 Aug 06 21:09:03.708192 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1756/3607] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:03 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:04.620284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:04.620919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:04.653068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:04.654360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:04.654864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:04.662343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:04.663249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:04.664192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:04.734045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:04.735363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:04.763544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:04.768501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:04.769830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:04.770420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:04.783182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:04.783685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:04.811828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:05.212866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:05.223754 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3392d8be-b6c6-400c-8be0-f0c23592420c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.608418 Aug 06 21:09:05.228359 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1852/3608] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:04 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:05.427549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:05.446133 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0c9708e-83a9-4f7a-bc67-37ed6fed2797 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.715733 Aug 06 21:09:05.447327 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1757/3609] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:04 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:06.247492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:06.248118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:06.256523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:06.268150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:06.269519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:06.274716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:06.278115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:06.287540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:06.479675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:06.482994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:06.513170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:06.514485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:06.515639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:06.527725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:06.528554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:06.529298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:07.483524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:07.505438 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6251682f-708f-4901-ac66-62341906a231 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 1.038600 Aug 06 21:09:07.508206 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1758/3610] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:06 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:07.796879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:07.805525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:07.848968 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-503dcc77-2c2a-43da-a7f7-8fa5ff7d6136 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 1.603751 Aug 06 21:09:07.852466 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1853/3611] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:06 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:08.530538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:08.532255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:08.556288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:08.559558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:08.560945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:08.564591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:08.566858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:08.568668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:08.882279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:08.883908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:08.919149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:08.919850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:08.920416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:08.921341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:08.921908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:08.922444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:09.509987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:09.521490 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d28db0f-299d-401f-9885-69f687e6b115 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.650206 Aug 06 21:09:09.535790 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1854/3612] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:08 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:09.579599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:09.615385 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c6d485c0-3d21-43fc-8b2d-6250efd5150f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 1.090238 Aug 06 21:09:09.618183 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1759/3613] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:08 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:10.548399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:10.549082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:10.561351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:10.561873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:10.562298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:10.567310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:10.567771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:10.568226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:10.625284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:10.637964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:10.639245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:10.651785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:10.663567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:10.668208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:10.671518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:10.679476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:10.683962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:10.919704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:10.946285 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d6d1f53b-7f5b-4b06-9546-9d0969f1166b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.401914 Aug 06 21:09:10.947411 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1855/3614] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:10 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:11.472821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:11.484946 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e9796278-b2c6-4a7e-9752-2798c77a4c9d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.848420 Aug 06 21:09:11.500720 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1760/3615] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:10 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:11.863914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:11.868728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:11.896495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:11.898775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:11.899440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:11.904451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:11.907046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:11.908521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:11.973034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:11.974783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:12.033811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:12.034345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:12.045742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:12.061129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:12.064226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:12.064833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:12.577228 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719348 Aug 06 21:09:12.584141 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1856/3616] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:09:11 2022] POST /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:12.602912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:12.606081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:12.633399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:12.634265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:12.637141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:12.638391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:12.640636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:12.641875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:13.232025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:13.250279 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8e5c4441-1076-4888-b162-1f168039f9a5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 1.283267 Aug 06 21:09:13.257466 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1761/3617] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:11 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:14.138714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:14.164217 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eef43f76-8298-4899-840c-8bac390abc7a tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 1.568704 Aug 06 21:09:14.168921 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1857/3618] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:12 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:14.286629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:14.287755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:14.320336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:14.324240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:14.325485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:14.337342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:14.337886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:14.338484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:15.208492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:15.209142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:15.234213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:15.235017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:15.235724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:15.245034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:15.247708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:15.248883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:15.891961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:15.913964 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f6b6ed91-1da3-4c9a-b778-baffe043af9a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 1.636194 Aug 06 21:09:15.920371 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1762/3619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:14 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:16.088755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:16.103983 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-067e8293-44e9-4fca-a2e6-8da60e69cc65 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1510 microversion: 2.1 time: 0.902564 Aug 06 21:09:16.109966 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1858/3620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:15 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1510 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:16.520385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f6e9e42f-889f-42f5-bf34-6de76fa8aa45 tempest-ComputeTenantNetworksTest-771589757 tempest-ComputeTenantNetworksTest-771589757-project] Calling method '.version_select at 0x7f72a35a3280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:16.945926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:16.946535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:16.964988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:16.965516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:16.965944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:16.966689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:16.971274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:16.973927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:17.093653 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f6e9e42f-889f-42f5-bf34-6de76fa8aa45 tempest-ComputeTenantNetworksTest-771589757 tempest-ComputeTenantNetworksTest-771589757-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.864290 Aug 06 21:09:17.095560 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1763/3621] 10.222.0.33 () {58 vars in 1158 bytes} [Sat Aug 6 21:09:16 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:17.111735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-472f6d9a-cabe-4826-97c2-714a98a60cac tempest-ComputeTenantNetworksTest-771589757 tempest-ComputeTenantNetworksTest-771589757-project] Calling method '.version_select at 0x7f729d982af0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:17.267780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:17.281829 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-27343deb-bdc0-4804-a90f-fda6d1acd41f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.339731 Aug 06 21:09:17.290330 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1859/3622] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:16 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:17.295221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:17.295846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:17.319145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:17.319905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:17.320398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:17.321216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:17.321677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:17.322174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:17.445585 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-472f6d9a-cabe-4826-97c2-714a98a60cac tempest-ComputeTenantNetworksTest-771589757 tempest-ComputeTenantNetworksTest-771589757-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks/9a107105-2657-4c92-b26f-5cf21aff4a32" status: 200 len: 139 microversion: 2.1 time: 0.343042 Aug 06 21:09:17.446497 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1764/3623] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:09:17 2022] GET /compute/v2.1/os-tenant-networks/9a107105-2657-4c92-b26f-5cf21aff4a32 => generated 139 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:17.614404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:17.621990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:17.627266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:17.661667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:17.663512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:17.667498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:17.670141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:17.673205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:17.673662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:17.773230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lazy-loading 'flavor' on Instance uuid d6e52696-5e64-4d90-a90c-69d78aad14e8 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:09:17.920541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:17.931317 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-24f50de8-f02a-4c64-ac2d-299b9acb1d73 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1487 microversion: 2.1 time: 0.639787 Aug 06 21:09:17.931916 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1860/3624] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:17 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1487 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:17.954590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f4e260cd-0fda-4f15-b758-47a31786af59 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1976113850"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:17.959114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f4e260cd-0fda-4f15-b758-47a31786af59 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:17.991509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4e260cd-0fda-4f15-b758-47a31786af59 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:17.992561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4e260cd-0fda-4f15-b758-47a31786af59 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:17.994175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4e260cd-0fda-4f15-b758-47a31786af59 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:18.001824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4e260cd-0fda-4f15-b758-47a31786af59 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:18.002538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4e260cd-0fda-4f15-b758-47a31786af59 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:18.006004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4e260cd-0fda-4f15-b758-47a31786af59 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:18.166749 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d2acdb11-9117-4ea7-b95e-12d0db738b49 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/action" status: 200 len: 32 microversion: 2.1 time: 0.558024 Aug 06 21:09:18.169653 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1765/3625] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:09:17 2022] POST /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/action => generated 32 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:09:18.197157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:18.201783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:18.232850 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f4e260cd-0fda-4f15-b758-47a31786af59 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "PUT /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1060 microversion: 2.1 time: 0.282030 Aug 06 21:09:18.233533 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1861/3626] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:09:17 2022] PUT /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1060 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:18.249164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:18.265332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:18.265965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:18.268106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:18.271287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:18.274018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:18.278000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:18.286242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:18.287321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:18.289501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:18.290287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:18.293035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:18.293532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:18.293983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:18.860407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:18.868671 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1da48fa7-a17b-4b96-8606-03dae1912ee8 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1487 microversion: 2.1 time: 0.615045 Aug 06 21:09:18.869254 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1862/3627] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:18 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1487 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:18.882858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:18.888054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:18.900164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:18.900681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:18.901128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:18.901856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:18.902329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:18.903173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:19.391832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:19.407312 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0d615da8-8afa-435f-bd1b-50a3cd77ddce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 1.225375 Aug 06 21:09:19.410404 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1766/3628] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:18 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:19.807260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:19.819554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1431298275", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0dc34d54-ae4c-4acf-9643-9ee7fdd70f9d"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:19.838783 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8afd146d-a515-45e4-bded-49809a20cec5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.965346 Aug 06 21:09:19.856557 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1863/3629] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:18 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:19.886969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:19.888597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:19.900753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:19.901256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:19.901705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:19.902420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:19.902926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:19.903357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:19.950577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] validate_networks() for [('0dc34d54-ae4c-4acf-9643-9ee7fdd70f9d', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:09:21.039519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:09:21.040867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:09:21.041555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:09:21.042138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:09:21.042778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:09:21.057747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:21.074627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:21.075506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:21.082957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:21.083764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:21.085119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:21.143959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Getting quotas for project 9ed8f9cbedd14527bb98ac545eaf70d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:09:21.157312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Getting quotas for user c3601924229d4254817f827b64c9380e and project 9ed8f9cbedd14527bb98ac545eaf70d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:09:21.188137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:09:21.192162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:09:21.298613 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e4908feb-073b-41b1-a5da-18cf493dbf90 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.886831 Aug 06 21:09:21.300406 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1767/3630] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:09:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:09:21.306809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:21.307821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:21.314930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:21.316514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:21.317187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:21.318237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:21.318919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:21.319557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:21.666793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:21.680292 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7857ca1d-360f-416c-a59f-3a5374712d77 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1487 microversion: 2.1 time: 1.817046 Aug 06 21:09:21.686231 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1864/3631] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:19 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1487 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:21.707590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:21.708618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:21.734495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:21.740337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:21.742685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:21.744985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:21.745730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:21.754716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:21.809079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:21.825479 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fa8f011a-3f1a-4cd3-a2e0-a6fb98529fc1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.523014 Aug 06 21:09:21.826199 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1768/3632] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:21 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:21.845353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d273c693-12ba-462f-8945-e981d295109c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:21.847013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d273c693-12ba-462f-8945-e981d295109c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:21.998279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d273c693-12ba-462f-8945-e981d295109c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:22.024472 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d273c693-12ba-462f-8945-e981d295109c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1228 microversion: 2.1 time: 0.184987 Aug 06 21:09:22.026958 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1769/3633] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:21 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1228 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:22.038331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:22.040273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:22.073885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:22.075966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:22.076432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:22.077568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:22.078333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:22.079044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:22.123265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:09:22.421488 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e68aa069-4c73-464c-ad06-202d6c50626f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 204 len: 0 microversion: 2.1 time: 0.385913 Aug 06 21:09:22.421902 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1770/3634] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:22 2022] DELETE /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:22.457891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:22.462869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:22.485788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:22.489207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:22.489884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:22.491250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:22.496705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:22.500849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:22.501603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:22.509824 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-18894727-524d-497f-986c-9f69fd8dbb59 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.815380 Aug 06 21:09:22.530354 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1865/3635] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:21 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:22.851261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:22.852797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:22.881731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:22.884146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:22.884865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:22.887306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:22.891829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:22.896884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:22.901061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:22.914070 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-94b68b98-7bba-4e20-b6e0-12cb54ec62cf tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1493 microversion: 2.1 time: 0.463087 Aug 06 21:09:22.922011 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1771/3636] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:22 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1493 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:23.048340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ee80bc6-9ac6-43eb-a0a0-579ad5b404bf tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:23.049066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1ee80bc6-9ac6-43eb-a0a0-579ad5b404bf tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:23.233103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1ee80bc6-9ac6-43eb-a0a0-579ad5b404bf tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:23.251670 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1ee80bc6-9ac6-43eb-a0a0-579ad5b404bf tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1228 microversion: 2.1 time: 0.203843 Aug 06 21:09:23.252581 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1772/3637] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:23 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1228 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:23.533543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:23.535175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:23.555437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:23.556386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:23.557101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:23.558085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:23.571742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:23.572231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:24.297130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:24.308818 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6181f5be-5f42-43a9-b83f-87c5ad846d34 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 1.462963 Aug 06 21:09:24.309402 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1866/3638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:22 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:24.336124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:24.337579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:24.359857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:24.360356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:24.360800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:24.361509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:24.361993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:24.362433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:24.432187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:24.441605 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fbdfe053-d072-4164-9d5c-c7cd8216d10a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.912012 Aug 06 21:09:24.450975 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1773/3639] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:23 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:24.479513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:24.486675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:24.514590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:24.514590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:24.515034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:24.515770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:24.516390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:24.516674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:25.212564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:25.230043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:25.249141 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ae9ef961-ee64-41de-9683-48bf8309d227 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 200 len: 1493 microversion: 2.1 time: 0.931195 Aug 06 21:09:25.269983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:25.270238 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1867/3640] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:24 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 1493 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:25.314216 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c1011e07-0873-4211-a93f-7cc310bf8c8c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1280 microversion: 2.1 time: 0.855458 Aug 06 21:09:25.322975 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1774/3641] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:24 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1280 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:25.335964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:25.337960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:25.370897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:25.371512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:25.371972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:25.372734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:25.373207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:25.382722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:25.479239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:25.480509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:25.488351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:25.501656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:25.504353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:25.505484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:25.506129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:25.506924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:25.510798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:26.276310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:26.299194 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3f0f4c7b-9e87-470a-aa91-e73191c5d4c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.823056 Aug 06 21:09:26.301415 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1775/3642] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:25 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:26.752081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-14c634fe-dfb4-463a-abac-490edb9908e5 req-81514884-4a20-4668-8f3b-2e346d413a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342ecaee-7b6f-4f86-a681-97c31d3a313b", "name": "network-vif-deleted", "tag": "60a9a881-0e7f-4904-b75e-bcc8b7e9a53d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:26.782202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-14c634fe-dfb4-463a-abac-490edb9908e5 req-81514884-4a20-4668-8f3b-2e346d413a54 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:26.785944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-14c634fe-dfb4-463a-abac-490edb9908e5 req-81514884-4a20-4668-8f3b-2e346d413a54 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:26.787137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-14c634fe-dfb4-463a-abac-490edb9908e5 req-81514884-4a20-4668-8f3b-2e346d413a54 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:26.823107 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-14c634fe-dfb4-463a-abac-490edb9908e5 req-81514884-4a20-4668-8f3b-2e346d413a54 service nova] Creating event network-vif-deleted:60a9a881-0e7f-4904-b75e-bcc8b7e9a53d for instance 342ecaee-7b6f-4f86-a681-97c31d3a313b on nch1-master-1 Aug 06 21:09:26.837740 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-14c634fe-dfb4-463a-abac-490edb9908e5 req-81514884-4a20-4668-8f3b-2e346d413a54 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.532620 Aug 06 21:09:26.842021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:26.842535 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1776/3643] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:26.850680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:26.854005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:26.860055 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f7c812c3-2e41-4574-a97f-8465874900af tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 1.528498 Aug 06 21:09:26.881566 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1868/3644] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:25 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:26.885865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:26.899818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:26.904928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:26.918159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:26.920124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:26.921334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:26.921677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:26.922075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:26.922949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:26.923443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:26.923771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:26.923911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:26.931959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:26.934832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:26.935383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:26.969521 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b HTTP/1.1 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '342ecaee-7b6f-4f86-a681-97c31d3a313b'} Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:26.980519 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:26.985776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:26.985776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:26.985776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:26.985776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:26.985776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:26.985776 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:26.993987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:26.997404 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4feb5007-a068-4ace-8882-1e9c31f46f1c tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 404 len: 111 microversion: 2.1 time: 0.154040 Aug 06 21:09:26.999989 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1777/3645] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:26 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.026080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.026646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.042915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.043379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.044866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.046149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.047362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.048485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.084423 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b HTTP/1.1 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '342ecaee-7b6f-4f86-a681-97c31d3a313b'} Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.088579 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.094318 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.099174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.100525 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ca5f61df-3fb3-4405-b1d8-9e1a6f8e8959 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 404 len: 111 microversion: 2.1 time: 0.086441 Aug 06 21:09:27.102264 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1778/3646] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:27 2022] DELETE /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:09:27.119839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.121562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 342ecaee-7b6f-4f86-a681-97c31d3a313b] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.140607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.141046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.141502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.145030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.147248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.147716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.161770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:27.180910 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-688bb4ed-30db-4200-9f3a-692d3b48c108 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1286 microversion: 2.1 time: 0.297425 Aug 06 21:09:27.182927 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1869/3647] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:26 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1286 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:27.189502 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b HTTP/1.1 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '342ecaee-7b6f-4f86-a681-97c31d3a313b'} Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.191224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.197044 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.197044 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.197044 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.197044 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.197044 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. Aug 06 21:09:27.197044 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.203933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 342ecaee-7b6f-4f86-a681-97c31d3a313b could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.206293 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7ea9153-3e08-40b8-8e44-96a34bf0a7fc tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b" status: 404 len: 111 microversion: 2.1 time: 0.098099 Aug 06 21:09:27.209641 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1779/3648] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:27 2022] GET /compute/v2.1/servers/342ecaee-7b6f-4f86-a681-97c31d3a313b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.219754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.220511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.237978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.238478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.239008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.239915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.240434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.241059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.266372 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 HTTP/1.1 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '3229247f-828a-4c89-8986-792f56e6c1c7'} Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.269158 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.275039 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.279478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.281790 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e3553c2-1298-4495-aa23-3c2cd3366d82 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 404 len: 111 microversion: 2.1 time: 0.066677 Aug 06 21:09:27.283534 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1870/3649] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:27 2022] DELETE /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.296787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.300924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 3229247f-828a-4c89-8986-792f56e6c1c7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.311804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.313519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.314696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.316791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.318129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.319086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.323768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.324733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.336934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.337499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.337952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.338893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.340300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.340838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.345544 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 HTTP/1.1 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '3229247f-828a-4c89-8986-792f56e6c1c7'} Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.348792 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.357473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.357473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.357473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.357473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.357473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. Aug 06 21:09:27.357473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.360080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 3229247f-828a-4c89-8986-792f56e6c1c7 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.361684 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a934547e-32fa-4e56-8533-bafc599106b5 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7" status: 404 len: 111 microversion: 2.1 time: 0.070988 Aug 06 21:09:27.363895 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1780/3650] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:27 2022] GET /compute/v2.1/servers/3229247f-828a-4c89-8986-792f56e6c1c7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.374122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.375979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.386926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.387917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.388626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.389598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.391236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.391935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.424383 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 HTTP/1.1 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '9cbd6244-6ccb-4ab4-9291-4b0cb23369d2'} Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.426622 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.434663 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.441011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.442603 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-52d9b460-9e3e-47d8-85f2-c973a6c7956d tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 404 len: 111 microversion: 2.1 time: 0.074833 Aug 06 21:09:27.443750 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1781/3651] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:27 2022] DELETE /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.461913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.462741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.470317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.471525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.473352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.474483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.475064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.475517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.499017 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 HTTP/1.1 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '9cbd6244-6ccb-4ab4-9291-4b0cb23369d2'} Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.501413 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.508272 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.508272 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.508272 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.508272 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.508272 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. Aug 06 21:09:27.508272 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.510281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.511889 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c4c3309-dcf7-4c69-b854-ce3b9b2a0cce tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2" status: 404 len: 111 microversion: 2.1 time: 0.062360 Aug 06 21:09:27.516138 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1782/3652] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:27 2022] GET /compute/v2.1/servers/9cbd6244-6ccb-4ab4-9291-4b0cb23369d2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.523330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.523983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.531907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.532491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.533043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.534534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.535310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.536437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.556734 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 HTTP/1.1 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'e0b1d8f6-c200-4f9d-958c-d3594e12be88'} Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.558759 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.566970 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.571009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.571899 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4ab5ed6f-65bb-4ced-9a25-0464b9daab29 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 404 len: 111 microversion: 2.1 time: 0.054293 Aug 06 21:09:27.572751 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1783/3653] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:27 2022] DELETE /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.583408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.584238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: e0b1d8f6-c200-4f9d-958c-d3594e12be88] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.592906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.593533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.594346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.595415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.596047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.596762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.617590 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 HTTP/1.1 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'e0b1d8f6-c200-4f9d-958c-d3594e12be88'} Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.619722 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.625518 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.625518 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.625518 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.625518 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.625518 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. Aug 06 21:09:27.625518 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.627241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance e0b1d8f6-c200-4f9d-958c-d3594e12be88 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.629091 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-88033d88-4be9-433e-bd31-77f3bcd62b9f tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88" status: 404 len: 111 microversion: 2.1 time: 0.051970 Aug 06 21:09:27.630308 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1784/3654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:27 2022] GET /compute/v2.1/servers/e0b1d8f6-c200-4f9d-958c-d3594e12be88 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:09:27.638430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.639408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.648436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.649363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.650103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.651067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.651784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.652544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.671706 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 HTTP/1.1 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'd389375c-139a-4e55-8ddb-90459d2d0770'} Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.673811 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.679395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.681612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.683130 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-94b9534f-a21f-4020-b711-cfd6acf442d4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 404 len: 111 microversion: 2.1 time: 0.048612 Aug 06 21:09:27.685296 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1785/3655] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:27 2022] DELETE /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.697814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.699850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: d389375c-139a-4e55-8ddb-90459d2d0770] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.710224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.711431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.712229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.713534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.714409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.715253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.732429 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 HTTP/1.1 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'd389375c-139a-4e55-8ddb-90459d2d0770'} Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.734784 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.742148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.742148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.742148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.742148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.742148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. Aug 06 21:09:27.742148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.743998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance d389375c-139a-4e55-8ddb-90459d2d0770 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.745422 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-32ef2ff2-60a0-4a0f-ba74-8bf5e0d4c531 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770" status: 404 len: 111 microversion: 2.1 time: 0.055255 Aug 06 21:09:27.746332 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1786/3656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:27 2022] GET /compute/v2.1/servers/d389375c-139a-4e55-8ddb-90459d2d0770 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:09:27.756327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.757694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.766825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.768901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.770116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.771512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.772241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.773100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.791015 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d HTTP/1.1 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'b7fe8c8c-7873-436b-8c54-e98ce91b892d'} Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.793129 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.799171 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.803075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.804602 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-22fa88ea-c6b6-4f40-9342-87395d1fda10 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 404 len: 111 microversion: 2.1 time: 0.053573 Aug 06 21:09:27.806292 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1787/3657] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:27 2022] DELETE /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:09:27.816119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.817307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: b7fe8c8c-7873-436b-8c54-e98ce91b892d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.841339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.843165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.843930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.845052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:27.848323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.849855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.855276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.863441 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ac68a0c3-9b88-4e0c-88e6-d74f00ab0cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1525 microversion: 2.1 time: 0.541322 Aug 06 21:09:27.874939 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1871/3658] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:27 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1525 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:27.884552 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d HTTP/1.1 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'b7fe8c8c-7873-436b-8c54-e98ce91b892d'} Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.886150 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.890993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.890993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.890993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.890993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.890993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. Aug 06 21:09:27.890993 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.891564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.891564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.895665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance b7fe8c8c-7873-436b-8c54-e98ce91b892d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.896400 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-637e8559-e211-46f8-a90e-e4d9a14ab224 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d" status: 404 len: 111 microversion: 2.1 time: 0.085916 Aug 06 21:09:27.900611 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1788/3659] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:27 2022] GET /compute/v2.1/servers/b7fe8c8c-7873-436b-8c54-e98ce91b892d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.904298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.904786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.905647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.905900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d2e87d40-7395-40fd-a905-5532d58a6eef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.906415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d2e87d40-7395-40fd-a905-5532d58a6eef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 4b409fac-c5bf-4a05-bb04-01106727f788] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.906846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.907332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.907751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.926070 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-d2e87d40-7395-40fd-a905-5532d58a6eef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d2e87d40-7395-40fd-a905-5532d58a6eef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788 HTTP/1.1 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4b409fac-c5bf-4a05-bb04-01106727f788'} Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.927700 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.933813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.933813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.933813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.933813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.933813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.933813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.933813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.933813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d2e87d40-7395-40fd-a905-5532d58a6eef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.933813 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d2e87d40-7395-40fd-a905-5532d58a6eef tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788" status: 404 len: 111 microversion: 2.1 time: 0.027275 Aug 06 21:09:27.937648 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1789/3660] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:27 2022] DELETE /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.947550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6caa105-3106-42ef-a7d2-576c89003f98 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.948487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e6caa105-3106-42ef-a7d2-576c89003f98 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 4b409fac-c5bf-4a05-bb04-01106727f788] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.956379 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-e6caa105-3106-42ef-a7d2-576c89003f98 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6caa105-3106-42ef-a7d2-576c89003f98 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788 HTTP/1.1 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4b409fac-c5bf-4a05-bb04-01106727f788'} Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:27.962624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:27.977827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:27.977827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:27.977827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. Aug 06 21:09:27.977827 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:27.977827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6caa105-3106-42ef-a7d2-576c89003f98 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 4b409fac-c5bf-4a05-bb04-01106727f788 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:27.977827 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6caa105-3106-42ef-a7d2-576c89003f98 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788" status: 404 len: 111 microversion: 2.1 time: 0.024965 Aug 06 21:09:27.977827 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1790/3661] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:27 2022] GET /compute/v2.1/servers/4b409fac-c5bf-4a05-bb04-01106727f788 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:27.977827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:27.977827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:27.982916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.983411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.984086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:27.984872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:27.986437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:27.986437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:28.024385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:09:28.250947 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c9e7a28c-2235-45db-97df-980202474282 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 204 len: 0 microversion: 2.1 time: 0.281513 Aug 06 21:09:28.257194 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1791/3662] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:27 2022] DELETE /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:28.266101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:28.270940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:28.278716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:28.279485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:28.280290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:28.281580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:28.282213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:28.282885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:28.418943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:28.442123 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d7b24f76-12f9-4801-a211-afdcb7d02b3b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1286 microversion: 2.1 time: 0.180822 Aug 06 21:09:28.444206 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1792/3663] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:28 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1286 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:28.461656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:28.462308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:28.481477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:28.484395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:28.485221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:28.488194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:28.488744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:28.489196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:28.668005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:28.679374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0596526a-ac8f-4d4c-9919-65a2ff7c88d7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.795605 Aug 06 21:09:28.680237 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1872/3664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:27 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:28.845180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:28.864805 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c14b00d-e005-4bc3-a2b6-cf7bfd1975e4 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1479 microversion: 2.1 time: 0.416396 Aug 06 21:09:28.879013 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1793/3665] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:28 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1479 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:28.891487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:28.892756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:28.915550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:28.916533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:28.918054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:28.918747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:28.920872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:28.921681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:28.921979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:28.923057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Searching by: {'deleted': False, 'project_id': '3389d5492b224ef9963f6305139ae9b8'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:09:28.923817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:28.936228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:28.936811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:28.937203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:28.937979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:28.938684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:28.939289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:28.997431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:09:29.048033 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c509bdfe-0463-4ac2-a782-7322b2e9b9c0 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.141344 Aug 06 21:09:29.048139 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1794/3666] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:09:28 2022] GET /compute/v2.1/servers => generated 344 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:29.064327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:29.073416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:29.074624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Searching by: {'deleted': False, 'project_id': '3389d5492b224ef9963f6305139ae9b8'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:09:29.083333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:29.084168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:29.085722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:29.089200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:29.089438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:29.091395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:29.131602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:09:29.258415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:29.291692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:29.293265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:29.293265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:29.459150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:29.479067 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-276f154b-967e-4784-9739-168dd14ac19e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1507 microversion: 2.1 time: 0.592114 Aug 06 21:09:29.480544 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1873/3667] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:28 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1507 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:29.488031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:29.489245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:29.507718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:29.509310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:29.510056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:29.510852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:29.512726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:29.513235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:29.765579 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a9b372c-f6af-480f-b017-7bd1280e8a76 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.707628 Aug 06 21:09:29.766280 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1795/3668] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:09:29 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:30.016484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-385847993", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "736ed351-96b2-40f9-b19a-2a7e79779668"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:30.037175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:30.057238 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-73d98b68-7e98-486b-8592-5d34896ad600 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1328 microversion: 2.1 time: 0.575274 Aug 06 21:09:30.066898 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1874/3669] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:29 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1328 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:30.071994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:30.074526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:30.091502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:30.092293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:30.092926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:30.093874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:30.094531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:30.097039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:30.125945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] validate_networks() for [('736ed351-96b2-40f9-b19a-2a7e79779668', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:09:30.857868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:30.874047 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb756d6b-4604-4209-8fba-af05cf0977c2 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.805007 Aug 06 21:09:30.875914 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1875/3670] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:30 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:30.886713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d9fe86f-d1af-48db-abe9-d1869f76a0f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:30.946364 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d9fe86f-d1af-48db-abe9-d1869f76a0f1 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.067429 Aug 06 21:09:30.949465 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1876/3671] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:09:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:30.963701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:30.967570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:30.984371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:30.985404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:30.988247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:30.989265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:30.989982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:30.990844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:31.118076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd210e197347f8ad1622ee882bee92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbbbe30122a7461ea225294728dc8af7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:31.133023 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd5638b8-020f-45a9-8d81-b2988bcd42e0 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 200 len: 1437 microversion: 2.1 time: 0.173117 Aug 06 21:09:31.135102 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1877/3672] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:30 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 1437 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:31.153954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:31.157613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:31.175653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:31.176621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:31.177183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:31.179094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:31.180521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:31.182904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:31.408800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:09:31.409891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:09:31.411441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:09:31.412102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:09:31.412981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:09:31.437899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:31.439093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:31.441484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:31.444295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:31.446210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:31.448614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:31.517027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Getting quotas for project 591beac720d74a8889ad521c436e64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:09:31.545128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:31.553604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Getting quotas for user 22318132bfd04aa0886eb9b14a983731 and project 591beac720d74a8889ad521c436e64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:09:31.577751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:09:31.580724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:09:31.629373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:31.639905 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d6ba5f1-85a2-4bf2-b81a-9c0d913752dc tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1507 microversion: 2.1 time: 0.503321 Aug 06 21:09:31.640871 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1878/3673] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:31 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1507 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:31.663359 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-152987f5-6413-42e2-9eb1-f9e515c412f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.891219 Aug 06 21:09:31.664974 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1796/3674] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:09:31.699033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5c1be334-265c-46bb-86c4-8c8b9722da2c req-bf22c815-b065-49b3-ac26-ee70ea7b7813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6de9449c-2f19-42d8-8476-fb7ccf1b0c94", "name": "network-vif-deleted", "tag": "81411f88-8c50-40a1-b174-1dfabe4d6575"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:31.726397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5c1be334-265c-46bb-86c4-8c8b9722da2c req-bf22c815-b065-49b3-ac26-ee70ea7b7813 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:31.734615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5c1be334-265c-46bb-86c4-8c8b9722da2c req-bf22c815-b065-49b3-ac26-ee70ea7b7813 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:31.735137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5c1be334-265c-46bb-86c4-8c8b9722da2c req-bf22c815-b065-49b3-ac26-ee70ea7b7813 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:31.765504 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-5c1be334-265c-46bb-86c4-8c8b9722da2c req-bf22c815-b065-49b3-ac26-ee70ea7b7813 service nova] Creating event network-vif-deleted:81411f88-8c50-40a1-b174-1dfabe4d6575 for instance 6de9449c-2f19-42d8-8476-fb7ccf1b0c94 on nch1-master-1 Aug 06 21:09:31.796813 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5c1be334-265c-46bb-86c4-8c8b9722da2c req-bf22c815-b065-49b3-ac26-ee70ea7b7813 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125917 Aug 06 21:09:31.803433 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1797/3675] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:31.832818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:31.833804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:31.873981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:31.876781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:31.878279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:31.882403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:31.882958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:31.883412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.028837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-302004a9-ce35-4b5a-a24b-f8c99e7be9a6 req-8aa6d4e6-d2d3-4dbb-8f60-3c958ed34b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48be0892-8100-4fb8-9e02-08c5887f1e5c", "tag": "b8e95348-df26-4f1a-81db-f2f97d1ff2ac"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:32.072062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-302004a9-ce35-4b5a-a24b-f8c99e7be9a6 req-8aa6d4e6-d2d3-4dbb-8f60-3c958ed34b2f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:32.072763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-302004a9-ce35-4b5a-a24b-f8c99e7be9a6 req-8aa6d4e6-d2d3-4dbb-8f60-3c958ed34b2f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:32.074653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-302004a9-ce35-4b5a-a24b-f8c99e7be9a6 req-8aa6d4e6-d2d3-4dbb-8f60-3c958ed34b2f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.108930 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-302004a9-ce35-4b5a-a24b-f8c99e7be9a6 req-8aa6d4e6-d2d3-4dbb-8f60-3c958ed34b2f service nova] Creating event network-changed:b8e95348-df26-4f1a-81db-f2f97d1ff2ac for instance 48be0892-8100-4fb8-9e02-08c5887f1e5c on nch2-master-1 Aug 06 21:09:32.117758 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-302004a9-ce35-4b5a-a24b-f8c99e7be9a6 req-8aa6d4e6-d2d3-4dbb-8f60-3c958ed34b2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.453606 Aug 06 21:09:32.118796 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1879/3676] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:32.127035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:32.129554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:32.140751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:32.141755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:32.142702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.143761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:32.144688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:32.146166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.186092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:09:32.371946 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d825d2a1-6721-42f0-b920-46680683d1a3 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 204 len: 0 microversion: 2.1 time: 0.250019 Aug 06 21:09:32.372717 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1880/3677] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:32 2022] DELETE /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:32.385811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5deb654-4b70-42ea-bd7c-bcb88a6bc4bd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:32.388516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a5deb654-4b70-42ea-bd7c-bcb88a6bc4bd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:32.513789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a5deb654-4b70-42ea-bd7c-bcb88a6bc4bd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:32.535289 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5deb654-4b70-42ea-bd7c-bcb88a6bc4bd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1217 microversion: 2.1 time: 0.160174 Aug 06 21:09:32.535880 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1881/3678] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:32 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:32.538069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:32.550861 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c86ec46b-7b6b-4dad-9417-67a8020fd063 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1328 microversion: 2.1 time: 0.743259 Aug 06 21:09:32.551512 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1798/3679] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:31 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1328 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:32.566166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:32.568823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:32.569442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] [instance: 6de9449c-2f19-42d8-8476-fb7ccf1b0c94] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:32.570684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:32.591601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:32.595025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:32.597470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.597767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:32.598284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:32.599238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:32.599847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.601248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:32.601690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.603651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:32.604361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:32.605063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.626387 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] HTTP exception thrown: Instance 6de9449c-2f19-42d8-8476-fb7ccf1b0c94 could not be found. Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Request method failure captured: Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 HTTP/1.1 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7teeCBCyMd8kZjQGG-Sq4pglJd-FcgtyiFXAUTLBkzxO2pXgdbgnShOclHouAhTsrceb56bVKJBqT41Cn6w6xToSDmhpLdXNhqhT3phBBkoJ483iRkujXSpOpFqPOg4vnlmeWpSDX56p57qHCllWYUOB9G70F9uPToK9a0Au1ay7zm8 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbbbe30122a7461ea225294728dc8af7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbbbe30122a7461ea225294728dc8af7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersTestJSON-713760366 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbbbe30122a7461ea225294728dc8af7 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersTestJSON-713760366 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersTestJSON-713760366-project Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7dcd210e197347f8ad1622ee882bee92 Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersTestJSON-713760366-project Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 6de9449c-2f19-42d8-8476-fb7ccf1b0c94 could not be found. Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '6de9449c-2f19-42d8-8476-fb7ccf1b0c94'} Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6de9449c-2f19-42d8-8476-fb7ccf1b0c94 could not be found. Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6de9449c-2f19-42d8-8476-fb7ccf1b0c94 could not be found. Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:32.628687 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:32.635423 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:32.635423 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:32.635423 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:32.635423 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:32.635423 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6de9449c-2f19-42d8-8476-fb7ccf1b0c94 could not be found. Aug 06 21:09:32.635423 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:32.636895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] Returning 404 to user: Instance 6de9449c-2f19-42d8-8476-fb7ccf1b0c94 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:32.637981 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8c55ba3-e364-4ec9-9a9b-6248e8551c11 tempest-ServersTestJSON-713760366 tempest-ServersTestJSON-713760366-project] 10.222.0.33 "GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94" status: 404 len: 111 microversion: 2.1 time: 0.080567 Aug 06 21:09:32.638961 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1799/3680] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:32 2022] GET /compute/v2.1/servers/6de9449c-2f19-42d8-8476-fb7ccf1b0c94 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:32.645875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:32.647504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:32.655930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:32.656798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:32.657484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.658618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:32.659810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:32.660624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:32.913669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:32.925039 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9903bd7d-59dd-4f91-aa2a-0ee073b7b24b tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1608 microversion: 2.1 time: 0.284156 Aug 06 21:09:32.927930 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1800/3681] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:32 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1608 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:33.042615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:33.064822 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c0d20df0-a1f9-45c0-8882-4f07fc2e939f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.521631 Aug 06 21:09:33.065935 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1882/3682] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:32 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:33.088771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:33.089666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:33.097799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:33.098693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:33.099312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:33.101798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:33.102464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:33.103122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:33.133471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-95b8f989-b7e6-4075-b91e-9bbfac84fd4d req-8c0b0700-d51d-41b8-8d67-8d413924585e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51422ace-16be-4c73-a47b-fef4706c040f", "name": "network-vif-unplugged", "status": "completed", "tag": "648f1909-7a3d-44f5-a174-4763c3fa4039"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:33.152280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-95b8f989-b7e6-4075-b91e-9bbfac84fd4d req-8c0b0700-d51d-41b8-8d67-8d413924585e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:33.152772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-95b8f989-b7e6-4075-b91e-9bbfac84fd4d req-8c0b0700-d51d-41b8-8d67-8d413924585e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:33.153219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-95b8f989-b7e6-4075-b91e-9bbfac84fd4d req-8c0b0700-d51d-41b8-8d67-8d413924585e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:33.178618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.compute.server_external_events [req-95b8f989-b7e6-4075-b91e-9bbfac84fd4d req-8c0b0700-d51d-41b8-8d67-8d413924585e service nova] Unable to find a host for instance 51422ace-16be-4c73-a47b-fef4706c040f. Dropping event network-vif-unplugged {{(pid=142462) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 21:09:33.179540 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-95b8f989-b7e6-4075-b91e-9bbfac84fd4d req-8c0b0700-d51d-41b8-8d67-8d413924585e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.250586 Aug 06 21:09:33.181368 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1801/3683] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 253 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 21:09:33.562183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:33.563378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:33.566293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:33.575949 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e113ca6-01bf-4021-ae01-9fa517317177 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 200 len: 1450 microversion: 2.1 time: 0.490836 Aug 06 21:09:33.577639 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1883/3684] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:33 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 1450 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:33.586725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:33.589927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:33.591243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:33.593136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:33.593797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:33.598422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:33.611478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:33.614278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:33.615206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:33.615844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:33.615987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:33.624139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:33.624642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:33.625099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:33.639836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:33.748139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:33.759536 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-889886f4-fbaa-4398-b743-cc804122105b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1213 microversion: 2.1 time: 0.207086 Aug 06 21:09:33.760899 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1802/3685] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:33 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1213 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:33.783397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:33.783397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:33.792657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:33.792657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:33.792657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:33.792657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:33.792657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:33.792657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:33.841939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:09:33.852038 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.compute.api [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Working on deleting snapshot e0114534-4840-4d62-89d7-db1136a961a4 from shelved instance... Aug 06 21:09:34.203110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:34.237389 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fe3be26d-d1d5-40d3-9505-541f996e0e7e tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1328 microversion: 2.1 time: 0.657618 Aug 06 21:09:34.239872 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1884/3686] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:33 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1328 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:34.250058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:34.251714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:34.268745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:34.269838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:34.270460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:34.271799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:34.272769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:34.273633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:34.989705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:35.011552 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74a7f160-aacd-4a99-ab92-665267c1dd0a tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1608 microversion: 2.1 time: 0.769877 Aug 06 21:09:35.012186 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1885/3687] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:34 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1608 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:35.017021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:35.021758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:35.035790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:35.036421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:35.036874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:35.037592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:35.038059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:35.038493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:35.046767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Doing local delete in cell 7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) {{(pid=142462) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 06 21:09:35.047507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:35.047996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:35.048437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:35.048867 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.compute.api [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 06 21:09:35.065267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] deallocate_for_instance() {{(pid=142462) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 06 21:09:35.234941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:35.240166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:35.252242 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc64f04a-ba99-4b2c-9a0f-43f069993f07 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.238714 Aug 06 21:09:35.253415 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1886/3688] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:35 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:35.261548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:35.267223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:35.280710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:35.281608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:35.282213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:35.287489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:35.288200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:35.288799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:35.465129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:35.481747 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2b9797d-6756-4e1c-9866-8286532f034c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1275 microversion: 2.1 time: 0.226976 Aug 06 21:09:35.494358 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1887/3689] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:35 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1275 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:35.510640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:35.513527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:35.532562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:35.532918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:35.533401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:35.534926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:35.535208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:35.535650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:35.841256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:35.858436 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e5e0776c-534f-4d82-9e7e-4e1163474295 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1328 microversion: 2.1 time: 0.362309 Aug 06 21:09:35.859149 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1888/3690] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:35 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:36.033126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:36.034709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:36.041911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:36.042794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:36.043499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:36.044471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:36.045158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:36.045808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:36.405638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:36.423679 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ac30890f-a409-4abd-b748-98cf8b9d6b37 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1541 microversion: 2.1 time: 0.391453 Aug 06 21:09:36.427112 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1889/3691] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:36 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1541 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:36.441456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:36.442904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:36.457797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:36.460457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:36.460938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:36.461907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:36.465400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:36.466878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:36.934590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Updating instance_info_cache with network_info: [] {{(pid=142462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:09:36.971588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:36.986985 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9a78d51b-4d4c-4e57-94e0-17952c5cdddf tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.553093 Aug 06 21:09:37.004139 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1890/3692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:36 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:37.007630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:37.008249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:37.042478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:37.043074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:37.043451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:37.044175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:37.044643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:37.045077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:37.572040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:37.584649 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9ba6afb-c8ef-4b85-bad4-43c83d4b35df tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1317 microversion: 2.1 time: 0.580741 Aug 06 21:09:37.585264 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1891/3693] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:37 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:37.641847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:37.643848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:37.671710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:37.687054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:37.687679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:37.708081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:37.712200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:37.713868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:38.323274 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-38ad761a-5115-4991-b26d-7a44fd8cb413 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 204 len: 0 microversion: 2.1 time: 4.558792 Aug 06 21:09:38.324048 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1803/3694] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:33 2022] DELETE /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 0 bytes in 4562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:38.348916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5a931aee-21ea-462a-b27c-5121c37e932c req-a7c88409-4425-4e42-ac64-f6a4fd0124ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51422ace-16be-4c73-a47b-fef4706c040f", "name": "network-vif-deleted", "tag": "648f1909-7a3d-44f5-a174-4763c3fa4039"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:38.364217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5a931aee-21ea-462a-b27c-5121c37e932c req-a7c88409-4425-4e42-ac64-f6a4fd0124ac service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:38.365733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5a931aee-21ea-462a-b27c-5121c37e932c req-a7c88409-4425-4e42-ac64-f6a4fd0124ac service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:38.367415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5a931aee-21ea-462a-b27c-5121c37e932c req-a7c88409-4425-4e42-ac64-f6a4fd0124ac service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:38.384897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.compute.server_external_events [req-5a931aee-21ea-462a-b27c-5121c37e932c req-a7c88409-4425-4e42-ac64-f6a4fd0124ac service nova] Unable to find a host for instance 51422ace-16be-4c73-a47b-fef4706c040f. Dropping event network-vif-deleted {{(pid=142462) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 21:09:38.387473 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5a931aee-21ea-462a-b27c-5121c37e932c req-a7c88409-4425-4e42-ac64-f6a4fd0124ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.061217 Aug 06 21:09:38.398514 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1804/3695] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 21:09:38.422780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8bc10aec-ab45-4f7e-a60a-0f2fbde9c7b9 req-cf4b2ae3-d4dc-4f9d-8d4e-ccff06adcc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48be0892-8100-4fb8-9e02-08c5887f1e5c", "name": "network-vif-plugged", "status": "completed", "tag": "b8e95348-df26-4f1a-81db-f2f97d1ff2ac"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:38.464429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8bc10aec-ab45-4f7e-a60a-0f2fbde9c7b9 req-cf4b2ae3-d4dc-4f9d-8d4e-ccff06adcc39 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:38.469872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8bc10aec-ab45-4f7e-a60a-0f2fbde9c7b9 req-cf4b2ae3-d4dc-4f9d-8d4e-ccff06adcc39 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:38.470471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8bc10aec-ab45-4f7e-a60a-0f2fbde9c7b9 req-cf4b2ae3-d4dc-4f9d-8d4e-ccff06adcc39 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:38.504844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:38.510243 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8bc10aec-ab45-4f7e-a60a-0f2fbde9c7b9 req-cf4b2ae3-d4dc-4f9d-8d4e-ccff06adcc39 service nova] Creating event network-vif-plugged:b8e95348-df26-4f1a-81db-f2f97d1ff2ac for instance 48be0892-8100-4fb8-9e02-08c5887f1e5c on nch2-master-1 Aug 06 21:09:38.516201 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8bc10aec-ab45-4f7e-a60a-0f2fbde9c7b9 req-cf4b2ae3-d4dc-4f9d-8d4e-ccff06adcc39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113859 Aug 06 21:09:38.517057 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1805/3696] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:38.521230 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-30765a64-fcca-4b35-b6e3-3d8c264d1572 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1328 microversion: 2.1 time: 0.912909 Aug 06 21:09:38.524520 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1892/3697] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:37 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1328 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:38.525198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:38.526178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:38.545098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:38.545701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:38.546411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:38.549549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:38.550974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:38.556270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:38.557057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:38.557583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:38.584321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:38.587178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:38.589094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:38.594678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:38.598439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:38.600350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:38.691560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:38.692576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:38.694291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:38.695162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lazy-loading 'fault' on Instance uuid 0a81b975-f91b-4df1-8618-3c3d6f2b2282 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:09:39.087098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:39.095674 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-266803a8-bcf2-447a-826e-8791949f091b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.569145 Aug 06 21:09:39.099152 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1893/3698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:38 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:39.104197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:39.108794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:39.123346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:39.128984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:39.135298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:39.136440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:39.137174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:39.137847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:39.156159 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f HTTP/1.1 Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '51422ace-16be-4c73-a47b-fef4706c040f'} Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:39.158291 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:39.163618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:39.163618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:39.163618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:39.163618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:39.163618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:39.163618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:09:39.163618 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:39.165880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:39.167348 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32017498-9111-4d05-af0e-96bd6f0fe285 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 404 len: 111 microversion: 2.1 time: 0.066812 Aug 06 21:09:39.167936 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1894/3699] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:39 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:39.172901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:39.174577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:39.182121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:39.183125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:39.183899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:39.184863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:39.185555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:39.186461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:39.273654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '469d18e4c7db4b0d989f7c5b72e744f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3389d5492b224ef9963f6305139ae9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:39.285829 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c0b7dbdc-28f0-4a0f-ad5b-05bcafb7cf70 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 200 len: 1212 microversion: 2.1 time: 0.766407 Aug 06 21:09:39.307517 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1806/3700] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:38 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 1212 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:39.457766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-708021221", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5c00ae50-9c12-446f-a3fc-256b5e473c43"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:39.486325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:39.497104 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f09b6a5b-a4d6-46e1-89ab-1d1fc23cad08 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1317 microversion: 2.1 time: 0.327815 Aug 06 21:09:39.497707 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1895/3701] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:39 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:39.552859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:39.553561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:39.571369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:39.572296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:39.572761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:39.573699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:39.574244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:39.577877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:39.686488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] validate_networks() for [('5c00ae50-9c12-446f-a3fc-256b5e473c43', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:09:39.929565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:39.955873 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ecbcc339-e262-44b3-b91c-a0fffabc7217 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1328 microversion: 2.1 time: 0.412625 Aug 06 21:09:39.970189 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1896/3702] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:39 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1328 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:40.122278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:40.122939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:40.132847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:40.133355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:40.133805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:40.134589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:40.135051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:40.135627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:40.483518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:40.496924 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce3717a0-eaa0-42d7-8241-1d9d1b2e7ed7 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.379472 Aug 06 21:09:40.521521 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1897/3703] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:40 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:40.532724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:40.533399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] [instance: 0a81b975-f91b-4df1-8618-3c3d6f2b2282] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:40.544847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:40.545388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:40.545885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:40.546832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:40.547300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:40.547732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:40.563329 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] HTTP exception thrown: Instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 could not be found. Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Request method failure captured: Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 HTTP/1.1 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tglQOxnQRYzaITtP8K01Z0h49M18l8ntZRLoI2K3OiqUfQYkC_4QgQy8hogsTFVZ9ChyW-cEX1176tcvnKIPeQeFI2DRPQW_KIUiK2GNnGHZfSKtCiOWp5ti0HFLtQEpi_eq6uOpXmh6JmWpK65K3oQaFFu22mr5UV1hU-uoxPGFxY Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 3389d5492b224ef9963f6305139ae9b8 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersTestBootFromVolume-463747702 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3389d5492b224ef9963f6305139ae9b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3389d5492b224ef9963f6305139ae9b8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3389d5492b224ef9963f6305139ae9b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3389d5492b224ef9963f6305139ae9b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersTestBootFromVolume-463747702 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 3389d5492b224ef9963f6305139ae9b8 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersTestBootFromVolume-463747702 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersTestBootFromVolume-463747702-project Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 469d18e4c7db4b0d989f7c5b72e744f7 Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersTestBootFromVolume-463747702-project Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 could not be found. Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '0a81b975-f91b-4df1-8618-3c3d6f2b2282'} Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 could not be found. Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 could not be found. Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:40.565262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 could not be found. Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Returning 404 to user: Instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e19f7149-04bc-4c84-90b5-68c448992381 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282" status: 404 len: 111 microversion: 2.1 time: 0.043994 Aug 06 21:09:40.570947 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1898/3704] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:40 2022] GET /compute/v2.1/servers/0a81b975-f91b-4df1-8618-3c3d6f2b2282 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:40.582426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bbba7038-1584-49e6-8ae9-379033ea9f58 req-5e754b59-630d-44dc-b1b3-8ff706afecc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a81b975-f91b-4df1-8618-3c3d6f2b2282", "name": "network-vif-deleted", "tag": "52a237f9-d2cb-46f2-a85a-442708aca2b1"}, {"name": "network-changed", "server_uuid": "ee15ef61-72e0-4c6b-95b2-cc86cf4f3938", "tag": "568333be-be61-4dca-a5a2-bc925dfbc81b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:40.599152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bbba7038-1584-49e6-8ae9-379033ea9f58 req-5e754b59-630d-44dc-b1b3-8ff706afecc3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:40.599649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bbba7038-1584-49e6-8ae9-379033ea9f58 req-5e754b59-630d-44dc-b1b3-8ff706afecc3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:40.600086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bbba7038-1584-49e6-8ae9-379033ea9f58 req-5e754b59-630d-44dc-b1b3-8ff706afecc3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:40.626769 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bbba7038-1584-49e6-8ae9-379033ea9f58 req-5e754b59-630d-44dc-b1b3-8ff706afecc3 service nova] Creating event network-vif-deleted:52a237f9-d2cb-46f2-a85a-442708aca2b1 for instance 0a81b975-f91b-4df1-8618-3c3d6f2b2282 on nch1-master-1 Aug 06 21:09:40.627486 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bbba7038-1584-49e6-8ae9-379033ea9f58 req-5e754b59-630d-44dc-b1b3-8ff706afecc3 service nova] Creating event network-changed:568333be-be61-4dca-a5a2-bc925dfbc81b for instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 on nch1-master-1 Aug 06 21:09:40.640152 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bbba7038-1584-49e6-8ae9-379033ea9f58 req-5e754b59-630d-44dc-b1b3-8ff706afecc3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069290 Aug 06 21:09:40.640785 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1899/3705] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:40.646730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:40.647512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:40.662604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:40.662604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:40.662604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:40.662604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:40.664000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:40.664441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:40.988571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:09:40.989329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:09:40.989888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:09:40.990431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:09:40.990960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:09:41.005952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:41.006825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:41.007628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:41.008789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:41.010313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:41.011761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:41.057339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:09:41.061260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:41.079134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for user bdf1b5180a814cf39234892c6c1f26df and project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:09:41.089876 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e4345ebc-3b93-4cb0-b75d-cde75be7c124 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1317 microversion: 2.1 time: 0.447802 Aug 06 21:09:41.090490 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1900/3706] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:40 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:41.109462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:09:41.110130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9b5ba17-0d6f-40cd-8afe-e17c26da1934 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] Calling method '.version_select at 0x7f729cdcce50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:41.114310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:09:41.154637 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9b5ba17-0d6f-40cd-8afe-e17c26da1934 tempest-ServersTestBootFromVolume-463747702 tempest-ServersTestBootFromVolume-463747702-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462970590" status: 202 len: 0 microversion: 2.1 time: 0.048722 Aug 06 21:09:41.155470 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1901/3707] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462970590 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:09:41.170379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:41.171024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:41.193452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:41.193960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:41.210108 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7eff5a9a-38ec-4062-8204-298e6528b3cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764160 Aug 06 21:09:41.213285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:41.213527 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1807/3708] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:09:41.214720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:41.217857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:41.219719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:41.225151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2e3dacf8-6de4-430e-9675-82dc41877d94 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:41.226033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2e3dacf8-6de4-430e-9675-82dc41877d94 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:41.369572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2e3dacf8-6de4-430e-9675-82dc41877d94 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:41.378678 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2e3dacf8-6de4-430e-9675-82dc41877d94 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1214 microversion: 2.1 time: 0.158241 Aug 06 21:09:41.379293 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1808/3709] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:41 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:41.524882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:41.525399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:41.537992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:41.538505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:41.538979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:41.542021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:41.542509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:41.542991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:41.801553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:41.819952 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ecf422d-d9c6-4e56-8569-de094e21440d tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1529 microversion: 2.1 time: 0.663476 Aug 06 21:09:41.820542 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1902/3710] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:41 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1529 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:41.851141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:41.852368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:41.866104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:41.866843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:41.867379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:41.868222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:41.868790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:41.869349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:42.120116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:42.133705 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0e7ce8ef-0b1f-49ec-b6c4-e14fbce1d7ec tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.613098 Aug 06 21:09:42.150420 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1809/3711] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:41 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:42.163802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:42.164334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:42.178279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:42.179035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:42.179668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:42.180867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:42.181493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:42.182083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:42.364968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:42.376115 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-06822a69-0d60-4301-a2eb-ebd9ba3428c3 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1529 microversion: 2.1 time: 0.529044 Aug 06 21:09:42.379154 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1903/3712] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:41 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1529 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:42.535323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:42.772411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:42.773177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:42.800227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:42.805216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:42.805856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:42.806528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:42.807089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:42.807526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:42.856736 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] HTTP exception thrown: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Request method failure captured: Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c HTTP/1.1 Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7th-vmIPf3M106aLhvXrrHsR1268asTpD_k0WM1S2PaL97VNrXIUW4ey1FDIl0DE6nMxNilcf8bFlqkR8ysEx02uwXR5JXxkkZSc4jBclx6MtULxkP2yfILfzirNZ_YZ1KcjorQUSPflxNLxuL5z510LQST-DkbzBuNCgzcC4oSQv4A Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 6f65aeac4595423f89d77bbefddce2eb Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-743061394 Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6f65aeac4595423f89d77bbefddce2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6f65aeac4595423f89d77bbefddce2eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f65aeac4595423f89d77bbefddce2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f65aeac4595423f89d77bbefddce2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-743061394 Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 6f65aeac4595423f89d77bbefddce2eb Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-743061394 Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestMultiTenantJSON-743061394-project Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 60937cf67d164238a35870c98b53f0ef Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-743061394-project Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '48be0892-8100-4fb8-9e02-08c5887f1e5c'} Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:42.859586 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Returning 404 to user: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:42.866109 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd41dac4-abef-465f-834a-18167761a31d tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] 10.222.0.33 "DELETE /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 404 len: 111 microversion: 2.1 time: 0.465687 Aug 06 21:09:42.870962 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1904/3713] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:42 2022] DELETE /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 111 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:42.885633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:42.886682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:42.898255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:42.899832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:42.900422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:42.901363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:42.901946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:42.902492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.053558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:43.066410 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1168fbf0-9f3b-4632-9ab2-b27f6a5afb03 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1284 microversion: 2.1 time: 0.193400 Aug 06 21:09:43.088015 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1905/3714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:42 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:43.097271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:43.098689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:43.107909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.108660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.109420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.110670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.112159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.112767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.121266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:43.134751 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-353449f7-3a90-4d82-a39c-c1a07b566838 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1317 microversion: 2.1 time: 0.982723 Aug 06 21:09:43.139326 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1810/3715] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:42 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1317 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:43.156626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:43.157491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:43.174252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.175058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.176508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.177447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.179559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.180513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.353052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:43.364761 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2a7ac6b1-45fb-4244-941a-f3027a8a5315 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1529 microversion: 2.1 time: 0.273385 Aug 06 21:09:43.365672 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1906/3716] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:43 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1529 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:43.387861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Action: 'update', calling method: >, body: {"server": {"name": "48be0892-8100-4fb8-9e02-08c5887f1e5c_new"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:43.391674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:43.401564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.402411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.403085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.404171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.404913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.405549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.413733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:43.431902 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] HTTP exception thrown: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Request method failure captured: Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c HTTP/1.1 Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 64 Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7th-vmIPf3M106aLhvXrrHsR1268asTpD_k0WM1S2PaL97VNrXIUW4ey1FDIl0DE6nMxNilcf8bFlqkR8ysEx02uwXR5JXxkkZSc4jBclx6MtULxkP2yfILfzirNZ_YZ1KcjorQUSPflxNLxuL5z510LQST-DkbzBuNCgzcC4oSQv4A Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 6f65aeac4595423f89d77bbefddce2eb Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-743061394 Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6f65aeac4595423f89d77bbefddce2eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6f65aeac4595423f89d77bbefddce2eb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f65aeac4595423f89d77bbefddce2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6f65aeac4595423f89d77bbefddce2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-743061394 Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 6f65aeac4595423f89d77bbefddce2eb Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-743061394 Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestMultiTenantJSON-743061394-project Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 60937cf67d164238a35870c98b53f0ef Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-743061394-project Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "48be0892-8100-4fb8-9e02-08c5887f1e5c_new"}} Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '48be0892-8100-4fb8-9e02-08c5887f1e5c', 'body': {'server': {'name': '48be0892-8100-4fb8-9e02-08c5887f1e5c_new'}}} Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:09:43.434507 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:43.441174 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:09:43.445513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] Returning 404 to user: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:43.447863 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ed89e8d4-7f0d-4d53-a4f0-3d7dc9898122 tempest-ServersNegativeTestMultiTenantJSON-743061394 tempest-ServersNegativeTestMultiTenantJSON-743061394-project] 10.222.0.33 "PUT /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 404 len: 111 microversion: 2.1 time: 0.064975 Aug 06 21:09:43.449197 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1907/3717] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:09:43 2022] PUT /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:09:43.459056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:43.459861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:43.473346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.474204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.474916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.475864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.476623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.477335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.508968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:09:43.622031 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-73444577-312f-4e56-a2e7-d5ef84b3036b tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "DELETE /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 204 len: 0 microversion: 2.1 time: 0.166665 Aug 06 21:09:43.623511 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1908/3718] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:09:43 2022] DELETE /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:09:43.634267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:43.635754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:43.644670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.645173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.645938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.646941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:43.647415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:43.647850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:43.840876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:43.852197 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21e1c5b6-b8fd-4259-8550-5230db309655 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1734 microversion: 2.1 time: 0.699903 Aug 06 21:09:43.856957 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1811/3719] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:43 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1734 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:43.871002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:43.880019 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1fc2f1bf-fe3c-4c82-b50e-3573378b3df2 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1535 microversion: 2.1 time: 0.251749 Aug 06 21:09:43.880593 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1909/3720] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:43 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1535 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:44.090370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:44.091561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:44.100635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:44.101507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:44.102205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:44.103419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:44.104407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:44.105367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:44.159434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:44.160210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:44.171588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:44.172084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:44.175300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:44.178803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:44.179470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:44.180540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:44.236604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:44.248672 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f050ce2-e0c2-4747-a477-b942270f005d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1272 microversion: 2.1 time: 0.162292 Aug 06 21:09:44.249614 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1812/3721] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:44 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:44.407413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:44.416065 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ea7d31cc-5fdc-4d48-9f18-0459b7ac5b45 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1317 microversion: 2.1 time: 0.261188 Aug 06 21:09:44.416662 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1910/3722] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:44 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:44.880200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:44.882141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:44.898223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:44.900598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:44.901208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:44.901842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:44.903968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:44.909753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:44.911082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:44.912006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:44.912557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:44.912947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:44.913660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:44.915527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:44.916021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:44.919293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:44.919745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:45.244176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:45.258982 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-de997486-765b-4307-910e-768d0cd49f87 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1714 microversion: 2.1 time: 0.382278 Aug 06 21:09:45.261422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1813/3723] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:44 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1714 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:45.431453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:45.446008 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fd00b34e-a391-479a-b13e-49576aecbaa1 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1535 microversion: 2.1 time: 0.548422 Aug 06 21:09:45.447155 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1911/3724] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:44 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1535 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:45.456453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:45.457114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:45.464397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:45.465460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:45.466278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:45.467338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:45.468961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:45.469769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:45.625564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:45.642397 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3501961d-ffb9-45cf-82c8-39e707c603ad tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1272 microversion: 2.1 time: 0.194052 Aug 06 21:09:45.646869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1912/3725] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:45 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:45.658729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:45.659705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:45.668937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5c264faf-76c5-49e9-8a02-a9e8a26d64e1 tempest-ExtensionsTest-494170623 tempest-ExtensionsTest-494170623-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:45.670773 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5c264faf-76c5-49e9-8a02-a9e8a26d64e1 tempest-ExtensionsTest-494170623 tempest-ExtensionsTest-494170623-project] 10.222.0.33 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.406950 Aug 06 21:09:45.673482 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1814/3726] 10.222.0.33 () {58 vars in 1170 bytes} [Sat Aug 6 21:09:45 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:45.681200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:45.681715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:45.682166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:45.684815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:45.685332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:45.687620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:45.688141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:45.691774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:45.701927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:45.702441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:45.702928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:45.703663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:45.704123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:45.704558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:45.874251 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] HTTP exception thrown: Cannot 'detach_volume' instance d6e52696-5e64-4d90-a90c-69d78aad14e8 while it is in vm_state rescued Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Request method failure captured: Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments/ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8 HTTP/1.1 Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tfLEawbHpN6jMURxdzK2EbJF4VOuu9Oa5UpiLUmKBNlhjCkr9kH_MmWQvt1hNGSGmL37UKnTYuWQ1qLqZpSKaucQe-XZMrOo54Rzzy38O3wJqXN2UfBzSzmpVXWUazExIacv2EKUyLKBOIK69QkSvDLfRUnPsiYAPeIlk26rmd3IhA Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8046f1ab9c004060965dced02db4b7c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: f7cf258df10248d0bdcf64fa075c132c Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: exception: Cannot 'detach_volume' instance d6e52696-5e64-4d90-a90c-69d78aad14e8 while it is in vm_state rescued Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'server_id': 'd6e52696-5e64-4d90-a90c-69d78aad14e8', 'id': 'ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8'} Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d6e52696-5e64-4d90-a90c-69d78aad14e8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d6e52696-5e64-4d90-a90c-69d78aad14e8 while it is in vm_state rescued Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:45.882099 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:45.887614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:45.887614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:45.887614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:45.887614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:45.887614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d6e52696-5e64-4d90-a90c-69d78aad14e8 while it is in vm_state rescued Aug 06 21:09:45.887614 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:45.888214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Returning 409 to user: Cannot 'detach_volume' instance d6e52696-5e64-4d90-a90c-69d78aad14e8 while it is in vm_state rescued {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:45.889858 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c5eb9f6-9c5c-4796-b32a-a2424c3eb89a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments/ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8" status: 409 len: 152 microversion: 2.1 time: 0.214374 Aug 06 21:09:45.891147 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1815/3727] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Aug 6 21:09:45 2022] DELETE /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments/ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8 => generated 152 bytes in 217 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:09:45.902212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fa6bfb11-8dfc-45ff-854d-3e0176cc0e04 tempest-ExtensionsTest-494170623 tempest-ExtensionsTest-494170623-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:45.914208 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fa6bfb11-8dfc-45ff-854d-3e0176cc0e04 tempest-ExtensionsTest-494170623 tempest-ExtensionsTest-494170623-project] 10.222.0.33 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.019813 Aug 06 21:09:45.915061 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1816/3728] 10.222.0.33 () {58 vars in 1134 bytes} [Sat Aug 6 21:09:45 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:09:45.933413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4053a2c-a679-4fae-b6a2-f33da6383dee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:45.935371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f4053a2c-a679-4fae-b6a2-f33da6383dee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:45.971264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4053a2c-a679-4fae-b6a2-f33da6383dee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:45.973426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4053a2c-a679-4fae-b6a2-f33da6383dee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:45.977251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4053a2c-a679-4fae-b6a2-f33da6383dee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:45.980422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4053a2c-a679-4fae-b6a2-f33da6383dee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:45.982742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4053a2c-a679-4fae-b6a2-f33da6383dee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:45.982902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4053a2c-a679-4fae-b6a2-f33da6383dee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:46.001566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:46.230893 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f4053a2c-a679-4fae-b6a2-f33da6383dee tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/action" status: 202 len: 0 microversion: 2.1 time: 0.310961 Aug 06 21:09:46.237488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:46.241836 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1817/3729] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:09:45 2022] POST /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:09:46.252059 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-023976ff-bcae-45df-bf98-bb29d675af04 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1317 microversion: 2.1 time: 0.602168 Aug 06 21:09:46.254813 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1913/3730] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:45 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:46.259477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:46.261853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:46.275468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:46.276420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:46.277317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:46.278419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:46.279151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:46.279819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:46.469099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:46.470292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:46.489814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:46.491348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:46.495569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:46.498719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:46.505018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:46.506144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:46.857475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3601924229d4254817f827b64c9380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8f9cbedd14527bb98ac545eaf70d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:46.873966 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-09f90f65-0150-401c-be5a-64187300ee50 tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 200 len: 1493 microversion: 2.1 time: 0.408899 Aug 06 21:09:46.876554 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1914/3731] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:46 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 1493 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:46.884923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:46.897037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:46.917227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:46.918208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:46.918993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:46.920008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:46.920959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:46.921917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:47.178372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:47.178537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:47.188504 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b9a5c212-58b7-4652-a4a8-23ad12c97116 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1722 microversion: 2.1 time: 0.939811 Aug 06 21:09:47.189089 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1818/3732] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:46 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1722 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:47.205614 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-167822d7-811c-4fea-8ffc-f6f1660b078f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1314 microversion: 2.1 time: 0.324248 Aug 06 21:09:47.211287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-85558e1f-40ed-4b92-84f2-226688ccb98c req-eef96d69-07c6-416b-8fac-478185d761a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48be0892-8100-4fb8-9e02-08c5887f1e5c", "name": "network-vif-deleted", "tag": "b8e95348-df26-4f1a-81db-f2f97d1ff2ac"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:47.218973 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1915/3733] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:46 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:47.231349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-85558e1f-40ed-4b92-84f2-226688ccb98c req-eef96d69-07c6-416b-8fac-478185d761a0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:47.232524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-85558e1f-40ed-4b92-84f2-226688ccb98c req-eef96d69-07c6-416b-8fac-478185d761a0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:47.233548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-85558e1f-40ed-4b92-84f2-226688ccb98c req-eef96d69-07c6-416b-8fac-478185d761a0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:47.259934 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-85558e1f-40ed-4b92-84f2-226688ccb98c req-eef96d69-07c6-416b-8fac-478185d761a0 service nova] Creating event network-vif-deleted:b8e95348-df26-4f1a-81db-f2f97d1ff2ac for instance 48be0892-8100-4fb8-9e02-08c5887f1e5c on nch2-master-1 Aug 06 21:09:47.270994 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-85558e1f-40ed-4b92-84f2-226688ccb98c req-eef96d69-07c6-416b-8fac-478185d761a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078861 Aug 06 21:09:47.273348 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1819/3734] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:47.275388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:47.276024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:47.294476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:47.295878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:47.299431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:47.300623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:47.301842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:47.303060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:47.609231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d2f8f8dc-3994-446c-8721-13cca7db5df6 req-3a3b3db3-2579-45ad-a3fa-c2aaa037cb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee15ef61-72e0-4c6b-95b2-cc86cf4f3938", "name": "network-vif-plugged", "status": "completed", "tag": "568333be-be61-4dca-a5a2-bc925dfbc81b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:47.637531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d2f8f8dc-3994-446c-8721-13cca7db5df6 req-3a3b3db3-2579-45ad-a3fa-c2aaa037cb1c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:47.638821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d2f8f8dc-3994-446c-8721-13cca7db5df6 req-3a3b3db3-2579-45ad-a3fa-c2aaa037cb1c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:47.639499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d2f8f8dc-3994-446c-8721-13cca7db5df6 req-3a3b3db3-2579-45ad-a3fa-c2aaa037cb1c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:47.661382 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d2f8f8dc-3994-446c-8721-13cca7db5df6 req-3a3b3db3-2579-45ad-a3fa-c2aaa037cb1c service nova] Creating event network-vif-plugged:568333be-be61-4dca-a5a2-bc925dfbc81b for instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 on nch1-master-1 Aug 06 21:09:47.679480 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d2f8f8dc-3994-446c-8721-13cca7db5df6 req-3a3b3db3-2579-45ad-a3fa-c2aaa037cb1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075178 Aug 06 21:09:47.681326 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1820/3735] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:09:47.742265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:47.754523 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-60b366dc-cd39-4dba-aaf6-01737ab88b41 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1317 microversion: 2.1 time: 0.482368 Aug 06 21:09:47.766642 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1916/3736] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:47 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:47.899107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:47.899823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] [instance: 48be0892-8100-4fb8-9e02-08c5887f1e5c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:47.910979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:47.911590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:47.912135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:47.912934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:47.913461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:47.914112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:47.931608 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] HTTP exception thrown: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Request method failure captured: Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c HTTP/1.1 Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7thuUPqHFpyn521wJfKNGFsFLkgZtCpEbKYT4TwynClTu2tvaEFM11TbxmSE7pvDPIkp1jVe5BdgLszfI1b72SHBFsHLYU8LVULHSVAX5v8fYb8TQl5iT6zPXspK3vX2tf_vMJn3hsI39OYb-mop02RP9GHbvwW9DWaF8BlOy2InhWE Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 9ed8f9cbedd14527bb98ac545eaf70d8 Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-503480347 Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9ed8f9cbedd14527bb98ac545eaf70d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9ed8f9cbedd14527bb98ac545eaf70d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ed8f9cbedd14527bb98ac545eaf70d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ed8f9cbedd14527bb98ac545eaf70d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-503480347 Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 9ed8f9cbedd14527bb98ac545eaf70d8 Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-503480347 Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestMultiTenantJSON-503480347-project Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: c3601924229d4254817f827b64c9380e Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-503480347-project Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '48be0892-8100-4fb8-9e02-08c5887f1e5c'} Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:47.933828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:47.938708 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:09:47.938708 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:47.938708 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:09:47.938708 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:09:47.938708 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:09:47.938708 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:09:47.938708 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:09:47.938708 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. Aug 06 21:09:47.938708 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:09:47.942929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] Returning 404 to user: Instance 48be0892-8100-4fb8-9e02-08c5887f1e5c could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:09:47.944691 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a915de3c-e3b5-4389-bc32-6c447147977c tempest-ServersNegativeTestMultiTenantJSON-503480347 tempest-ServersNegativeTestMultiTenantJSON-503480347-project] 10.222.0.33 "GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c" status: 404 len: 111 microversion: 2.1 time: 0.049690 Aug 06 21:09:47.946046 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1821/3737] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:47 2022] GET /compute/v2.1/servers/48be0892-8100-4fb8-9e02-08c5887f1e5c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:09:48.210201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:48.211230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:48.231910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:48.232875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:48.240726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:48.242358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:48.245021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:48.246433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:48.246759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:48.247403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:48.248829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:48.249606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:48.250291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:48.253764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:48.262813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:48.264915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:48.868218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:48.877361 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5da6c50c-8c11-440b-903b-a5e1b99e864e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1314 microversion: 2.1 time: 0.651072 Aug 06 21:09:48.883876 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1822/3738] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:48 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:48.903710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:48.904416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:48.912947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:48.915039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:48.917564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:48.922272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:48.923205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:48.928546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:49.028109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:49.042877 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d425489-4bb2-4640-86ae-3fc8a786a78f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1722 microversion: 2.1 time: 0.831545 Aug 06 21:09:49.043540 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1917/3739] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:48 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1722 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:49.085242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-6700f09a-8173-41b6-922b-d267523efd59 req-2225dcf3-d508-4338-81be-fecef11c5582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0911c35-ac57-4dd9-b4fb-c7667583a653", "tag": "91e8a9eb-10b6-43e0-9172-5c4eba78ae48"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:49.109872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6700f09a-8173-41b6-922b-d267523efd59 req-2225dcf3-d508-4338-81be-fecef11c5582 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:49.110657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6700f09a-8173-41b6-922b-d267523efd59 req-2225dcf3-d508-4338-81be-fecef11c5582 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:49.112036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6700f09a-8173-41b6-922b-d267523efd59 req-2225dcf3-d508-4338-81be-fecef11c5582 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:49.133928 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-6700f09a-8173-41b6-922b-d267523efd59 req-2225dcf3-d508-4338-81be-fecef11c5582 service nova] Creating event network-changed:91e8a9eb-10b6-43e0-9172-5c4eba78ae48 for instance b0911c35-ac57-4dd9-b4fb-c7667583a653 on nch2-master-1 Aug 06 21:09:49.145739 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-6700f09a-8173-41b6-922b-d267523efd59 req-2225dcf3-d508-4338-81be-fecef11c5582 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064069 Aug 06 21:09:49.146740 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1918/3740] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:49.362342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:49.372486 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bfd7dc4e-a708-4b0b-9d76-ddbf5303c6c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1317 microversion: 2.1 time: 0.487209 Aug 06 21:09:49.379372 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1823/3741] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:48 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:49.907665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:49.909754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:49.917200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:49.918030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:49.919062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:49.920173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:49.920857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:49.921614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:50.068512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:50.069928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:50.083105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:50.085318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:50.086136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:50.088418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:50.091150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:50.091942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:50.254656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:50.265732 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e0e8ada3-b1c6-47d5-b48c-f0b15861cc0d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1314 microversion: 2.1 time: 0.362484 Aug 06 21:09:50.270619 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1919/3742] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:49 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:50.400421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:50.401110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:50.417326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:50.418766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:50.419412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:50.420847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:50.424042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:50.424705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:50.893301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:50.905571 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b5883388-203d-4339-8858-603213833c54 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1507 microversion: 2.1 time: 0.507344 Aug 06 21:09:50.920196 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1920/3743] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:50 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1507 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:50.963467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:50.980431 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-49ddee5f-9cff-42ff-9aed-445c238d5b5c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1722 microversion: 2.1 time: 0.915217 Aug 06 21:09:50.981706 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1824/3744] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:50 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1722 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:50.989830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:50.990861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:51.011112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:51.011886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:51.012529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:51.013441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:51.014076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:51.014709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:51.056151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=10 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:51.337310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50f6992e-16b8-4e4a-80c1-bf1b5f426e7d tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Calling method '.version_select at 0x7f729e28ef70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:51.374364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=26 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:51.398780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:51.411673 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a3c3039-4866-4f95-b6a2-0d838ab1d06f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1507 microversion: 2.1 time: 0.426493 Aug 06 21:09:51.412350 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1825/3745] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:50 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1507 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:51.452019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:51.463768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:51.498773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:51.500941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:51.501711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:51.503879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:51.535412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:51.536806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:52.029199 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-50f6992e-16b8-4e4a-80c1-bf1b5f426e7d tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040/defaults" status: 200 len: 371 microversion: 2.1 time: 1.107634 Aug 06 21:09:52.037526 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1921/3746] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:09:50 2022] GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040/defaults => generated 371 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:52.044554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "OS-DCF:diskConfig": "AUTO"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:52.057060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:52.077305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:52.078135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:52.078926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:52.081667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:52.082896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:52.083545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:52.233146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:09:52.233802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:09:52.235432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:09:52.236505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:09:52.239789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:09:52.414733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:52.415273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:52.432383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:52.433457 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8ee9578b-7b4b-4700-a7ec-767c81aa8c60 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1314 microversion: 2.1 time: 1.000614 Aug 06 21:09:52.434219 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1826/3747] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:51 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1314 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:52.435229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:52.435738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:52.436519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:52.440484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:52.441026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:52.451277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:52.453450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:52.456423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:52.483824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:52.487963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:52.488857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:52.497011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:52.498105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:52.500170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:52.512163 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5d805922-3a46-4e9c-b82e-7510c0c10aee tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "POST /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938/action" status: 202 len: 1109 microversion: 2.1 time: 0.477642 Aug 06 21:09:52.522639 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1922/3748] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:09:52 2022] POST /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938/action => generated 1109 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 06 21:09:52.539732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa1084ad-69be-4dd1-a873-b14fcbe14d20 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Calling method '.version_select at 0x7f729ce63c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:53.048775 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa1084ad-69be-4dd1-a873-b14fcbe14d20 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040" status: 200 len: 371 microversion: 2.1 time: 0.524443 Aug 06 21:09:53.062284 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1923/3749] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:09:52 2022] GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040 => generated 371 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:53.076803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:53.077699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:53.101384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:53.104680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:53.105422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:53.106871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:53.110321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:53.111017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:53.391595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:53.402537 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-47f6addd-56fc-4cd2-86d8-cf580ba5093c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1728 microversion: 2.1 time: 0.964079 Aug 06 21:09:53.403172 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1827/3750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:52 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1728 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:53.410821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f95c138-50a4-4306-a781-4c0e96ab2354 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Calling method '.version_select at 0x7f729d07edc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:53.617178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:53.625055 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cae7b1b7-7f90-499f-9ac8-341e05870eb9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.561303 Aug 06 21:09:53.625632 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1924/3751] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:53 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:53.635497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5758e935-547a-4624-8792-4ae71614a8ab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:53.639210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5758e935-547a-4624-8792-4ae71614a8ab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:53.660190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5758e935-547a-4624-8792-4ae71614a8ab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:53.660858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5758e935-547a-4624-8792-4ae71614a8ab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:53.661492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5758e935-547a-4624-8792-4ae71614a8ab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:53.662372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5758e935-547a-4624-8792-4ae71614a8ab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:53.681074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5758e935-547a-4624-8792-4ae71614a8ab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:53.682094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5758e935-547a-4624-8792-4ae71614a8ab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:53.847482 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5758e935-547a-4624-8792-4ae71614a8ab tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215696 Aug 06 21:09:53.848663 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1925/3752] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:09:53 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-interface => generated 284 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:53.853585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:53.854426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:53.869028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:53.869533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:53.869978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:53.873893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:53.874436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:53.874943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:53.963631 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f95c138-50a4-4306-a781-4c0e96ab2354 tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040/defaults" status: 200 len: 371 microversion: 2.1 time: 0.558935 Aug 06 21:09:53.965333 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1828/3753] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:09:53 2022] GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040/defaults => generated 371 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:53.981883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2aaf427a-1cf8-43f6-83d8-5c47678b250d tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Calling method '.version_select at 0x7f729d1a03a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:54.492123 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2aaf427a-1cf8-43f6-83d8-5c47678b250d tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040" status: 200 len: 371 microversion: 2.1 time: 0.514666 Aug 06 21:09:54.493324 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1829/3754] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:09:53 2022] GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040 => generated 371 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:54.505636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-82dbf746-cb27-4696-8f6e-715c67c022ff tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] Calling method '.version_select at 0x7f72a361a3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:54.653475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:54.663794 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e546816-eef2-435c-a755-49bd53b594fa tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1314 microversion: 2.1 time: 0.812525 Aug 06 21:09:54.666040 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1926/3755] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:53 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1314 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:54.682037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:54.683544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:54.704152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:54.705100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:54.705744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:54.706486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:54.706974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:54.707408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:54.928115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:09:54.960430 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-82dbf746-cb27-4696-8f6e-715c67c022ff tempest-QuotasTestJSON-1053449673 tempest-QuotasTestJSON-1053449673-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040?user_id=9132a8f57b2246a88d1f2157c2f63963" status: 200 len: 371 microversion: 2.1 time: 0.459247 Aug 06 21:09:54.961510 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1830/3756] 10.222.0.33 () {58 vars in 1323 bytes} [Sat Aug 6 21:09:54 2022] GET /compute/v2.1/os-quota-sets/ae7a24bfa0bd4684bb0871f2d814c040?user_id=9132a8f57b2246a88d1f2157c2f63963 => generated 371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:54.966399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-660de0ef-8104-45f1-bab8-d7dfd6457e6d req-df458fee-0ade-4a22-b2f3-f476c3de9fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0911c35-ac57-4dd9-b4fb-c7667583a653", "name": "network-vif-plugged", "status": "completed", "tag": "91e8a9eb-10b6-43e0-9172-5c4eba78ae48"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:54.991168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-660de0ef-8104-45f1-bab8-d7dfd6457e6d req-df458fee-0ade-4a22-b2f3-f476c3de9fdd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:54.991773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-660de0ef-8104-45f1-bab8-d7dfd6457e6d req-df458fee-0ade-4a22-b2f3-f476c3de9fdd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:54.992123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-660de0ef-8104-45f1-bab8-d7dfd6457e6d req-df458fee-0ade-4a22-b2f3-f476c3de9fdd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:55.030013 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-660de0ef-8104-45f1-bab8-d7dfd6457e6d req-df458fee-0ade-4a22-b2f3-f476c3de9fdd service nova] Creating event network-vif-plugged:91e8a9eb-10b6-43e0-9172-5c4eba78ae48 for instance b0911c35-ac57-4dd9-b4fb-c7667583a653 on nch2-master-1 Aug 06 21:09:55.036163 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-660de0ef-8104-45f1-bab8-d7dfd6457e6d req-df458fee-0ade-4a22-b2f3-f476c3de9fdd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073294 Aug 06 21:09:55.037256 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1831/3757] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:55.497801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:55.507293 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e16c1081-025f-4b1c-86cc-faa77dd38b36 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.835949 Aug 06 21:09:55.511341 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1927/3758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:54 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:55.694481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:55.695561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:55.709883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:55.718627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:55.719390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:55.720366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:55.721171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:55.721786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:55.981299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:55.994423 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b63b033-0c98-45c7-8be9-44981ee6d850 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1314 microversion: 2.1 time: 0.305965 Aug 06 21:09:55.995356 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1832/3759] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:55 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:09:56.535474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:56.536783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:56.568983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:56.570214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:56.574311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:56.577157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:56.578006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:56.578992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:57.018442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:57.019160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:57.032429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:57.035068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:57.035908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:57.036312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:57.036780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:57.039310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:57.258367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:57.273989 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e1a2f23-8434-49b4-a7a1-8ed9ebeef188 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.745175 Aug 06 21:09:57.292777 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1928/3760] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:56 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:57.388489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:57.405879 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2a9d5afd-1733-4e46-8966-aca8fe63e833 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1502 microversion: 2.1 time: 0.392405 Aug 06 21:09:57.424743 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1833/3761] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:57 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:57.447301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d95a1a0f-7e48-4aec-b3f3-633c76c94155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:57.461852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d95a1a0f-7e48-4aec-b3f3-633c76c94155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:57.462660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d95a1a0f-7e48-4aec-b3f3-633c76c94155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:57.464235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d95a1a0f-7e48-4aec-b3f3-633c76c94155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:57.510195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d95a1a0f-7e48-4aec-b3f3-633c76c94155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Going to try to stop instance {{(pid=142461) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 21:09:57.586636 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d95a1a0f-7e48-4aec-b3f3-633c76c94155 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653/action" status: 202 len: 0 microversion: 2.1 time: 0.148031 Aug 06 21:09:57.588982 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1929/3762] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:09:57 2022] POST /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:09:57.599447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:57.601803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:57.624537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:57.626047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:57.628657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:57.631445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:57.632072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:57.636276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:58.006153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7a4d3a65-034a-4f80-a092-bdef2230daa9 req-bfc12008-119a-4b61-967c-62cf72b837dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e52696-5e64-4d90-a90c-69d78aad14e8", "tag": "26a07487-037f-4b16-b6ce-e506fe5ccc79"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:09:58.030882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7a4d3a65-034a-4f80-a092-bdef2230daa9 req-bfc12008-119a-4b61-967c-62cf72b837dc service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:58.031781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7a4d3a65-034a-4f80-a092-bdef2230daa9 req-bfc12008-119a-4b61-967c-62cf72b837dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:58.032396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7a4d3a65-034a-4f80-a092-bdef2230daa9 req-bfc12008-119a-4b61-967c-62cf72b837dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:58.082272 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7a4d3a65-034a-4f80-a092-bdef2230daa9 req-bfc12008-119a-4b61-967c-62cf72b837dc service nova] Creating event network-changed:26a07487-037f-4b16-b6ce-e506fe5ccc79 for instance d6e52696-5e64-4d90-a90c-69d78aad14e8 on nch1-master-1 Aug 06 21:09:58.105039 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7a4d3a65-034a-4f80-a092-bdef2230daa9 req-bfc12008-119a-4b61-967c-62cf72b837dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100127 Aug 06 21:09:58.107342 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1930/3763] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:09:58.306250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:58.308466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:58.327769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:58.329099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:58.332517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:58.343444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:58.346688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:58.348691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:58.622156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:58.630260 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-216a045a-3fc6-49e1-8ffc-33c545aea013 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 1.038582 Aug 06 21:09:58.642508 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1834/3764] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:57 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:58.954449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:09:58.965554 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08b445a3-2a36-4f75-bcf6-b422f02fa69a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.668463 Aug 06 21:09:58.989582 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1931/3765] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:58 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:09:59.662027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:09:59.663349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:09:59.687990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:59.693706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:59.694355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:09:59.697476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:09:59.698285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:09:59.700311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:00.003732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:00.004834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:00.016536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:00.019641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:00.020239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:00.021487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:00.023065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:00.027333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:00.363539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:00.373898 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bcd4ac26-26b5-4fbc-a421-f0964d9d5cd3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.717187 Aug 06 21:10:00.379502 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1835/3766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:59 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:00.386935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d4f658bd-6aa8-4775-a37f-120cc18059da req-cff43847-9128-4138-af1d-1fe564ba60ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e52696-5e64-4d90-a90c-69d78aad14e8", "tag": "26a07487-037f-4b16-b6ce-e506fe5ccc79"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:00.426338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d4f658bd-6aa8-4775-a37f-120cc18059da req-cff43847-9128-4138-af1d-1fe564ba60ef service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:00.426875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d4f658bd-6aa8-4775-a37f-120cc18059da req-cff43847-9128-4138-af1d-1fe564ba60ef service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:00.428396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d4f658bd-6aa8-4775-a37f-120cc18059da req-cff43847-9128-4138-af1d-1fe564ba60ef service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:00.464385 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d4f658bd-6aa8-4775-a37f-120cc18059da req-cff43847-9128-4138-af1d-1fe564ba60ef service nova] Creating event network-changed:26a07487-037f-4b16-b6ce-e506fe5ccc79 for instance d6e52696-5e64-4d90-a90c-69d78aad14e8 on nch1-master-1 Aug 06 21:10:00.482182 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d4f658bd-6aa8-4775-a37f-120cc18059da req-cff43847-9128-4138-af1d-1fe564ba60ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100946 Aug 06 21:10:00.485992 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1836/3767] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:00.929944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:00.943862 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4769824e-f7fb-43eb-a4f7-7e7384c9175e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.950428 Aug 06 21:10:00.961332 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1932/3768] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:09:59 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:01.413359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:01.416286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:01.473238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:01.476670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:01.479964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:01.481633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:01.487595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:01.490956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:01.976754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:01.977414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:02.013296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:02.018068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:02.018593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:02.019447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:02.019826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:02.023460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:02.537012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:02.550082 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f3e7a7e-1fd1-4c08-aba7-a9de0d63e12e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.584405 Aug 06 21:10:02.566573 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1933/3769] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:01 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:02.842598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:02.852957 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4de1466e-c1f9-4c75-b182-fae7a0782090 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 1.449909 Aug 06 21:10:02.868932 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1837/3770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:01 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:03.576628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:03.578294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:03.589792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:03.593258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:03.594028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:03.595254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:03.597537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:03.598517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:03.599560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:03.875665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:03.877101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:03.887983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:03.893495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:03.894293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:03.895629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:03.896493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:03.897286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:03.916819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:03.926959 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9c11b5d-4a62-4c2c-89f8-8d16ab3ab053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.355520 Aug 06 21:10:03.933481 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1934/3771] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:03 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:04.383834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:04.393616 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-972afc3d-f111-45ca-ae59-af820275da5a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.522123 Aug 06 21:10:04.394214 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1838/3772] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:03 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:04.960622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:04.962045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:04.976914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:04.978412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:04.980951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:04.981718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:04.982184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:04.982671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:05.417184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:05.419323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:05.436310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:05.443954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:05.444747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:05.447010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:05.456182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:05.459657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:05.460364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:05.477987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:05.545034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:05.555199 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fde4dd07-1d4d-4cae-957e-3faa4439079c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.600377 Aug 06 21:10:05.559433 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1935/3773] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:04 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:05.853721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:05.869369 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b0dd43d-174c-4a89-b591-c30d1981fd92 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.457082 Aug 06 21:10:05.872720 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1839/3774] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:05 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:06.580789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:06.581495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:06.593862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:06.596007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:06.600936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:06.602576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:06.603226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:06.603834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:06.894368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:06.896314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:06.906743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:06.911486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:06.912601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:06.919804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:06.920378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:06.921216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:06.992847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:07.003576 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-739b0a8c-2b4e-490b-9f89-1a5adc65b195 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.427125 Aug 06 21:10:07.006695 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1936/3775] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:06 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:07.362283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:07.372572 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.483140 Aug 06 21:10:07.382867 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1840/3776] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:06 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:08.027144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:08.028376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:08.050604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:08.053601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:08.054287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:08.057179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:08.058243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:08.058915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:08.087209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:08.088810 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001984 Aug 06 21:10:08.089791 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1841/3777] 10.222.0.33 () {56 vars in 886 bytes} [Sat Aug 6 21:10:08 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 06 21:10:08.098289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:08.100186 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002390 Aug 06 21:10:08.101294 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1842/3778] 10.222.0.33 () {54 vars in 1035 bytes} [Sat Aug 6 21:10:08 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 06 21:10:08.108048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:08.109642 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001940 Aug 06 21:10:08.110893 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1843/3779] 10.222.0.33 () {54 vars in 1041 bytes} [Sat Aug 6 21:10:08 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:10:08.119277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:08.120834 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a6fb69a1-389b-4949-ae86-e0d6fc0f742d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001936 Aug 06 21:10:08.121826 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1844/3780] 10.222.0.33 () {56 vars in 886 bytes} [Sat Aug 6 21:10:08 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 06 21:10:08.396671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:08.397587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:08.411483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:08.412366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:08.412822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:08.413592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:08.414015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:08.414450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:08.656985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:08.669417 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ec7b478c-e1ba-48fd-bde0-6a40a7d40f1f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.646283 Aug 06 21:10:08.672238 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1937/3781] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:08 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:08.695164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:08.706359 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-458c1f43-ad28-435e-8887-e276ab9e85b2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.314408 Aug 06 21:10:08.707504 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1845/3782] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:08 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:09.693826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:09.694447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:09.706161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:09.710431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:09.710926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:09.711797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:09.712127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:09.714341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:09.728762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:09.730733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:09.741476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:09.753406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:09.757434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:09.758288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:09.758971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:09.759597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:10.076578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:10.087638 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-935650c7-0524-4b95-a9ec-4a8ca363197f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.362604 Aug 06 21:10:10.102577 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1846/3783] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:09 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:10.247737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:10.262649 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a0aba53d-7d38-46f7-9b3b-1c86fbec53c9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.573823 Aug 06 21:10:10.263289 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1938/3784] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:09 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:11.108613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:11.109398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:11.120153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:11.123928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:11.126251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:11.128774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:11.129436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:11.129878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:11.291129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:11.291749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:11.303204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:11.307309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:11.308045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:11.308986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:11.309684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:11.310335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:11.588757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:11.597711 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4495fd16-3b9a-4eed-819d-40626dde7e24 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.492820 Aug 06 21:10:11.598380 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1847/3785] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:11 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:12.265030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:12.294520 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d7c984f1-d9f3-484e-aad3-12135ebbae7e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.999930 Aug 06 21:10:12.299799 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1939/3786] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:11 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:12.623737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:12.624352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:12.633863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:12.637242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:12.639178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:12.640970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:12.641937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:12.643488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:13.052489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-995628519", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "06d8f588-17a3-4f40-a6f5-12622024e0eb"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:13.183441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] validate_networks() for [('06d8f588-17a3-4f40-a6f5-12622024e0eb', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:10:13.344135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:13.360638 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dee39eeb-c44f-43d5-afdd-98ca500a6c4b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.740614 Aug 06 21:10:13.361568 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1848/3787] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:12 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:13.368776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:13.370056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:13.391574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:13.395605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:13.398325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:13.401457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:13.403306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:13.407676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:13.810570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:13.820376 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f52f9a8-87b4-4517-aef4-2b2c0fccc4fd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.457553 Aug 06 21:10:13.820988 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1849/3788] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:13 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:14.384559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:14.385442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:14.395406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:14.399844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:14.401099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:14.402699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:14.404715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:14.405468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:14.488203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:10:14.488777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:10:14.489091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:10:14.490429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:10:14.491091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:10:14.516912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:14.517638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:14.518209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:14.519171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:14.521242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:14.523813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:14.561866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:14.581661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Getting quotas for project 734f4706c86040eba82cde45971d4c5b. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:10:14.590932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Getting quotas for user 17004e771b6a47cb88e8aa31e197b25a and project 734f4706c86040eba82cde45971d4c5b. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:10:14.621145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Going to run 2 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:10:14.623890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 46519ead-c542-4111-b122-bca83ea8d107] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:10:14.696791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=46519ead-c542-4111-b122-bca83ea8d107,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:10:14.831889 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c74edaeb-198b-489b-a43f-9e04c22c3c4f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.131378 Aug 06 21:10:14.832549 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1940/3789] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:10:14.845550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:14.846308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:14.856623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:14.857122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:14.857565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:14.858287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:14.858797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:14.859227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:14.894890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:14.932995 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ec4c0470-1750-4e27-b496-42ce1e97eb26 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.554294 Aug 06 21:10:14.935600 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1850/3790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:14 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:14.942536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:14.958470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:14.969004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Searching by: {'deleted': False, 'project_id': '734f4706c86040eba82cde45971d4c5b'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:10:15.033080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:15.033581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:15.036798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:15.038307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:15.042012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:15.043634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:15.099571 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-27ea7ee1-7c5f-419a-b99f-998711c7d8b7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.161105 Aug 06 21:10:15.109456 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1851/3791] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:10:14 2022] GET /compute/v2.1/servers => generated 675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:15.116245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-249bd976-d2e2-4dad-a6e5-8c86596a3f3b tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:15.117639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-249bd976-d2e2-4dad-a6e5-8c86596a3f3b tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:15.265841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-249bd976-d2e2-4dad-a6e5-8c86596a3f3b tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:15.277404 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-249bd976-d2e2-4dad-a6e5-8c86596a3f3b tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1219 microversion: 2.1 time: 0.163640 Aug 06 21:10:15.291512 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1852/3792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:15 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1219 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:15.356313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:15.367143 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-59332f08-8856-4750-a770-641eab48a78c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.526073 Aug 06 21:10:15.382701 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1941/3793] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:14 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:15.961280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:15.962948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:15.977343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:15.979226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:15.979886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:15.983220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:15.983776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:15.985515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:16.299648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:16.300277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:16.322409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:16.331175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:16.331682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:16.332131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:16.332858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:16.333330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:16.333754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:16.629429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:16.649479 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-50bf4d35-212c-4a36-834e-d7fbe1d39a9d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1223 microversion: 2.1 time: 0.353923 Aug 06 21:10:16.651841 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1942/3794] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:16 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1223 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:16.666259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:16.666939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:16.681195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:16.684487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:16.686328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:16.690752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:16.691661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:16.696392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:17.087437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:17.097223 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d3bdcac-67be-454e-9ad1-f3c5a8e240ff tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.444100 Aug 06 21:10:17.100078 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1943/3795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:16 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:17.372596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:17.385184 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ba3d137c-e883-46cb-b047-74cd18d060b8 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 1.430345 Aug 06 21:10:17.387428 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1853/3796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:15 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:17.676177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:17.677044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:17.701898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:17.702781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:17.703418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:17.708601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:17.709304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:17.709946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:17.830867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:17.846178 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3dae9d61-fa16-486d-a712-605f8e255e2f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1277 microversion: 2.1 time: 0.176143 Aug 06 21:10:17.866201 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1944/3797] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:17 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:18.123984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:18.125031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:18.150370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:18.152016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:18.153340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:18.155230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:18.157329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:18.158538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:18.411636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:18.412866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:18.434882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:18.436981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:18.441920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:18.443386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:18.444085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:18.445398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:18.665718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:18.680955 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c72a6e68-02e3-4e58-91ad-841cd0122121 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.274174 Aug 06 21:10:18.689600 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1945/3798] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:18 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:18.786943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:18.804912 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03a57054-502a-4e6a-a6e0-ba08ac438f4b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1514 microversion: 2.1 time: 0.688733 Aug 06 21:10:18.807675 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1854/3799] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:18 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1514 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:18.872960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:18.873521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:18.887138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:18.887640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:18.888080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:18.888793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:18.889251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:18.891757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:19.002030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:19.010477 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a45a251e-9ac0-4916-ab36-7d14341d1d3c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1277 microversion: 2.1 time: 0.143663 Aug 06 21:10:19.013973 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1946/3800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:18 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:19.706733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:19.707405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:19.721221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:19.721629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:19.722074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:19.722829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:19.723291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:19.723728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:19.829445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:19.830279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:19.837974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:19.839955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:19.841601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:19.843131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:19.846110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:19.847055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:20.176604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:20.200913 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16f02d30-478f-4054-85c7-ce369d3fc932 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1520 microversion: 2.1 time: 0.375671 Aug 06 21:10:20.201556 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1947/3801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:19 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:20.212102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:20.213179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:20.239095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:20.240271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:20.241317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:20.242680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:20.243389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:20.244032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:20.359087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:20.376412 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a06e1796-0507-4d9f-a7e9-8a7df9366200 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1277 microversion: 2.1 time: 0.173791 Aug 06 21:10:20.396560 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1948/3802] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:20 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:20.748589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:20.764283 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4a0dabd9-32c7-450d-8b7f-b7b1efc38b35 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 1.062465 Aug 06 21:10:20.769829 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1855/3803] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:19 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:21.054383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:21.055206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:21.064427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.065023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.065538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.066342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.067062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.067856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.165553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lazy-loading 'services' on Instance uuid d6e52696-5e64-4d90-a90c-69d78aad14e8 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:10:21.228048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:21.228773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:21.237924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.238418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.240647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.241411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.241862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.242299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.332887 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments/ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8" status: 202 len: 0 microversion: 2.1 time: 0.284014 Aug 06 21:10:21.334945 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1949/3804] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Aug 6 21:10:21 2022] DELETE /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments/ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:10:21.361716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-848522e4-be7e-45bc-96d5-07d9fe08ff1c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:21.387819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-848522e4-be7e-45bc-96d5-07d9fe08ff1c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:21.405044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-848522e4-be7e-45bc-96d5-07d9fe08ff1c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.405557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-848522e4-be7e-45bc-96d5-07d9fe08ff1c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.406016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-848522e4-be7e-45bc-96d5-07d9fe08ff1c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.418803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-848522e4-be7e-45bc-96d5-07d9fe08ff1c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.419470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-848522e4-be7e-45bc-96d5-07d9fe08ff1c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.420094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-848522e4-be7e-45bc-96d5-07d9fe08ff1c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.508726 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-848522e4-be7e-45bc-96d5-07d9fe08ff1c tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168904 Aug 06 21:10:21.512410 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1950/3805] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:10:21 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:10:21.526475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:21.527425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:21.545996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.546977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.547829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.549664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.550529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.551191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.913140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:21.928181 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a95d87c4-7c8d-4f56-bdcc-06f553afcbd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.414116 Aug 06 21:10:21.932851 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1951/3806] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:21 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:21.948161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:21.951493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:21.958268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:21.966499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.969228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.971364 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-96725b7f-17b2-4aeb-8d73-ae696bbbb88a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1520 microversion: 2.1 time: 0.747693 Aug 06 21:10:21.971690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.986759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:21.986759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:21.986759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:21.987471 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1856/3807] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:21 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1520 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:22.523943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-452e299c-195d-4ee2-8f0e-f12660254cf3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:22.526754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-452e299c-195d-4ee2-8f0e-f12660254cf3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:22.531032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:22.541204 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6f88ec40-7435-413f-8d0b-c938fd86a40b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1512 microversion: 2.1 time: 0.607256 Aug 06 21:10:22.543920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-452e299c-195d-4ee2-8f0e-f12660254cf3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:22.544421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-452e299c-195d-4ee2-8f0e-f12660254cf3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:22.544868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-452e299c-195d-4ee2-8f0e-f12660254cf3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:22.545149 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1952/3808] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:21 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1512 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:22.545587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-452e299c-195d-4ee2-8f0e-f12660254cf3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:22.554137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-452e299c-195d-4ee2-8f0e-f12660254cf3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:22.557525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-452e299c-195d-4ee2-8f0e-f12660254cf3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:22.646334 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-452e299c-195d-4ee2-8f0e-f12660254cf3 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126735 Aug 06 21:10:22.650877 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1857/3809] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:10:22 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:10:22.781627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:22.785416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:22.801629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:22.802445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:22.804472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:22.807138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:22.807803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:22.809884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:22.886019 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] HTTP exception thrown: Cannot 'reboot' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Request method failure captured: Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba/action HTTP/1.1 Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 28 Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tfLEawbHpN6jMURxdzK2EbJF4VOuu9Oa5UpiLUmKBNlhjCkr9kH_MmWQvt1hNGSGmL37UKnTYuWQ1qLqZpSKaucQe-XZMrOo54Rzzy38O3wJqXN2UfBzSzmpVXWUazExIacv2EKUyLKBOIK69QkSvDLfRUnPsiYAPeIlk26rmd3IhA Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8046f1ab9c004060965dced02db4b7c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f7cf258df10248d0bdcf64fa075c132c Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: {"reboot": {"type": "HARD"}} Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: exception: Cannot 'reboot' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '16b66ce3-9ebf-4346-93e9-39e370d165ba', 'body': {'reboot': {'type': 'HARD'}}} Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16b66ce3-9ebf-4346-93e9-39e370d165ba in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:10:22.888051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Returning 409 to user: Cannot 'reboot' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4ba2502d-d506-4de6-8dd8-bd9895a6d3e0 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba/action" status: 409 len: 145 microversion: 2.1 time: 0.112650 Aug 06 21:10:22.894838 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1953/3810] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:10:22 2022] POST /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba/action => generated 145 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:10:22.905903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:22.911597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:22.932285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:22.933079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:22.933709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:22.936253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:22.952014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:22.954662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:22.960310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:22.962829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:22.969577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:22.970610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:22.971685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:22.973044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:22.975183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:22.977068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:23.081479 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] HTTP exception thrown: Cannot 'rebuild' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Request method failure captured: Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba/action HTTP/1.1 Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 65 Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tfLEawbHpN6jMURxdzK2EbJF4VOuu9Oa5UpiLUmKBNlhjCkr9kH_MmWQvt1hNGSGmL37UKnTYuWQ1qLqZpSKaucQe-XZMrOo54Rzzy38O3wJqXN2UfBzSzmpVXWUazExIacv2EKUyLKBOIK69QkSvDLfRUnPsiYAPeIlk26rmd3IhA Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8046f1ab9c004060965dced02db4b7c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: f7cf258df10248d0bdcf64fa075c132c Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: exception: Cannot 'rebuild' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '16b66ce3-9ebf-4346-93e9-39e370d165ba', 'body': {'rebuild': {'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd'}}} Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16b66ce3-9ebf-4346-93e9-39e370d165ba in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:10:23.091063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Returning 409 to user: Cannot 'rebuild' instance 16b66ce3-9ebf-4346-93e9-39e370d165ba while it is in vm_state rescued {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:10:23.098224 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-153af4f8-f685-41dc-a502-5912e15dfe8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "POST /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba/action" status: 409 len: 146 microversion: 2.1 time: 0.194463 Aug 06 21:10:23.100840 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1858/3811] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:10:22 2022] POST /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba/action => generated 146 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:10:23.106173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:23.106836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:23.114530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:23.116626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:23.117308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:23.118614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:23.119294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:23.119934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:23.448519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:23.457082 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-115fbe1f-2d8c-4996-baef-a14565278f75 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.508787 Aug 06 21:10:23.463345 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1954/3812] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:22 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:23.469666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:23.473312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:23.488172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:23.490734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:23.491454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:23.502049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:23.502939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:23.503644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:23.548330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:10:23.660289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:23.743385 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2583fc0b-bafb-441a-bfe8-cd0b29d93533 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 204 len: 0 microversion: 2.1 time: 0.278208 Aug 06 21:10:23.744634 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1955/3813] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:10:23 2022] DELETE /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:23.760636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b8341378-76b9-4a42-802c-9e59a7cfb541 req-daef7110-37a3-472a-8293-fd7c425e8066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46519ead-c542-4111-b122-bca83ea8d107", "tag": "b6dd8361-a74a-4626-a70b-1a5a53fd0148"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:23.812297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b8341378-76b9-4a42-802c-9e59a7cfb541 req-daef7110-37a3-472a-8293-fd7c425e8066 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:23.813659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b8341378-76b9-4a42-802c-9e59a7cfb541 req-daef7110-37a3-472a-8293-fd7c425e8066 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:23.814113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b8341378-76b9-4a42-802c-9e59a7cfb541 req-daef7110-37a3-472a-8293-fd7c425e8066 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:23.829329 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b8341378-76b9-4a42-802c-9e59a7cfb541 req-daef7110-37a3-472a-8293-fd7c425e8066 service nova] Creating event network-changed:b6dd8361-a74a-4626-a70b-1a5a53fd0148 for instance 46519ead-c542-4111-b122-bca83ea8d107 on nch2-master-1 Aug 06 21:10:23.836345 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b8341378-76b9-4a42-802c-9e59a7cfb541 req-daef7110-37a3-472a-8293-fd7c425e8066 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089052 Aug 06 21:10:23.837222 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1956/3814] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:23.844975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:23.846299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:23.854827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:23.856318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:23.856992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:23.857897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:23.858579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:23.859195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:24.204473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:24.213889 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3ec0b631-d86c-4d1f-82ed-6a533e968430 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1520 microversion: 2.1 time: 1.111848 Aug 06 21:10:24.221998 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1859/3815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:23 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1520 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:24.239663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:24.240409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:24.262219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:24.262912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:24.265327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:24.266790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:24.276688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:24.277337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:24.537374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:24.549913 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3faf9094-cff2-4e8c-b25d-307812626952 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1489 microversion: 2.1 time: 0.709131 Aug 06 21:10:24.550583 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1957/3816] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:23 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1489 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:24.558241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:24.559086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:24.569809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:24.571282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:24.583736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:24.584740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:24.585893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:24.588159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:24.589223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:24.622710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:25.032603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:25.042434 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-967b54d8-4cee-4c66-9e17-1414e15ba096 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.489908 Aug 06 21:10:25.046209 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1958/3817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:24 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:25.079630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-063a7e7d-9f07-493c-9084-14fbd63868c4 req-10458760-0a75-4302-853b-9004175c4ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee15ef61-72e0-4c6b-95b2-cc86cf4f3938", "name": "network-vif-plugged", "status": "completed", "tag": "568333be-be61-4dca-a5a2-bc925dfbc81b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:25.081072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:25.105438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-063a7e7d-9f07-493c-9084-14fbd63868c4 req-10458760-0a75-4302-853b-9004175c4ed8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:25.106374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-063a7e7d-9f07-493c-9084-14fbd63868c4 req-10458760-0a75-4302-853b-9004175c4ed8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:25.107303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-063a7e7d-9f07-493c-9084-14fbd63868c4 req-10458760-0a75-4302-853b-9004175c4ed8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:25.132917 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-063a7e7d-9f07-493c-9084-14fbd63868c4 req-10458760-0a75-4302-853b-9004175c4ed8 service nova] Creating event network-vif-plugged:568333be-be61-4dca-a5a2-bc925dfbc81b for instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 on nch1-master-1 Aug 06 21:10:25.143455 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-063a7e7d-9f07-493c-9084-14fbd63868c4 req-10458760-0a75-4302-853b-9004175c4ed8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093361 Aug 06 21:10:25.144894 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1959/3818] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:25.154300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:25.155216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:25.165802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:25.167926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:25.168614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:25.172384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:25.172384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:25.172384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:25.215715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:10:25.275149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:25.360519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b1b99374-f823-4419-9aa3-4cc906880c3d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 204 len: 0 microversion: 2.1 time: 0.210359 Aug 06 21:10:25.366479 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1960/3819] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:10:25 2022] DELETE /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:25.380107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:25.382405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:25.390240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:25.391152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:25.391806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:25.393414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:25.394295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:25.394995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:25.454200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:25.474002 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d334a741-8287-466d-9acf-454b6f887a94 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1688 microversion: 2.1 time: 1.249855 Aug 06 21:10:25.488529 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1860/3820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:24 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1688 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:25.495829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:25.498366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:25.542000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=60 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:25.543661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:25.544166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:25.545354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:25.546128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:25.546698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:25.548618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:25.796390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:25.806433 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-823cf516-1275-4462-aa71-1a5f494ca053 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1520 microversion: 2.1 time: 0.433232 Aug 06 21:10:25.808591 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1961/3821] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:25 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:26.014236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:26.017352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:26.026587 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b68e4a04-4956-4974-8a93-ea3377448ef5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1495 microversion: 2.1 time: 0.535713 Aug 06 21:10:26.038525 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1861/3822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:25 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1495 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:26.065302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:26.066355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:26.097261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:26.098906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:26.100255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:26.101735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:26.103364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:26.105014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:26.165815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9d667eaa-18ea-49be-ab8c-2f1ff356942e req-68dd68b5-7ec5-44fa-b5d4-47f1546712f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0cb283-0fd8-454f-ab21-2782368daeb3", "tag": "f7f1d6c0-f2c0-453a-b1f2-94ac37f7df2e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:26.183519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9d667eaa-18ea-49be-ab8c-2f1ff356942e req-68dd68b5-7ec5-44fa-b5d4-47f1546712f5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:26.184014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9d667eaa-18ea-49be-ab8c-2f1ff356942e req-68dd68b5-7ec5-44fa-b5d4-47f1546712f5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:26.184442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9d667eaa-18ea-49be-ab8c-2f1ff356942e req-68dd68b5-7ec5-44fa-b5d4-47f1546712f5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:26.263980 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9d667eaa-18ea-49be-ab8c-2f1ff356942e req-68dd68b5-7ec5-44fa-b5d4-47f1546712f5 service nova] Creating event network-changed:f7f1d6c0-f2c0-453a-b1f2-94ac37f7df2e for instance fa0cb283-0fd8-454f-ab21-2782368daeb3 on nch1-master-1 Aug 06 21:10:26.273390 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9d667eaa-18ea-49be-ab8c-2f1ff356942e req-68dd68b5-7ec5-44fa-b5d4-47f1546712f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112702 Aug 06 21:10:26.275996 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1862/3823] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:26.520790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:26.523818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:26.565972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:26.569502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:26.579048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:26.584550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:26.596576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:26.602729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:26.603242 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b04ffeb5-508a-488a-ad07-7b1d674363e9 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.534343 Aug 06 21:10:26.608847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:26.611421 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1962/3824] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:26 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:26.830106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:26.830861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:26.837157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:26.837752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:26.838094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:26.845726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:26.846488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:26.847133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:27.287057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:27.295088 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67c44cbb-2424-4ddc-ba95-c0977566b751 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1520 microversion: 2.1 time: 0.469521 Aug 06 21:10:27.306903 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1963/3825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:26 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1520 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:27.312403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:27.313631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:27.329323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:27.330120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:27.330784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:27.331698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:27.332342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:27.332949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:27.993286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:28.007894 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-87df5e18-1df6-4756-9a20-4010462f8ff1 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1495 microversion: 2.1 time: 0.699332 Aug 06 21:10:28.010798 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1964/3826] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:27 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1495 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:28.020624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:28.022003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:28.033914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:28.034510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:28.035083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:28.035933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:28.036471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:28.036982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:28.154148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:28.175561 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ef47f4f5-bb80-4c9b-8fce-19d629355985 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1688 microversion: 2.1 time: 1.668920 Aug 06 21:10:28.176963 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1863/3827] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:26 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1688 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:28.317517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:28.318301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:28.326963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:28.327920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:28.328623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:28.330943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:28.331647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:28.332310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:28.645600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:28.657733 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e9ad63c0-f845-4d32-87f2-f55a37698a50 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.644165 Aug 06 21:10:28.660487 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1965/3828] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:28 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:28.728478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-93984876-1943-452d-be62-31702cae6f1c req-3d2476ce-43f0-4fff-9ec2-213151a72ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0911c35-ac57-4dd9-b4fb-c7667583a653", "name": "network-vif-deleted", "tag": "91e8a9eb-10b6-43e0-9172-5c4eba78ae48"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:28.752645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-93984876-1943-452d-be62-31702cae6f1c req-3d2476ce-43f0-4fff-9ec2-213151a72ff1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:28.753313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-93984876-1943-452d-be62-31702cae6f1c req-3d2476ce-43f0-4fff-9ec2-213151a72ff1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:28.753954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-93984876-1943-452d-be62-31702cae6f1c req-3d2476ce-43f0-4fff-9ec2-213151a72ff1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:28.776692 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-93984876-1943-452d-be62-31702cae6f1c req-3d2476ce-43f0-4fff-9ec2-213151a72ff1 service nova] Creating event network-vif-deleted:91e8a9eb-10b6-43e0-9172-5c4eba78ae48 for instance b0911c35-ac57-4dd9-b4fb-c7667583a653 on nch2-master-1 Aug 06 21:10:28.794684 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-93984876-1943-452d-be62-31702cae6f1c req-3d2476ce-43f0-4fff-9ec2-213151a72ff1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068710 Aug 06 21:10:28.795516 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1966/3829] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:28.993653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:29.011091 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cbf831e3-7843-4eac-a42a-cfd850d226dd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1520 microversion: 2.1 time: 0.698071 Aug 06 21:10:29.012001 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1864/3830] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:28 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1520 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:29.036582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:29.037550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:29.059830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:29.084312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:29.084796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:29.089273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:29.091391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:29.091859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:29.197724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:29.198947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:29.208394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:29.209155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:29.211074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:29.212213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:29.219690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:29.220748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:29.242214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:29.245970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:29.247306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:29.248653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lazy-loading 'fault' on Instance uuid b0911c35-ac57-4dd9-b4fb-c7667583a653 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:10:29.360335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:29.371260 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-23920149-5bf1-4d55-96c1-6b1536ee4b08 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 200 len: 1304 microversion: 2.1 time: 0.338691 Aug 06 21:10:29.371896 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1967/3831] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:29 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 1304 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:29.683406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:29.684958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:29.698145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:29.698910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:29.699544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:29.700475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:29.703820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:29.704714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:30.020446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:30.032901 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78412cc0-7121-4b76-8355-56409a469712 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.353964 Aug 06 21:10:30.047891 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1968/3832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:29 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:30.065369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:30.066285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:30.080340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:30.087022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:30.087507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:30.088271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:30.088751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:30.090587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:30.264957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:30.284397 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b45ba33b-e732-4f13-979b-b7336a641e7f tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1688 microversion: 2.1 time: 1.090734 Aug 06 21:10:30.287731 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1865/3833] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:29 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1688 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:30.393045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:30.393814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:30.403651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:30.405963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:30.407708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:30.408814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:30.411768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:30.413649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:30.453634 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 HTTP/1.1 Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'b0911c35-ac57-4dd9-b4fb-c7667583a653'} Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:30.456955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:30.462083 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:30.462083 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:30.462083 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:30.462083 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:10:30.462083 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:10:30.462083 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:10:30.462083 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:30.463622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:10:30.469571 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dd2f2603-c244-4157-9143-0e913ac3ea21 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 404 len: 111 microversion: 2.1 time: 0.077578 Aug 06 21:10:30.470682 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1866/3834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:30 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:10:30.665024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-709106772", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5c00ae50-9c12-446f-a3fc-256b5e473c43"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:30.764475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] validate_networks() for [('5c00ae50-9c12-446f-a3fc-256b5e473c43', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:10:31.193203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:31.202503 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c29333ee-3d5f-444d-96a8-306f099805cd tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1505 microversion: 2.1 time: 1.152736 Aug 06 21:10:31.208397 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1969/3835] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:30 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1505 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:31.213731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:31.217561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:31.237058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:31.238228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:31.240867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:31.242843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:31.244338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:31.245025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:31.595281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:31.607172 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e9888b4-7986-410d-98eb-eae48ca9c918 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.396226 Aug 06 21:10:31.609109 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1970/3836] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:31 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:31.631388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:31.633459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:31.654124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:31.657655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:31.659128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:31.662164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:31.663787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:31.665456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:32.077219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:32.087717 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75bff859-f048-4c76-bf0c-45401bc0f711 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 200 len: 1505 microversion: 2.1 time: 0.476680 Aug 06 21:10:32.107580 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1971/3837] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:31 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:32.109103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:32.109975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:32.125609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:32.133447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:32.134102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:32.135738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:32.136350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:32.137108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:32.149982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:32.250391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:32.262846 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-557783db-bfd9-4439-a21f-b9092c05c626 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 200 len: 1620 microversion: 2.1 time: 0.158063 Aug 06 21:10:32.263195 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1972/3838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:32 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 1620 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:32.279222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:32.279711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:32.286865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:32.287687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:32.288349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:32.289427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:32.290086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:32.290870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:32.369665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:10:32.614409 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-317dde8b-5b90-4761-9ca7-7a3b36620ea1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 204 len: 0 microversion: 2.1 time: 0.349452 Aug 06 21:10:32.615795 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1973/3839] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:10:32 2022] DELETE /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:32.675823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:32.676962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:32.692243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:32.693095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:32.694113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:32.695862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:32.696572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:32.697182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:32.808352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:10:32.810116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:10:32.811329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:10:32.812036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:10:32.812680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:10:32.826592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:32.827353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:32.828384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:32.829449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:32.830943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:32.831757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:32.856770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:10:32.865511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Getting quotas for user bdf1b5180a814cf39234892c6c1f26df and project fe2ae1b1c16d4dedb2585dde7dab8113. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:10:32.883825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:10:32.892598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:10:32.987052 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-024b3869-f3c8-40bc-b907-f818b7cd7d72 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.321812 Aug 06 21:10:32.993586 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1867/3840] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:10:33.006253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-889b0947-18f4-4b8c-807a-b243f44a479d req-611fe5ee-08ed-49c4-952c-d9a909e76798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e52696-5e64-4d90-a90c-69d78aad14e8", "name": "network-vif-deleted", "tag": "26a07487-037f-4b16-b6ce-e506fe5ccc79"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:33.025878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-889b0947-18f4-4b8c-807a-b243f44a479d req-611fe5ee-08ed-49c4-952c-d9a909e76798 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:33.026845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-889b0947-18f4-4b8c-807a-b243f44a479d req-611fe5ee-08ed-49c4-952c-d9a909e76798 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:33.027970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-889b0947-18f4-4b8c-807a-b243f44a479d req-611fe5ee-08ed-49c4-952c-d9a909e76798 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:33.083106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:33.097658 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-406d8486-d63b-401a-afbb-c36dddfc6b1d tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.442941 Aug 06 21:10:33.100777 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-889b0947-18f4-4b8c-807a-b243f44a479d req-611fe5ee-08ed-49c4-952c-d9a909e76798 service nova] Creating event network-vif-deleted:26a07487-037f-4b16-b6ce-e506fe5ccc79 for instance d6e52696-5e64-4d90-a90c-69d78aad14e8 on nch1-master-1 Aug 06 21:10:33.107786 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1974/3841] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:32 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:33.133122 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-889b0947-18f4-4b8c-807a-b243f44a479d req-611fe5ee-08ed-49c4-952c-d9a909e76798 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139582 Aug 06 21:10:33.142041 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1868/3842] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:33.155075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-200967782", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "736ed351-96b2-40f9-b19a-2a7e79779668"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:33.256230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] validate_networks() for [('736ed351-96b2-40f9-b19a-2a7e79779668', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:10:33.727111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-15644b4b-fce2-4b4b-a1c3-79c0eb65df00 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: .version_select at 0x7f729cea34c0>, body: {"keypair": {"name": "tempest-keypair-2100226103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPh6yXxstjtFtkMpmEBcjEDeyj/GP+WC0p0bXXbiOlnxVdZ4ttvne9d9qBscXB9hvkH4odleCvLd1h3CadJWNF7E3qGWlcSzUzp3UailAVnk6HoXoM43hOwLgQadaW+ghw=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:33.776574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-15644b4b-fce2-4b4b-a1c3-79c0eb65df00 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for project f4980bb21b59412ca004d8069525d3b9. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:10:33.806416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-15644b4b-fce2-4b4b-a1c3-79c0eb65df00 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for user 1d7b9e27983940dcaf0e92f62273c588 and project f4980bb21b59412ca004d8069525d3b9. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:10:33.917479 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-15644b4b-fce2-4b4b-a1c3-79c0eb65df00 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.799651 Aug 06 21:10:33.918147 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1975/3843] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:10:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:33.944865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:33.947548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:33.972616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:33.973624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:33.974091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:33.977062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:33.977602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:33.978508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:34.381216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:10:34.381739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:10:34.382222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:10:34.382681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:10:34.383208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:10:34.411281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:34.411670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:34.417216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:34.420047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:34.420982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:34.423337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:34.478935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Getting quotas for project 591beac720d74a8889ad521c436e64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:10:34.489968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Getting quotas for user 22318132bfd04aa0886eb9b14a983731 and project 591beac720d74a8889ad521c436e64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:10:34.534097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:10:34.552274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:10:34.593340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:34.608719 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-770a338b-1ea3-469b-acc8-6c229f361c2c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1218 microversion: 2.1 time: 0.679030 Aug 06 21:10:34.620334 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1976/3844] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:33 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1218 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:34.635424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:34.642458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: d6e52696-5e64-4d90-a90c-69d78aad14e8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:34.650324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:34.675900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:34.678845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:34.679801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:34.683038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:34.683704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:34.684354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:34.718952 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7f1a45b-3123-4d9b-92ae-71bcb5b14366 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.573745 Aug 06 21:10:34.720282 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1869/3845] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:10:34.747380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-41c84336-82b2-4153-a887-34f59d908e75 req-9702f88d-0cdd-4b96-a406-a13ec917a522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46519ead-c542-4111-b122-bca83ea8d107", "name": "network-vif-plugged", "status": "completed", "tag": "b6dd8361-a74a-4626-a70b-1a5a53fd0148"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:34.754756 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] HTTP exception thrown: Instance d6e52696-5e64-4d90-a90c-69d78aad14e8 could not be found. Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Request method failure captured: Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 HTTP/1.1 Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tfLEawbHpN6jMURxdzK2EbJF4VOuu9Oa5UpiLUmKBNlhjCkr9kH_MmWQvt1hNGSGmL37UKnTYuWQ1qLqZpSKaucQe-XZMrOo54Rzzy38O3wJqXN2UfBzSzmpVXWUazExIacv2EKUyLKBOIK69QkSvDLfRUnPsiYAPeIlk26rmd3IhA Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8046f1ab9c004060965dced02db4b7c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: f7cf258df10248d0bdcf64fa075c132c Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance d6e52696-5e64-4d90-a90c-69d78aad14e8 could not be found. Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'd6e52696-5e64-4d90-a90c-69d78aad14e8'} Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e52696-5e64-4d90-a90c-69d78aad14e8 could not be found. Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e52696-5e64-4d90-a90c-69d78aad14e8 could not be found. Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:34.762306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:34.768316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:34.768316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:34.768316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:34.768316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:34.768316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:10:34.768316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:10:34.768316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e52696-5e64-4d90-a90c-69d78aad14e8 could not be found. Aug 06 21:10:34.768316 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:10:34.776285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Returning 404 to user: Instance d6e52696-5e64-4d90-a90c-69d78aad14e8 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:10:34.781218 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9fc3a4d5-6899-4823-905c-d0339a27316a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8" status: 404 len: 111 microversion: 2.1 time: 0.159611 Aug 06 21:10:34.782448 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1977/3846] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:34 2022] GET /compute/v2.1/servers/d6e52696-5e64-4d90-a90c-69d78aad14e8 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:10:34.794807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:34.801237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:34.807619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-41c84336-82b2-4153-a887-34f59d908e75 req-9702f88d-0cdd-4b96-a406-a13ec917a522 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:34.808453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-41c84336-82b2-4153-a887-34f59d908e75 req-9702f88d-0cdd-4b96-a406-a13ec917a522 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:34.809006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-41c84336-82b2-4153-a887-34f59d908e75 req-9702f88d-0cdd-4b96-a406-a13ec917a522 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:34.824783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:34.831224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:34.833175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:34.834601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:34.836335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:34.837382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:34.851843 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-41c84336-82b2-4153-a887-34f59d908e75 req-9702f88d-0cdd-4b96-a406-a13ec917a522 service nova] Creating event network-vif-plugged:b6dd8361-a74a-4626-a70b-1a5a53fd0148 for instance 46519ead-c542-4111-b122-bca83ea8d107 on nch2-master-1 Aug 06 21:10:34.870498 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-41c84336-82b2-4153-a887-34f59d908e75 req-9702f88d-0cdd-4b96-a406-a13ec917a522 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146997 Aug 06 21:10:34.875323 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1870/3847] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:34.911358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fa0b22ac-89af-4d21-b733-c1cc22b0557d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:34.913797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fa0b22ac-89af-4d21-b733-c1cc22b0557d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:35.141864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fa0b22ac-89af-4d21-b733-c1cc22b0557d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:35.152299 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fa0b22ac-89af-4d21-b733-c1cc22b0557d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1217 microversion: 2.1 time: 0.270608 Aug 06 21:10:35.157565 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1871/3848] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:34 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:35.179218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a25bbbb-e069-447e-a37a-56a6ee772392 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '.version_select at 0x7f72a34ca790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:35.246301 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5a25bbbb-e069-447e-a37a-56a6ee772392 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913635642" status: 202 len: 0 microversion: 2.1 time: 0.085119 Aug 06 21:10:35.247136 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1872/3849] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:10:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913635642 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:10:35.629721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:35.630352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:35.638155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:35.650003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:35.652147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:35.658689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:35.659192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:35.665371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:35.827923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:35.857985 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1fcd609e-e961-4207-a113-ca55b2529af7 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 1.072544 Aug 06 21:10:35.861899 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1978/3850] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:34 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:35.882974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-1a28cf67-86b2-43c7-be9a-04e4fd1ed962 req-9634dd95-c73c-45b4-9c9b-dc91b4b697d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee15ef61-72e0-4c6b-95b2-cc86cf4f3938", "name": "network-vif-deleted", "tag": "568333be-be61-4dca-a5a2-bc925dfbc81b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:35.924540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1a28cf67-86b2-43c7-be9a-04e4fd1ed962 req-9634dd95-c73c-45b4-9c9b-dc91b4b697d8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:35.925386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1a28cf67-86b2-43c7-be9a-04e4fd1ed962 req-9634dd95-c73c-45b4-9c9b-dc91b4b697d8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:35.926308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1a28cf67-86b2-43c7-be9a-04e4fd1ed962 req-9634dd95-c73c-45b4-9c9b-dc91b4b697d8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:35.955181 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-1a28cf67-86b2-43c7-be9a-04e4fd1ed962 req-9634dd95-c73c-45b4-9c9b-dc91b4b697d8 service nova] Creating event network-vif-deleted:568333be-be61-4dca-a5a2-bc925dfbc81b for instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 on nch1-master-1 Aug 06 21:10:35.967133 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-1a28cf67-86b2-43c7-be9a-04e4fd1ed962 req-9634dd95-c73c-45b4-9c9b-dc91b4b697d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103328 Aug 06 21:10:35.971137 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1979/3851] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:36.036540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:36.052519 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f67c26c-912e-4619-a597-42767f0e1011 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1272 microversion: 2.1 time: 0.426874 Aug 06 21:10:36.059373 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1873/3852] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:35 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:36.181040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:36.182850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:36.266864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:36.272495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:36.286757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:36.294275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:36.296017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:36.305570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:36.493038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:36.504313 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5d09bdcc-3c41-42da-a533-ddf01915082b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1213 microversion: 2.1 time: 0.329846 Aug 06 21:10:36.509367 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1980/3853] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:36 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1213 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:36.881958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:36.883029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:36.896272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:36.896784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:36.897239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:36.904503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:36.905194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:36.905648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:37.080538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:37.081165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:37.092704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:37.099903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:37.102146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:37.103948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:37.104599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:37.110495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:37.429168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:37.441270 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47d67b3b-6417-4a28-bab5-b4246034da1a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1272 microversion: 2.1 time: 0.364613 Aug 06 21:10:37.461385 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1981/3854] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:37 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1272 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:37.540498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:37.541141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:37.553559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:37.554067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:37.554779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:37.563585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:37.571417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:37.585749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:37.694702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:37.707688 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fad06a32-480e-4bbe-b65e-858b3593ea5e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.829241 Aug 06 21:10:37.709922 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1874/3855] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:36 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:37.776519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:37.805531 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b412e0f-d09c-4765-9446-11f828015eb5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1275 microversion: 2.1 time: 0.264754 Aug 06 21:10:37.809913 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1982/3856] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:37 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:38.113111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7fb232ee-3e40-4b0c-8f30-d5300017a5a6 req-b5d4fbf3-bc92-455d-8b39-c73429ada065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0cb283-0fd8-454f-ab21-2782368daeb3", "name": "network-vif-plugged", "status": "completed", "tag": "f7f1d6c0-f2c0-453a-b1f2-94ac37f7df2e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:38.137013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7fb232ee-3e40-4b0c-8f30-d5300017a5a6 req-b5d4fbf3-bc92-455d-8b39-c73429ada065 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:38.138312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7fb232ee-3e40-4b0c-8f30-d5300017a5a6 req-b5d4fbf3-bc92-455d-8b39-c73429ada065 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:38.141350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7fb232ee-3e40-4b0c-8f30-d5300017a5a6 req-b5d4fbf3-bc92-455d-8b39-c73429ada065 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:38.202594 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7fb232ee-3e40-4b0c-8f30-d5300017a5a6 req-b5d4fbf3-bc92-455d-8b39-c73429ada065 service nova] Creating event network-vif-plugged:f7f1d6c0-f2c0-453a-b1f2-94ac37f7df2e for instance fa0cb283-0fd8-454f-ab21-2782368daeb3 on nch1-master-1 Aug 06 21:10:38.237907 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7fb232ee-3e40-4b0c-8f30-d5300017a5a6 req-b5d4fbf3-bc92-455d-8b39-c73429ada065 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133950 Aug 06 21:10:38.242646 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1875/3857] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:38.463905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:38.465442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:38.480382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:38.483167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:38.483752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:38.486795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:38.488438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:38.494871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:38.630492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:38.639549 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf8bec5c-cc78-4dfa-8681-c7f497d9c89b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1272 microversion: 2.1 time: 0.179435 Aug 06 21:10:38.653458 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1983/3858] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:38 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:38.731019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:38.732237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:38.745551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:38.746391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:38.748804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:38.750356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:38.755057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:38.756536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:38.831606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:38.832332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:38.844286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:38.848124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:38.848576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:38.849324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:38.849784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:38.850214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:38.972120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:38.982626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65bb9f72-5ff7-45ee-ac39-0e8d5e68077a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1275 microversion: 2.1 time: 0.155761 Aug 06 21:10:38.985435 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1984/3859] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:38 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:39.651627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:39.709160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:39.709160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:39.710022 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a15332c2-b3d6-46b1-87cd-a280b1023e09 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1319 microversion: 2.1 time: 0.971974 Aug 06 21:10:39.710022 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1876/3860] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:38 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1319 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:39.710307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:39.710307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:39.713953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:39.714858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:39.715338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:39.715778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:40.009828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:40.010716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:40.028754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:40.029263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:40.032154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:40.033295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:40.034499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:40.037154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:40.265899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:40.279090 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-049d8c0c-0fa8-40dc-9143-915c9920e95a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1275 microversion: 2.1 time: 0.272202 Aug 06 21:10:40.279731 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1877/3861] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:40 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:40.389457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:40.401170 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc613f2f-8972-458b-a542-abeac7a52871 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1314 microversion: 2.1 time: 0.741455 Aug 06 21:10:40.414875 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1985/3862] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:39 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:40.733100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:40.735327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:40.745146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:40.745938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:40.746733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:40.747877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:40.755661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:40.756634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:41.188382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0fe11c9a-c022-42dc-8a05-0f8db7803e0b req-fd447225-fbf7-4b81-aae3-601a2e14d2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c07563-85cb-4502-80cb-4bf2682f112c", "tag": "cb6f9757-aeac-4c34-87dd-34ec08ddffbd"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:41.233420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0fe11c9a-c022-42dc-8a05-0f8db7803e0b req-fd447225-fbf7-4b81-aae3-601a2e14d2e2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:41.239252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0fe11c9a-c022-42dc-8a05-0f8db7803e0b req-fd447225-fbf7-4b81-aae3-601a2e14d2e2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:41.240011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0fe11c9a-c022-42dc-8a05-0f8db7803e0b req-fd447225-fbf7-4b81-aae3-601a2e14d2e2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:41.287079 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0fe11c9a-c022-42dc-8a05-0f8db7803e0b req-fd447225-fbf7-4b81-aae3-601a2e14d2e2 service nova] Creating event network-changed:cb6f9757-aeac-4c34-87dd-34ec08ddffbd for instance 21c07563-85cb-4502-80cb-4bf2682f112c on nch2-master-1 Aug 06 21:10:41.311688 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0fe11c9a-c022-42dc-8a05-0f8db7803e0b req-fd447225-fbf7-4b81-aae3-601a2e14d2e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117092 Aug 06 21:10:41.315291 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1986/3863] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:10:41.339159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:41.339897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:41.377049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:41.380199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:41.381772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:41.385104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:41.387332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:41.387899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:41.405607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:41.416219 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-451308e3-bd1c-4592-b6c9-23523ffb249e tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 200 len: 1508 microversion: 2.1 time: 0.688728 Aug 06 21:10:41.419939 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1878/3864] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:40 2022] GET /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 1508 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:41.444988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:41.450782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:41.480910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:41.481625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:41.483080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:41.486340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:41.487126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:41.487711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:41.822083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:41.832703 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-48908259-f0e3-41a6-aefb-65b13dac1280 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1317 microversion: 2.1 time: 0.514263 Aug 06 21:10:41.849032 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1987/3865] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:41 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:41.849032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:41.849032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 46519ead-c542-4111-b122-bca83ea8d107] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:41.860445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:41.862257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:41.867674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:41.868288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:41.870968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:41.871648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:41.872377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:41.878279 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ebbed38d-6992-441c-bcf1-772d93cc0d96 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1314 microversion: 2.1 time: 0.444288 Aug 06 21:10:41.882044 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1879/3866] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:41 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:41.971770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1719314288", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6095abc9-21e8-4e89-b536-00af77a125af"}], "security_groups": [{"name": "tempest-securitygroup--520139325"}], "key_name": "tempest-keypair-2100226103", "user_data": "}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:42.230505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] validate_networks() for [('6095abc9-21e8-4e89-b536-00af77a125af', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:10:42.309170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:42.321498 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-342302ba-106f-4b61-96cc-489eac645385 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/46519ead-c542-4111-b122-bca83ea8d107" status: 200 len: 1507 microversion: 2.1 time: 0.483684 Aug 06 21:10:42.326800 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1988/3867] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:41 2022] GET /compute/v2.1/servers/46519ead-c542-4111-b122-bca83ea8d107 => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:42.357155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:42.357660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 46519ead-c542-4111-b122-bca83ea8d107] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:42.365522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:42.366484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:42.367345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:42.368663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:42.369927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:42.370872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:42.408093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 46519ead-c542-4111-b122-bca83ea8d107] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:10:42.433264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:42.529817 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8eb2b9ad-56da-4b31-9929-d2f9a1b5191f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/46519ead-c542-4111-b122-bca83ea8d107" status: 204 len: 0 microversion: 2.1 time: 0.177803 Aug 06 21:10:42.531531 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1989/3868] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:10:42 2022] DELETE /compute/v2.1/servers/46519ead-c542-4111-b122-bca83ea8d107 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:10:42.538301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:42.539270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:42.554849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:42.555628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:42.556399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:42.557834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:42.558636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:42.559469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:42.607400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:10:42.743434 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cdb3a054-cc68-49f4-8b57-19febadc51c1 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "DELETE /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 204 len: 0 microversion: 2.1 time: 0.209667 Aug 06 21:10:42.744594 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1990/3869] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:10:42 2022] DELETE /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:42.755754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:42.756771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:42.767441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:42.768344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:42.769343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:42.770232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:42.771069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:42.771442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:42.808622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: fa0cb283-0fd8-454f-ab21-2782368daeb3] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:10:42.912382 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca965686-84df-47ad-a5a1-8fa94ad1ccd5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3" status: 204 len: 0 microversion: 2.1 time: 0.164561 Aug 06 21:10:42.914897 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1991/3870] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:10:42 2022] DELETE /compute/v2.1/servers/fa0cb283-0fd8-454f-ab21-2782368daeb3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:42.926406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:42.929095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:42.947279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:42.948277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:42.948938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:42.950075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:42.951287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:42.952301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:43.184646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:10:43.185198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:10:43.185935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:10:43.186530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:10:43.187444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:10:43.193119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:43.202773 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c8df16d-df23-4910-9da5-212051adabbe tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1508 microversion: 2.1 time: 0.286265 Aug 06 21:10:43.208515 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1992/3871] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:42 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:43.209527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:43.210264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:43.211078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:43.212710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:43.213511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:43.214217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:43.215534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:43.216417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:43.235573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:43.236734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:43.237073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:43.238812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:43.239317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:43.239756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:43.255682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for project f4980bb21b59412ca004d8069525d3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:10:43.275049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for user 1d7b9e27983940dcaf0e92f62273c588 and project f4980bb21b59412ca004d8069525d3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:10:43.307016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:10:43.309974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:10:43.369901 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-37963cf0-6c4b-410c-8944-7fbe5cc34faf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.401662 Aug 06 21:10:43.371528 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1880/3872] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:10:43.377536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:43.378483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:43.385484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:43.386297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:43.386939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:43.388571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:43.388909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:43.389357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:43.471681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:43.480319 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ae379b9a-1a82-483f-8338-cb952a8a8be1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1317 microversion: 2.1 time: 0.270810 Aug 06 21:10:43.480903 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1993/3873] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:43 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:43.490950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-13cbce46-798c-4936-a45c-bf9cdb741ac4 req-2d7cfd44-bc18-481a-a186-7d4d788bee29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c21ba021-9868-4b25-af32-7e2f42daeae1", "tag": "be8af179-3434-483d-a4a7-ce280a7f2c69"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:43.497448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-13cbce46-798c-4936-a45c-bf9cdb741ac4 req-2d7cfd44-bc18-481a-a186-7d4d788bee29 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:43.497930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-13cbce46-798c-4936-a45c-bf9cdb741ac4 req-2d7cfd44-bc18-481a-a186-7d4d788bee29 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:43.498371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-13cbce46-798c-4936-a45c-bf9cdb741ac4 req-2d7cfd44-bc18-481a-a186-7d4d788bee29 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:43.522631 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-13cbce46-798c-4936-a45c-bf9cdb741ac4 req-2d7cfd44-bc18-481a-a186-7d4d788bee29 service nova] Creating event network-changed:be8af179-3434-483d-a4a7-ce280a7f2c69 for instance c21ba021-9868-4b25-af32-7e2f42daeae1 on nch1-master-1 Aug 06 21:10:43.527880 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-13cbce46-798c-4936-a45c-bf9cdb741ac4 req-2d7cfd44-bc18-481a-a186-7d4d788bee29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045752 Aug 06 21:10:43.528701 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1994/3874] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:43.535266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1721280908", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "06d8f588-17a3-4f40-a6f5-12622024e0eb"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:43.611292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] validate_networks() for [('06d8f588-17a3-4f40-a6f5-12622024e0eb', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:10:43.617068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:43.631521 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4c080af8-00e0-435c-8326-ca48e52a7e56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1314 microversion: 2.1 time: 0.256414 Aug 06 21:10:43.634113 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1881/3875] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:43 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:43.654619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cdf2e0f1-c62c-4328-96a8-fe477519c121 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:43.659717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cdf2e0f1-c62c-4328-96a8-fe477519c121 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:43.762484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cdf2e0f1-c62c-4328-96a8-fe477519c121 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:43.777905 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cdf2e0f1-c62c-4328-96a8-fe477519c121 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1242 microversion: 2.1 time: 0.142018 Aug 06 21:10:43.778732 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1882/3876] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:43 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1242 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:43.845441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:44.210558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:10:44.210999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:10:44.211486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:10:44.211899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:10:44.212329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:10:44.223913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:44.224544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:44.230090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:44.235107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:44.235933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:44.236770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:44.236918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:44.237349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:44.237957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:44.238613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:44.240163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:44.241202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:44.242313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:44.244054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:44.284774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Getting quotas for project 734f4706c86040eba82cde45971d4c5b. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:10:44.299962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Getting quotas for user 17004e771b6a47cb88e8aa31e197b25a and project 734f4706c86040eba82cde45971d4c5b. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:10:44.320542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Going to run 2 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:10:44.324855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 7893f5e0-4430-4899-bb0c-08ffe805d1f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:10:44.370934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=7893f5e0-4430-4899-bb0c-08ffe805d1f9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:10:44.510471 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d0cf9814-275a-4753-b7c3-7171cf7982cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.980553 Aug 06 21:10:44.514451 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1995/3877] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:10:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 06 21:10:44.529990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:44.531742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:44.548927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:44.549468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:44.549902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:44.550638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:44.555503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:44.556169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:44.810463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:44.834283 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-39d37023-789b-46bb-b80e-f7dcaa84ccd6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1317 microversion: 2.1 time: 0.317652 Aug 06 21:10:44.835003 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1996/3878] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:44 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:44.852700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:44.862430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:44.871214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Searching by: {'deleted': False, 'project_id': '734f4706c86040eba82cde45971d4c5b'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:10:44.917362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:44.922531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:44.924325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:44.925574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:44.936251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:44.940134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:44.999957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:10:45.045657 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9441b9fb-3f77-469a-8303-5041748d0104 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.196786 Aug 06 21:10:45.047155 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1997/3879] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:10:44 2022] GET /compute/v2.1/servers => generated 1335 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:45.064634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:45.066855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:45.079086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:45.080401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:45.080998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:45.082144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:45.083166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:45.083788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:45.396637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:45.405411 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5d859ae1-bd49-4a0b-a5d3-65a1a52268cf tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1314 microversion: 2.1 time: 0.356939 Aug 06 21:10:45.423489 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1998/3880] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:45 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:45.431942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:45.433272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:45.453348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:45.456154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:45.456879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:45.457631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:45.457631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:45.457631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:45.569170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:45.583217 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ba722c8-45c5-4ffe-b02c-dce730acf994 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1300 microversion: 2.1 time: 0.157454 Aug 06 21:10:45.583925 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 1999/3881] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:45 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1300 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:45.603706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-acde6e30-1d1c-475b-b6ef-cc3e48cf82cb tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:45.606044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-acde6e30-1d1c-475b-b6ef-cc3e48cf82cb tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:45.611290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:45.621608 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f554043b-d09b-42b7-b84b-1ebe5285b1d9 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1508 microversion: 2.1 time: 1.401549 Aug 06 21:10:45.622209 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1883/3882] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:44 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1508 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:45.708322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-acde6e30-1d1c-475b-b6ef-cc3e48cf82cb tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:45.716899 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-acde6e30-1d1c-475b-b6ef-cc3e48cf82cb tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1218 microversion: 2.1 time: 0.131602 Aug 06 21:10:45.718235 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2000/3883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:45 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:45.858372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:45.859561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:45.867830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:45.868306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:45.872710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:45.876746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:45.877225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:45.877675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:46.429864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:46.430814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:46.446052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:46.451552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:46.451970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:46.452767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:46.453426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:46.453852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:46.605203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:46.617074 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e49184aa-66c3-4c61-a98e-5ee9908e0d8a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1317 microversion: 2.1 time: 0.759798 Aug 06 21:10:46.617725 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1884/3884] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:45 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:46.631172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:46.632154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:46.645819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:46.646392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:46.646982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:46.647769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:46.650346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:46.651001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:46.927024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:46.936599 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-811ebe00-28e6-466b-9b5d-eb5c1123fe19 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1314 microversion: 2.1 time: 0.511364 Aug 06 21:10:46.955452 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2001/3885] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:46 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:46.970314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:46.971658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:46.976206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:46.992580 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2c375142-ed27-4e81-b5ac-83968106d536 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1300 microversion: 2.1 time: 0.373060 Aug 06 21:10:46.993479 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1885/3886] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:46 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1300 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:47.004257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:47.004771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:47.005445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:47.007427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:47.007662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:47.008560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:47.009037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:47.009478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:47.019577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:47.031036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:47.031928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:47.032522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:47.033451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:47.034291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:47.034901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:47.355607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:47.361901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:47.375990 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fc43ac67-5e75-4b07-afb0-23b1e303f13c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1278 microversion: 2.1 time: 0.381225 Aug 06 21:10:47.378408 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1886/3887] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:46 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1278 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:47.386457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-11d0b209-f76c-4409-9db6-e9b14f324830 req-c463397d-628d-41f9-aeb2-4bc4bff6201b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c07563-85cb-4502-80cb-4bf2682f112c", "name": "network-vif-plugged", "status": "completed", "tag": "cb6f9757-aeac-4c34-87dd-34ec08ddffbd"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:47.402632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:47.405318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-11d0b209-f76c-4409-9db6-e9b14f324830 req-c463397d-628d-41f9-aeb2-4bc4bff6201b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:47.406011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-11d0b209-f76c-4409-9db6-e9b14f324830 req-c463397d-628d-41f9-aeb2-4bc4bff6201b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:47.406647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-11d0b209-f76c-4409-9db6-e9b14f324830 req-c463397d-628d-41f9-aeb2-4bc4bff6201b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:47.411965 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ebf2415-765b-4928-9746-4baa9054850e tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1508 microversion: 2.1 time: 0.454922 Aug 06 21:10:47.426420 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-11d0b209-f76c-4409-9db6-e9b14f324830 req-c463397d-628d-41f9-aeb2-4bc4bff6201b service nova] Creating event network-vif-plugged:cb6f9757-aeac-4c34-87dd-34ec08ddffbd for instance 21c07563-85cb-4502-80cb-4bf2682f112c on nch2-master-1 Aug 06 21:10:47.428798 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2002/3888] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:46 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1508 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:47.431838 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-11d0b209-f76c-4409-9db6-e9b14f324830 req-c463397d-628d-41f9-aeb2-4bc4bff6201b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051941 Aug 06 21:10:47.432614 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1887/3889] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:47.646498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:47.647326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:47.664864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:47.665360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:47.665808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:47.666534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:47.667016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:47.667440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:47.965624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:47.967108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:47.975503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:47.976346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:47.976988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:47.978685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:47.980366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:47.981022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:48.191822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:48.196846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:48.210704 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e4209c5-40cc-4a48-a9ba-82729d6cc85f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1317 microversion: 2.1 time: 0.568802 Aug 06 21:10:48.211319 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2003/3890] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:47 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:48.240200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:48.250746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:48.263687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:48.271133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:48.271599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:48.272350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:48.272816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:48.273252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:48.659795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:48.671760 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-72b6bf13-35f1-4808-a7dc-2d8160ce1bd7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1300 microversion: 2.1 time: 0.454050 Aug 06 21:10:48.673353 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2004/3891] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:48 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1300 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:48.674072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:48.680974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-4e4b21d4-a88c-483f-af05-21cd8b12ce40 req-af99b60a-b525-4211-8cc8-862470a5169f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0cb283-0fd8-454f-ab21-2782368daeb3", "name": "network-vif-deleted", "tag": "f7f1d6c0-f2c0-453a-b1f2-94ac37f7df2e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:48.682506 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f2bfa4ec-a104-4583-9c54-89f8f21f122e tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1314 microversion: 2.1 time: 0.722666 Aug 06 21:10:48.687047 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1888/3892] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:47 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:48.697719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:48.698370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:48.705606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4e4b21d4-a88c-483f-af05-21cd8b12ce40 req-af99b60a-b525-4211-8cc8-862470a5169f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:48.710111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4e4b21d4-a88c-483f-af05-21cd8b12ce40 req-af99b60a-b525-4211-8cc8-862470a5169f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:48.710788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4e4b21d4-a88c-483f-af05-21cd8b12ce40 req-af99b60a-b525-4211-8cc8-862470a5169f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:48.711929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:48.714594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:48.715448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:48.716202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:48.717351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:48.719758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:48.745501 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-4e4b21d4-a88c-483f-af05-21cd8b12ce40 req-af99b60a-b525-4211-8cc8-862470a5169f service nova] Creating event network-vif-deleted:f7f1d6c0-f2c0-453a-b1f2-94ac37f7df2e for instance fa0cb283-0fd8-454f-ab21-2782368daeb3 on nch1-master-1 Aug 06 21:10:48.752587 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-4e4b21d4-a88c-483f-af05-21cd8b12ce40 req-af99b60a-b525-4211-8cc8-862470a5169f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077075 Aug 06 21:10:48.755965 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2005/3893] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:48.764569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:48.765495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:48.837675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:48.839163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:48.845648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:48.850507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:48.851943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:48.852861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:48.918099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:48.937799 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-522a5f4c-3fd2-4338-a6e8-fc7a93aed8ef tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1276 microversion: 2.1 time: 0.245652 Aug 06 21:10:48.952301 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1889/3894] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:48 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:49.237558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:49.241709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:49.252733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:49.253457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:49.254042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:49.255053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:49.256441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:49.256888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:49.388823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:49.408627 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a1005467-4e8e-42b2-8af6-d923f37a4cce tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 200 len: 1508 microversion: 2.1 time: 0.647841 Aug 06 21:10:49.409292 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2006/3895] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:48 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 1508 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:49.701547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:49.705013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:49.724294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:49.729523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:49.731345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:49.733150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:49.735510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:49.736497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:50.135689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:50.160885 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8b4b870-09d2-4fd0-856c-71e07218e371 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1317 microversion: 2.1 time: 0.928123 Aug 06 21:10:50.165260 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1890/3896] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:49 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1317 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:50.215251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:50.223426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:50.243531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:50.244164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:50.249674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:50.256629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:50.263319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:50.264985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:50.739631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:50.759035 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-826a19d4-7838-478f-9c27-0fc541a2b03b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1300 microversion: 2.1 time: 1.065217 Aug 06 21:10:50.759625 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2007/3897] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:49 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1300 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:50.771055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:50.775433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:50.779822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:50.785587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:50.791772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:50.791772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:50.791772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:50.791772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:50.791772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:50.966514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:50.987582 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-db1a2710-2cd7-4d27-9a80-355b6fdd96ea tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1502 microversion: 2.1 time: 0.820752 Aug 06 21:10:50.988219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:50.990855 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1891/3898] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:50 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1502 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:50.995672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:51.000336 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ea7b32a1-bb91-487c-bde1-8c92122fa1ae tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1276 microversion: 2.1 time: 0.237793 Aug 06 21:10:51.002095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 16b66ce3-9ebf-4346-93e9-39e370d165ba] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:51.012827 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2008/3899] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:50 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1276 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:51.015484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.022867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0c824817-dde1-41a7-9ef1-5f1835335fd3 req-0dfd4d7a-3d9c-4340-8fbe-06ca9b5634ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b66ce3-9ebf-4346-93e9-39e370d165ba", "name": "network-vif-deleted", "tag": "d1dc8821-1ddb-4099-bc78-ac1cfb6b4170"}, {"server_uuid": "46519ead-c542-4111-b122-bca83ea8d107", "name": "network-vif-deleted", "tag": "b6dd8361-a74a-4626-a70b-1a5a53fd0148"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:51.027376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.028790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.029775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.033441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.034034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.060518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0c824817-dde1-41a7-9ef1-5f1835335fd3 req-0dfd4d7a-3d9c-4340-8fbe-06ca9b5634ae service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.061270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0c824817-dde1-41a7-9ef1-5f1835335fd3 req-0dfd4d7a-3d9c-4340-8fbe-06ca9b5634ae service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.063284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0c824817-dde1-41a7-9ef1-5f1835335fd3 req-0dfd4d7a-3d9c-4340-8fbe-06ca9b5634ae service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.074439 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] HTTP exception thrown: Instance 16b66ce3-9ebf-4346-93e9-39e370d165ba could not be found. Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Request method failure captured: Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba HTTP/1.1 Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tfLEawbHpN6jMURxdzK2EbJF4VOuu9Oa5UpiLUmKBNlhjCkr9kH_MmWQvt1hNGSGmL37UKnTYuWQ1qLqZpSKaucQe-XZMrOo54Rzzy38O3wJqXN2UfBzSzmpVXWUazExIacv2EKUyLKBOIK69QkSvDLfRUnPsiYAPeIlk26rmd3IhA Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8046f1ab9c004060965dced02db4b7c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: f7cf258df10248d0bdcf64fa075c132c Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 16b66ce3-9ebf-4346-93e9-39e370d165ba could not be found. Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '16b66ce3-9ebf-4346-93e9-39e370d165ba'} Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b66ce3-9ebf-4346-93e9-39e370d165ba could not be found. Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b66ce3-9ebf-4346-93e9-39e370d165ba could not be found. Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:51.076717 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:51.080634 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:51.080634 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:51.080634 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:51.080634 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:51.080634 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:10:51.080634 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:10:51.080634 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b66ce3-9ebf-4346-93e9-39e370d165ba could not be found. Aug 06 21:10:51.080634 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:51.086900 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0c824817-dde1-41a7-9ef1-5f1835335fd3 req-0dfd4d7a-3d9c-4340-8fbe-06ca9b5634ae service nova] Creating event network-vif-deleted:d1dc8821-1ddb-4099-bc78-ac1cfb6b4170 for instance 16b66ce3-9ebf-4346-93e9-39e370d165ba on nch2-master-1 Aug 06 21:10:51.087801 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0c824817-dde1-41a7-9ef1-5f1835335fd3 req-0dfd4d7a-3d9c-4340-8fbe-06ca9b5634ae service nova] Creating event network-vif-deleted:b6dd8361-a74a-4626-a70b-1a5a53fd0148 for instance 46519ead-c542-4111-b122-bca83ea8d107 on nch2-master-1 Aug 06 21:10:51.088865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Returning 404 to user: Instance 16b66ce3-9ebf-4346-93e9-39e370d165ba could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:10:51.090876 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-01895853-026e-4a88-8b34-1d665f47af8a tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba" status: 404 len: 111 microversion: 2.1 time: 0.098845 Aug 06 21:10:51.092788 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1892/3900] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:50 2022] GET /compute/v2.1/servers/16b66ce3-9ebf-4346-93e9-39e370d165ba => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:10:51.098306 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0c824817-dde1-41a7-9ef1-5f1835335fd3 req-0dfd4d7a-3d9c-4340-8fbe-06ca9b5634ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078969 Aug 06 21:10:51.099442 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2009/3901] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:51.103972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:51.105597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:51.106302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:51.106648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:51.115769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.116624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.117234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.118124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.118765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.119334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.122303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.127213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.127820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.128671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.133293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.133878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.151279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:10:51.184309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lazy-loading 'flavor' on Instance uuid 21c07563-85cb-4502-80cb-4bf2682f112c {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:10:51.348137 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6d44bda-bdcb-43e3-bcad-6fcf9874cd99 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "POST /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c/action" status: 202 len: 0 microversion: 2.1 time: 0.251704 Aug 06 21:10:51.354528 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1893/3902] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:10:51 2022] POST /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:10:51.371646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:51.373868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:51.375557 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fc2e6a09-d58c-47a9-acb1-0d0be0fc4f59 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "DELETE /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 204 len: 0 microversion: 2.1 time: 0.273183 Aug 06 21:10:51.376401 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2010/3903] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:10:51 2022] DELETE /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:51.388661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:51.391058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:51.392117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.392634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.397295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.398303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.398762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.400859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.406747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.408215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.408880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.411418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.411922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.413932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.800517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:51.818060 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-60a6d398-6343-4207-8bef-ca8f1b2a624f tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1510 microversion: 2.1 time: 0.439973 Aug 06 21:10:51.824920 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2011/3904] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:51 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:51.835944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:51.843740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:51.851177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:51.868824 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dc458bc5-dfe5-4929-b7e2-31727bb6a11b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1317 microversion: 2.1 time: 0.511420 Aug 06 21:10:51.872212 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1894/3905] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:51 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:51.887783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:51.887896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.889720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.890352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.891270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:51.894156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.894774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.895384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.908425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.910128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.912114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:51.913082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:51.915149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:51.916565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:52.159679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:52.169905 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c5b41895-6ca7-42c9-bb13-51d9297b3ede tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.343728 Aug 06 21:10:52.171948 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2012/3906] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:51 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:52.177749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-28ac612a-ee47-470a-aed0-8f6dcc8eeccf req-903aa66e-daed-46a0-b589-9ba2e21df907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21ba021-9868-4b25-af32-7e2f42daeae1", "name": "network-vif-plugged", "status": "completed", "tag": "be8af179-3434-483d-a4a7-ce280a7f2c69"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:52.190311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-28ac612a-ee47-470a-aed0-8f6dcc8eeccf req-903aa66e-daed-46a0-b589-9ba2e21df907 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:52.191444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-28ac612a-ee47-470a-aed0-8f6dcc8eeccf req-903aa66e-daed-46a0-b589-9ba2e21df907 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:52.192109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-28ac612a-ee47-470a-aed0-8f6dcc8eeccf req-903aa66e-daed-46a0-b589-9ba2e21df907 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:52.206681 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-28ac612a-ee47-470a-aed0-8f6dcc8eeccf req-903aa66e-daed-46a0-b589-9ba2e21df907 service nova] Creating event network-vif-plugged:be8af179-3434-483d-a4a7-ce280a7f2c69 for instance c21ba021-9868-4b25-af32-7e2f42daeae1 on nch1-master-1 Aug 06 21:10:52.214519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-28ac612a-ee47-470a-aed0-8f6dcc8eeccf req-903aa66e-daed-46a0-b589-9ba2e21df907 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041005 Aug 06 21:10:52.218334 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2013/3907] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:52.225020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:52.232469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:52.248019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:52.250577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:52.253576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:52.255094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:52.256402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:52.258523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:52.457718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:52.471319 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4069422d-b600-445f-b8ab-2b4fd3d5fd1e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1367 microversion: 2.1 time: 0.594896 Aug 06 21:10:52.472088 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1895/3908] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:51 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1367 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:52.475306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:52.494243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-19a3e6a0-15b5-4cc3-86e4-b453cc10848f req-6ed38697-2cfc-4562-81fa-ceb87c0f3061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7893f5e0-4430-4899-bb0c-08ffe805d1f9", "tag": "fe9636cc-3dcd-4ba7-95c1-de9b82034f93"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:52.495040 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c5f1953-a954-4bed-945f-277431e557a4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1276 microversion: 2.1 time: 0.275042 Aug 06 21:10:52.495631 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2014/3909] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:52 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:52.506365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-19a3e6a0-15b5-4cc3-86e4-b453cc10848f req-6ed38697-2cfc-4562-81fa-ceb87c0f3061 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:52.507525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-19a3e6a0-15b5-4cc3-86e4-b453cc10848f req-6ed38697-2cfc-4562-81fa-ceb87c0f3061 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:52.508172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-19a3e6a0-15b5-4cc3-86e4-b453cc10848f req-6ed38697-2cfc-4562-81fa-ceb87c0f3061 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:52.533107 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-19a3e6a0-15b5-4cc3-86e4-b453cc10848f req-6ed38697-2cfc-4562-81fa-ceb87c0f3061 service nova] Creating event network-changed:fe9636cc-3dcd-4ba7-95c1-de9b82034f93 for instance 7893f5e0-4430-4899-bb0c-08ffe805d1f9 on nch2-master-1 Aug 06 21:10:52.557788 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-19a3e6a0-15b5-4cc3-86e4-b453cc10848f req-6ed38697-2cfc-4562-81fa-ceb87c0f3061 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069835 Aug 06 21:10:52.560492 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1896/3910] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:52.849772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:52.851145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:52.860967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:52.861654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:52.862095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:52.863146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:52.864036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:52.864629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:52.894416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:52.895490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:52.913288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:52.913711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:52.914430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:52.916485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:52.917059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:52.919024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:53.243174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:53.263943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:53.277372 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4f830ebc-5652-41e2-8553-833d058ac02a tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1510 microversion: 2.1 time: 0.431601 Aug 06 21:10:53.282004 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2015/3911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:52 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:53.289194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:53.290150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:53.310888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:53.311837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:53.312377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:53.313018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:53.313624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:53.314201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:53.436445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:53.447754 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8dda9cf4-c9a8-4069-80d5-02c5a56cba56 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1317 microversion: 2.1 time: 0.558910 Aug 06 21:10:53.453814 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1897/3912] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:52 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:53.494919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:53.495555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:53.506510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:53.513225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:53.515296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:53.515296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:53.515920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:53.518355 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1fb473f4-b520-48bb-aae5-531681e0426d tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.234961 Aug 06 21:10:53.526974 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2016/3913] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:53 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:53.527129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:53.527129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:53.527261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:53.527261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:53.536576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:53.537046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:53.537488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:53.545087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:53.545701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:53.546740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:53.746518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:53.758130 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6021643d-7460-4f4a-9b8a-275f3252f0d5 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1318 microversion: 2.1 time: 0.237772 Aug 06 21:10:53.759200 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2017/3914] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:53 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:53.772176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=22 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:53.962032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-4ca8492a-2c66-4377-aeed-12fdf60c10c1 req-6a23d3d0-6ad3-401e-99a7-0b396641cea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd012aa-4178-47e4-81cd-a975a14958df", "tag": "6320632a-4601-4bf8-8044-13763d5b0b11"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:53.970144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:53.989638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4ca8492a-2c66-4377-aeed-12fdf60c10c1 req-6a23d3d0-6ad3-401e-99a7-0b396641cea9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:53.991408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4ca8492a-2c66-4377-aeed-12fdf60c10c1 req-6a23d3d0-6ad3-401e-99a7-0b396641cea9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:53.991896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4ca8492a-2c66-4377-aeed-12fdf60c10c1 req-6a23d3d0-6ad3-401e-99a7-0b396641cea9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:53.995417 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-09c1179e-dd9c-43ae-91a7-33fef425046e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1367 microversion: 2.1 time: 0.505487 Aug 06 21:10:54.006495 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1898/3915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:53 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:10:54.030810 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-4ca8492a-2c66-4377-aeed-12fdf60c10c1 req-6a23d3d0-6ad3-401e-99a7-0b396641cea9 service nova] Creating event network-changed:6320632a-4601-4bf8-8044-13763d5b0b11 for instance 2fd012aa-4178-47e4-81cd-a975a14958df on nch1-master-1 Aug 06 21:10:54.040325 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-4ca8492a-2c66-4377-aeed-12fdf60c10c1 req-6a23d3d0-6ad3-401e-99a7-0b396641cea9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081846 Aug 06 21:10:54.041856 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2018/3916] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:10:54.306693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:54.307501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:54.317363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:54.318748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:54.319346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:54.320472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:54.321234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:54.321815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:54.477402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:54.480210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:54.493944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:54.495107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:54.495745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:54.496767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:54.498364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:54.499833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:54.841601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:54.851930 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21643ef6-d00b-41da-8dc3-116cc4b6b73c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1510 microversion: 2.1 time: 0.554215 Aug 06 21:10:54.854170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:54.855356 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1899/3917] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:54 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1510 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:54.864670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:54.868286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:54.870489 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d76474c0-94d2-49a3-a6f4-35a319df7168 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1508 microversion: 2.1 time: 0.400101 Aug 06 21:10:54.871125 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2019/3918] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:54 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1508 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:54.885764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:54.886264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:54.886785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:54.887544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:54.888005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:54.888439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:54.904045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:54.907249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:54.923700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:54.924315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:54.925439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:54.926363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:54.928138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:54.930259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:54.973116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:55.259759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:55.277425 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-36d0dac8-34df-4cfc-9c2c-512ce071d3ca tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1318 microversion: 2.1 time: 0.382421 Aug 06 21:10:55.278047 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2020/3919] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:54 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:55.290540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:55.293394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:55.327067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:55.328752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:55.331385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:55.335036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:55.335543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:55.335982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:55.376147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:55.617975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:55.630072 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8ad359bc-1f62-4ad9-acec-dded849e9301 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1508 microversion: 2.1 time: 0.350945 Aug 06 21:10:55.630691 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2021/3920] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:55 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:55.655499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:55.656570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:55.668893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:55.673933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:55.674841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:55.675907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:55.684424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:55.684788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:55.715865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:55.771665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:55.785389 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36c100fc-a07b-4c8a-a974-0b8d993e2078 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1521 microversion: 2.1 time: 0.928605 Aug 06 21:10:55.806209 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1900/3921] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:54 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1521 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:55.824388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a61f81e9-38b2-412e-8f16-7c3d28149938 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:55.841675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a61f81e9-38b2-412e-8f16-7c3d28149938 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:55.852621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61f81e9-38b2-412e-8f16-7c3d28149938 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:55.854424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61f81e9-38b2-412e-8f16-7c3d28149938 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:55.855468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61f81e9-38b2-412e-8f16-7c3d28149938 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:55.856457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61f81e9-38b2-412e-8f16-7c3d28149938 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:55.857275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61f81e9-38b2-412e-8f16-7c3d28149938 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:55.858051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61f81e9-38b2-412e-8f16-7c3d28149938 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:55.913274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:55.925925 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f22e8ef4-3837-4b10-b2c2-d446cc90fd3b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1367 microversion: 2.1 time: 0.281732 Aug 06 21:10:55.935029 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2022/3922] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:55 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:55.949249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:55.949684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:55.961697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:55.962524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:55.963125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:55.963767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:55.964620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:55.965227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.007122 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a61f81e9-38b2-412e-8f16-7c3d28149938 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "PUT /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1080 microversion: 2.1 time: 0.197649 Aug 06 21:10:56.009417 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1901/3923] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:10:55 2022] PUT /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1080 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:56.026889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:56.027726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:56.036567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.037420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.038020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.039355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.040692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.041510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.174268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:56.186497 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b8bbdfc-9e78-440c-995e-d7fef06f9658 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1493 microversion: 2.1 time: 0.249870 Aug 06 21:10:56.187994 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2023/3924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:55 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1493 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:56.197975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3e3ca83d-5eb4-456b-ad89-4a422a32105f req-ccc653f5-b8eb-47ee-a308-ee5f3cbdfc35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6e1181-8296-47e9-af66-ec08df260bcf", "tag": "a0d5fad3-7b4e-4bfc-ac8e-5fafe5e0bd3c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:56.216117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3e3ca83d-5eb4-456b-ad89-4a422a32105f req-ccc653f5-b8eb-47ee-a308-ee5f3cbdfc35 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.216669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3e3ca83d-5eb4-456b-ad89-4a422a32105f req-ccc653f5-b8eb-47ee-a308-ee5f3cbdfc35 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.217182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3e3ca83d-5eb4-456b-ad89-4a422a32105f req-ccc653f5-b8eb-47ee-a308-ee5f3cbdfc35 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.231499 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3e3ca83d-5eb4-456b-ad89-4a422a32105f req-ccc653f5-b8eb-47ee-a308-ee5f3cbdfc35 service nova] Creating event network-changed:a0d5fad3-7b4e-4bfc-ac8e-5fafe5e0bd3c for instance 4e6e1181-8296-47e9-af66-ec08df260bcf on nch1-master-1 Aug 06 21:10:56.238079 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3e3ca83d-5eb4-456b-ad89-4a422a32105f req-ccc653f5-b8eb-47ee-a308-ee5f3cbdfc35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047805 Aug 06 21:10:56.239726 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2024/3925] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:56.246510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:56.247689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:56.259690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.260364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.260918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.261693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.262188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.262605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.315645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:10:56.446789 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02541e75-aafa-40c6-b918-d694fc68912d tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 204 len: 0 microversion: 2.1 time: 0.202787 Aug 06 21:10:56.459855 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2025/3926] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:10:56 2022] DELETE /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:10:56.469347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:56.470327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:56.490840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.491518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.492155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:56.492356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.495699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.497502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.498253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.509530 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9524087c-2728-4374-9bcc-f84ecb0e3dba tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1506 microversion: 2.1 time: 0.485182 Aug 06 21:10:56.518999 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1902/3927] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:56 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:56.527735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:56.528725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:56.543800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.544729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.545364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.546864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.547724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.548345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.553735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:10:56.819860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:56.831627 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-30a0c1fe-04a1-461f-84ea-8b0d502e80a0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1318 microversion: 2.1 time: 0.371018 Aug 06 21:10:56.832512 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2026/3928] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:56 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:56.837542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:56.838652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:56.844515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.844993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.845431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:56.846133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:56.846607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:56.847032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.022983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:57.035538 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7742d462-a0f0-494b-ba52-125380385a32 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1499 microversion: 2.1 time: 0.522656 Aug 06 21:10:57.036830 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1903/3929] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:56 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1499 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:57.041556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:57.042373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:57.049718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.050627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.051397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.052265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.052868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.053550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.075247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:57.091840 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-db8e6a11-e03b-4450-a78d-7f9de5a8b53d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1506 microversion: 2.1 time: 0.258253 Aug 06 21:10:57.094982 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2027/3930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:56 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:57.108788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:57.109646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:57.125857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.134260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.135725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.137445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.138032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.138804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.242914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf258df10248d0bdcf64fa075c132c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046f1ab9c004060965dced02db4b7c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:57.288672 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-56b41b47-79a5-44f1-b6b0-76883fdaac9b tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 200 len: 1479 microversion: 2.1 time: 0.250706 Aug 06 21:10:57.292958 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1904/3931] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:57 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 1479 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:57.302216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:57.310257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:57.322257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.323005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.323965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.325540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.326443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.327827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.331897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:57.349177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a1e5bc2-53fd-4111-b360-9dcad9849a6f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1367 microversion: 2.1 time: 0.246646 Aug 06 21:10:57.349851 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2028/3932] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:57 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:57.426530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:10:57.427377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:10:57.428120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:10:57.428822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:10:57.429727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:10:57.528415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:57.535643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.536331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.536892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.537906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.538897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.540235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.625287 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e7d61443-a012-4d53-979a-13bab74259fa tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "POST /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1/action" status: 202 len: 1112 microversion: 2.1 time: 0.329236 Aug 06 21:10:57.626188 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1905/3933] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:10:57 2022] POST /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1/action => generated 1112 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 06 21:10:57.645267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:57.646124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:57.653324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.653880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.654467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.655803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.656287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.656728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.853241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:57.853924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:57.863291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.864953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.865415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.866145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:57.866632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:57.871226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:57.883735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:57.892753 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6b26a45c-4efe-4151-a588-381c7baa841d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.253149 Aug 06 21:10:57.893843 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2029/3934] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:57 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:58.070158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:58.072061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:58.082130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:58.083391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:58.084098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:58.090916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:58.091607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:58.092309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:58.684531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:58.695439 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7aef6cc-650c-4926-95cb-727ea0a463b4 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1318 microversion: 2.1 time: 0.845608 Aug 06 21:10:58.696056 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1906/3935] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:57 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:58.706938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-dcd744bc-8452-4386-ba88-039aaf2cfb41 req-02a200ed-ba4f-4d82-87ba-edb9bd636092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d43d45-c3b6-44b0-8241-b8ff218d15d4", "name": "network-vif-deleted", "tag": "8ff6ffec-0dff-42e5-a7d2-cacb6354afb1"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:10:58.736546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-dcd744bc-8452-4386-ba88-039aaf2cfb41 req-02a200ed-ba4f-4d82-87ba-edb9bd636092 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:58.736546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-dcd744bc-8452-4386-ba88-039aaf2cfb41 req-02a200ed-ba4f-4d82-87ba-edb9bd636092 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:58.736546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-dcd744bc-8452-4386-ba88-039aaf2cfb41 req-02a200ed-ba4f-4d82-87ba-edb9bd636092 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:58.757470 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-dcd744bc-8452-4386-ba88-039aaf2cfb41 req-02a200ed-ba4f-4d82-87ba-edb9bd636092 service nova] Creating event network-vif-deleted:8ff6ffec-0dff-42e5-a7d2-cacb6354afb1 for instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 on nch2-master-1 Aug 06 21:10:58.770640 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-dcd744bc-8452-4386-ba88-039aaf2cfb41 req-02a200ed-ba4f-4d82-87ba-edb9bd636092 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073139 Aug 06 21:10:58.771281 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1907/3936] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:10:58.776752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:58.777510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] [instance: 13d43d45-c3b6-44b0-8241-b8ff218d15d4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:58.792277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:58.792770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:58.805413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:58.806432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:58.807097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:58.807705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:58.832421 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] HTTP exception thrown: Instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 could not be found. Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Request method failure captured: Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 HTTP/1.1 Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tfLEawbHpN6jMURxdzK2EbJF4VOuu9Oa5UpiLUmKBNlhjCkr9kH_MmWQvt1hNGSGmL37UKnTYuWQ1qLqZpSKaucQe-XZMrOo54Rzzy38O3wJqXN2UfBzSzmpVXWUazExIacv2EKUyLKBOIK69QkSvDLfRUnPsiYAPeIlk26rmd3IhA Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8046f1ab9c004060965dced02db4b7c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8046f1ab9c004060965dced02db4b7c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 8046f1ab9c004060965dced02db4b7c4 Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1101172257 Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: f7cf258df10248d0bdcf64fa075c132c Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1101172257-project Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 could not be found. Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '13d43d45-c3b6-44b0-8241-b8ff218d15d4'} Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 could not be found. Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 could not be found. Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:58.834120 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 could not be found. Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] Returning 404 to user: Instance 13d43d45-c3b6-44b0-8241-b8ff218d15d4 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c953f1cf-327b-4bf0-a601-af324250b753 tempest-ServerRescueNegativeTestJSON-1101172257 tempest-ServerRescueNegativeTestJSON-1101172257-project] 10.222.0.33 "GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4" status: 404 len: 111 microversion: 2.1 time: 0.063211 Aug 06 21:10:58.837596 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1908/3937] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:58 2022] GET /compute/v2.1/servers/13d43d45-c3b6-44b0-8241-b8ff218d15d4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:10:58.853671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:58.854304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:58.869891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:58.874474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:58.874964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:58.882647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:58.883256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:58.883719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:59.134744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:59.148602 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d7f8b155-8f6d-4d9f-bbc4-e4df5ea3de33 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1499 microversion: 2.1 time: 1.089367 Aug 06 21:10:59.153805 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2030/3938] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:58 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1499 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:59.164038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:59.164955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:59.185670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:59.186759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:59.187420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:59.188387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:59.189056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:59.189694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:59.688067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:59.703106 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-946c09fe-27ed-4bd8-ae92-e724b088a619 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.546655 Aug 06 21:10:59.714637 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2031/3939] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:59 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:10:59.734253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:10:59.735060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:10:59.744723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:59.747136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:59.747664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:59.750335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:10:59.751934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:10:59.752503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:10:59.815587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:10:59.831578 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-af7e93d5-9560-4714-85e3-c6b7aa5b0bf2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1367 microversion: 2.1 time: 0.994303 Aug 06 21:10:59.836133 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1909/3940] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:58 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1367 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:00.185951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:00.187516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:00.211698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:00.216688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:00.219147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:00.223376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:00.225517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:00.231201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:00.344174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:00.344333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:00.344933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:00.345696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lazy-loading 'fault' on Instance uuid 21c07563-85cb-4502-80cb-4bf2682f112c {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:11:00.416643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf1b5180a814cf39234892c6c1f26df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2ae1b1c16d4dedb2585dde7dab8113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:00.425381 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e54c6d3-cf78-496c-8f87-2d12dd46c1cb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 200 len: 1304 microversion: 2.1 time: 0.244476 Aug 06 21:11:00.440047 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1910/3941] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:00 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:00.440047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-18739001-b12d-47e9-af57-5d263a9726cf req-cf80f928-27b9-450c-8375-1fd5ac6e04f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd012aa-4178-47e4-81cd-a975a14958df", "name": "network-vif-plugged", "status": "completed", "tag": "6320632a-4601-4bf8-8044-13763d5b0b11"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:00.458393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-18739001-b12d-47e9-af57-5d263a9726cf req-cf80f928-27b9-450c-8375-1fd5ac6e04f9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:00.461223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-18739001-b12d-47e9-af57-5d263a9726cf req-cf80f928-27b9-450c-8375-1fd5ac6e04f9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:00.461680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-18739001-b12d-47e9-af57-5d263a9726cf req-cf80f928-27b9-450c-8375-1fd5ac6e04f9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:00.480650 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-18739001-b12d-47e9-af57-5d263a9726cf req-cf80f928-27b9-450c-8375-1fd5ac6e04f9 service nova] Creating event network-vif-plugged:6320632a-4601-4bf8-8044-13763d5b0b11 for instance 2fd012aa-4178-47e4-81cd-a975a14958df on nch1-master-1 Aug 06 21:11:00.486534 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-18739001-b12d-47e9-af57-5d263a9726cf req-cf80f928-27b9-450c-8375-1fd5ac6e04f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058935 Aug 06 21:11:00.487458 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1911/3942] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:00.731711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:00.732427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:00.744919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:00.745364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:00.745811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:00.746592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:00.747060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:00.747488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:00.767388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:00.775730 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7169ab1f-0f24-4b94-a3ba-20a1e998fdb1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1318 microversion: 2.1 time: 1.046259 Aug 06 21:11:00.781329 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2032/3943] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:10:59 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1318 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:00.818283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5db541dc-0ee4-4009-83f8-f8fd59667d1d req-af7b8b39-6bce-4163-bd88-d686920e619f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c07563-85cb-4502-80cb-4bf2682f112c", "name": "network-vif-deleted", "tag": "cb6f9757-aeac-4c34-87dd-34ec08ddffbd"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:00.839107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5db541dc-0ee4-4009-83f8-f8fd59667d1d req-af7b8b39-6bce-4163-bd88-d686920e619f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:00.839610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5db541dc-0ee4-4009-83f8-f8fd59667d1d req-af7b8b39-6bce-4163-bd88-d686920e619f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:00.840050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5db541dc-0ee4-4009-83f8-f8fd59667d1d req-af7b8b39-6bce-4163-bd88-d686920e619f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:00.871996 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5db541dc-0ee4-4009-83f8-f8fd59667d1d req-af7b8b39-6bce-4163-bd88-d686920e619f service nova] Creating event network-vif-deleted:cb6f9757-aeac-4c34-87dd-34ec08ddffbd for instance 21c07563-85cb-4502-80cb-4bf2682f112c on nch2-master-1 Aug 06 21:11:00.888499 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5db541dc-0ee4-4009-83f8-f8fd59667d1d req-af7b8b39-6bce-4163-bd88-d686920e619f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074149 Aug 06 21:11:00.889128 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2033/3944] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:00.905064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:00.906093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:00.916160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:00.922001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:00.923770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:00.925363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:00.925988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:00.926676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.058799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:01.066503 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4b5d74df-87fe-459f-9bd5-27f46fb57f61 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.339082 Aug 06 21:11:01.079700 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1912/3945] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:00 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:01.177424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:01.186796 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-63d2844c-0fd5-4230-bf08-28c4542ac787 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1367 microversion: 2.1 time: 0.295854 Aug 06 21:11:01.198573 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2034/3946] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:00 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:01.458243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:01.459099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:01.481071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.481629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.482262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.483278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.484381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.484834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.533327 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c HTTP/1.1 Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '21c07563-85cb-4502-80cb-4bf2682f112c'} Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.539602 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.543468 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.543468 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.543468 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.543468 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:01.543468 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:01.543468 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.543468 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.544290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:01.546214 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9827dc5d-8d93-4d71-b9b4-ffe0e5557fd2 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 404 len: 111 microversion: 2.1 time: 0.094902 Aug 06 21:11:01.547865 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1913/3947] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:01 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:01.560964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:01.561668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:01.571743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.572246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.572736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.573716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.574325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.574926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.634026 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c HTTP/1.1 Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '21c07563-85cb-4502-80cb-4bf2682f112c'} Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:01.643449 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.647997 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.651566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:01.652944 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-297e951a-0bba-4158-857d-6ec208089759 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 404 len: 111 microversion: 2.1 time: 0.096574 Aug 06 21:11:01.657745 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2035/3948] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:01 2022] DELETE /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:01.671136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:01.672101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 21c07563-85cb-4502-80cb-4bf2682f112c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:01.697586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.699982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.700521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.702627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.703196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.703942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.736012 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c HTTP/1.1 Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '21c07563-85cb-4502-80cb-4bf2682f112c'} Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.739456 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.742780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.742780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.742780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.742780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:01.742780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:01.742780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. Aug 06 21:11:01.742780 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.742780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 21c07563-85cb-4502-80cb-4bf2682f112c could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:01.743640 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cbefd094-6f1a-447f-a7fe-abe7cbb438a3 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c" status: 404 len: 111 microversion: 2.1 time: 0.084932 Aug 06 21:11:01.759719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:01.760974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:01.763465 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1914/3949] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:01 2022] GET /compute/v2.1/servers/21c07563-85cb-4502-80cb-4bf2682f112c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:11:01.768854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.769961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.770712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.771731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.773177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.773929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.794136 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.806291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:01.807482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:01.817365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.819008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.821270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.822249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.822983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.823645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 HTTP/1.1 Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'b0911c35-ac57-4dd9-b4fb-c7667583a653'} Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:01.827992 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.831391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:01.837136 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-13e80360-71d9-4911-8ada-a27a73bb3beb tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 404 len: 111 microversion: 2.1 time: 0.084170 Aug 06 21:11:01.839774 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2036/3950] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:01 2022] DELETE /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:01.854649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:01.856370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: b0911c35-ac57-4dd9-b4fb-c7667583a653] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:01.876647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.877373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.879914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.880801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.881166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.881599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.899826 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 HTTP/1.1 Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'b0911c35-ac57-4dd9-b4fb-c7667583a653'} Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:01.901556 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.906273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:01.906273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:01.906273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:01.906273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:01.906273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:01.906273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. Aug 06 21:11:01.906273 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:01.916673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance b0911c35-ac57-4dd9-b4fb-c7667583a653 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:01.922668 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2b53afb6-6be1-4483-822c-346f2befdab7 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653" status: 404 len: 111 microversion: 2.1 time: 0.077609 Aug 06 21:11:01.925219 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2037/3951] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:01 2022] GET /compute/v2.1/servers/b0911c35-ac57-4dd9-b4fb-c7667583a653 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:11:01.933458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:01.935333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:01.959155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.962214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.963053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:01.969434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:01.970294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:01.972471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.010367 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f HTTP/1.1 Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '51422ace-16be-4c73-a47b-fef4706c040f'} Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:02.012277 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.015933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:02.017482 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-225252e1-84a9-4064-8a7f-df591324c1fe tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 404 len: 111 microversion: 2.1 time: 0.087396 Aug 06 21:11:02.019584 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2038/3952] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:01 2022] DELETE /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:02.032435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:02.033078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 51422ace-16be-4c73-a47b-fef4706c040f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:02.049729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.050240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.051728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.052506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.052985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.053422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.095190 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f HTTP/1.1 Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '51422ace-16be-4c73-a47b-fef4706c040f'} Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.096765 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.100731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.100731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.100731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.100731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:02.100731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:02.100731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. Aug 06 21:11:02.100731 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.100731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 51422ace-16be-4c73-a47b-fef4706c040f could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:02.100731 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1cadd45-ff79-4b45-90eb-3c1d574969e0 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f" status: 404 len: 111 microversion: 2.1 time: 0.074519 Aug 06 21:11:02.108739 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2039/3953] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:02 2022] GET /compute/v2.1/servers/51422ace-16be-4c73-a47b-fef4706c040f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:02.117957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:02.120889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:02.136241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.138524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.140822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.142572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.144180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.144776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.408013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:02.418309 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3ebe64a0-02c9-4238-9080-0476f6ee1bc4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.305725 Aug 06 21:11:02.438030 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2040/3954] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:02 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:02.443935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:02.444694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:02.455933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.459852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:02.461866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.463158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.465140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.465876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.466523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.474212 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-599e06e2-2061-4aff-bf64-081a12cf151c tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1318 microversion: 2.1 time: 0.674927 Aug 06 21:11:02.476608 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1915/3955] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:01 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:11:02.489797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:02.490887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:02.506157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.509622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:02.509874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.510503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.512567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.513043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.515525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.517528 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb HTTP/1.1 Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'e56ce1b1-ff27-4907-bc44-ccdc01f940bb'} Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:02.524349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.528683 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.533531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:02.535362 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-41bf4768-375a-4c3c-a626-7ab21c469e34 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 404 len: 111 microversion: 2.1 time: 0.095944 Aug 06 21:11:02.536791 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2041/3956] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:02 2022] DELETE /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:02.544119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7c6201d6-2ac4-49d4-b395-166ed5d6c633 req-7e871a7a-d874-4050-be16-919c7014479b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7893f5e0-4430-4899-bb0c-08ffe805d1f9", "name": "network-vif-plugged", "status": "completed", "tag": "fe9636cc-3dcd-4ba7-95c1-de9b82034f93"}, {"server_uuid": "4e6e1181-8296-47e9-af66-ec08df260bcf", "name": "network-vif-plugged", "status": "completed", "tag": "a0d5fad3-7b4e-4bfc-ac8e-5fafe5e0bd3c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:02.556478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7c6201d6-2ac4-49d4-b395-166ed5d6c633 req-7e871a7a-d874-4050-be16-919c7014479b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.557375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7c6201d6-2ac4-49d4-b395-166ed5d6c633 req-7e871a7a-d874-4050-be16-919c7014479b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.557881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7c6201d6-2ac4-49d4-b395-166ed5d6c633 req-7e871a7a-d874-4050-be16-919c7014479b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.580199 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7c6201d6-2ac4-49d4-b395-166ed5d6c633 req-7e871a7a-d874-4050-be16-919c7014479b service nova] Creating event network-vif-plugged:fe9636cc-3dcd-4ba7-95c1-de9b82034f93 for instance 7893f5e0-4430-4899-bb0c-08ffe805d1f9 on nch2-master-1 Aug 06 21:11:02.581012 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7c6201d6-2ac4-49d4-b395-166ed5d6c633 req-7e871a7a-d874-4050-be16-919c7014479b service nova] Creating event network-vif-plugged:a0d5fad3-7b4e-4bfc-ac8e-5fafe5e0bd3c for instance 4e6e1181-8296-47e9-af66-ec08df260bcf on nch1-master-1 Aug 06 21:11:02.591599 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7c6201d6-2ac4-49d4-b395-166ed5d6c633 req-7e871a7a-d874-4050-be16-919c7014479b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053057 Aug 06 21:11:02.593777 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2042/3957] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:02.630871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:02.633545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: e56ce1b1-ff27-4907-bc44-ccdc01f940bb] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:02.667166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.667705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.668184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.672044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.677948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.678436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.730779 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb HTTP/1.1 Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'e56ce1b1-ff27-4907-bc44-ccdc01f940bb'} Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.732793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.736293 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.736293 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.736293 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.736293 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:02.736293 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:02.736293 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. Aug 06 21:11:02.736293 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.741768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance e56ce1b1-ff27-4907-bc44-ccdc01f940bb could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:02.742919 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5053a710-49b5-4dcd-b409-ea251dea4273 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb" status: 404 len: 111 microversion: 2.1 time: 0.131008 Aug 06 21:11:02.745841 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2043/3958] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:02 2022] GET /compute/v2.1/servers/e56ce1b1-ff27-4907-bc44-ccdc01f940bb => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:02.763542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:02.765531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:02.783467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.787498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.788097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.789357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.789968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.790605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.830831 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 HTTP/1.1 Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'a74b595a-db9a-40e0-9a72-2a164c7f5d53'} Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:02.834313 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.837632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:02.838226 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bb626266-11d7-4c77-b88c-7feee028ba50 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 404 len: 111 microversion: 2.1 time: 0.085527 Aug 06 21:11:02.839135 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2044/3959] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:02 2022] DELETE /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:02.848020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:02.849293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: a74b595a-db9a-40e0-9a72-2a164c7f5d53] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:02.858344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.859237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.859963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.860844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:02.861467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:02.862091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:02.898213 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 HTTP/1.1 Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'a74b595a-db9a-40e0-9a72-2a164c7f5d53'} Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:02.901993 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.905745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:02.905745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:02.905745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:02.905745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:02.905745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:02.905745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. Aug 06 21:11:02.905745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:02.909031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance a74b595a-db9a-40e0-9a72-2a164c7f5d53 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:02.910105 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7a5b0cdb-3c6b-4ad3-b8c3-635b148f064c tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53" status: 404 len: 111 microversion: 2.1 time: 0.066003 Aug 06 21:11:02.910925 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2045/3960] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:02 2022] GET /compute/v2.1/servers/a74b595a-db9a-40e0-9a72-2a164c7f5d53 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:03.322197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:03.340407 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-62c8abee-5ede-453d-bd1d-0f1ecf13f889 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1557 microversion: 2.1 time: 0.861702 Aug 06 21:11:03.342036 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1916/3961] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:02 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1557 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:03.365587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a095f24a-072a-4c1b-b622-edb18d88abc9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:03.366118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a095f24a-072a-4c1b-b622-edb18d88abc9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:03.376620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a095f24a-072a-4c1b-b622-edb18d88abc9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:03.377116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a095f24a-072a-4c1b-b622-edb18d88abc9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:03.377644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a095f24a-072a-4c1b-b622-edb18d88abc9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:03.378508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a095f24a-072a-4c1b-b622-edb18d88abc9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:03.379041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a095f24a-072a-4c1b-b622-edb18d88abc9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:03.389865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a095f24a-072a-4c1b-b622-edb18d88abc9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:03.443958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:03.444610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:03.459427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:03.459932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:03.473473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:03.474431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:03.480605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:03.481106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:03.676291 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a095f24a-072a-4c1b-b622-edb18d88abc9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.315658 Aug 06 21:11:03.685799 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2046/3962] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:11:03 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-interface => generated 284 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:11:03.691853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:03.692767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:03.712420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:03.720298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:03.722431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:03.728256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:03.729233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:03.730759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:03.877336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:03.888809 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-25f60cda-8189-4809-b394-d1be5f70f1b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.449125 Aug 06 21:11:03.891075 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1917/3963] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:03 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:04.160173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:04.161031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:04.169760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.171386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.172593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:04.178460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.179935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.180694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:04.221888 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 HTTP/1.1 Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '095c55d4-3b38-45e1-926a-bbbe858afa81'} Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:04.232111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.236779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.238309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:04.239282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:04.239839 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7ca6b39d-2e56-4c8d-bcff-f317887f0d61 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 404 len: 111 microversion: 2.1 time: 0.084450 Aug 06 21:11:04.240860 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1918/3964] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:04 2022] DELETE /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:04.250384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:04.256020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: 095c55d4-3b38-45e1-926a-bbbe858afa81] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:04.276552 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-edc12069-4e95-4b63-8ac9-efff6cc5064f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1318 microversion: 2.1 time: 0.587425 Aug 06 21:11:04.281399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.282092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.282764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:04.283680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.284280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.284885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:04.288684 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2047/3965] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:03 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:04.304984 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 HTTP/1.1 Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '095c55d4-3b38-45e1-926a-bbbe858afa81'} Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:04.307893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.311965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.311965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:04.311965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:04.311965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:04.311965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:04.311965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. Aug 06 21:11:04.311965 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.315128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance 095c55d4-3b38-45e1-926a-bbbe858afa81 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:04.316454 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c4c77ad-0b21-425d-a632-ba204c4914c5 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81" status: 404 len: 111 microversion: 2.1 time: 0.071790 Aug 06 21:11:04.317462 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1919/3966] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:04 2022] GET /compute/v2.1/servers/095c55d4-3b38-45e1-926a-bbbe858afa81 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:04.329105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:04.329812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:04.343515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.357037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.360191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:04.361471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.365559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.366149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:04.406933 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 HTTP/1.1 Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'c40435db-3fd6-4788-a4ed-e07c44c04191'} Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:04.410687 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2c1a1dda-dd7e-4fc2-a840-47e558ae2d56 tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 404 len: 111 microversion: 2.1 time: 0.090653 Aug 06 21:11:04.415763 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2048/3967] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:04 2022] DELETE /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:04.425224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:04.425912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] [instance: c40435db-3fd6-4788-a4ed-e07c44c04191] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:04.441648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.443107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.443762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:04.445678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.446473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.447092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:04.466224 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] HTTP exception thrown: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Request method failure captured: Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 HTTP/1.1 Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7te3omKCBStU8820kmnJqSGZujCphrjNqTZk0uPR6mYiTRzK9mDAm-LavD5BDgdumc-S_rzBZwfVF2DNNE1RlObuiQE947fgfv8tXHQ8AGB6oalIACHzLoP3pDZfCXvB6XDIozWJkssS0I3r3Ie9AJvAEtHc-xeRx7YxcDmljVr2LjU Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe2ae1b1c16d4dedb2585dde7dab8113", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe2ae1b1c16d4dedb2585dde7dab8113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: fe2ae1b1c16d4dedb2585dde7dab8113 Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1467588605 Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: bdf1b5180a814cf39234892c6c1f26df Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersTestJSON-1467588605-project Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'c40435db-3fd6-4788-a4ed-e07c44c04191'} Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:04.469559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.473354 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:04.473354 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:04.473354 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:04.473354 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:04.473354 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:04.473354 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. Aug 06 21:11:04.473354 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:04.476480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] Returning 404 to user: Instance c40435db-3fd6-4788-a4ed-e07c44c04191 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:04.477631 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b5d42fa9-91ad-442f-82c4-700a931a441b tempest-DeleteServersTestJSON-1467588605 tempest-DeleteServersTestJSON-1467588605-project] 10.222.0.33 "GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191" status: 404 len: 111 microversion: 2.1 time: 0.060705 Aug 06 21:11:04.478933 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1920/3968] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:04 2022] GET /compute/v2.1/servers/c40435db-3fd6-4788-a4ed-e07c44c04191 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:04.916776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:04.917616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:04.930046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.930642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.931220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:04.932237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:04.932756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:04.933367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:05.312997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:05.313828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:05.325749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:05.326163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:05.334587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:05.335777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:05.336278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:05.336731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:05.739960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:05.750739 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d4b8f482-3dae-41a2-be44-aff3b69b71b1 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.842538 Aug 06 21:11:05.755784 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2049/3969] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:04 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:05.827768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:05.840035 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-10ccabf5-e6cd-4324-a483-f2bf62d4ea28 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1507 microversion: 2.1 time: 0.531515 Aug 06 21:11:05.840737 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1921/3970] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:05 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1507 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:05.868786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:05.869528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 7893f5e0-4430-4899-bb0c-08ffe805d1f9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:05.883282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:05.884122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:05.884925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:05.885840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:05.886791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:05.888292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:06.159490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:06.171372 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-00caa3b0-c644-4bef-ad8b-78a2ea0726cf tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9" status: 200 len: 1506 microversion: 2.1 time: 0.305555 Aug 06 21:11:06.172038 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2050/3971] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:05 2022] GET /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:06.196540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:06.197737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 7893f5e0-4430-4899-bb0c-08ffe805d1f9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:06.225071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:06.229052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:06.230825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:06.234237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:06.235659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:06.237597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:06.312583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 7893f5e0-4430-4899-bb0c-08ffe805d1f9] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:11:06.326394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:06.480690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-6361c295-031b-4ff9-b253-22c63f3ec272 req-e8cb0346-f907-4990-b4a8-74ce5ef86380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd012aa-4178-47e4-81cd-a975a14958df", "tag": "6320632a-4601-4bf8-8044-13763d5b0b11"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:06.506680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6361c295-031b-4ff9-b253-22c63f3ec272 req-e8cb0346-f907-4990-b4a8-74ce5ef86380 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:06.513328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6361c295-031b-4ff9-b253-22c63f3ec272 req-e8cb0346-f907-4990-b4a8-74ce5ef86380 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:06.517684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6361c295-031b-4ff9-b253-22c63f3ec272 req-e8cb0346-f907-4990-b4a8-74ce5ef86380 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:06.534444 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0828ee0d-302e-490c-a48f-4f99fc1db6e1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9" status: 204 len: 0 microversion: 2.1 time: 0.343061 Aug 06 21:11:06.536128 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1922/3972] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:06 2022] DELETE /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:11:06.553473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:06.554237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:06.561437 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-6361c295-031b-4ff9-b253-22c63f3ec272 req-e8cb0346-f907-4990-b4a8-74ce5ef86380 service nova] Creating event network-changed:6320632a-4601-4bf8-8044-13763d5b0b11 for instance 2fd012aa-4178-47e4-81cd-a975a14958df on nch1-master-1 Aug 06 21:11:06.573638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:06.573638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:06.573909 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-6361c295-031b-4ff9-b253-22c63f3ec272 req-e8cb0346-f907-4990-b4a8-74ce5ef86380 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098239 Aug 06 21:11:06.574049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:06.577052 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2051/3973] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:11:06.580028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:06.583205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:06.584685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:06.662328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:11:06.778395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:06.779795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:06.792291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:06.797492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:06.799185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:06.806665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:06.810841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:06.812693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:06.814272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:06.848053 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8237494e-03e5-4256-86de-423dd5551672 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 204 len: 0 microversion: 2.1 time: 0.306035 Aug 06 21:11:06.851100 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1923/3974] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:06 2022] DELETE /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:11:06.860443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:06.865006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 7893f5e0-4430-4899-bb0c-08ffe805d1f9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:06.872828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:06.874723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:06.876503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:06.878299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:06.879641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:06.880814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:07.232922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:07.242376 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a6eca56a-ea6a-4d54-9c3f-cb5fdbdec067 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.469383 Aug 06 21:11:07.246171 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2052/3975] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:06 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:07.588879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:07.602970 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-40be92d7-e2ae-438f-9c17-5078f376ac95 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9" status: 200 len: 1512 microversion: 2.1 time: 0.742602 Aug 06 21:11:07.617386 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1924/3976] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:06 2022] GET /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9 => generated 1512 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:08.268837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:08.269492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:08.278181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:08.287549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:08.292542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:08.294205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:08.298038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:08.298898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:08.626929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:08.628669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 7893f5e0-4430-4899-bb0c-08ffe805d1f9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:08.645533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:08.646130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:08.649548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:08.650654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:08.651052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:08.651572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:08.743795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:08.752858 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-39c0ca17-c9bd-4aff-9514-237709751eb0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.489865 Aug 06 21:11:08.769537 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2053/3977] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:08 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:09.774245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:09.775071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:09.789428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:09.790260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:09.791142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:09.792160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:09.797390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:09.811935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:09.857026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:09.886399 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df164e3f-21bd-446a-b5c9-22751823d008 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9" status: 200 len: 1512 microversion: 2.1 time: 1.253704 Aug 06 21:11:09.892865 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1925/3978] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:08 2022] GET /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9 => generated 1512 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:10.030883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:10.040438 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7debc5e2-f244-488a-b810-91aaa08a1d6c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.271165 Aug 06 21:11:10.055422 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2054/3979] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:09 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:10.306522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7b2d8b12-f539-4d9e-b434-e407db43947f req-a9d2cd68-5e82-476c-aa7b-9be44df6659e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7893f5e0-4430-4899-bb0c-08ffe805d1f9", "name": "network-vif-deleted", "tag": "fe9636cc-3dcd-4ba7-95c1-de9b82034f93"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:10.325798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7b2d8b12-f539-4d9e-b434-e407db43947f req-a9d2cd68-5e82-476c-aa7b-9be44df6659e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:10.331171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7b2d8b12-f539-4d9e-b434-e407db43947f req-a9d2cd68-5e82-476c-aa7b-9be44df6659e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:10.345231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7b2d8b12-f539-4d9e-b434-e407db43947f req-a9d2cd68-5e82-476c-aa7b-9be44df6659e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:10.388973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7b2d8b12-f539-4d9e-b434-e407db43947f req-a9d2cd68-5e82-476c-aa7b-9be44df6659e service nova] Creating event network-vif-deleted:fe9636cc-3dcd-4ba7-95c1-de9b82034f93 for instance 7893f5e0-4430-4899-bb0c-08ffe805d1f9 on nch2-master-1 Aug 06 21:11:10.397988 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7b2d8b12-f539-4d9e-b434-e407db43947f req-a9d2cd68-5e82-476c-aa7b-9be44df6659e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094872 Aug 06 21:11:10.399350 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1926/3980] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:10.916726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:10.918066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 7893f5e0-4430-4899-bb0c-08ffe805d1f9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:10.933250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:10.934451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:10.935198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:10.936632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:10.937514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:10.940524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:10.972192 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] HTTP exception thrown: Instance 7893f5e0-4430-4899-bb0c-08ffe805d1f9 could not be found. Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Request method failure captured: Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9 HTTP/1.1 Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7ti070-YzpCP7DSCWGhwd5TtzPMZNhRuCzyvrFgFTjJ7RDx3vYzMvhy4Nxp6yjRWdrD3nMa94My0Vjc2bqkr4MOeGcQrLEQHqCD9qw-JzzZcuwPrPcVQwk4PnUDcoVfxemWj8XkqgmHvVVM-QWQ7BrxLlLZzyGVSBsLqm9Fy8Aii2JE Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 734f4706c86040eba82cde45971d4c5b Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-MultipleCreateTestJSON-258344216 Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/734f4706c86040eba82cde45971d4c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_734f4706c86040eba82cde45971d4c5b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734f4706c86040eba82cde45971d4c5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734f4706c86040eba82cde45971d4c5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-MultipleCreateTestJSON-258344216 Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 734f4706c86040eba82cde45971d4c5b Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-MultipleCreateTestJSON-258344216 Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-MultipleCreateTestJSON-258344216-project Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 17004e771b6a47cb88e8aa31e197b25a Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-MultipleCreateTestJSON-258344216-project Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 7893f5e0-4430-4899-bb0c-08ffe805d1f9 could not be found. Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7893f5e0-4430-4899-bb0c-08ffe805d1f9'} Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7893f5e0-4430-4899-bb0c-08ffe805d1f9 could not be found. Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7893f5e0-4430-4899-bb0c-08ffe805d1f9 could not be found. Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:10.974903 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:10.979863 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:10.979863 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:10.979863 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:10.979863 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:10.979863 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:10.979863 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7893f5e0-4430-4899-bb0c-08ffe805d1f9 could not be found. Aug 06 21:11:10.979863 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:11:10.981931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Returning 404 to user: Instance 7893f5e0-4430-4899-bb0c-08ffe805d1f9 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:10.984037 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-68ba9148-1726-4103-975b-a3b978c9c3d0 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9" status: 404 len: 111 microversion: 2.1 time: 0.073665 Aug 06 21:11:10.995881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:10.997743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:11.002729 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2055/3981] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:10 2022] GET /compute/v2.1/servers/7893f5e0-4430-4899-bb0c-08ffe805d1f9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:11.006065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:11.015044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:11.017693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:11.018625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:11.021577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:11.024231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:11.025412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:11.065997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:11.066753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:11.081378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:11.081889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:11.082356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:11.090235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:11.095682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:11.097792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:11.175042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:11.179547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:11.180120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:11.180686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lazy-loading 'fault' on Instance uuid 4e6e1181-8296-47e9-af66-ec08df260bcf {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:11:11.291401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17004e771b6a47cb88e8aa31e197b25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734f4706c86040eba82cde45971d4c5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:11.316281 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c41bb8d-64e2-469d-9332-a88965b6d6f1 tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 200 len: 1308 microversion: 2.1 time: 0.326687 Aug 06 21:11:11.316890 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1927/3982] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:10 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:11:11.448498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:11.462408 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fd0f2828-f212-41bf-964f-1c3ec9d574a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.401181 Aug 06 21:11:11.465869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2056/3983] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:11 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:11:12.341326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:12.342171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] [instance: 4e6e1181-8296-47e9-af66-ec08df260bcf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:12.351414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:12.352158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:12.352924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:12.353792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:12.354265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:12.354714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:12.370936 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] HTTP exception thrown: Instance 4e6e1181-8296-47e9-af66-ec08df260bcf could not be found. Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Request method failure captured: Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf HTTP/1.1 Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7ti070-YzpCP7DSCWGhwd5TtzPMZNhRuCzyvrFgFTjJ7RDx3vYzMvhy4Nxp6yjRWdrD3nMa94My0Vjc2bqkr4MOeGcQrLEQHqCD9qw-JzzZcuwPrPcVQwk4PnUDcoVfxemWj8XkqgmHvVVM-QWQ7BrxLlLZzyGVSBsLqm9Fy8Aii2JE Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 734f4706c86040eba82cde45971d4c5b Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-MultipleCreateTestJSON-258344216 Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/734f4706c86040eba82cde45971d4c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_734f4706c86040eba82cde45971d4c5b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734f4706c86040eba82cde45971d4c5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/734f4706c86040eba82cde45971d4c5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-MultipleCreateTestJSON-258344216 Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 734f4706c86040eba82cde45971d4c5b Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-MultipleCreateTestJSON-258344216 Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-MultipleCreateTestJSON-258344216-project Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 17004e771b6a47cb88e8aa31e197b25a Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-MultipleCreateTestJSON-258344216-project Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 4e6e1181-8296-47e9-af66-ec08df260bcf could not be found. Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4e6e1181-8296-47e9-af66-ec08df260bcf'} Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e6e1181-8296-47e9-af66-ec08df260bcf could not be found. Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e6e1181-8296-47e9-af66-ec08df260bcf could not be found. Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:11:12.372828 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:12.377125 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:11:12.377125 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:11:12.377125 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:11:12.377125 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:11:12.377125 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:11:12.377125 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e6e1181-8296-47e9-af66-ec08df260bcf could not be found. Aug 06 21:11:12.377125 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:11:12.378532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] Returning 404 to user: Instance 4e6e1181-8296-47e9-af66-ec08df260bcf could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:11:12.379561 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-560afbc0-ff32-4840-9137-072e954ea07f tempest-MultipleCreateTestJSON-258344216 tempest-MultipleCreateTestJSON-258344216-project] 10.222.0.33 "GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf" status: 404 len: 111 microversion: 2.1 time: 0.044733 Aug 06 21:11:12.380608 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1928/3984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:12 2022] GET /compute/v2.1/servers/4e6e1181-8296-47e9-af66-ec08df260bcf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:11:12.484303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:12.484936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:12.493435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:12.497933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:12.499319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:12.501328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:12.503393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:12.504076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:12.542118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-501d33b1-77d6-414b-95b6-e91752d5f50c req-28ea0a0f-6c79-4a5c-804b-7c41312b590b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6e1181-8296-47e9-af66-ec08df260bcf", "name": "network-vif-deleted", "tag": "a0d5fad3-7b4e-4bfc-ac8e-5fafe5e0bd3c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:12.570976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-501d33b1-77d6-414b-95b6-e91752d5f50c req-28ea0a0f-6c79-4a5c-804b-7c41312b590b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:12.575997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-501d33b1-77d6-414b-95b6-e91752d5f50c req-28ea0a0f-6c79-4a5c-804b-7c41312b590b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:12.578176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-501d33b1-77d6-414b-95b6-e91752d5f50c req-28ea0a0f-6c79-4a5c-804b-7c41312b590b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:12.619217 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-501d33b1-77d6-414b-95b6-e91752d5f50c req-28ea0a0f-6c79-4a5c-804b-7c41312b590b service nova] Creating event network-vif-deleted:a0d5fad3-7b4e-4bfc-ac8e-5fafe5e0bd3c for instance 4e6e1181-8296-47e9-af66-ec08df260bcf on nch1-master-1 Aug 06 21:11:12.629906 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-501d33b1-77d6-414b-95b6-e91752d5f50c req-28ea0a0f-6c79-4a5c-804b-7c41312b590b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091213 Aug 06 21:11:12.631650 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1929/3985] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:12.805377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:12.817051 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3422b2c7-e453-41c8-a006-dbc43eea847e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.334679 Aug 06 21:11:12.821216 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2057/3986] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:12 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:13.841092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:13.841958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:13.862497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:13.863109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:13.863605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:13.864524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:13.865417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:13.866149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:14.688953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:14.700395 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-be0fdc35-324d-474c-87ac-b5659d435ad9 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.862271 Aug 06 21:11:14.702243 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1930/3987] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:13 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:15.722435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:15.723256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:15.735760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:15.740681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:15.741373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:15.742328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:15.743113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:15.743576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:16.293359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:16.303836 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6fdc7816-7eed-444f-9424-bfc199c63730 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.585577 Aug 06 21:11:16.305953 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2058/3988] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:15 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:17.326598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:17.327789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:17.345905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:17.346663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:17.347253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:17.348133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:17.348750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:17.349357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:18.729521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:18.740693 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfa49dc6-3a2a-43f1-9a14-6c011ec885e6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 1.417888 Aug 06 21:11:18.768580 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1931/3989] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:17 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:11:19.775799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:19.776755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:19.798073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:19.805994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:19.806528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:19.807314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:19.811366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:19.811940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:20.145199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:20.172419 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf962e92-8fb0-4421-816e-c611169203a8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.400795 Aug 06 21:11:20.188585 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2059/3990] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:19 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:21.197653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:21.198608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:21.212038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:21.212868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:21.213524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:21.215832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:21.216573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:21.217243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:21.700890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1301689217", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "780df2aa-ef0c-4003-99c6-6cc7a7503baa"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:21.839903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] validate_networks() for [('780df2aa-ef0c-4003-99c6-6cc7a7503baa', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:11:21.869730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:21.886103 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-640d9397-809c-4c65-aeb8-117bcbae386e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.692548 Aug 06 21:11:21.887819 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1932/3991] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:21 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:22.936804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:22.943952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:22.974969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:22.976510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:22.977300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:22.982388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:22.983196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:22.983979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:23.253673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:23.266309 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-501ed56f-babc-411c-8824-561a75c3a1f4 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 0.359822 Aug 06 21:11:23.284083 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1933/3992] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:22 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:23.844420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:11:23.845420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:11:23.846253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:11:23.846895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:11:23.847577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:11:23.861046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:23.861907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:23.862626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:23.864281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:23.865011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:23.865693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:23.904242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Getting quotas for project b39a59bd658147feaa89b79ae9ebe3af. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:11:23.912620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Getting quotas for user 23f007a900b143c2ab6521003d025035 and project b39a59bd658147feaa89b79ae9ebe3af. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:11:23.930252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:11:23.933263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:11:24.038243 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ef1443b-529d-496c-8138-1ec639a8aa44 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.540705 Aug 06 21:11:24.064419 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2060/3993] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:11:24.296389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:24.297018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:24.328174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:24.329036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:24.333391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:24.334175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:24.334689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:24.335127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:24.459724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1017629427", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "780df2aa-ef0c-4003-99c6-6cc7a7503baa"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:24.689522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] validate_networks() for [('780df2aa-ef0c-4003-99c6-6cc7a7503baa', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:11:25.433304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:25.459954 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-acbe83b1-532e-47a5-a4af-9b6e9bc34746 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1517 microversion: 2.1 time: 1.168104 Aug 06 21:11:25.476042 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1934/3994] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:24 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1517 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:26.493214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:26.496520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:26.518643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:26.521681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:26.522422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:26.524981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:26.526943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:26.527672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:26.990877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:27.001669 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e0af2bfe-8afe-454e-baec-5cf86d56c360 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1523 microversion: 2.1 time: 0.515980 Aug 06 21:11:27.002604 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1935/3995] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:26 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1523 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:11:27.150731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:11:27.152626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:11:27.153952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:11:27.155036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:11:27.155979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:11:27.190875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:27.192639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:27.194289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:27.195534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:27.196643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:27.197455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:27.229467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Getting quotas for project b39a59bd658147feaa89b79ae9ebe3af. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:11:27.239295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Getting quotas for user 23f007a900b143c2ab6521003d025035 and project b39a59bd658147feaa89b79ae9ebe3af. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:11:27.270802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:11:27.272969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:11:27.376153 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b336708f-35a8-47af-adaa-de7bcc365934 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.920826 Aug 06 21:11:27.387424 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2061/3996] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:11:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:11:27.605596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-645883583", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "451", "networks": [{"uuid": "780df2aa-ef0c-4003-99c6-6cc7a7503baa"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:27.818735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] validate_networks() for [('780df2aa-ef0c-4003-99c6-6cc7a7503baa', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:11:28.026425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:28.027156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:28.044146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:28.045162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:28.045610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:28.046336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:28.046826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:28.047256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:29.030423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:29.044073 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5491a8db-f7bf-44c3-8cc2-412d765e3823 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1523 microversion: 2.1 time: 1.021508 Aug 06 21:11:29.053369 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2062/3997] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:28 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1523 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:29.783141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-93865141", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "728c0cdc-d09d-47ff-b334-9b653d114cfd"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:29.908557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] validate_networks() for [('728c0cdc-d09d-47ff-b334-9b653d114cfd', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:11:30.747090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:11:30.748378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:11:30.748821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:11:30.749367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:11:30.749784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:11:30.770086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:30.770661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:30.771313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:30.772281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:30.772743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:30.773178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:30.793474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Getting quotas for project b39a59bd658147feaa89b79ae9ebe3af. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:11:30.801251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Getting quotas for user 23f007a900b143c2ab6521003d025035 and project b39a59bd658147feaa89b79ae9ebe3af. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:11:30.816408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:11:30.819391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:11:30.918179 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-624bf211-d46d-4e4a-874a-30cffc9e0854 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.318864 Aug 06 21:11:30.925399 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1936/3998] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:11:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:11:30.931814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:30.932685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:30.939917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:30.940660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:30.941451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:30.942395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:30.943081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:30.943714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:31.584689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:11:31.585225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:11:31.585602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:11:31.586017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:11:31.586521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:11:31.601021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:31.601677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:31.612235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:31.615865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:31.616531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:31.616991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:31.692650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Getting quotas for project 227ed263d0044aa39b2bf3390d4c4dc9. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:11:31.710370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Getting quotas for user 2d050e7deab24698b6cb13d7a885606e and project 227ed263d0044aa39b2bf3390d4c4dc9. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:11:31.740100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:11:31.742480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:11:31.835119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:31.837978 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c14f4206-9803-48f8-b9b9-f04c32fe75cc tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.781548 Aug 06 21:11:31.840598 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2063/3999] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 21:11:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2786 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:11:31.851963 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ff6567c4-3441-49a6-b55e-cb3391a359c7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1523 microversion: 2.1 time: 0.924902 Aug 06 21:11:31.854799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:31.855052 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1937/4000] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:30 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1523 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:31.869793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:31.893994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f828782a-669a-4059-888c-70b91de02473 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:31.895368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f828782a-669a-4059-888c-70b91de02473 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:31.902737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:31.905142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:31.905609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:31.906371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:31.906862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:31.907299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:32.189897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f828782a-669a-4059-888c-70b91de02473 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:32.199566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f828782a-669a-4059-888c-70b91de02473 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:32.204139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f828782a-669a-4059-888c-70b91de02473 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:32.212486 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f828782a-669a-4059-888c-70b91de02473 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1260 microversion: 2.26 time: 0.350410 Aug 06 21:11:32.213102 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1938/4001] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:31 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:32.221910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:32.235282 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf916465-4264-4dd6-942e-16947f329714 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1224 microversion: 2.1 time: 0.392340 Aug 06 21:11:32.237987 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2064/4002] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:31 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1224 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:32.855891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-2356ba87-448b-4d72-8072-cca094a94ba0 req-dbda4c1d-b3bf-4ea6-97be-97a49a0b9a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21ba021-9868-4b25-af32-7e2f42daeae1", "name": "network-vif-plugged", "status": "completed", "tag": "be8af179-3434-483d-a4a7-ce280a7f2c69"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:32.881472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:32.882828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:32.891481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2356ba87-448b-4d72-8072-cca094a94ba0 req-dbda4c1d-b3bf-4ea6-97be-97a49a0b9a31 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:32.894201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2356ba87-448b-4d72-8072-cca094a94ba0 req-dbda4c1d-b3bf-4ea6-97be-97a49a0b9a31 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:32.896480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:32.897483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:32.898121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:32.899060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:32.907361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2356ba87-448b-4d72-8072-cca094a94ba0 req-dbda4c1d-b3bf-4ea6-97be-97a49a0b9a31 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:32.908246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:32.911817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:32.920779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:32.945956 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-2356ba87-448b-4d72-8072-cca094a94ba0 req-dbda4c1d-b3bf-4ea6-97be-97a49a0b9a31 service nova] Creating event network-vif-plugged:be8af179-3434-483d-a4a7-ce280a7f2c69 for instance c21ba021-9868-4b25-af32-7e2f42daeae1 on nch1-master-1 Aug 06 21:11:32.966931 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-2356ba87-448b-4d72-8072-cca094a94ba0 req-dbda4c1d-b3bf-4ea6-97be-97a49a0b9a31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111362 Aug 06 21:11:32.968106 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1939/4003] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:33.240087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:33.241026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:33.262741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:33.263387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:33.263958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:33.264798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:33.274196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:33.274778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:33.337898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:33.640133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:33.679400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:33.683704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:33.686934 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4acde122-7173-4042-967b-495b0e3760da tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1256 microversion: 2.26 time: 0.451247 Aug 06 21:11:33.688154 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1940/4004] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:33 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1256 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:33.705862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:33.707485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:33.720886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:33.721428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:33.727676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:33.728580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:33.728989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:33.745662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:33.801300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:33.815439 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dff105e9-8c99-430c-a994-b4a168f9b9a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1523 microversion: 2.1 time: 0.938412 Aug 06 21:11:33.837803 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2065/4005] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:32 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1523 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:34.287060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:34.313612 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4892d5aa-3ab8-4714-ba7f-a2f974939943 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1278 microversion: 2.1 time: 0.623948 Aug 06 21:11:34.314476 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1941/4006] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:33 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1278 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:34.715666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:34.718150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:34.726347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:34.726942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:34.728559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:34.729384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:34.730078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:34.730684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:34.781172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-29afc838-8e7c-4589-a18b-d6a5bf56ba5e req-0d080455-58f0-4830-91c7-6ebbed7d89f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a90fe4-8b15-4d15-b524-16b72c4d9374", "tag": "b1bd8d73-feb8-41c9-a24f-ffd0303bdec4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:34.800420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-29afc838-8e7c-4589-a18b-d6a5bf56ba5e req-0d080455-58f0-4830-91c7-6ebbed7d89f2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:34.801289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-29afc838-8e7c-4589-a18b-d6a5bf56ba5e req-0d080455-58f0-4830-91c7-6ebbed7d89f2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:34.801947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-29afc838-8e7c-4589-a18b-d6a5bf56ba5e req-0d080455-58f0-4830-91c7-6ebbed7d89f2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:34.820971 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-29afc838-8e7c-4589-a18b-d6a5bf56ba5e req-0d080455-58f0-4830-91c7-6ebbed7d89f2 service nova] Creating event network-changed:b1bd8d73-feb8-41c9-a24f-ffd0303bdec4 for instance 09a90fe4-8b15-4d15-b524-16b72c4d9374 on nch2-master-1 Aug 06 21:11:34.828604 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-29afc838-8e7c-4589-a18b-d6a5bf56ba5e req-0d080455-58f0-4830-91c7-6ebbed7d89f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055882 Aug 06 21:11:34.829320 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1942/4007] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:11:34.845543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:34.846318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:34.854960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:34.855478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:34.855935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:34.857607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:34.858434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:34.859465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:34.863700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:34.877608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:34.879618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:34.881214 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-25c99690-3f43-442e-87e5-6416b861b643 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1318 microversion: 2.26 time: 0.170519 Aug 06 21:11:34.882719 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2066/4008] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:34 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:35.339107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:35.340119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:35.347454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:35.348197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:35.348816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:35.349691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:35.350327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:35.350996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:35.455433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:35.467466 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f459732e-4de4-4fae-ab49-7c43d05dea3a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1278 microversion: 2.1 time: 0.132195 Aug 06 21:11:35.474720 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2067/4009] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:35 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:35.754144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3aff10cd-123a-4f8a-9667-bd2505554bd6 req-48279e83-907e-4d7d-acb7-585c823ab757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee1875e-cb91-412f-b21d-437b3cb6537f", "tag": "38b298a0-af38-4c5e-91d7-6a02768b5b5e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:35.779496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3aff10cd-123a-4f8a-9667-bd2505554bd6 req-48279e83-907e-4d7d-acb7-585c823ab757 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:35.780300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3aff10cd-123a-4f8a-9667-bd2505554bd6 req-48279e83-907e-4d7d-acb7-585c823ab757 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:35.780866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3aff10cd-123a-4f8a-9667-bd2505554bd6 req-48279e83-907e-4d7d-acb7-585c823ab757 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:35.815522 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3aff10cd-123a-4f8a-9667-bd2505554bd6 req-48279e83-907e-4d7d-acb7-585c823ab757 service nova] Creating event network-changed:38b298a0-af38-4c5e-91d7-6a02768b5b5e for instance 0ee1875e-cb91-412f-b21d-437b3cb6537f on nch2-master-1 Aug 06 21:11:35.825247 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3aff10cd-123a-4f8a-9667-bd2505554bd6 req-48279e83-907e-4d7d-acb7-585c823ab757 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075582 Aug 06 21:11:35.833288 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2068/4010] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:11:35.910520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:35.911441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:35.928256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:35.938850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:35.939393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:35.940447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:35.941468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:35.942134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:36.111686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:36.124155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:36.130251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:36.131588 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2dad4864-0f30-46c0-a403-b4c16f74ea6d tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1318 microversion: 2.26 time: 0.225945 Aug 06 21:11:36.135674 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2069/4011] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:35 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:36.490477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:36.491143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:36.501331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:36.502818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:36.505084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:36.506659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:36.507438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:36.508266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:36.637355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:36.644819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:36.657414 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aafa123b-1200-4132-8b05-b5c20c0ea21f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1278 microversion: 2.1 time: 0.172308 Aug 06 21:11:36.660113 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ff732ac-c366-47a0-b88f-959c6e285404 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1523 microversion: 2.1 time: 1.821677 Aug 06 21:11:36.661678 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1943/4012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:34 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1523 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:36.662241 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2070/4013] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:36 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:11:37.161615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:37.162688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:37.170335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:37.170861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:37.171304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:37.172255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:37.172866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:37.173532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:37.350875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:37.368430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:37.370824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:37.375598 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d931678c-3961-4e06-a091-a4515e7b730c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1318 microversion: 2.26 time: 0.218052 Aug 06 21:11:37.383660 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1944/4014] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:37 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:37.683724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:37.684703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:37.686626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:37.687363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:37.688219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=9 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:37.695332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:37.695840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:37.696801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:37.698373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:37.698950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:37.699228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:37.699450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:37.699889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:37.700812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:37.701290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:37.701766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:37.702199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:37.956433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:37.969880 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b416bd8-74f8-4931-909c-59899c3fab7e tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1320 microversion: 2.1 time: 0.290861 Aug 06 21:11:37.970770 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2071/4015] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:37 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:38.405534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:38.406678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:38.415502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:38.416203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:38.416814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:38.417814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:38.418827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:38.419545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:38.604739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:38.622370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:38.624904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:38.627791 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fd832ff6-77b7-4eb8-876e-8342cfe7b207 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1318 microversion: 2.26 time: 0.230928 Aug 06 21:11:38.633056 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2072/4016] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:38 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:38.991210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:38.991859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:39.008473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:39.008974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:39.009623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:39.010531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:39.011182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:39.011774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:39.111676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:39.121371 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1f97c2c0-c4fb-4aae-b98e-b77abb5186c2 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1508 microversion: 2.1 time: 1.442267 Aug 06 21:11:39.124603 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1945/4017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:37 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1508 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:39.145906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:39.147178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:39.155611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:39.156516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:39.157774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:39.158807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:39.159275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:39.159710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:39.282310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:39.296515 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9a2f7bb5-896e-4ed7-82cb-5078d0cf0125 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1320 microversion: 2.1 time: 0.309269 Aug 06 21:11:39.297431 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2073/4018] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:38 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1320 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:39.462380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7392d296-c2f6-41a2-8c8d-9585d8d764ef tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:39.463354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7392d296-c2f6-41a2-8c8d-9585d8d764ef tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:39.472417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7392d296-c2f6-41a2-8c8d-9585d8d764ef tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:39.473346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7392d296-c2f6-41a2-8c8d-9585d8d764ef tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:39.474209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7392d296-c2f6-41a2-8c8d-9585d8d764ef tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:39.476230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7392d296-c2f6-41a2-8c8d-9585d8d764ef tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:39.477058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7392d296-c2f6-41a2-8c8d-9585d8d764ef tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:39.477676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7392d296-c2f6-41a2-8c8d-9585d8d764ef tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:39.515567 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7392d296-c2f6-41a2-8c8d-9585d8d764ef tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/ips" status: 200 len: 150 microversion: 2.1 time: 0.059981 Aug 06 21:11:39.518912 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2074/4019] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:11:39 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/ips => generated 150 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:11:39.658486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:39.659222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:39.675349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:39.692024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:39.694163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:39.696628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:39.697677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:39.701607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:39.916647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:39.927135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:39.929458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:39.930787 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9202b954-6a88-4c76-9168-63833383ca77 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1360 microversion: 2.26 time: 0.281287 Aug 06 21:11:39.931493 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2075/4020] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:39 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1360 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:40.110276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:40.134557 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b66d55d6-bb08-4782-a6ee-7d61fab07baf tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 200 len: 1508 microversion: 2.1 time: 0.994071 Aug 06 21:11:40.158872 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1946/4021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:39 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 1508 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:40.161365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:40.161888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:40.182508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:40.188959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:40.192315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:40.194723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:40.198728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:40.199367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:40.267103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:11:40.318137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:40.319108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:40.335857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:40.342960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:40.343627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:40.347820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:40.348928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:40.351503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:40.471145 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ef09cd05-5ffe-4144-97f2-0e642ac326b5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 204 len: 0 microversion: 2.1 time: 0.316126 Aug 06 21:11:40.472022 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2076/4022] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:11:40 2022] DELETE /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:11:40.784870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:40.798765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2023750597", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "736ed351-96b2-40f9-b19a-2a7e79779668"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:40.897587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] validate_networks() for [('736ed351-96b2-40f9-b19a-2a7e79779668', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:11:41.375203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:41.393721 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ae2559df-e7a4-494e-8c1d-c746add62a9d tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1320 microversion: 2.1 time: 1.080119 Aug 06 21:11:41.406710 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1947/4023] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:40 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1320 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:11:41.417236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:41.417797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:41.451355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:41.458014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:41.460275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:41.460744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:41.461507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:41.461985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:41.462429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:41.673449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:41.727159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=18 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:42.107056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:11:42.108069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:11:42.108796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:11:42.109415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:11:42.110037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:11:42.129561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:42.130467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:42.131221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:42.132233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:42.132931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:42.135607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:42.191388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Getting quotas for project 591beac720d74a8889ad521c436e64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:11:42.194709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:42.210092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Getting quotas for user 22318132bfd04aa0886eb9b14a983731 and project 591beac720d74a8889ad521c436e64c3. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:11:42.254079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:11:42.256637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:11:42.367811 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-af4bdcff-3c97-421d-b675-ada90bfac122 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574311 Aug 06 21:11:42.371426 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2077/4024] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:11:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:11:42.384214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da21e4cb-8f2e-4146-9204-b6a84bccd68b"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:42.386818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:42.410848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:42.411632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:42.412086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:42.412827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:42.413305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:42.413743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:42.998039 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.625094 Aug 06 21:11:43.013665 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2078/4025] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:11:42 2022] POST /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-volume_attachments => generated 194 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:43.053976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-fe3b1a6d-4e85-45bf-ad67-109572df9289 req-33fa8af0-ca39-4b41-9f35-8b77ff4f1e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee1875e-cb91-412f-b21d-437b3cb6537f", "name": "network-vif-plugged", "status": "completed", "tag": "38b298a0-af38-4c5e-91d7-6a02768b5b5e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:43.093722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fe3b1a6d-4e85-45bf-ad67-109572df9289 req-33fa8af0-ca39-4b41-9f35-8b77ff4f1e88 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:43.094206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fe3b1a6d-4e85-45bf-ad67-109572df9289 req-33fa8af0-ca39-4b41-9f35-8b77ff4f1e88 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:43.094677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fe3b1a6d-4e85-45bf-ad67-109572df9289 req-33fa8af0-ca39-4b41-9f35-8b77ff4f1e88 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:43.171453 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-fe3b1a6d-4e85-45bf-ad67-109572df9289 req-33fa8af0-ca39-4b41-9f35-8b77ff4f1e88 service nova] Creating event network-vif-plugged:38b298a0-af38-4c5e-91d7-6a02768b5b5e for instance 0ee1875e-cb91-412f-b21d-437b3cb6537f on nch2-master-1 Aug 06 21:11:43.187255 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-fe3b1a6d-4e85-45bf-ad67-109572df9289 req-33fa8af0-ca39-4b41-9f35-8b77ff4f1e88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171036 Aug 06 21:11:43.188164 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2079/4026] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:43.247545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-284755ee-d7f2-4de2-a788-badd1a0bc0b6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:43.248373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-284755ee-d7f2-4de2-a788-badd1a0bc0b6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:43.873331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-284755ee-d7f2-4de2-a788-badd1a0bc0b6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:43.886157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-284755ee-d7f2-4de2-a788-badd1a0bc0b6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1218 microversion: 2.1 time: 0.696367 Aug 06 21:11:43.887046 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2080/4027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:43 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1218 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:43.903814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:43.904989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:43.931790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:43.936555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:43.947514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:43.948962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:43.952778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:43.953887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:43.955437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:43.956371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:43.959547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:43.969268 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5e879b80-41fa-4864-a7d6-2f25ab351f8c tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1360 microversion: 2.26 time: 2.556616 Aug 06 21:11:43.972466 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1948/4028] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:41 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1360 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:44.625139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:44.638792 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7424fefa-2dc8-45ed-ade1-85865e5d3bc8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1320 microversion: 2.1 time: 0.749915 Aug 06 21:11:44.639625 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2081/4029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:43 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1320 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:44.806837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-318a0a9b-9ef4-43d5-b82d-b2a2b54783df req-a6bfea00-86df-4d40-b1b1-8f73cea044ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e5244d-0d66-43bd-8816-d2e84fb28e19", "tag": "7525b8cc-d123-4d3f-ba5c-f9b305d67f06"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:44.850522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-318a0a9b-9ef4-43d5-b82d-b2a2b54783df req-a6bfea00-86df-4d40-b1b1-8f73cea044ec service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:44.851537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-318a0a9b-9ef4-43d5-b82d-b2a2b54783df req-a6bfea00-86df-4d40-b1b1-8f73cea044ec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:44.855036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-318a0a9b-9ef4-43d5-b82d-b2a2b54783df req-a6bfea00-86df-4d40-b1b1-8f73cea044ec service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:44.891315 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-318a0a9b-9ef4-43d5-b82d-b2a2b54783df req-a6bfea00-86df-4d40-b1b1-8f73cea044ec service nova] Creating event network-changed:7525b8cc-d123-4d3f-ba5c-f9b305d67f06 for instance f7e5244d-0d66-43bd-8816-d2e84fb28e19 on nch1-master-1 Aug 06 21:11:44.905316 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-318a0a9b-9ef4-43d5-b82d-b2a2b54783df req-a6bfea00-86df-4d40-b1b1-8f73cea044ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113155 Aug 06 21:11:44.906663 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1949/4030] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:44.912143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:44.912772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:44.920131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:44.920630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:44.924815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:44.925597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:44.926079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:44.926515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:44.937363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:44.995793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:44.997399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:45.011667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:45.012228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:45.013381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:45.015382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:45.016933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:45.017398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:45.307756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:45.316830 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1845983-44c6-4135-b551-fab7381d90a5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1270 microversion: 2.1 time: 0.408638 Aug 06 21:11:45.323446 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2082/4031] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:44 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1270 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:45.338400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-09b517d4-08e4-4dd2-9d3d-08db2475a4cc req-e2d0f844-e89e-4b07-a051-e59116c4a154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a90fe4-8b15-4d15-b524-16b72c4d9374", "name": "network-vif-plugged", "status": "completed", "tag": "b1bd8d73-feb8-41c9-a24f-ffd0303bdec4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:45.355074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-09b517d4-08e4-4dd2-9d3d-08db2475a4cc req-e2d0f844-e89e-4b07-a051-e59116c4a154 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:45.356416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-09b517d4-08e4-4dd2-9d3d-08db2475a4cc req-e2d0f844-e89e-4b07-a051-e59116c4a154 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:45.357194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-09b517d4-08e4-4dd2-9d3d-08db2475a4cc req-e2d0f844-e89e-4b07-a051-e59116c4a154 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:45.385368 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-09b517d4-08e4-4dd2-9d3d-08db2475a4cc req-e2d0f844-e89e-4b07-a051-e59116c4a154 service nova] Creating event network-vif-plugged:b1bd8d73-feb8-41c9-a24f-ffd0303bdec4 for instance 09a90fe4-8b15-4d15-b524-16b72c4d9374 on nch2-master-1 Aug 06 21:11:45.393432 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-09b517d4-08e4-4dd2-9d3d-08db2475a4cc req-e2d0f844-e89e-4b07-a051-e59116c4a154 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064140 Aug 06 21:11:45.394934 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2083/4032] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:45.663881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:45.665557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:45.685300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:45.685817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:45.686266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:45.687567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:45.688392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:45.689014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:45.898507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:45.914058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:45.922174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:45.923949 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f844d2f-46db-432a-b998-8d4be0aefba8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1360 microversion: 2.26 time: 0.933328 Aug 06 21:11:45.925118 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1950/4033] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:44 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1360 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:46.342087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:46.343150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:46.352756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:46.361597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:46.362413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:46.363409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:46.363869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:46.364292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:46.540723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:46.589098 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-062269ee-d041-4d57-a2bc-337f92c84b0a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1276 microversion: 2.1 time: 0.242432 Aug 06 21:11:46.590996 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1951/4034] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:46 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:11:46.701330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-89a64675-b29f-4c56-9bac-63026511d9cb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: .version_select at 0x7f729cf09a60>, body: {"keypair": {"name": "tempest-keypair-1234818718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHTwpbvOgYsBSiBOHelgEDjl3wsiDgn/rOjJAviNw0NjFlJgOT0LyYV9JxbuaG0ckhEbfHKaXbMrSVIHn6WuR+VB1OYQnl/iueT6Mx4q0bGXsjx4bP6aLTTpgqQ83TNgw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:46.721117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-89a64675-b29f-4c56-9bac-63026511d9cb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for project f4980bb21b59412ca004d8069525d3b9. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:11:46.727212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-89a64675-b29f-4c56-9bac-63026511d9cb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for user 1d7b9e27983940dcaf0e92f62273c588 and project f4980bb21b59412ca004d8069525d3b9. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:11:46.757350 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-89a64675-b29f-4c56-9bac-63026511d9cb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064900 Aug 06 21:11:46.766333 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1952/4035] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:11:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:46.886508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:46.924040 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3f5cca8f-c41c-4ae6-b3eb-70e97a4049ed tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1320 microversion: 2.1 time: 1.264290 Aug 06 21:11:46.928332 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2084/4036] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:45 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1320 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:11:46.954245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:46.954910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:46.974797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:46.976847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:46.978067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:46.981076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:46.982861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:46.983397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:46.997806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0b7a73dc-6a70-4191-b7bf-5324c94313ef req-1cbeb89b-ebac-4b36-a7c8-2b63af140f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a03433-094b-44ac-bf2e-4ff18952260e", "tag": "5e788c7d-6a71-46a1-b6ed-a665f8719435"}, {"server_uuid": "c21ba021-9868-4b25-af32-7e2f42daeae1", "name": "network-vif-deleted", "tag": "be8af179-3434-483d-a4a7-ce280a7f2c69"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:47.021974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0b7a73dc-6a70-4191-b7bf-5324c94313ef req-1cbeb89b-ebac-4b36-a7c8-2b63af140f95 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:47.022486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0b7a73dc-6a70-4191-b7bf-5324c94313ef req-1cbeb89b-ebac-4b36-a7c8-2b63af140f95 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:47.022952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0b7a73dc-6a70-4191-b7bf-5324c94313ef req-1cbeb89b-ebac-4b36-a7c8-2b63af140f95 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:47.043456 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0b7a73dc-6a70-4191-b7bf-5324c94313ef req-1cbeb89b-ebac-4b36-a7c8-2b63af140f95 service nova] Creating event network-changed:5e788c7d-6a71-46a1-b6ed-a665f8719435 for instance 06a03433-094b-44ac-bf2e-4ff18952260e on nch1-master-1 Aug 06 21:11:47.044336 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0b7a73dc-6a70-4191-b7bf-5324c94313ef req-1cbeb89b-ebac-4b36-a7c8-2b63af140f95 service nova] Creating event network-vif-deleted:be8af179-3434-483d-a4a7-ce280a7f2c69 for instance c21ba021-9868-4b25-af32-7e2f42daeae1 on nch1-master-1 Aug 06 21:11:47.051179 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0b7a73dc-6a70-4191-b7bf-5324c94313ef req-1cbeb89b-ebac-4b36-a7c8-2b63af140f95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058511 Aug 06 21:11:47.052329 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2085/4037] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:11:47.619122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:47.620059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:47.626184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:47.629196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:47.629779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:47.630706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:47.631587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:47.632777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:47.633698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:47.641231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:47.643025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:47.645741 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6b74b13d-82c3-407b-bf03-8edc1e9e1227 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1360 microversion: 2.26 time: 0.696791 Aug 06 21:11:47.647363 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1953/4038] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:46 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1360 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:47.829539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:47.840188 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2541ba93-81d3-4b39-805e-b0fdea47a8ab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1276 microversion: 2.1 time: 0.226721 Aug 06 21:11:47.845283 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2086/4039] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:47 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:47.949245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:47.954233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:47.961987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:47.962712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:47.963338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:47.964226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:47.964675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:47.968995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:48.437970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:48.455274 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ad6a3a40-e2ec-474d-9de2-85df93743fcf tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1320 microversion: 2.1 time: 0.508155 Aug 06 21:11:48.474860 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1954/4040] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:47 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1320 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:48.699287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:48.699287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:48.704760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:48.706108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:48.706766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:48.707701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:48.708333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:48.708925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:48.868618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:48.870351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:48.878274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:48.879388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:48.880082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:48.884136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:48.885272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:48.885900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:49.389286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:49.412730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:49.417512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:49.423875 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3e70f16-dd58-4320-844b-2477df559817 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1360 microversion: 2.26 time: 0.757050 Aug 06 21:11:49.426133 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2087/4041] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:48 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1360 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:49.480132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:49.483238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:49.509498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:49.509980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:49.510640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:49.511531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:49.512726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:49.513527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:49.596167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:49.613192 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-62e851c3-a3f5-4db3-875e-bcd71c1609f0 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1318 microversion: 2.1 time: 0.750207 Aug 06 21:11:49.628302 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1955/4042] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:48 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:49.912530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-939914968", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "64a49b5c-a189-4d4b-911b-65f1d48ff28f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:50.004670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] validate_networks() for [('64a49b5c-a189-4d4b-911b-65f1d48ff28f', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:11:50.058320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:50.069339 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dff6eb8e-02ca-4a36-895a-774945d3628a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1320 microversion: 2.1 time: 0.595861 Aug 06 21:11:50.076558 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2088/4043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:49 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1320 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:50.454136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:50.454845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:50.468318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:50.468863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:50.471447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:50.473687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:50.474251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:50.474746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:51.276354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:51.297747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:51.300324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:51.302522 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c93eb847-77a4-433c-bf80-9e418697f93e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1360 microversion: 2.26 time: 0.853264 Aug 06 21:11:51.328625 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2089/4044] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:50 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1360 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:51.351210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:51.352306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:51.360588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:51.361878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:51.362584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:51.364815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:51.365513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:51.366102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:51.735191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:11:51.736602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:11:51.737314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:11:51.737891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:11:51.743600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:11:51.766569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:51.771596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:51.772379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:51.773384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:51.774366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:51.775551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:51.776195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:51.789084 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-21ea0f16-73f0-4700-9129-d14d7c277aab tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1318 microversion: 2.1 time: 0.456874 Aug 06 21:11:51.790999 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2090/4045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:51 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:51.809200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:51.838402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:51.860709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Getting quotas for project 97a16c231f804b41bfd49fe5f4d96605. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:11:51.863617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:51.864143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:51.864589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:51.865318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:51.865778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:51.866203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:51.875383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Getting quotas for user c1c8ba4023a444a4baa633b5c599213e and project 97a16c231f804b41bfd49fe5f4d96605. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:11:51.917530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:11:51.926406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:11:52.000508 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b7152824-3493-47e5-b731-49301cadea3d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369592 Aug 06 21:11:52.001894 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1956/4046] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:11:52.007692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7c25b9d9-7587-4f23-aaf7-c8e77fa1b7bb req-71c8db1d-e3ea-4c2e-b90c-7de11f792dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb40ecb-cf3f-4b4e-9ec6-648761c1446f", "tag": "3ee9f6ca-cd68-41a0-aa35-10afbae988b3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:52.025892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7c25b9d9-7587-4f23-aaf7-c8e77fa1b7bb req-71c8db1d-e3ea-4c2e-b90c-7de11f792dd6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:52.026811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7c25b9d9-7587-4f23-aaf7-c8e77fa1b7bb req-71c8db1d-e3ea-4c2e-b90c-7de11f792dd6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:52.027413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7c25b9d9-7587-4f23-aaf7-c8e77fa1b7bb req-71c8db1d-e3ea-4c2e-b90c-7de11f792dd6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:52.042174 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7c25b9d9-7587-4f23-aaf7-c8e77fa1b7bb req-71c8db1d-e3ea-4c2e-b90c-7de11f792dd6 service nova] Creating event network-changed:3ee9f6ca-cd68-41a0-aa35-10afbae988b3 for instance feb40ecb-cf3f-4b4e-9ec6-648761c1446f on nch2-master-1 Aug 06 21:11:52.069230 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7c25b9d9-7587-4f23-aaf7-c8e77fa1b7bb req-71c8db1d-e3ea-4c2e-b90c-7de11f792dd6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052905 Aug 06 21:11:52.072638 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1957/4047] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:52.088383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e0ebc616-f88e-454e-931a-6291d183e548 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:52.091461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e0ebc616-f88e-454e-931a-6291d183e548 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:52.167548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:52.257131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e0ebc616-f88e-454e-931a-6291d183e548 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:52.269953 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e0ebc616-f88e-454e-931a-6291d183e548 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1224 microversion: 2.1 time: 0.193343 Aug 06 21:11:52.271466 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1958/4048] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:52 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:52.336194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:52.337126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:52.357902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:52.358722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:52.359358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:52.360420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:52.361189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:52.361783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:52.937752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:52.956331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:52.958413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:52.959864 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5593a7ec-feed-4969-a339-6125b1eb43a0 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1360 microversion: 2.26 time: 0.633137 Aug 06 21:11:52.971275 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1959/4049] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:52 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1360 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:52.985538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-2e7f482c-2755-4f97-ad71-3f4f75e0573c req-233a4b14-dce4-40f6-97e7-ecc68c962078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e5244d-0d66-43bd-8816-d2e84fb28e19", "name": "network-vif-plugged", "status": "completed", "tag": "7525b8cc-d123-4d3f-ba5c-f9b305d67f06"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:53.003610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2e7f482c-2755-4f97-ad71-3f4f75e0573c req-233a4b14-dce4-40f6-97e7-ecc68c962078 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:53.006199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2e7f482c-2755-4f97-ad71-3f4f75e0573c req-233a4b14-dce4-40f6-97e7-ecc68c962078 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:53.008925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2e7f482c-2755-4f97-ad71-3f4f75e0573c req-233a4b14-dce4-40f6-97e7-ecc68c962078 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:53.033240 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-2e7f482c-2755-4f97-ad71-3f4f75e0573c req-233a4b14-dce4-40f6-97e7-ecc68c962078 service nova] Creating event network-vif-plugged:7525b8cc-d123-4d3f-ba5c-f9b305d67f06 for instance f7e5244d-0d66-43bd-8816-d2e84fb28e19 on nch1-master-1 Aug 06 21:11:53.039384 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-2e7f482c-2755-4f97-ad71-3f4f75e0573c req-233a4b14-dce4-40f6-97e7-ecc68c962078 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058590 Aug 06 21:11:53.041117 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1960/4050] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:53.061084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:53.063369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:53.085083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:53.085598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:53.086600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:53.087597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:53.088899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:53.091276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:53.091817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:53.103459 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d962b0d-ab58-4959-bcfd-cd7f066f6166 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1320 microversion: 2.1 time: 1.311010 Aug 06 21:11:53.104422 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2091/4051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:51 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1320 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:53.291681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:53.292309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:53.310731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:53.311263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:53.311677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:53.312404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:53.312876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:53.313307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:53.392189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:53.400845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-709a3a51-e2f1-41df-8171-15a28523bbc5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1318 microversion: 2.1 time: 0.357931 Aug 06 21:11:53.401679 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1961/4052] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:53 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:53.448808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:53.458081 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a26fa078-36d0-4a82-bd7b-9baca0ebd740 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1228 microversion: 2.1 time: 0.170235 Aug 06 21:11:53.458797 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2092/4053] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:53 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1228 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:53.989811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:53.993457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:54.023796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:54.024306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:54.024760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:54.025489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:54.025948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:54.030310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:54.083506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:54.127352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:54.128944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:54.147709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:54.155257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:54.157584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:54.158567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:54.162752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:54.165180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:54.165909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:54.540928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:54.545384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:54.551281 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c8e2606-bbc3-4ae3-90b5-9e90db07f671 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1320 microversion: 2.1 time: 0.430572 Aug 06 21:11:54.555833 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2093/4054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:54 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1320 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:54.564883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2070159453", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6095abc9-21e8-4e89-b536-00af77a125af"}], "security_groups": [{"name": "tempest-securitygroup--1484971980"}], "key_name": "tempest-keypair-1234818718", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:54.581592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:54.592083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:54.596554 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e87e363c-6049-4dab-9886-746fb80cdcaa tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1360 microversion: 2.26 time: 0.613805 Aug 06 21:11:54.601587 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1962/4055] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:53 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1360 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:54.625605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:54.634265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:54.661668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:54.676906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:54.677747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:54.683316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:54.684740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:54.686851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:54.866869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] validate_networks() for [('6095abc9-21e8-4e89-b536-00af77a125af', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:11:55.012607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:55.029048 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7cc49fc7-fe7b-4fb0-b20f-17369b321ad8 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1318 microversion: 2.1 time: 0.425402 Aug 06 21:11:55.042383 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1963/4056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:54 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:55.056239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:55.057083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:55.064835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:55.066648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:55.067322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:55.068434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:55.069269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:55.069923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:55.222908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:55.231967 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1e5ea473-8c10-4113-add8-660f080ebd1b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1282 microversion: 2.1 time: 0.184614 Aug 06 21:11:55.233158 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1964/4057] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:55 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:55.252608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-672b7697-f464-469f-9931-43568be9ef73 req-4da697d4-8cf2-4db8-814a-29bcb876a5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a03433-094b-44ac-bf2e-4ff18952260e", "name": "network-vif-plugged", "status": "completed", "tag": "5e788c7d-6a71-46a1-b6ed-a665f8719435"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:55.267695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-672b7697-f464-469f-9931-43568be9ef73 req-4da697d4-8cf2-4db8-814a-29bcb876a5e5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:55.269334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-672b7697-f464-469f-9931-43568be9ef73 req-4da697d4-8cf2-4db8-814a-29bcb876a5e5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:55.274368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-672b7697-f464-469f-9931-43568be9ef73 req-4da697d4-8cf2-4db8-814a-29bcb876a5e5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:55.302242 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-672b7697-f464-469f-9931-43568be9ef73 req-4da697d4-8cf2-4db8-814a-29bcb876a5e5 service nova] Creating event network-vif-plugged:5e788c7d-6a71-46a1-b6ed-a665f8719435 for instance 06a03433-094b-44ac-bf2e-4ff18952260e on nch1-master-1 Aug 06 21:11:55.335674 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-672b7697-f464-469f-9931-43568be9ef73 req-4da697d4-8cf2-4db8-814a-29bcb876a5e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073983 Aug 06 21:11:55.337962 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1965/4058] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:55.578253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:55.579373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:55.594732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:55.596187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:55.597291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:55.602080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:55.604251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:55.609915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:55.877985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:55.894944 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-48b73ba6-372a-45bb-a415-9b480171e659 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1511 microversion: 2.1 time: 0.322093 Aug 06 21:11:55.915551 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1966/4059] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:55 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:55.922762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:55.925032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:55.941988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:55.943466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:55.945035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:55.947225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:55.948241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:55.948937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:56.269126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:56.300569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:56.303432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:56.306894 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5211981e-22d3-42d8-af9b-75a55b34d349 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1360 microversion: 2.26 time: 0.389970 Aug 06 21:11:56.314461 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1967/4060] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:55 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1360 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:56.336286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:56.351151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:56.370526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:56.371303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:56.373049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:56.374050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:56.374870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:56.375956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:56.503106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:11:56.504382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:11:56.505679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:11:56.506737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:11:56.508426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:11:56.541487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:56.541984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:56.542514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:56.543207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:56.543661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:56.544093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:56.605115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for project f4980bb21b59412ca004d8069525d3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:11:56.625295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for user 1d7b9e27983940dcaf0e92f62273c588 and project f4980bb21b59412ca004d8069525d3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:11:56.680478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:11:56.685085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:11:56.698135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:56.716912 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4d7bffa1-6c74-40a7-8aee-bf376e635c86 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1511 microversion: 2.1 time: 0.399043 Aug 06 21:11:56.718626 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1968/4061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:56 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:56.749934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:56.751697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:56.770426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:56.771241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:56.773428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:56.776314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:56.778264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:56.779654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:56.805559 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d6787cc-0294-4994-8714-7bd197e7e363 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.248327 Aug 06 21:11:56.807448 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2094/4062] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:11:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:11:56.825078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:56.825996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:56.840766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:56.842530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:56.847142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:56.849391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:56.850073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:56.850705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:57.217721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:57.249940 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-472b7b21-c423-4ea2-8874-6dca17b76d1c tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1318 microversion: 2.1 time: 0.509622 Aug 06 21:11:57.266816 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1969/4063] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:56 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:57.279035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:57.282572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:57.291883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:57.292511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:57.293789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:57.294633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:57.295230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:57.295744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:57.502177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:57.523007 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6a82229-b7a6-4507-9aca-5f870f4562ad tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f" status: 200 len: 1512 microversion: 2.1 time: 0.254835 Aug 06 21:11:57.523614 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1970/4064] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:57 2022] GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f => generated 1512 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:57.546059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-97b1e7e1-09d3-4f8a-abf1-3d5633d87381 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:57.551801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-97b1e7e1-09d3-4f8a-abf1-3d5633d87381 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:57.611747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:57.624750 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-726e0282-72f9-46d2-839f-fb5b6a32096d tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 0.806549 Aug 06 21:11:57.627548 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2095/4065] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:56 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:57.637751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:57.640426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:57.653607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:57.655606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:57.656247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:57.658061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:57.659717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:57.660406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:57.695292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-97b1e7e1-09d3-4f8a-abf1-3d5633d87381 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:57.704505 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-97b1e7e1-09d3-4f8a-abf1-3d5633d87381 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1242 microversion: 2.1 time: 0.172468 Aug 06 21:11:57.709216 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1971/4066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:57 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1242 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:57.719502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:57.733073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:57.734009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:11:57.759636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:57.768350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:57.769698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:57.770780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:57.771935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:57.772568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:57.946686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:11:58.075170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:58.082435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.083648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.084316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.177938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:58.198296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:58.200733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:58.202314 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ed14ea7-49ce-4eff-8580-fd4c439d5007 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1543 microversion: 2.26 time: 0.573521 Aug 06 21:11:58.215822 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2096/4067] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:11:57 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1543 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:11:58.238971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-74764036-53fa-4bc0-bd67-c0d5305ae7e7 req-6aaa6255-6973-434c-ba8e-7605e082ea77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb40ecb-cf3f-4b4e-9ec6-648761c1446f", "name": "network-vif-plugged", "status": "completed", "tag": "3ee9f6ca-cd68-41a0-aa35-10afbae988b3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:11:58.266035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-74764036-53fa-4bc0-bd67-c0d5305ae7e7 req-6aaa6255-6973-434c-ba8e-7605e082ea77 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.266848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-74764036-53fa-4bc0-bd67-c0d5305ae7e7 req-6aaa6255-6973-434c-ba8e-7605e082ea77 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.267542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-74764036-53fa-4bc0-bd67-c0d5305ae7e7 req-6aaa6255-6973-434c-ba8e-7605e082ea77 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.291595 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-74764036-53fa-4bc0-bd67-c0d5305ae7e7 req-6aaa6255-6973-434c-ba8e-7605e082ea77 service nova] Creating event network-vif-plugged:3ee9f6ca-cd68-41a0-aa35-10afbae988b3 for instance feb40ecb-cf3f-4b4e-9ec6-648761c1446f on nch2-master-1 Aug 06 21:11:58.307568 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-74764036-53fa-4bc0-bd67-c0d5305ae7e7 req-6aaa6255-6973-434c-ba8e-7605e082ea77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090140 Aug 06 21:11:58.308853 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2097/4068] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:11:58.324219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729d871ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:58.371449 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2c9366bd-375a-47e5-9d1c-dcc3fa623911 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.661129 Aug 06 21:11:58.372330 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1972/4069] 10.222.0.33 () {58 vars in 1167 bytes} [Sat Aug 6 21:11:57 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:58.375459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.376929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.377235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:58.377748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:58.378368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.379805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:58.388920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.389156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.389639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.390093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.390808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.394225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.395800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.396569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.397115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.408150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.408998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.409602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.439332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.440492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.441045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.474580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.475272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.475842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.537647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:11:58.593321 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e1d2216-0e88-44c3-818b-11b2368f3549 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1955481928" status: 201 len: 0 microversion: 2.26 time: 0.279345 Aug 06 21:11:58.594791 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2098/4070] 10.222.0.33 () {62 vars in 1380 bytes} [Sat Aug 6 21:11:58 2022] PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1955481928 => generated 0 bytes in 285 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 06 21:11:58.600452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:58.615343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:58.617098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1301689217', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:11:58.624284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.625322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.626106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.627227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.628151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.629227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.800293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:11:58.806291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:58.845470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:58.857053 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a01a591f-7df4-4db5-a06f-764921ccf3b7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1318 microversion: 2.1 time: 0.480352 Aug 06 21:11:58.866771 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1973/4071] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:58 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:58.876452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-56c8156a-00b4-42aa-93b0-16e23789a492 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cf591f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:58.896076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56c8156a-00b4-42aa-93b0-16e23789a492 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.897328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56c8156a-00b4-42aa-93b0-16e23789a492 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.897328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56c8156a-00b4-42aa-93b0-16e23789a492 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.925976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:58.936962 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-56c8156a-00b4-42aa-93b0-16e23789a492 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1955481928" status: 204 len: 0 microversion: 2.26 time: 0.068444 Aug 06 21:11:58.938788 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1974/4072] 10.222.0.33 () {60 vars in 1361 bytes} [Sat Aug 6 21:11:58 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1955481928 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:11:58.943305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.944275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.945096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.953062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:58.954179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:58.964245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.965682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.966987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:58.967995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:58.968706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:58.969537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.307899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:59.317937 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b2e9104-9f12-46a5-bb07-a7f0d29380c6 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 0.376006 Aug 06 21:11:59.318960 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1975/4073] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:58 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:59.327271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:59.328618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:59.336599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.337474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.338949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.341055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.342045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.342854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.459658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:59.476633 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b20d3cea-c9dc-4e89-84c1-4cb5a3876747 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1300 microversion: 2.1 time: 0.151157 Aug 06 21:11:59.477476 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1976/4074] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:59 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:59.484870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cef4a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:59.498523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.499396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.500053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.500786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:59.512448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.513295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.514029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.515141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.515719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.516251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.541192 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5afb9df0-0a47-4616-99e7-c9162bb6e9a0 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1301689217" status: 200 len: 1514 microversion: 2.1 time: 0.944830 Aug 06 21:11:59.542142 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2099/4075] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:11:58 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1301689217 => generated 1514 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:59.563723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.564806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.565606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.566651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:59.571708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:59.572763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:11:59.575961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:59.583632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.584592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.585580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.587282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.588091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.588844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.598495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:11:59.634174 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-90816aa6-10c8-40c8-aa94-bfe30d51a4c2 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 204 len: 0 microversion: 2.26 time: 0.155165 Aug 06 21:11:59.641445 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1977/4076] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Aug 6 21:11:59 2022] DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:11:59.662663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb70aa64-f3cf-4077-b980-3e150127ef06 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cf44b80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:59.683130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb70aa64-f3cf-4077-b980-3e150127ef06 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.684186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb70aa64-f3cf-4077-b980-3e150127ef06 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.684673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb70aa64-f3cf-4077-b980-3e150127ef06 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.699724 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb70aa64-f3cf-4077-b980-3e150127ef06 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 200 len: 12 microversion: 2.26 time: 0.049251 Aug 06 21:11:59.706678 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1978/4077] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Aug 6 21:11:59 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:11:59.712265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cf19280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:59.722600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.723044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.723837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.724483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:59.733343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.733997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.734616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.735824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.736540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:11:59.739732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.740702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.820820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.823566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.825236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.848791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.851272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.851846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.870129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:11:59.931341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:11:59.948077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:11:59.975760 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4677ca83-26e9-433b-a46b-238242421311 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1599891285" status: 201 len: 0 microversion: 2.26 time: 0.267816 Aug 06 21:11:59.978834 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1979/4078] 10.222.0.33 () {62 vars in 1380 bytes} [Sat Aug 6 21:11:59 2022] PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1599891285 => generated 0 bytes in 271 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 06 21:11:59.991319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:11:59.991576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:11:59.991962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:11:59.992452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:11:59.993140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:11:59.999019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:00.007332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.008182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.008858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.009807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.010674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.011391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.332105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:00.342715 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c07d8938-9cbc-4b49-b049-3479b50453db tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1508 microversion: 2.1 time: 0.361957 Aug 06 21:12:00.343069 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1980/4079] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:11:59 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1508 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:00.348918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c581011-4e09-4580-9604-b310b39847c8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cf0f1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:00.359784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c581011-4e09-4580-9604-b310b39847c8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.360507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c581011-4e09-4580-9604-b310b39847c8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.361635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c581011-4e09-4580-9604-b310b39847c8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.378872 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3c581011-4e09-4580-9604-b310b39847c8 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 200 len: 36 microversion: 2.26 time: 0.034317 Aug 06 21:12:00.382588 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1981/4080] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Aug 6 21:12:00 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 36 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:00.385101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:00.385872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:00.393057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.393787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.394328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.395192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.395776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.396310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.684066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:00.698365 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-93c22d93-36be-43e8-a625-6080dd46887f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 0.317390 Aug 06 21:12:00.711569 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1982/4081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:00 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:00.720138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:00.721424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:00.727791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.728417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.728961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.729783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.730418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.731015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.798462 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ea36e0e-14c7-4dfc-b64d-15cc102502d4 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.236775 Aug 06 21:12:00.803345 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2100/4082] 10.222.0.33 () {58 vars in 1173 bytes} [Sat Aug 6 21:11:59 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:00.819726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729d58ef70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:00.835680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.836310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.837328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.838517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:00.850026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.850898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.852314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.853381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.854101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.856865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.922213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:00.922756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:00.923205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:00.971611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:00.993281 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b4c9e3d2-23ad-4766-9833-914c6f6921bd tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1599891285" status: 204 len: 0 microversion: 2.26 time: 0.188032 Aug 06 21:12:00.995657 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2101/4083] 10.222.0.33 () {60 vars in 1364 bytes} [Sat Aug 6 21:12:00 2022] DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1599891285 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:12:01.007452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:01.008550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:01.021649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.022578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.023605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.024687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.025679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.026392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.030808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:01.042317 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-09c6df43-83eb-480a-bf0f-3f4ec10eb21d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1508 microversion: 2.1 time: 0.329302 Aug 06 21:12:01.044144 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1983/4084] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:00 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:01.053590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8adffcd4-3f1e-4187-b22d-e2eb957f5946 req-37399ef6-34b2-486a-bcd6-82e548110265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1358cf93-62c9-438a-9bcb-e4f9a89cf45a", "tag": "22765c99-c6b4-44e7-b83d-abdf8ac1055f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:01.082054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8adffcd4-3f1e-4187-b22d-e2eb957f5946 req-37399ef6-34b2-486a-bcd6-82e548110265 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.086751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8adffcd4-3f1e-4187-b22d-e2eb957f5946 req-37399ef6-34b2-486a-bcd6-82e548110265 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.087562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8adffcd4-3f1e-4187-b22d-e2eb957f5946 req-37399ef6-34b2-486a-bcd6-82e548110265 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.114193 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8adffcd4-3f1e-4187-b22d-e2eb957f5946 req-37399ef6-34b2-486a-bcd6-82e548110265 service nova] Creating event network-changed:22765c99-c6b4-44e7-b83d-abdf8ac1055f for instance 1358cf93-62c9-438a-9bcb-e4f9a89cf45a on nch2-master-1 Aug 06 21:12:01.127196 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8adffcd4-3f1e-4187-b22d-e2eb957f5946 req-37399ef6-34b2-486a-bcd6-82e548110265 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079719 Aug 06 21:12:01.128324 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1984/4085] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:01.134748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:01.142174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:01.142993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.compute.servers [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Removing options 'limit' from query {{(pid=142462) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 06 21:12:01.144816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:01.156470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.157203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.158271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.159222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.159893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.161490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.215504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:01.224374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.225109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.225803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.459054 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5efd387c-6558-42cc-aab2-3e0b36a9281c tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.328482 Aug 06 21:12:01.459820 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1985/4086] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 21:12:01 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:01.465475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46af2d70-47cf-46a3-8c16-6c9ef779945a tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729ce00040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:01.476173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46af2d70-47cf-46a3-8c16-6c9ef779945a tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.477056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46af2d70-47cf-46a3-8c16-6c9ef779945a tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.478287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46af2d70-47cf-46a3-8c16-6c9ef779945a tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.492344 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46af2d70-47cf-46a3-8c16-6c9ef779945a tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 200 len: 12 microversion: 2.26 time: 0.030860 Aug 06 21:12:01.493739 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1986/4087] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Aug 6 21:12:01 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:01.499324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71339818-4f7e-40a6-9bea-b63c348627c5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:01.502971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-71339818-4f7e-40a6-9bea-b63c348627c5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:01.510278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71339818-4f7e-40a6-9bea-b63c348627c5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.511190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71339818-4f7e-40a6-9bea-b63c348627c5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.511880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71339818-4f7e-40a6-9bea-b63c348627c5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.513117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71339818-4f7e-40a6-9bea-b63c348627c5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.514131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71339818-4f7e-40a6-9bea-b63c348627c5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.514861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71339818-4f7e-40a6-9bea-b63c348627c5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.608816 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71339818-4f7e-40a6-9bea-b63c348627c5 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "PUT /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1080 microversion: 2.1 time: 0.113643 Aug 06 21:12:01.610594 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1987/4088] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:12:01 2022] PUT /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1080 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:01.617751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d2a98ac9-79d7-45f8-9218-cbf2eb764b1a req-5ad0bd13-05c3-4086-8790-f4ced21a2ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac", "tag": "f1f90627-f550-4959-aa15-41f896172104"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:01.634993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d2a98ac9-79d7-45f8-9218-cbf2eb764b1a req-5ad0bd13-05c3-4086-8790-f4ced21a2ae9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.638418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d2a98ac9-79d7-45f8-9218-cbf2eb764b1a req-5ad0bd13-05c3-4086-8790-f4ced21a2ae9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.640040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d2a98ac9-79d7-45f8-9218-cbf2eb764b1a req-5ad0bd13-05c3-4086-8790-f4ced21a2ae9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.655731 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d2a98ac9-79d7-45f8-9218-cbf2eb764b1a req-5ad0bd13-05c3-4086-8790-f4ced21a2ae9 service nova] Creating event network-changed:f1f90627-f550-4959-aa15-41f896172104 for instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac on nch1-master-1 Aug 06 21:12:01.663338 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d2a98ac9-79d7-45f8-9218-cbf2eb764b1a req-5ad0bd13-05c3-4086-8790-f4ced21a2ae9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050857 Aug 06 21:12:01.664859 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1988/4089] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:01.672663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:01.679514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:01.681094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:01.687750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.689119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.689562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.690340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.690822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.691250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.866816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:01.942962 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-241683a2-648a-44a2-970e-841e4f07fa05 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.276445 Aug 06 21:12:01.944111 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1989/4090] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:12:01 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:01.950756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cf44c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:01.959379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.959878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.961007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.961740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:01.969601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.969601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.969989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:01.970679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:01.971142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:01.971679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.341937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.342429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.342906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.355942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:02.376671 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ffcfb371-17d6-43cb-8a1f-427a38b56cda tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 204 len: 0 microversion: 2.26 time: 0.431142 Aug 06 21:12:02.382345 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1990/4091] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Aug 6 21:12:01 2022] DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:12:02.387981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:02.388613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:02.397001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.397494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.397935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.399610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.400050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.400770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.537284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:02.547157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bdb59d6e-b7e4-479b-8cc0-99bcd7dd0a97 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1368 microversion: 2.1 time: 1.550122 Aug 06 21:12:02.547754 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2102/4092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:00 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1368 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:02.554915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:02.556505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:02.568125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.569238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.570683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.571974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.572735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.573381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.593853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:02.602651 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf82547f-751b-4c19-af37-60e27cb05a5a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1506 microversion: 2.1 time: 0.222887 Aug 06 21:12:02.603483 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1991/4093] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:02 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:02.628045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:02.633021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:02.633491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.compute.servers [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Removing options 'limit' from query {{(pid=142462) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 06 21:12:02.634167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:02.645474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.645965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.646591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.647175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.647633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.648061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.714272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:02.764850 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-10f3fcf3-0e97-4a8d-8828-cd9e5af88390 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.145868 Aug 06 21:12:02.765763 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1992/4094] 10.222.0.33 () {58 vars in 1150 bytes} [Sat Aug 6 21:12:02 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:02.771687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cf0aee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:02.782608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.783439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.783891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.784415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:02.792216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.792216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.793261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.794349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.794847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.795400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.830043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.831665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.832270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.845256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.845878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.846197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.906157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:02.911213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1,nova_cell1:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:02.927029 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fe0b6cc1-71ca-4f7b-8720-d199bdb10067 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1534123061" status: 201 len: 0 microversion: 2.26 time: 0.159213 Aug 06 21:12:02.927858 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1993/4095] 10.222.0.33 () {62 vars in 1380 bytes} [Sat Aug 6 21:12:02 2022] PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1534123061 => generated 0 bytes in 161 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 06 21:12:02.935648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:02.936390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:02.944755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.945416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.945943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:02.948381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:02.948974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:02.949488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.031089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:03.045631 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5150c587-176f-4068-a0c5-a58769b033de tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 0.495191 Aug 06 21:12:03.048355 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2103/4096] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:02 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:03.062870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:03.081227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:03.081941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:03.091286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.092015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.092633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.093637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.094317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.095031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.132806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:03.195166 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aabbe12c-6ae8-4f4f-8393-3e35ee43c906 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.139051 Aug 06 21:12:03.195868 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2104/4097] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:12:03 2022] GET /compute/v2.1/servers => generated 1011 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:03.201915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729ddab0d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:03.230894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.231802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.232394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.232980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:03.243322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.244167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.245649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.246925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.251840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.252730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.262531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:03.276450 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1b478b01-985c-433d-88c8-627331276773 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1506 microversion: 2.1 time: 0.343244 Aug 06 21:12:03.277737 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1994/4098] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:02 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:03.298494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:03.330159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:03.331086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:03.351701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.352274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.352720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.357705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.359159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.361002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.361951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.364812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.366705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.376666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.377167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.377619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.425993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:03.474263 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a69583b6-168d-4dd8-97b1-8de3f9718868 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-964414509" status: 201 len: 0 microversion: 2.26 time: 0.277126 Aug 06 21:12:03.479060 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2105/4099] 10.222.0.33 () {62 vars in 1377 bytes} [Sat Aug 6 21:12:03 2022] PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-964414509 => generated 0 bytes in 279 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 06 21:12:03.481612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-06060812-ec29-449f-a4fe-3d786700317a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:03.486626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-06060812-ec29-449f-a4fe-3d786700317a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:03.500027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06060812-ec29-449f-a4fe-3d786700317a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.500491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06060812-ec29-449f-a4fe-3d786700317a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.500932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06060812-ec29-449f-a4fe-3d786700317a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.501649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06060812-ec29-449f-a4fe-3d786700317a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.502105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06060812-ec29-449f-a4fe-3d786700317a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.506498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-06060812-ec29-449f-a4fe-3d786700317a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.581365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:03.697709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-06060812-ec29-449f-a4fe-3d786700317a tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "PUT /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1082 microversion: 2.1 time: 0.221239 Aug 06 21:12:03.700002 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2106/4100] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:12:03 2022] PUT /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1082 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:03.715751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729d5f5700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:03.729345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.730920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.731377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.736657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:03.751356 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-283095dd-821d-453a-9dda-4955b63afd7a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.471587 Aug 06 21:12:03.755024 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1995/4101] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:12:03 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:03.758742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.759250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.759695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.766961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:03.770939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:03.771514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.772012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.772458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.809756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.810352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.810933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.811784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.812371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.812910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.825112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.829129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.829848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.867383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:03.904283 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-301ae5b6-352c-45ad-a17f-7ec07a933b92 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 204 len: 0 microversion: 2.26 time: 0.203064 Aug 06 21:12:03.909452 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2107/4102] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Aug 6 21:12:03 2022] DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:12:03.917110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:03.917884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:03.937774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.938276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.938748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:03.942786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:03.943353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:03.943800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:04.318476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:04.332273 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c639249c-d62c-4865-be94-83457d63061f tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1508 microversion: 2.1 time: 0.421430 Aug 06 21:12:04.333168 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2108/4103] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:03 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:04.338232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:04.354665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:04.356273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.compute.servers [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Removing options 'limit' from query {{(pid=142461) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 06 21:12:04.357156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:04.364242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:04.364899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:04.365500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:04.366384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:04.367144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:04.367556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:04.384297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:04.395027 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e3af74b2-e8f5-405b-82c7-1cdbe2f8d871 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1368 microversion: 2.1 time: 0.638615 Aug 06 21:12:04.399144 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1996/4104] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:03 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1368 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:04.399649 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3bc1459a-1f93-4eb1-9129-5f4509d533e1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.064937 Aug 06 21:12:04.400574 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2109/4105] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Aug 6 21:12:04 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:04.407548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46834fac-f6a6-43c0-998c-b77682a461d1 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cf19f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:04.408601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:04.409599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:04.417175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:04.418731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:04.419394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:04.420345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:04.421146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:04.421765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:04.430392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46834fac-f6a6-43c0-998c-b77682a461d1 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:04.430929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46834fac-f6a6-43c0-998c-b77682a461d1 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:04.435607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46834fac-f6a6-43c0-998c-b77682a461d1 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:04.453359 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46834fac-f6a6-43c0-998c-b77682a461d1 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 200 len: 12 microversion: 2.26 time: 0.052920 Aug 06 21:12:04.462087 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1997/4106] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Aug 6 21:12:04 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 12 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:04.467444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:04.468072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:04.478407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:04.479171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:04.480530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:04.482784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:04.483580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:04.484869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:04.848057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:04.867467 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2ea8032c-4465-4f1d-931c-91ec8c005049 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1508 microversion: 2.1 time: 0.403063 Aug 06 21:12:04.875675 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1998/4107] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:04 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1508 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:04.895404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:04.907691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:04.908392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1301689217', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:04.920744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:04.921508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:04.922114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:04.923082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:04.923768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:04.924379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.045825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:05.135775 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1877e92e-58b3-4809-99ae-171e8a77e4ec tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1301689217" status: 200 len: 346 microversion: 2.1 time: 0.258564 Aug 06 21:12:05.136815 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 1999/4108] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:12:04 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1301689217 => generated 346 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:05.142122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cf0fd30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:05.151099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.152429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.153053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.153704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:05.160285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.161031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.161627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.162503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.163158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.163773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.196389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.197735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.198345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.214317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:05.237731 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71b6f7ec-2879-44c5-8724-961bcd99a565 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 204 len: 0 microversion: 2.26 time: 0.099656 Aug 06 21:12:05.239637 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2000/4109] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Aug 6 21:12:05 2022] DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:12:05.245084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:05.246420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:05.255111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.255876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.257042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.257956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.258603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.259501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.306967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:12:05.454313 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03209549-4c19-4617-89f0-91ddd8cac065 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 204 len: 0 microversion: 2.1 time: 0.211773 Aug 06 21:12:05.455741 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2001/4110] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:12:05 2022] DELETE /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:12:05.469801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-06aef7cc-a352-4474-af80-3eae76f4f384 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:05.479318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-06aef7cc-a352-4474-af80-3eae76f4f384 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.480274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-06aef7cc-a352-4474-af80-3eae76f4f384 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.481053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-06aef7cc-a352-4474-af80-3eae76f4f384 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.528201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-06aef7cc-a352-4474-af80-3eae76f4f384 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Going to try to stop instance {{(pid=142462) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 21:12:05.599238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:05.608374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7eceb152-b2b2-4cc7-a17e-ec928a27bb2e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 1.206591 Aug 06 21:12:05.622216 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2110/4111] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:04 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:05.625934 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-06aef7cc-a352-4474-af80-3eae76f4f384 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "POST /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374/action" status: 202 len: 0 microversion: 2.1 time: 0.167973 Aug 06 21:12:05.627079 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2002/4112] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:12:05 2022] POST /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:12:05.628836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729db19790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:05.632808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:05.633717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:05.641938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.642442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.642909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.643940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:05.654395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.654702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.655264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.655709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.656934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.657379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.658103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.658600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.658710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.659173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.659599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.668974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.669201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:05.751678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.752573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.754576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.770883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.771576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.772190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.821934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:05.857258 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a2334e2f-23c9-4796-b149-a7d54dfee81b tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-493621491" status: 201 len: 0 microversion: 2.26 time: 0.246314 Aug 06 21:12:05.858833 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2111/4113] 10.222.0.33 () {62 vars in 1377 bytes} [Sat Aug 6 21:12:05 2022] PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-493621491 => generated 0 bytes in 249 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 06 21:12:05.863932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:05.864618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:05.875632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.877029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.877651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.878669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:05.879282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:05.879879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:05.922834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:12:05.991264 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.compute.api [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Instance is already in deleting state, ignoring this request Aug 06 21:12:05.992275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ad2b6e9f-8afc-4cb8-8aa3-32f49d0fc3a6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 204 len: 0 microversion: 2.1 time: 0.132193 Aug 06 21:12:05.993008 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2112/4114] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:12:05 2022] DELETE /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:12:05.998896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:05.999584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:06.018350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.018922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.019585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.020586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.021358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.023231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.193656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:06.207909 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5fafcb40-30d1-44f9-86a2-94cc2de22338 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1368 microversion: 2.1 time: 0.579300 Aug 06 21:12:06.211338 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2003/4115] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:05 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1368 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:06.228609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729cf19c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:06.259217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.261901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.262606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.266435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:06.285459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.287673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.287673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.291509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.291509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.293807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.369476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.370204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.371476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.393555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.394182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.394776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.431690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:06.466100 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fec54201-0ddb-46eb-a545-fc7dae2ae899 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1979801039" status: 201 len: 0 microversion: 2.26 time: 0.252906 Aug 06 21:12:06.471476 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2004/4116] 10.222.0.33 () {62 vars in 1380 bytes} [Sat Aug 6 21:12:06 2022] PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags/tempest-tag-1979801039 => generated 0 bytes in 255 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 06 21:12:06.475144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:06.475935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:06.493256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.493822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.494283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.495136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.495688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.496396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.526390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:06.818167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:06.844182 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f2319875-e983-4c3b-9809-4f5eb5ba0def tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1521 microversion: 2.1 time: 0.849259 Aug 06 21:12:06.858456 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2113/4117] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:05 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1521 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:06.870437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Action: 'update_all', calling method: .version_select at 0x7f729d7765e0>, body: {"tags": ["tempest-tag-1251833202", "tempest-tag-1172986561"]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:06.888472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.889189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.889659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.890168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:06.899903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.900764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.901513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.903055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.903746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.904413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.935966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.936864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.937522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.944634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:06.955208 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-17c96c4c-d201-4273-8b8c-be82d691c5f6 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1514 microversion: 2.1 time: 0.486860 Aug 06 21:12:06.956476 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2005/4118] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:06 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1514 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:06.961606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:06.962501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:06.969788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.970629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.972147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.973118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:06.973846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:06.974888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:06.988773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:07.025020 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da0b1196-9f8a-4b31-8c5f-b698d380f2e4 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 200 len: 62 microversion: 2.26 time: 0.162167 Aug 06 21:12:07.026305 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2114/4119] 10.222.0.33 () {62 vars in 1312 bytes} [Sat Aug 6 21:12:06 2022] PUT /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 62 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:07.037062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc8e2625-5912-40f5-8ae4-83f0ad05ff2e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729d831040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:07.051982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc8e2625-5912-40f5-8ae4-83f0ad05ff2e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.052938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc8e2625-5912-40f5-8ae4-83f0ad05ff2e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.053600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc8e2625-5912-40f5-8ae4-83f0ad05ff2e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.065643 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc8e2625-5912-40f5-8ae4-83f0ad05ff2e tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 200 len: 62 microversion: 2.26 time: 0.032968 Aug 06 21:12:07.066976 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2115/4120] 10.222.0.33 () {60 vars in 1292 bytes} [Sat Aug 6 21:12:07 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 62 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:07.086396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '.version_select at 0x7f729d776940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:07.096704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.097588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.098195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.098881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:07.105765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.106495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.107157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.108178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.110609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.111271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.139514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.140815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.141673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.171435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lazy-loading 'flavor' on Instance uuid 06a03433-094b-44ac-bf2e-4ff18952260e {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:07.211010 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f71e7bc9-1e4d-44e6-937d-299b63b44639 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags" status: 204 len: 0 microversion: 2.26 time: 0.137060 Aug 06 21:12:07.211958 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2116/4121] 10.222.0.33 () {60 vars in 1295 bytes} [Sat Aug 6 21:12:07 2022] DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e/tags => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 21:12:07.226150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:07.226981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:07.253325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.256590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.262250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.264403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.265113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.265786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.325369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:12:07.514470 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67ecc5a2-9eda-4842-94d3-982245a3ab40 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 204 len: 0 microversion: 2.26 time: 0.294759 Aug 06 21:12:07.515482 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2117/4122] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:12:07 2022] DELETE /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 21:12:07.522011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:07.522918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:07.534070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.535245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.535816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.536652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.537230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.537867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.561751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:07.572573 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9354b4dc-5140-4e76-8c9d-995302f4ca7a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 0.614723 Aug 06 21:12:07.573182 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2006/4123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:06 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:07.599074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:07.600129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:07.613725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.614830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.615460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:07.616442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:07.617813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:07.618846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:08.128510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:08.142726 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7ca2691d-8709-40a9-bc3d-fdb2a5dc76ba tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1368 microversion: 2.1 time: 0.625856 Aug 06 21:12:08.143656 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2118/4124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:07 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1368 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:08.148237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:08.148849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:08.179234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:08.179789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:08.180406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:08.181391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:08.181870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:08.182378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:08.513970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:08.528977 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47c24603-93c5-4820-94a3-3d36a641c7cd tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1521 microversion: 2.1 time: 0.379281 Aug 06 21:12:08.545724 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2119/4125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:08 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:08.551789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:08.559411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:08.575460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:08.576329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:08.576999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:08.580738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:08.581606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:08.582364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:08.957097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:08.967857 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d7c1e626-9dc2-44c9-b883-ab445b2ba189 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1514 microversion: 2.1 time: 0.418489 Aug 06 21:12:08.969523 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2120/4126] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:08 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1514 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:08.982845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:08.983653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:08.990894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:08.998928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:09.000264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:09.000891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:09.001814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:09.002518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:09.003391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:09.004720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:09.007664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:09.013293 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c7692c0-b2a6-48f1-9ffe-6dec07e05774 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1549 microversion: 2.26 time: 1.428561 Aug 06 21:12:09.014633 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2007/4127] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:12:07 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1549 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:12:09.165550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:09.166203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:09.178610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:09.184213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:09.184802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:09.185588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:09.186069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:09.186516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:09.544866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:09.556724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2,nova_cell1:DELETE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:09.563303 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5cbd023-bfdc-49f5-a819-067cbf7dd04c tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 0.591545 Aug 06 21:12:09.564535 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2121/4128] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:08 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:09.570210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:09.571283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:09.598821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:09.599855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:09.600601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:09.601870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:09.602810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:09.603539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:09.837135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:09.870634 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-22e5f8c1-a71b-490d-8626-657437da0f9e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1368 microversion: 2.1 time: 0.708743 Aug 06 21:12:09.884188 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2008/4129] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:09 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1368 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:09.884188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d777a26e-c26b-4f5b-a08b-26fb2c3384b6 req-71da0eb2-d450-4c62-8295-35874c8fd24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb40ecb-cf3f-4b4e-9ec6-648761c1446f", "name": "network-vif-deleted", "tag": "3ee9f6ca-cd68-41a0-aa35-10afbae988b3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:09.895063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d777a26e-c26b-4f5b-a08b-26fb2c3384b6 req-71da0eb2-d450-4c62-8295-35874c8fd24e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:09.895952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d777a26e-c26b-4f5b-a08b-26fb2c3384b6 req-71da0eb2-d450-4c62-8295-35874c8fd24e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:09.897266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d777a26e-c26b-4f5b-a08b-26fb2c3384b6 req-71da0eb2-d450-4c62-8295-35874c8fd24e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:09.933596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:09.946697 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d777a26e-c26b-4f5b-a08b-26fb2c3384b6 req-71da0eb2-d450-4c62-8295-35874c8fd24e service nova] Creating event network-vif-deleted:3ee9f6ca-cd68-41a0-aa35-10afbae988b3 for instance feb40ecb-cf3f-4b4e-9ec6-648761c1446f on nch2-master-1 Aug 06 21:12:09.958630 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d777a26e-c26b-4f5b-a08b-26fb2c3384b6 req-71da0eb2-d450-4c62-8295-35874c8fd24e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084944 Aug 06 21:12:09.959579 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2009/4130] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:09.993249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:09.993989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:10.003734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.004235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.004680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:10.005410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.005864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.006297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:10.077263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:10.087690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.088416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.089014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:10.090250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lazy-loading 'fault' on Instance uuid feb40ecb-cf3f-4b4e-9ec6-648761c1446f {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:10.097007 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9339a985-f056-40f4-aba6-7973870065b3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1521 microversion: 2.1 time: 0.529363 Aug 06 21:12:10.097872 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2122/4131] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:09 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1521 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:10.105749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:10.110102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:10.127343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.128408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.129171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:10.130313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.130879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.131641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:10.351283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:10.361486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:10.363715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:10.373413 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-58148876-4e49-4723-86df-696f15a0b3ab tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1549 microversion: 2.26 time: 0.271003 Aug 06 21:12:10.386666 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2123/4132] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:12:10 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1549 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:12:10.520921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22318132bfd04aa0886eb9b14a983731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '591beac720d74a8889ad521c436e64c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:10.528937 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a0984ea8-e866-4a75-bf95-bac5eb7912d7 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 200 len: 1308 microversion: 2.1 time: 0.541944 Aug 06 21:12:10.529466 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2010/4133] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:09 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 1308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:10.572961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ef8386d9-2026-4eff-9382-0e0fb041b8fd req-b2bceff3-37f9-48a7-b839-76564c5ee8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac", "name": "network-vif-plugged", "status": "completed", "tag": "f1f90627-f550-4959-aa15-41f896172104"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:10.586658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:10.587789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:10.598392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ef8386d9-2026-4eff-9382-0e0fb041b8fd req-b2bceff3-37f9-48a7-b839-76564c5ee8f1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.598794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.599788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.599980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ef8386d9-2026-4eff-9382-0e0fb041b8fd req-b2bceff3-37f9-48a7-b839-76564c5ee8f1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.600626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ef8386d9-2026-4eff-9382-0e0fb041b8fd req-b2bceff3-37f9-48a7-b839-76564c5ee8f1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:10.601240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:10.602078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.602580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.603076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:10.629184 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ef8386d9-2026-4eff-9382-0e0fb041b8fd req-b2bceff3-37f9-48a7-b839-76564c5ee8f1 service nova] Creating event network-vif-plugged:f1f90627-f550-4959-aa15-41f896172104 for instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac on nch1-master-1 Aug 06 21:12:10.642723 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ef8386d9-2026-4eff-9382-0e0fb041b8fd req-b2bceff3-37f9-48a7-b839-76564c5ee8f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071963 Aug 06 21:12:10.644595 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2124/4134] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:10.898442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:10.899924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:10.923386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.926416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.938697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:10.939877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:10.940516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:10.941167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.172917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:11.182576 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8172fad8-8f8b-4733-aff9-790de3567e88 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1368 microversion: 2.1 time: 0.293047 Aug 06 21:12:11.185505 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2125/4135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:10 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:11.190641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:11.191638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:11.198782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.199627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.200338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.201279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.201964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.202630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.213951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=18 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:11.291352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:11.305152 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-17652e7d-b7eb-4db2-b343-8d396d5dde9f tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 0.722493 Aug 06 21:12:11.306569 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2011/4136] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:10 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:11.402742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:11.404784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:11.416194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.418521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.419619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.422244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:11.423115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.424142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.425678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.432284 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f28a076b-70aa-4f2d-8221-87fa13c9aa63 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1521 microversion: 2.1 time: 0.245308 Aug 06 21:12:11.433536 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2126/4137] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:11 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:11.554411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:11.556060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: feb40ecb-cf3f-4b4e-9ec6-648761c1446f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:11.564603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.565487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.566082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.569220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.570055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.570815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.592592 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] HTTP exception thrown: Instance feb40ecb-cf3f-4b4e-9ec6-648761c1446f could not be found. Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Request method failure captured: Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f HTTP/1.1 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tiJipXPSkK7BseAWjZ9BmtE-9isAHeWGxykj9XuPpGhZMcImVT4jOVlRv9P7DgxTJNtkChXIjXXkQh3dE8KGx3aJGXrHe05Kp8rcOAhXgUPBikGUFX1zsrcNYFVAzdAEdLPcHUalRULl_auHz3CncF6PYn-hDZq17_nNkT77ecqmSI Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/591beac720d74a8889ad521c436e64c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_591beac720d74a8889ad521c436e64c3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 22318132bfd04aa0886eb9b14a983731 Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance feb40ecb-cf3f-4b4e-9ec6-648761c1446f could not be found. Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'feb40ecb-cf3f-4b4e-9ec6-648761c1446f'} Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb40ecb-cf3f-4b4e-9ec6-648761c1446f could not be found. Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb40ecb-cf3f-4b4e-9ec6-648761c1446f could not be found. Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.595869 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.600788 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.600788 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.600788 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.600788 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:11.600788 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:11.600788 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb40ecb-cf3f-4b4e-9ec6-648761c1446f could not be found. Aug 06 21:12:11.600788 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.602735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Returning 404 to user: Instance feb40ecb-cf3f-4b4e-9ec6-648761c1446f could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:11.604133 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92a0f0ff-ce6b-451a-9aa5-12635d905c87 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f" status: 404 len: 111 microversion: 2.1 time: 0.057550 Aug 06 21:12:11.606161 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2127/4138] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:11 2022] GET /compute/v2.1/servers/feb40ecb-cf3f-4b4e-9ec6-648761c1446f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:12:11.615401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:11.616353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:11.625477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.626826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.627424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.628392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.629073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.629508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.648036 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] HTTP exception thrown: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Request method failure captured: Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 HTTP/1.1 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tiJipXPSkK7BseAWjZ9BmtE-9isAHeWGxykj9XuPpGhZMcImVT4jOVlRv9P7DgxTJNtkChXIjXXkQh3dE8KGx3aJGXrHe05Kp8rcOAhXgUPBikGUFX1zsrcNYFVAzdAEdLPcHUalRULl_auHz3CncF6PYn-hDZq17_nNkT77ecqmSI Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/591beac720d74a8889ad521c436e64c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_591beac720d74a8889ad521c436e64c3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 22318132bfd04aa0886eb9b14a983731 Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'c21ba021-9868-4b25-af32-7e2f42daeae1'} Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:11.649623 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Returning 404 to user: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c69d3c02-73ed-48ba-982d-ffa2962d8b6d tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 404 len: 111 microversion: 2.1 time: 0.041180 Aug 06 21:12:11.654406 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2128/4139] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:12:11 2022] DELETE /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:12:11.660399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:11.661267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: c21ba021-9868-4b25-af32-7e2f42daeae1] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:11.669039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.669859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.673204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.674248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.674982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.675609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.693370 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] HTTP exception thrown: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Request method failure captured: Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 HTTP/1.1 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tiJipXPSkK7BseAWjZ9BmtE-9isAHeWGxykj9XuPpGhZMcImVT4jOVlRv9P7DgxTJNtkChXIjXXkQh3dE8KGx3aJGXrHe05Kp8rcOAhXgUPBikGUFX1zsrcNYFVAzdAEdLPcHUalRULl_auHz3CncF6PYn-hDZq17_nNkT77ecqmSI Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/591beac720d74a8889ad521c436e64c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_591beac720d74a8889ad521c436e64c3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 22318132bfd04aa0886eb9b14a983731 Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'c21ba021-9868-4b25-af32-7e2f42daeae1'} Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.695010 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Returning 404 to user: Instance c21ba021-9868-4b25-af32-7e2f42daeae1 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3fced87e-d2bc-4cff-ae62-c71e5047660e tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1" status: 404 len: 111 microversion: 2.1 time: 0.040044 Aug 06 21:12:11.699281 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2129/4140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:11 2022] GET /compute/v2.1/servers/c21ba021-9868-4b25-af32-7e2f42daeae1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:12:11.706760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:11.707583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:11.716976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.717623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.718263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.719534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.720198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.720753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.738202 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] HTTP exception thrown: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Request method failure captured: Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 HTTP/1.1 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tiJipXPSkK7BseAWjZ9BmtE-9isAHeWGxykj9XuPpGhZMcImVT4jOVlRv9P7DgxTJNtkChXIjXXkQh3dE8KGx3aJGXrHe05Kp8rcOAhXgUPBikGUFX1zsrcNYFVAzdAEdLPcHUalRULl_auHz3CncF6PYn-hDZq17_nNkT77ecqmSI Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/591beac720d74a8889ad521c436e64c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_591beac720d74a8889ad521c436e64c3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 22318132bfd04aa0886eb9b14a983731 Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ee15ef61-72e0-4c6b-95b2-cc86cf4f3938'} Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:11.740123 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.744364 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.746753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Returning 404 to user: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:11.747638 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-358fe20f-217f-42b2-a9a7-709d61163a59 tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 404 len: 111 microversion: 2.1 time: 0.046327 Aug 06 21:12:11.748215 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2130/4141] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:12:11 2022] DELETE /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:12:11.757120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:11.757907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] [instance: ee15ef61-72e0-4c6b-95b2-cc86cf4f3938] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:11.765629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.766131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.766722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.767492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:11.767957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:11.768495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:11.784206 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] HTTP exception thrown: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Request method failure captured: Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 HTTP/1.1 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tiJipXPSkK7BseAWjZ9BmtE-9isAHeWGxykj9XuPpGhZMcImVT4jOVlRv9P7DgxTJNtkChXIjXXkQh3dE8KGx3aJGXrHe05Kp8rcOAhXgUPBikGUFX1zsrcNYFVAzdAEdLPcHUalRULl_auHz3CncF6PYn-hDZq17_nNkT77ecqmSI Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/591beac720d74a8889ad521c436e64c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_591beac720d74a8889ad521c436e64c3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/591beac720d74a8889ad521c436e64c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 591beac720d74a8889ad521c436e64c3 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994762589 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 22318132bfd04aa0886eb9b14a983731 Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerDiskConfigTestJSON-994762589-project Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ee15ef61-72e0-4c6b-95b2-cc86cf4f3938'} Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:11.786018 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.789614 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:11.789614 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:11.789614 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:11.789614 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:11.789614 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:11.789614 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. Aug 06 21:12:11.789614 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:11.791494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] Returning 404 to user: Instance ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:11.792435 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5248ab46-03df-4f1e-81ec-a5733ed07f1b tempest-ServerDiskConfigTestJSON-994762589 tempest-ServerDiskConfigTestJSON-994762589-project] 10.222.0.33 "GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938" status: 404 len: 111 microversion: 2.1 time: 0.039993 Aug 06 21:12:11.793401 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2131/4142] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:11 2022] GET /compute/v2.1/servers/ee15ef61-72e0-4c6b-95b2-cc86cf4f3938 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:12:11.953990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:11.971881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:11.973429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d050e7deab24698b6cb13d7a885606e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227ed263d0044aa39b2bf3390d4c4dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:11.974689 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b8148c86-29a6-49aa-8ceb-193fd610ca62 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 200 len: 1507 microversion: 2.26 time: 0.577472 Aug 06 21:12:11.975275 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2012/4143] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:12:11 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 1507 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:12:12.115773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-4eafc2e5-7c80-4e15-960a-a0305900a6b9 req-21baf3ac-f6c1-4eea-b433-72fb28c7c3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a03433-094b-44ac-bf2e-4ff18952260e", "name": "network-vif-deleted", "tag": "5e788c7d-6a71-46a1-b6ed-a665f8719435"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:12.134768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4eafc2e5-7c80-4e15-960a-a0305900a6b9 req-21baf3ac-f6c1-4eea-b433-72fb28c7c3f6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:12.139264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4eafc2e5-7c80-4e15-960a-a0305900a6b9 req-21baf3ac-f6c1-4eea-b433-72fb28c7c3f6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:12.144527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4eafc2e5-7c80-4e15-960a-a0305900a6b9 req-21baf3ac-f6c1-4eea-b433-72fb28c7c3f6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:12.159656 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-4eafc2e5-7c80-4e15-960a-a0305900a6b9 req-21baf3ac-f6c1-4eea-b433-72fb28c7c3f6 service nova] Creating event network-vif-deleted:5e788c7d-6a71-46a1-b6ed-a665f8719435 for instance 06a03433-094b-44ac-bf2e-4ff18952260e on nch1-master-1 Aug 06 21:12:12.171521 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-4eafc2e5-7c80-4e15-960a-a0305900a6b9 req-21baf3ac-f6c1-4eea-b433-72fb28c7c3f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059993 Aug 06 21:12:12.172790 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2132/4144] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:12.205902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:12.206918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:12.219103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:12.220475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:12.221157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:12.233841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:12.235099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:12.240674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:12.335796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:12.337302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:12.345179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:12.345995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:12.346434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:12.347441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:12.348125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:12.348647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:12.474034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:12.484388 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1f39be1d-6c1b-412f-b025-f90d85c2eca0 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1368 microversion: 2.1 time: 0.282901 Aug 06 21:12:12.485001 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2013/4145] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:12 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:12.505098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:12.505853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:12.513695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:12.514201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:12.514683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:12.515472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:12.515944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:12.516383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:12.869614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:12.882048 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2051ce00-5cfd-4ae1-bf8b-9657627eeccb tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1521 microversion: 2.1 time: 0.380859 Aug 06 21:12:12.883202 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2014/4146] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:12 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:12.891548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a2acb68c-aeee-4315-95de-1f5a2136d202 req-bd792697-c26c-4a93-a271-86fa98a33adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1358cf93-62c9-438a-9bcb-e4f9a89cf45a", "name": "network-vif-plugged", "status": "completed", "tag": "22765c99-c6b4-44e7-b83d-abdf8ac1055f"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:12.902606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a2acb68c-aeee-4315-95de-1f5a2136d202 req-bd792697-c26c-4a93-a271-86fa98a33adb service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:12.903157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a2acb68c-aeee-4315-95de-1f5a2136d202 req-bd792697-c26c-4a93-a271-86fa98a33adb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:12.903608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a2acb68c-aeee-4315-95de-1f5a2136d202 req-bd792697-c26c-4a93-a271-86fa98a33adb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:12.920455 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a2acb68c-aeee-4315-95de-1f5a2136d202 req-bd792697-c26c-4a93-a271-86fa98a33adb service nova] Creating event network-vif-plugged:22765c99-c6b4-44e7-b83d-abdf8ac1055f for instance 1358cf93-62c9-438a-9bcb-e4f9a89cf45a on nch2-master-1 Aug 06 21:12:12.925400 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a2acb68c-aeee-4315-95de-1f5a2136d202 req-bd792697-c26c-4a93-a271-86fa98a33adb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040681 Aug 06 21:12:12.926590 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2015/4147] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:12.999641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:13.000392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] [instance: 06a03433-094b-44ac-bf2e-4ff18952260e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:13.012784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:13.013419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:13.013867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:13.014891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:13.015513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:13.015949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:13.035687 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] HTTP exception thrown: Instance 06a03433-094b-44ac-bf2e-4ff18952260e could not be found. Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Request method failure captured: Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e HTTP/1.1 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tkAx1RY6jZhuZEN0FJjgCAtsVQdram-wukoptHGqDlqATqkOZE4iaaiShpAOh7kyZsF8v4u2RzIPHLqehc9LGfSEhXhv0tuWQbPRotDJvWqvXUehfv7N3MRetOwk_awLHLo9APMQRGFo98PqkCSVxVb3ffkOdb9yrWlX9RRcloGvlg Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.26 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 227ed263d0044aa39b2bf3390d4c4dc9 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerTagsTestJSON-873417754 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/227ed263d0044aa39b2bf3390d4c4dc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_227ed263d0044aa39b2bf3390d4c4dc9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/227ed263d0044aa39b2bf3390d4c4dc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/227ed263d0044aa39b2bf3390d4c4dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerTagsTestJSON-873417754 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 227ed263d0044aa39b2bf3390d4c4dc9 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerTagsTestJSON-873417754 Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerTagsTestJSON-873417754-project Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 2d050e7deab24698b6cb13d7a885606e Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerTagsTestJSON-873417754-project Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 06a03433-094b-44ac-bf2e-4ff18952260e could not be found. Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '06a03433-094b-44ac-bf2e-4ff18952260e'} Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a03433-094b-44ac-bf2e-4ff18952260e could not be found. Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a03433-094b-44ac-bf2e-4ff18952260e could not be found. Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:13.039415 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:13.044059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:13.044059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:13.044059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:13.044059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:13.044059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:13.044059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a03433-094b-44ac-bf2e-4ff18952260e could not be found. Aug 06 21:12:13.044059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:13.046734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] Returning 404 to user: Instance 06a03433-094b-44ac-bf2e-4ff18952260e could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:13.048281 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b59886a5-3fde-40dc-80b5-b357253c7738 tempest-ServerTagsTestJSON-873417754 tempest-ServerTagsTestJSON-873417754-project] 10.222.0.33 "GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e" status: 404 len: 111 microversion: 2.26 time: 0.054217 Aug 06 21:12:13.052776 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2016/4148] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:12:12 2022] GET /compute/v2.1/servers/06a03433-094b-44ac-bf2e-4ff18952260e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:12:13.206321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:13.214916 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6cf921b8-12c6-4750-b385-18321b2fd35b tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 0.890486 Aug 06 21:12:13.228902 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2133/4149] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:12 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:13.509889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:13.511237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:13.520152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:13.520996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:13.521612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:13.522642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:13.523123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:13.523573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:13.854369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:13.873530 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d06f9b5f-8432-4793-8942-0b358cd3555a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1558 microversion: 2.1 time: 0.367500 Aug 06 21:12:13.883611 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2017/4150] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:13 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1558 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:13.898096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a4ea2870-0eef-4a21-898e-369f835eea20 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:13.898772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a4ea2870-0eef-4a21-898e-369f835eea20 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:13.907083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:13.907729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:13.915265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4ea2870-0eef-4a21-898e-369f835eea20 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:13.915786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4ea2870-0eef-4a21-898e-369f835eea20 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:13.916240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4ea2870-0eef-4a21-898e-369f835eea20 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:13.918305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:13.921821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4ea2870-0eef-4a21-898e-369f835eea20 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:13.922371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4ea2870-0eef-4a21-898e-369f835eea20 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:13.922653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:13.922847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4ea2870-0eef-4a21-898e-369f835eea20 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:13.923435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:13.924367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:13.926447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:13.927108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:14.126402 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a4ea2870-0eef-4a21-898e-369f835eea20 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232725 Aug 06 21:12:14.133915 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2134/4151] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:12:13 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:14.236041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:14.237544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:14.243937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:14.244193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:14.244813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:14.246528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:14.247205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:14.247761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:14.321202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:14.331202 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f3713df-7e79-4085-bf8a-b8d932b8eda2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1521 microversion: 2.1 time: 0.427692 Aug 06 21:12:14.332185 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2018/4152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:13 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:14.374923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:14.676777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:14.689717 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b7afed6a-3aea-4dc3-95ca-5a1ef333f706 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1324 microversion: 2.1 time: 0.457175 Aug 06 21:12:14.690694 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2135/4153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:14 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:15.357117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:15.359212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:15.363134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=14 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:15.371404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:15.372851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:15.373472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:15.374444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:15.375093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:15.375777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:15.710977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:15.711726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:15.720248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:15.721035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:15.721478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:15.722232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:15.722740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:15.723174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:15.798469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:15.810121 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-66f27503-7c52-4f3e-919a-57d4937dc302 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1521 microversion: 2.1 time: 0.460154 Aug 06 21:12:15.817585 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2019/4154] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:15 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:16.345752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:16.353445 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b2e0c3ac-6228-417f-8522-27e4f1eeecf5 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1522 microversion: 2.1 time: 0.646388 Aug 06 21:12:16.358610 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2136/4155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:15 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1522 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:16.390979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:16.392094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:16.398514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:16.408092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:16.409404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:16.410197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:16.411230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:16.411967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:16.416777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:16.476074 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] HTTP exception thrown: Instance is not a member of specified network Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Request method failure captured: Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a/ips/invalid HTTP/1.1 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tkVaBTXpV3Sij9C17xvnNs1rkvSC6b_sy7Se_tkAcDyR28ZdiFuMshrQNpnbubMvAcyh7ob8UpHVaFWvKP5QbBz46xxY68cmTKIWLUcFyJrjO8r0b52j9Zljte0VAcYyXGjjdGhLxyYt9hKm2tevrkx3EvAZUCODudESl-BSvCJ2j8 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 97a16c231f804b41bfd49fe5f4d96605 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-766046523 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/97a16c231f804b41bfd49fe5f4d96605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_97a16c231f804b41bfd49fe5f4d96605", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97a16c231f804b41bfd49fe5f4d96605"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97a16c231f804b41bfd49fe5f4d96605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-766046523 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 97a16c231f804b41bfd49fe5f4d96605 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-766046523 Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerAddressesNegativeTestJSON-766046523-project Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: c1c8ba4023a444a4baa633b5c599213e Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-766046523-project Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance is not a member of specified network Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'server_id': '1358cf93-62c9-438a-9bcb-e4f9a89cf45a', 'id': 'invalid'} Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 06 21:12:16.494242 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:16.502060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Returning 404 to user: Instance is not a member of specified network {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:16.503863 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-899c4d1e-efe3-454b-9590-3322c8ea767e tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.124618 Aug 06 21:12:16.505314 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2020/4156] 10.222.0.33 () {58 vars in 1272 bytes} [Sat Aug 6 21:12:16 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a/ips/invalid => generated 91 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:12:16.515991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8527636c-9248-4f3e-bc83-97d9ae3572e7 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:16.516737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8527636c-9248-4f3e-bc83-97d9ae3572e7 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Failed to fetch instance by id 999 {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 06 21:12:16.517248 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-8527636c-9248-4f3e-bc83-97d9ae3572e7 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] HTTP exception thrown: Instance 999 could not be found. Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8527636c-9248-4f3e-bc83-97d9ae3572e7 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Request method failure captured: Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tkVaBTXpV3Sij9C17xvnNs1rkvSC6b_sy7Se_tkAcDyR28ZdiFuMshrQNpnbubMvAcyh7ob8UpHVaFWvKP5QbBz46xxY68cmTKIWLUcFyJrjO8r0b52j9Zljte0VAcYyXGjjdGhLxyYt9hKm2tevrkx3EvAZUCODudESl-BSvCJ2j8 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 97a16c231f804b41bfd49fe5f4d96605 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-766046523 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/97a16c231f804b41bfd49fe5f4d96605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_97a16c231f804b41bfd49fe5f4d96605", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97a16c231f804b41bfd49fe5f4d96605"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97a16c231f804b41bfd49fe5f4d96605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-766046523 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 97a16c231f804b41bfd49fe5f4d96605 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-766046523 Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerAddressesNegativeTestJSON-766046523-project Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: c1c8ba4023a444a4baa633b5c599213e Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-766046523-project Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 999 could not be found. Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'server_id': '999'} Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 06 21:12:16.519009 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:16.526072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8527636c-9248-4f3e-bc83-97d9ae3572e7 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Returning 404 to user: Instance 999 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:16.527858 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8527636c-9248-4f3e-bc83-97d9ae3572e7 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.017274 Aug 06 21:12:16.529162 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2137/4157] 10.222.0.33 () {58 vars in 1149 bytes} [Sat Aug 6 21:12:16 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:12:16.540917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:16.541660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:16.552169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:16.553108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:16.554094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:16.555896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:16.556380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:16.557036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:16.597673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:12:16.708680 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e636ffc0-ef82-43e8-bfa2-32f303c5a310 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 204 len: 0 microversion: 2.1 time: 0.172415 Aug 06 21:12:16.709809 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2021/4158] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:12:16 2022] DELETE /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:12:16.720322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:16.721186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:16.731305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:16.731908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:16.732741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:16.733594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:16.734278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:16.734985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:16.833479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:16.836101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:16.843773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:16.845123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:16.845811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:16.846807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:16.847497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:16.848189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:16.875837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:17.249459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:17.279978 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dbbba540-d47c-487c-8559-b7ae5256ed43 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1521 microversion: 2.1 time: 0.451138 Aug 06 21:12:17.282499 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2022/4159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:16 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:17.503556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:17.515360 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fcf218b0-5cf5-41ff-ba74-a5fb21110b77 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1528 microversion: 2.1 time: 0.801773 Aug 06 21:12:17.520836 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2138/4160] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:16 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1528 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:18.305353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:18.308239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:18.322631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:18.324147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:18.324788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:18.327618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:18.328310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:18.328926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:18.541156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:18.542102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:18.553564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:18.563935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:18.565993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:18.570759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:18.576290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:18.579391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:19.264402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:19.273717 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a60896bf-8ed8-4576-abf2-0454d763de85 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1498 microversion: 2.1 time: 0.975982 Aug 06 21:12:19.280898 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2023/4161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:18 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1498 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:19.298595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-021f0fcb-69c7-4bd4-9c09-a977176132bb req-08b40cb6-770b-46be-8f48-baaa9a74eadd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac", "tag": "f1f90627-f550-4959-aa15-41f896172104"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:19.312664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-021f0fcb-69c7-4bd4-9c09-a977176132bb req-08b40cb6-770b-46be-8f48-baaa9a74eadd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:19.313944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-021f0fcb-69c7-4bd4-9c09-a977176132bb req-08b40cb6-770b-46be-8f48-baaa9a74eadd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:19.314979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-021f0fcb-69c7-4bd4-9c09-a977176132bb req-08b40cb6-770b-46be-8f48-baaa9a74eadd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:19.319493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:19.335403 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ac8ccbc7-daa0-40b3-a52b-5377612cd9ef tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1528 microversion: 2.1 time: 0.798232 Aug 06 21:12:19.336110 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2139/4162] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:18 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1528 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:19.341255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:19.353123 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-021f0fcb-69c7-4bd4-9c09-a977176132bb req-08b40cb6-770b-46be-8f48-baaa9a74eadd service nova] Creating event network-changed:f1f90627-f550-4959-aa15-41f896172104 for instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac on nch1-master-1 Aug 06 21:12:19.358972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:19.360409 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-021f0fcb-69c7-4bd4-9c09-a977176132bb req-08b40cb6-770b-46be-8f48-baaa9a74eadd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078026 Aug 06 21:12:19.361632 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2024/4163] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:19.363582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:19.373961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:19.381815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:19.383469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:19.384750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:19.386372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:19.387273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:19.471559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:19.538072 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ed877f39-a032-421e-adc0-4b576c5c26bc tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.199916 Aug 06 21:12:19.541644 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2140/4164] 10.222.0.33 () {58 vars in 1154 bytes} [Sat Aug 6 21:12:19 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:19.557072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55f155b7-9996-4cac-9456-f6eeffba2d2a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:19.571146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55f155b7-9996-4cac-9456-f6eeffba2d2a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:19.572409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55f155b7-9996-4cac-9456-f6eeffba2d2a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:19.573663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55f155b7-9996-4cac-9456-f6eeffba2d2a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:19.636807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-55f155b7-9996-4cac-9456-f6eeffba2d2a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Going to try to start instance {{(pid=142462) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 21:12:19.751195 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55f155b7-9996-4cac-9456-f6eeffba2d2a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "POST /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374/action" status: 202 len: 0 microversion: 2.1 time: 0.199775 Aug 06 21:12:19.755193 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2025/4165] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:12:19 2022] POST /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:12:19.764924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:19.765605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:19.780213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:19.781756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:19.782458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:19.783971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:19.785061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:19.785846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:19.786785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:20.358457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:20.361049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:20.392319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:20.394890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:20.395378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:20.397710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:20.399115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:20.399646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:20.506106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:20.518646 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9a720685-9e55-46ea-8874-428229cafb83 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1507 microversion: 2.1 time: 0.756947 Aug 06 21:12:20.532516 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2141/4166] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:19 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1507 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:20.610698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-fda32eff-8efd-4328-bbb6-d949bb2eb7ff req-1f6c4043-4855-4ca7-b960-9e4a4acee53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1358cf93-62c9-438a-9bcb-e4f9a89cf45a", "name": "network-vif-deleted", "tag": "22765c99-c6b4-44e7-b83d-abdf8ac1055f"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:20.643314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fda32eff-8efd-4328-bbb6-d949bb2eb7ff req-1f6c4043-4855-4ca7-b960-9e4a4acee53e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:20.644287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fda32eff-8efd-4328-bbb6-d949bb2eb7ff req-1f6c4043-4855-4ca7-b960-9e4a4acee53e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:20.647146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fda32eff-8efd-4328-bbb6-d949bb2eb7ff req-1f6c4043-4855-4ca7-b960-9e4a4acee53e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:20.682354 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-fda32eff-8efd-4328-bbb6-d949bb2eb7ff req-1f6c4043-4855-4ca7-b960-9e4a4acee53e service nova] Creating event network-vif-deleted:22765c99-c6b4-44e7-b83d-abdf8ac1055f for instance 1358cf93-62c9-438a-9bcb-e4f9a89cf45a on nch2-master-1 Aug 06 21:12:20.694458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8ba4023a444a4baa633b5c599213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97a16c231f804b41bfd49fe5f4d96605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:20.696212 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-fda32eff-8efd-4328-bbb6-d949bb2eb7ff req-1f6c4043-4855-4ca7-b960-9e4a4acee53e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099778 Aug 06 21:12:20.704582 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2142/4167] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:20.729168 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0fe5da2a-12c0-401b-b072-ea05ef4f9b14 tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 200 len: 1486 microversion: 2.1 time: 0.357085 Aug 06 21:12:20.730077 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2026/4168] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:20 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 1486 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:21.542746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:21.543978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:21.560728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:21.561235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:21.561684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:21.562411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:21.562912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:21.563348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:21.757878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:21.757878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] [instance: 1358cf93-62c9-438a-9bcb-e4f9a89cf45a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:21.774330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:21.775147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:21.776915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:21.779614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:21.780378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:21.781057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:21.828057 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] HTTP exception thrown: Instance 1358cf93-62c9-438a-9bcb-e4f9a89cf45a could not be found. Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Request method failure captured: Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a HTTP/1.1 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tkVaBTXpV3Sij9C17xvnNs1rkvSC6b_sy7Se_tkAcDyR28ZdiFuMshrQNpnbubMvAcyh7ob8UpHVaFWvKP5QbBz46xxY68cmTKIWLUcFyJrjO8r0b52j9Zljte0VAcYyXGjjdGhLxyYt9hKm2tevrkx3EvAZUCODudESl-BSvCJ2j8 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 97a16c231f804b41bfd49fe5f4d96605 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-766046523 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/97a16c231f804b41bfd49fe5f4d96605"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_97a16c231f804b41bfd49fe5f4d96605", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97a16c231f804b41bfd49fe5f4d96605"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97a16c231f804b41bfd49fe5f4d96605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-766046523 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 97a16c231f804b41bfd49fe5f4d96605 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-766046523 Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerAddressesNegativeTestJSON-766046523-project Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: c1c8ba4023a444a4baa633b5c599213e Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-766046523-project Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 1358cf93-62c9-438a-9bcb-e4f9a89cf45a could not be found. Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '1358cf93-62c9-438a-9bcb-e4f9a89cf45a'} Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1358cf93-62c9-438a-9bcb-e4f9a89cf45a could not be found. Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1358cf93-62c9-438a-9bcb-e4f9a89cf45a could not be found. Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:21.830843 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1358cf93-62c9-438a-9bcb-e4f9a89cf45a could not be found. Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] Returning 404 to user: Instance 1358cf93-62c9-438a-9bcb-e4f9a89cf45a could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7577966b-7c2f-494d-8683-f820562b7e4a tempest-ServerAddressesNegativeTestJSON-766046523 tempest-ServerAddressesNegativeTestJSON-766046523-project] 10.222.0.33 "GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a" status: 404 len: 111 microversion: 2.1 time: 0.081714 Aug 06 21:12:21.835433 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2027/4169] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:21 2022] GET /compute/v2.1/servers/1358cf93-62c9-438a-9bcb-e4f9a89cf45a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:12:22.161028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:22.171123 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d2a92ae9-a160-4f8c-b9dc-7a6ea5a317b6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1507 microversion: 2.1 time: 0.633130 Aug 06 21:12:22.172139 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2143/4170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:21 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:23.204025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:23.205555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:23.219527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:23.220571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:23.221278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:23.222237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:23.223000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:23.223873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:24.004019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:24.013930 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4ea1a3df-ff4a-4222-9c70-23af87ede484 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1511 microversion: 2.1 time: 0.820669 Aug 06 21:12:24.020182 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2028/4171] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:23 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1511 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:24.050835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:24.056507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:24.056968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.compute.servers [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Removing options 'limit' from query {{(pid=142461) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 06 21:12:24.058015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:24.062799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:24.070707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:24.071320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:24.072308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:24.073475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:24.074367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:24.076948 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ff3c2da6-3106-4f57-8aa5-aeacfd885803 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.030000 Aug 06 21:12:24.077720 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2144/4172] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Aug 6 21:12:24 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:12:24.090306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:24.091480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:24.103398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:24.104767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:24.105363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:24.106455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:24.107260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:24.107805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:25.120944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:25.136306 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3fb5a48f-26c5-44fb-bce4-15cd6baf2d87 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1511 microversion: 2.1 time: 1.049042 Aug 06 21:12:25.137946 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2029/4173] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:24 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1511 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:25.157647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:25.158364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:25.165779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:25.166993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:25.167676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:25.168617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:25.169287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:25.169934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:25.797711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:25.805125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:25.816484 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3b78b611-ac6f-4d75-b1e7-6f898e903665 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f" status: 200 len: 1512 microversion: 2.1 time: 0.662706 Aug 06 21:12:25.818337 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2145/4174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:25 2022] GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f => generated 1512 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:25.846849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:25.848350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:25.868647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:25.869599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:25.870200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:25.871095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:25.872710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:25.873315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:26.559835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:26.569638 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-300d9239-98b7-4a2e-b152-0349a49df9ba tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1511 microversion: 2.1 time: 0.735517 Aug 06 21:12:26.591359 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2030/4175] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:25 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1511 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:26.593906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:26.599214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:26.599880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:26.835319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:26.836456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:26.836907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:26.837660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:26.838122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:26.839694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:26.947502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:27.063633 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d726ddb-3017-4504-93e6-2df9ed2dc1e6 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.473474 Aug 06 21:12:27.064896 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2146/4176] 10.222.0.33 () {58 vars in 1154 bytes} [Sat Aug 6 21:12:26 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:27.079046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:27.079683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:27.086048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:27.086814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:27.087554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:27.088521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:27.089171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:27.089776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:27.998109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:28.017001 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d572981-97da-4e6f-9522-2e35a73ce1d9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1511 microversion: 2.1 time: 0.942874 Aug 06 21:12:28.042259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:28.042922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:28.048823 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2031/4177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:27 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1511 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:28.052828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:28.054980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:28.056303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:28.057265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:28.058099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:28.058737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:28.302623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:28.317839 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-885756b4-e615-4ba3-a0fc-2d81af39ded2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f" status: 200 len: 1512 microversion: 2.1 time: 0.279982 Aug 06 21:12:28.321977 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2147/4178] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:28 2022] GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f => generated 1512 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:28.351046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:28.351715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:28.373694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:28.374217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:28.374711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:28.375619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:28.376369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:28.376823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:29.031334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:29.045097 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1223e617-d8de-48ef-9981-4ffbf20af467 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1511 microversion: 2.1 time: 0.704713 Aug 06 21:12:29.047520 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2032/4179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:28 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1511 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:29.069113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:29.074048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:29.091614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:29.101832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:29.102529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:29.103138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:29.105536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:29.106160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:29.106769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:29.165441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:29.273691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:29.288718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:29.289652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:29.290313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:29.827143 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e590f280-7ff8-46f3-af98-1949f20c1dd3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.761261 Aug 06 21:12:29.840458 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2148/4180] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:12:29 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:29.855847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:29.862425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:29.867412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:30.161514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:30.163546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:30.164552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:30.165405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:30.165882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:30.166393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:30.272554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:30.342072 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c9b5366-9fd6-4040-b423-adddf552be68 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.490070 Aug 06 21:12:30.342719 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2033/4181] 10.222.0.33 () {58 vars in 1150 bytes} [Sat Aug 6 21:12:29 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:30.359383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:30.365803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:30.366809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:30.373568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:30.374068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:30.374508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:30.375274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:30.375730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:30.376165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:30.471964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:30.538735 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2fbdc931-b8fe-4e69-a97f-c665311f79da tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.185003 Aug 06 21:12:30.539401 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2149/4182] 10.222.0.33 () {58 vars in 1212 bytes} [Sat Aug 6 21:12:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:30.552085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:30.559707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:30.561124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:30.568101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:30.569552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:30.571029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:30.573147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:30.574118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:30.574787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:30.680777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:30.766018 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e8f4acea-d0ad-41bc-acb4-7a3e4af64586 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.217904 Aug 06 21:12:30.766809 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2034/4183] 10.222.0.33 () {58 vars in 1196 bytes} [Sat Aug 6 21:12:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:30.780205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:30.786934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:30.787844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'name': '1301689217', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:30.797544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:30.798230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:30.801235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:30.802088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:30.802825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:30.803330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:30.908424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:30.999671 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a35faa61-d046-49a3-bdea-7e1ecd1f8a23 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?name=1301689217" status: 200 len: 346 microversion: 2.1 time: 0.224971 Aug 06 21:12:31.007404 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2150/4184] 10.222.0.33 () {58 vars in 1156 bytes} [Sat Aug 6 21:12:30 2022] GET /compute/v2.1/servers?name=1301689217 => generated 346 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:31.013402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:31.020027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:31.020862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:31.038064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:31.038996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:31.041500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:31.042836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:31.043646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:31.044316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:31.167957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:31.254484 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b7516023-1586-40ca-93bd-ab782f28b8f9 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.245094 Aug 06 21:12:31.255214 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2035/4185] 10.222.0.33 () {58 vars in 1154 bytes} [Sat Aug 6 21:12:31 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:31.268785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:31.274430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:31.276174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-130168921', 'deleted': False, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:12:31.282275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:31.283030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:31.283620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:31.284752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:31.285363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:31.286007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:31.390891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:12:31.474232 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c4a7e98c-6d37-430b-88d4-e88f45eaee61 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-130168921" status: 200 len: 346 microversion: 2.1 time: 0.210216 Aug 06 21:12:31.475321 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2151/4186] 10.222.0.33 () {58 vars in 1228 bytes} [Sat Aug 6 21:12:31 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-130168921 => generated 346 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:31.490416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:31.491246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:31.500128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:31.503411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:31.504158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:31.505642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:31.506514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:31.507730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:31.543719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:12:31.617812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:31.677253 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21d19bf3-d176-4020-acf7-be6ad883ca11 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 204 len: 0 microversion: 2.1 time: 0.189733 Aug 06 21:12:31.683170 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2036/4187] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:12:31 2022] DELETE /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:12:31.688835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:31.689921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:31.696722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:31.697227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:31.698519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:31.699936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:31.701271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:31.701742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:31.974948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:31.986910 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1def0c17-7328-402d-afde-25cced9d62a1 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1517 microversion: 2.1 time: 0.302397 Aug 06 21:12:31.988912 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2152/4188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:31 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1517 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:33.021556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:33.024331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:33.039798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:33.041037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:33.042163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:33.043372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:33.044145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:33.045000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:34.511721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:34.541700 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-89f67598-7d7c-4124-ad15-43fd1929c344 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1517 microversion: 2.1 time: 1.529929 Aug 06 21:12:34.544558 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2037/4189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:33 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1517 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:35.569092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:35.569715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:35.587752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:35.589231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:35.590446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:35.591384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:35.592499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:35.593144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:36.185010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:36.214210 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f34d74e0-549b-4a69-b197-9fca4ad218ef tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1517 microversion: 2.1 time: 0.640255 Aug 06 21:12:36.215526 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2153/4190] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:35 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1517 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:36.887767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f844c320-1210-4cd1-8a75-0a07021941f2 req-f35c438b-6b51-43f0-82dc-b513a95e5da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e5244d-0d66-43bd-8816-d2e84fb28e19", "name": "network-vif-deleted", "tag": "7525b8cc-d123-4d3f-ba5c-f9b305d67f06"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:36.949886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f844c320-1210-4cd1-8a75-0a07021941f2 req-f35c438b-6b51-43f0-82dc-b513a95e5da3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:36.958877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f844c320-1210-4cd1-8a75-0a07021941f2 req-f35c438b-6b51-43f0-82dc-b513a95e5da3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:36.959411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f844c320-1210-4cd1-8a75-0a07021941f2 req-f35c438b-6b51-43f0-82dc-b513a95e5da3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:36.995039 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f844c320-1210-4cd1-8a75-0a07021941f2 req-f35c438b-6b51-43f0-82dc-b513a95e5da3 service nova] Creating event network-vif-deleted:7525b8cc-d123-4d3f-ba5c-f9b305d67f06 for instance f7e5244d-0d66-43bd-8816-d2e84fb28e19 on nch1-master-1 Aug 06 21:12:37.008231 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f844c320-1210-4cd1-8a75-0a07021941f2 req-f35c438b-6b51-43f0-82dc-b513a95e5da3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125173 Aug 06 21:12:37.012843 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2038/4191] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:37.238213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:37.240320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:37.266047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:37.267049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:37.267981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:37.269343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:37.270071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:37.271705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:37.347068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:37.347833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:37.348447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:37.349070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lazy-loading 'fault' on Instance uuid f7e5244d-0d66-43bd-8816-d2e84fb28e19 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:37.458952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:37.470683 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40cd5255-7db7-46fa-9666-b48e24616bc2 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 200 len: 1310 microversion: 2.1 time: 0.237613 Aug 06 21:12:37.472906 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2154/4192] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:37 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 1310 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:37.939052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f844c320-1210-4cd1-8a75-0a07021941f2 req-f35c438b-6b51-43f0-82dc-b513a95e5da3 service nova] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:37.940101 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f844c320-1210-4cd1-8a75-0a07021941f2 req-f35c438b-6b51-43f0-82dc-b513a95e5da3 service nova] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001605 Aug 06 21:12:37.940450 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2039/4193] 10.222.0.33 () {56 vars in 886 bytes} [Sat Aug 6 21:12:37 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 06 21:12:38.493388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:38.494887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: f7e5244d-0d66-43bd-8816-d2e84fb28e19] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:38.511970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:38.513272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:38.516223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:38.519776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:38.520693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:38.522959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:38.566423 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] HTTP exception thrown: Instance f7e5244d-0d66-43bd-8816-d2e84fb28e19 could not be found. Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Request method failure captured: Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 HTTP/1.1 Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tj5tu3ZhYIjRY_9lKjVS3BfY1fzEks0Q3RHGqlD27wtxteCeavFTr3BqC1ej4sMMehZt0CLE81_9voolb_lD6mIonyGmnPDjHySm6F19FbMvVF_Mfs0D5sWaIevgdGZ8jQyDOrXKd78M6k1OffkPy8NMJl7MjLUBdcbAtPisUJIKc8 Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: b39a59bd658147feaa89b79ae9ebe3af Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ListServerFiltersTestJSON-1006080117 Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b39a59bd658147feaa89b79ae9ebe3af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b39a59bd658147feaa89b79ae9ebe3af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b39a59bd658147feaa89b79ae9ebe3af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b39a59bd658147feaa89b79ae9ebe3af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ListServerFiltersTestJSON-1006080117 Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: b39a59bd658147feaa89b79ae9ebe3af Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1006080117 Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ListServerFiltersTestJSON-1006080117-project Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 23f007a900b143c2ab6521003d025035 Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ListServerFiltersTestJSON-1006080117-project Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance f7e5244d-0d66-43bd-8816-d2e84fb28e19 could not be found. Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'f7e5244d-0d66-43bd-8816-d2e84fb28e19'} Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e5244d-0d66-43bd-8816-d2e84fb28e19 could not be found. Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e5244d-0d66-43bd-8816-d2e84fb28e19 could not be found. Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:38.571071 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:38.575195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:38.575195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:38.575195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:38.575195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:38.575195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:38.575195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e5244d-0d66-43bd-8816-d2e84fb28e19 could not be found. Aug 06 21:12:38.575195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:38.579273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Returning 404 to user: Instance f7e5244d-0d66-43bd-8816-d2e84fb28e19 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:38.580672 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a2efad55-1f3b-4e7f-a795-403a05ccb580 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19" status: 404 len: 111 microversion: 2.1 time: 0.091059 Aug 06 21:12:38.585654 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2155/4194] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:38 2022] GET /compute/v2.1/servers/f7e5244d-0d66-43bd-8816-d2e84fb28e19 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:12:38.592166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:38.592777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:38.606073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:38.606600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:38.607060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:38.607784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:38.608247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:38.618123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:38.659574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:12:38.884097 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3747cde7-764d-4223-a4ad-3006ee33558f tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f" status: 204 len: 0 microversion: 2.1 time: 0.297194 Aug 06 21:12:38.885014 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2040/4195] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:12:38 2022] DELETE /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:12:38.894046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:38.895201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:38.907164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:38.918703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:38.924095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:38.925411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:38.931897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:38.932602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:39.267686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:40.186812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:40.197219 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-051644a7-edf9-44c4-bef2-967b73ac2907 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f" status: 200 len: 1518 microversion: 2.1 time: 1.307766 Aug 06 21:12:40.210741 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2156/4196] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:38 2022] GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f => generated 1518 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:41.218539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:41.219344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:41.222358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:41.234970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:41.238793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:41.239386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:41.240173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:41.240663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:41.241111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:41.809636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:41.826681 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-de7db835-49b9-482d-9972-0bd4b715f3f3 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f" status: 200 len: 1518 microversion: 2.1 time: 0.610973 Aug 06 21:12:41.827758 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2041/4197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:41 2022] GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f => generated 1518 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:42.849405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:42.850034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:42.853987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=12 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:42.866155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:42.869512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:42.878644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:42.880011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:42.880671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:42.883932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:43.138503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:43.153226 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6ecb5ec6-7c25-4997-9c7c-93c828c73406 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f" status: 200 len: 1476 microversion: 2.1 time: 0.308051 Aug 06 21:12:43.162215 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2157/4198] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:42 2022] GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:43.233407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-cebaf950-574b-4ed4-9e00-1516c225490b req-4cc3848b-a63a-4aab-86b8-6f2691027999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee1875e-cb91-412f-b21d-437b3cb6537f", "name": "network-vif-deleted", "tag": "38b298a0-af38-4c5e-91d7-6a02768b5b5e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:43.269256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cebaf950-574b-4ed4-9e00-1516c225490b req-4cc3848b-a63a-4aab-86b8-6f2691027999 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:43.272356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cebaf950-574b-4ed4-9e00-1516c225490b req-4cc3848b-a63a-4aab-86b8-6f2691027999 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:43.273540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cebaf950-574b-4ed4-9e00-1516c225490b req-4cc3848b-a63a-4aab-86b8-6f2691027999 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:43.309894 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-cebaf950-574b-4ed4-9e00-1516c225490b req-4cc3848b-a63a-4aab-86b8-6f2691027999 service nova] Creating event network-vif-deleted:38b298a0-af38-4c5e-91d7-6a02768b5b5e for instance 0ee1875e-cb91-412f-b21d-437b3cb6537f on nch2-master-1 Aug 06 21:12:43.330983 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-cebaf950-574b-4ed4-9e00-1516c225490b req-4cc3848b-a63a-4aab-86b8-6f2691027999 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105495 Aug 06 21:12:43.331598 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2158/4199] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:43.378728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75253ae8-82af-403b-9a1c-5634efae47f8 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Action: 'create', calling method: .version_select at 0x7f72a3641940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-13699849", "metadata": {"Type": "work"}}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75253ae8-82af-403b-9a1c-5634efae47f8 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Request method failure captured: Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 120 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlKuWnoKBQVMZMVjFPGpAMtVkzz43qxzmKwtlidAkfpCYQ41FzJyiYUDE2j4AMNhDnLbvH7cqwb-6n1oBVI6wm-VGwXfpcMFHhjUh46duFbY1bhml_fQin2MSqBZa6AyshhdvOJfZgz67sNYlhcputev0fVdJMAeKt9nd8fOVQbUSE Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc43f19f84f14dcfa679306a44a084a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7f4428ffb7084beeae4b70be1356c332 Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-13699849", "metadata": {"Type": "work"}}} Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-13699849', 'metadata': {'Type': 'work'}}}} Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi '#$%' Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:12:43.387455 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 21:12:43.392245 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.401544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75253ae8-82af-403b-9a1c-5634efae47f8 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:43.404683 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-75253ae8-82af-403b-9a1c-5634efae47f8 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.406814 Aug 06 21:12:43.410905 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2042/4200] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:12:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 414 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:12:43.424955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5b570f6-fa11-40e4-b7f2-11631a4c3660 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Action: 'create', calling method: .version_select at 0x7f729d982670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-154376820", "metadata": {"Type": "work"}}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5b570f6-fa11-40e4-b7f2-11631a4c3660 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Request method failure captured: Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 119 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlKuWnoKBQVMZMVjFPGpAMtVkzz43qxzmKwtlidAkfpCYQ41FzJyiYUDE2j4AMNhDnLbvH7cqwb-6n1oBVI6wm-VGwXfpcMFHhjUh46duFbY1bhml_fQin2MSqBZa6AyshhdvOJfZgz67sNYlhcputev0fVdJMAeKt9nd8fOVQbUSE Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc43f19f84f14dcfa679306a44a084a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7f4428ffb7084beeae4b70be1356c332 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-154376820", "metadata": {"Type": "work"}}} Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-154376820', 'metadata': {'Type': 'work'}}}} Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi '0' Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:12:43.444646 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 21:12:43.450191 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.456291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5b570f6-fa11-40e4-b7f2-11631a4c3660 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:43.460742 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b5b570f6-fa11-40e4-b7f2-11631a4c3660 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.047076 Aug 06 21:12:43.464272 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2043/4201] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:12:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:12:43.477090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c282bd3-7907-4f2c-b0a5-23f8363aebec tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Action: 'create', calling method: .version_select at 0x7f729d96ca60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1721756664", "metadata": {"Type": "work"}}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c282bd3-7907-4f2c-b0a5-23f8363aebec tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Request method failure captured: Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 119 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlKuWnoKBQVMZMVjFPGpAMtVkzz43qxzmKwtlidAkfpCYQ41FzJyiYUDE2j4AMNhDnLbvH7cqwb-6n1oBVI6wm-VGwXfpcMFHhjUh46duFbY1bhml_fQin2MSqBZa6AyshhdvOJfZgz67sNYlhcputev0fVdJMAeKt9nd8fOVQbUSE Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc43f19f84f14dcfa679306a44a084a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7f4428ffb7084beeae4b70be1356c332 Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1721756664", "metadata": {"Type": "work"}}} Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1721756664', 'metadata': {'Type': 'work'}}}} Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi '' Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:12:43.482180 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 21:12:43.486787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.487515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-902fe98b-53d6-40a6-b114-888ef824eac4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'create', calling method: .version_select at 0x7f72a35c1a60>, body: {"keypair": {"name": "tempest-keypair-683625295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHRrndAqUvyMwdzcWbl6qB2IgdAwEhZFnu3r8LDQYRKSN6Mz7kAUFX+LrSColGDFvHS128otgjIUtXsCZyatip+WmfoxnIGokeEuwopcmi49ibNF3NTocBGsVidrZsjQg=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:43.489378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c282bd3-7907-4f2c-b0a5-23f8363aebec tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:43.491845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3c282bd3-7907-4f2c-b0a5-23f8363aebec tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023544 Aug 06 21:12:43.492884 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2044/4202] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:12:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:12:43.505644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf68e949-1737-47a3-bc39-eda21ff4b1a6 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Calling method '.version_select at 0x7f729d8e4a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:43.522063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-902fe98b-53d6-40a6-b114-888ef824eac4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for project 9feea686598e4a0d90d716e00e3e290a. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:12:43.551348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-902fe98b-53d6-40a6-b114-888ef824eac4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for user 9b8463a42f2642aaba586380391de6fd and project 9feea686598e4a0d90d716e00e3e290a. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:12:43.563907 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-bf68e949-1737-47a3-bc39-eda21ff4b1a6 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] HTTP exception thrown: Volume tempest-invalid-440695672 could not be found. Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf68e949-1737-47a3-bc39-eda21ff4b1a6 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Request method failure captured: Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-440695672 HTTP/1.1 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlKuWnoKBQVMZMVjFPGpAMtVkzz43qxzmKwtlidAkfpCYQ41FzJyiYUDE2j4AMNhDnLbvH7cqwb-6n1oBVI6wm-VGwXfpcMFHhjUh46duFbY1bhml_fQin2MSqBZa6AyshhdvOJfZgz67sNYlhcputev0fVdJMAeKt9nd8fOVQbUSE Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc43f19f84f14dcfa679306a44a084a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7f4428ffb7084beeae4b70be1356c332 Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: exception: Volume tempest-invalid-440695672 could not be found. Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'tempest-invalid-440695672'} Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-440695672 could not be found. (HTTP 404) (Request-ID: req-41276bfc-733f-4afe-bb8d-d4cbf23c9959) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 21:12:43.566111 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-440695672 could not be found. Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-440695672 could not be found. Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-440695672 could not be found. Aug 06 21:12:43.570767 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.576383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf68e949-1737-47a3-bc39-eda21ff4b1a6 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Returning 404 to user: Volume tempest-invalid-440695672 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:43.576383 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bf68e949-1737-47a3-bc39-eda21ff4b1a6 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-440695672" status: 404 len: 98 microversion: 2.1 time: 0.075324 Aug 06 21:12:43.576383 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2045/4203] 10.222.0.33 () {58 vars in 1215 bytes} [Sat Aug 6 21:12:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-440695672 => generated 98 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 06 21:12:43.588033 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-477fe1ad-6162-4027-8855-0edcae84bb23 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004575 Aug 06 21:12:43.589130 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2046/4204] 10.222.0.33 () {58 vars in 1140 bytes} [Sat Aug 6 21:12:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 21:12:43.598216 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5536b8a3-4ca1-446c-bad9-94e0898a6727 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003875 Aug 06 21:12:43.599116 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2047/4205] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:12:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 06 21:12:43.609390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-12b234f3-e1c3-44b6-a1c2-65bc81aac593 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Calling method '.version_select at 0x7f72a36415e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:43.611496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-902fe98b-53d6-40a6-b114-888ef824eac4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.278603 Aug 06 21:12:43.612136 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2159/4206] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:12:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:43.664867 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-12b234f3-e1c3-44b6-a1c2-65bc81aac593 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] HTTP exception thrown: Volume f8891f5c-1208-4966-a057-78bc310a6c3e could not be found. Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-12b234f3-e1c3-44b6-a1c2-65bc81aac593 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Request method failure captured: Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/os-volumes/f8891f5c-1208-4966-a057-78bc310a6c3e HTTP/1.1 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlKuWnoKBQVMZMVjFPGpAMtVkzz43qxzmKwtlidAkfpCYQ41FzJyiYUDE2j4AMNhDnLbvH7cqwb-6n1oBVI6wm-VGwXfpcMFHhjUh46duFbY1bhml_fQin2MSqBZa6AyshhdvOJfZgz67sNYlhcputev0fVdJMAeKt9nd8fOVQbUSE Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc43f19f84f14dcfa679306a44a084a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7f4428ffb7084beeae4b70be1356c332 Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: method: Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: exception: Volume f8891f5c-1208-4966-a057-78bc310a6c3e could not be found. Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'f8891f5c-1208-4966-a057-78bc310a6c3e'} Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8891f5c-1208-4966-a057-78bc310a6c3e could not be found. (HTTP 404) (Request-ID: req-41dfe3e7-372e-4343-8851-f6da5d3b2322) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 21:12:43.668287 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8891f5c-1208-4966-a057-78bc310a6c3e could not be found. Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8891f5c-1208-4966-a057-78bc310a6c3e could not be found. Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8891f5c-1208-4966-a057-78bc310a6c3e could not be found. Aug 06 21:12:43.671973 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.681375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-12b234f3-e1c3-44b6-a1c2-65bc81aac593 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Returning 404 to user: Volume f8891f5c-1208-4966-a057-78bc310a6c3e could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:43.681375 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-12b234f3-e1c3-44b6-a1c2-65bc81aac593 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/f8891f5c-1208-4966-a057-78bc310a6c3e" status: 404 len: 109 microversion: 2.1 time: 0.075193 Aug 06 21:12:43.681375 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2048/4207] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:12:43 2022] DELETE /compute/v2.1/os-volumes/f8891f5c-1208-4966-a057-78bc310a6c3e => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:12:43.692268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b954e252-7514-4ae6-8014-51e4b48ea920 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Calling method '.version_select at 0x7f72a34eb310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:43.761121 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-b954e252-7514-4ae6-8014-51e4b48ea920 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] HTTP exception thrown: Volume 949aec87-f784-49c3-a349-f76d58c6edba could not be found. Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b954e252-7514-4ae6-8014-51e4b48ea920 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Request method failure captured: Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-volumes/949aec87-f784-49c3-a349-f76d58c6edba HTTP/1.1 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlKuWnoKBQVMZMVjFPGpAMtVkzz43qxzmKwtlidAkfpCYQ41FzJyiYUDE2j4AMNhDnLbvH7cqwb-6n1oBVI6wm-VGwXfpcMFHhjUh46duFbY1bhml_fQin2MSqBZa6AyshhdvOJfZgz67sNYlhcputev0fVdJMAeKt9nd8fOVQbUSE Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc43f19f84f14dcfa679306a44a084a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc43f19f84f14dcfa679306a44a084a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cc43f19f84f14dcfa679306a44a084a4 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-VolumesNegativeTest-1129616845 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7f4428ffb7084beeae4b70be1356c332 Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-VolumesNegativeTest-1129616845-project Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: exception: Volume 949aec87-f784-49c3-a349-f76d58c6edba could not be found. Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '949aec87-f784-49c3-a349-f76d58c6edba'} Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 949aec87-f784-49c3-a349-f76d58c6edba could not be found. (HTTP 404) (Request-ID: req-67c13a04-3b5f-4495-8ef4-f8fd15c8014f) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 21:12:43.764198 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 949aec87-f784-49c3-a349-f76d58c6edba could not be found. Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 949aec87-f784-49c3-a349-f76d58c6edba could not be found. Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 949aec87-f784-49c3-a349-f76d58c6edba could not be found. Aug 06 21:12:43.769504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:43.775895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b954e252-7514-4ae6-8014-51e4b48ea920 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] Returning 404 to user: Volume 949aec87-f784-49c3-a349-f76d58c6edba could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:43.775895 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b954e252-7514-4ae6-8014-51e4b48ea920 tempest-VolumesNegativeTest-1129616845 tempest-VolumesNegativeTest-1129616845-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/949aec87-f784-49c3-a349-f76d58c6edba" status: 404 len: 109 microversion: 2.1 time: 0.087585 Aug 06 21:12:43.776396 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2160/4208] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:12:43 2022] GET /compute/v2.1/os-volumes/949aec87-f784-49c3-a349-f76d58c6edba => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:12:44.188279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:44.189081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 0ee1875e-cb91-412f-b21d-437b3cb6537f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:44.203980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:44.205769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:44.207169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:44.211035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:44.211789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:44.212395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:44.259571 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] HTTP exception thrown: Instance 0ee1875e-cb91-412f-b21d-437b3cb6537f could not be found. Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Request method failure captured: Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f HTTP/1.1 Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tj5tu3ZhYIjRY_9lKjVS3BfY1fzEks0Q3RHGqlD27wtxteCeavFTr3BqC1ej4sMMehZt0CLE81_9voolb_lD6mIonyGmnPDjHySm6F19FbMvVF_Mfs0D5sWaIevgdGZ8jQyDOrXKd78M6k1OffkPy8NMJl7MjLUBdcbAtPisUJIKc8 Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: b39a59bd658147feaa89b79ae9ebe3af Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ListServerFiltersTestJSON-1006080117 Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b39a59bd658147feaa89b79ae9ebe3af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b39a59bd658147feaa89b79ae9ebe3af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b39a59bd658147feaa89b79ae9ebe3af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b39a59bd658147feaa89b79ae9ebe3af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ListServerFiltersTestJSON-1006080117 Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: b39a59bd658147feaa89b79ae9ebe3af Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1006080117 Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ListServerFiltersTestJSON-1006080117-project Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 23f007a900b143c2ab6521003d025035 Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ListServerFiltersTestJSON-1006080117-project Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 0ee1875e-cb91-412f-b21d-437b3cb6537f could not be found. Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '0ee1875e-cb91-412f-b21d-437b3cb6537f'} Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee1875e-cb91-412f-b21d-437b3cb6537f could not be found. Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee1875e-cb91-412f-b21d-437b3cb6537f could not be found. Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:44.263477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:44.267893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:44.267893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:44.267893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:44.267893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:44.267893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:44.267893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee1875e-cb91-412f-b21d-437b3cb6537f could not be found. Aug 06 21:12:44.267893 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:44.269220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Returning 404 to user: Instance 0ee1875e-cb91-412f-b21d-437b3cb6537f could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:44.270375 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-650e177a-2bd8-41db-be93-7bfe8ac9ba90 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f" status: 404 len: 111 microversion: 2.1 time: 0.089355 Aug 06 21:12:44.271465 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2049/4209] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:44 2022] GET /compute/v2.1/servers/0ee1875e-cb91-412f-b21d-437b3cb6537f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:12:44.287152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:44.287687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:44.309561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:44.310111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:44.310616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:44.311393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:44.311860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:44.312300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:44.395353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:12:44.505971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:44.562308 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-daeae7c8-b706-48f6-9913-de19e27d6a6a tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 204 len: 0 microversion: 2.1 time: 0.285402 Aug 06 21:12:44.566309 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2161/4210] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:12:44 2022] DELETE /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:12:44.582784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:44.582784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:44.587015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:44.594663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:44.595486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:44.596416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:44.597388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:44.597990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:45.591413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:45.608232 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8ab1ce1c-5385-414b-b415-55b9952a8246 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1517 microversion: 2.1 time: 1.040128 Aug 06 21:12:45.623681 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2050/4211] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:44 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1517 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:46.634081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:46.637395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:46.673205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:46.673986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:46.674642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:46.675568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:46.676180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:46.676759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:47.815950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:47.843127 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-815d3fcd-d1c9-44c4-8006-8287d234bb0b tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1517 microversion: 2.1 time: 1.216833 Aug 06 21:12:47.851982 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2162/4212] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:46 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1517 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:48.738581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1315571770", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:48.757755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:48.844730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] validate_networks() for [('c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:12:48.878224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:48.879650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:48.889636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:48.891274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:48.892068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:48.893749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:48.894444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:48.895944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:49.081833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:49.094846 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf45ebc3-a3f2-4ad6-bb31-7966a1a0b558 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1475 microversion: 2.1 time: 0.224210 Aug 06 21:12:49.105136 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2163/4213] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:48 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1475 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:49.220574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d87ae007-c43c-4f44-a0f5-348002a0b651 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:49.222594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d87ae007-c43c-4f44-a0f5-348002a0b651 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:49.241355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d87ae007-c43c-4f44-a0f5-348002a0b651 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:49.246100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d87ae007-c43c-4f44-a0f5-348002a0b651 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:49.253802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d87ae007-c43c-4f44-a0f5-348002a0b651 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:49.257035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d87ae007-c43c-4f44-a0f5-348002a0b651 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:49.257798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d87ae007-c43c-4f44-a0f5-348002a0b651 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:49.259702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d87ae007-c43c-4f44-a0f5-348002a0b651 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:49.337980 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d87ae007-c43c-4f44-a0f5-348002a0b651 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac/ips" status: 200 len: 150 microversion: 2.1 time: 0.118627 Aug 06 21:12:49.343563 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2164/4214] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:12:49 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac/ips => generated 150 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:49.355953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da21e4cb-8f2e-4146-9204-b6a84bccd68b"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:49.359374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:49.379846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:49.380577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:49.381294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:49.383304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:49.385813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:49.387092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:49.659956 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Invalid volume: volume da21e4cb-8f2e-4146-9204-b6a84bccd68b is already attached to instances: 2fd012aa-4178-47e4-81cd-a975a14958df Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac/os-volume_attachments HTTP/1.1 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 74 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: {"volumeAttachment": {"volumeId": "da21e4cb-8f2e-4146-9204-b6a84bccd68b"}} Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid volume: volume da21e4cb-8f2e-4146-9204-b6a84bccd68b is already attached to instances: 2fd012aa-4178-47e4-81cd-a975a14958df Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'server_id': '1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac', 'body': {'volumeAttachment': {'volumeId': 'da21e4cb-8f2e-4146-9204-b6a84bccd68b'}}} Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume da21e4cb-8f2e-4146-9204-b6a84bccd68b is already attached to instances: 2fd012aa-4178-47e4-81cd-a975a14958df Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:12:49.665142 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume da21e4cb-8f2e-4146-9204-b6a84bccd68b is already attached to instances: 2fd012aa-4178-47e4-81cd-a975a14958df Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume da21e4cb-8f2e-4146-9204-b6a84bccd68b is already attached to instances: 2fd012aa-4178-47e4-81cd-a975a14958df Aug 06 21:12:49.670657 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:49.671732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 400 to user: Invalid volume: volume da21e4cb-8f2e-4146-9204-b6a84bccd68b is already attached to instances: 2fd012aa-4178-47e4-81cd-a975a14958df {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:49.674856 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5cdb2bef-d773-424d-bd3d-a0adfbc59fd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.321998 Aug 06 21:12:49.676285 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2165/4215] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:12:49 2022] POST /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac/os-volume_attachments => generated 174 bytes in 326 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:12:49.712046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e5b88d62-e284-4c6f-a1f0-7f5b379545cb req-37655092-e2b2-4760-bb71-29b15aa0f4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a90fe4-8b15-4d15-b524-16b72c4d9374", "name": "network-vif-deleted", "tag": "b1bd8d73-feb8-41c9-a24f-ffd0303bdec4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:49.746770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e5b88d62-e284-4c6f-a1f0-7f5b379545cb req-37655092-e2b2-4760-bb71-29b15aa0f4ad service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:49.747468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e5b88d62-e284-4c6f-a1f0-7f5b379545cb req-37655092-e2b2-4760-bb71-29b15aa0f4ad service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:49.748053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e5b88d62-e284-4c6f-a1f0-7f5b379545cb req-37655092-e2b2-4760-bb71-29b15aa0f4ad service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:49.804158 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e5b88d62-e284-4c6f-a1f0-7f5b379545cb req-37655092-e2b2-4760-bb71-29b15aa0f4ad service nova] Creating event network-vif-deleted:b1bd8d73-feb8-41c9-a24f-ffd0303bdec4 for instance 09a90fe4-8b15-4d15-b524-16b72c4d9374 on nch2-master-1 Aug 06 21:12:49.840062 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e5b88d62-e284-4c6f-a1f0-7f5b379545cb req-37655092-e2b2-4760-bb71-29b15aa0f4ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158556 Aug 06 21:12:49.842236 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2166/4216] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:49.852563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:49.854236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:49.893462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:49.904638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:49.905887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:49.908493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:49.909290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:49.909775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:49.910227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:49.975753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:12:50.150688 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-46b79e43-dd1b-49a0-8a87-bfc418f972e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 204 len: 0 microversion: 2.1 time: 0.303604 Aug 06 21:12:50.154614 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2167/4217] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:12:49 2022] DELETE /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:12:50.161988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:50.162874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:50.182017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:50.182596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:50.183199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:50.184008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:50.184484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:50.184919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:50.297153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:50.297642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:50.298090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:50.298636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lazy-loading 'fault' on Instance uuid 09a90fe4-8b15-4d15-b524-16b72c4d9374 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:50.511166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23f007a900b143c2ab6521003d025035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39a59bd658147feaa89b79ae9ebe3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:50.522916 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5484cf16-ed46-4a91-be8a-e848546a8ce8 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 200 len: 1311 microversion: 2.1 time: 0.365747 Aug 06 21:12:50.535138 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2168/4218] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:50 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 1311 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:50.560549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:50.561189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:50.607895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:50.611077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:50.613308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:50.615237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:50.623400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:50.625936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:51.296159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:12:51.296738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:12:51.297074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:12:51.297568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:12:51.298073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:12:51.330710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:51.331359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:51.331899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:51.332802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:51.334771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:51.335289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:51.388002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Getting quotas for project da1a7d63a1a048df9cdf8e86a26b4086. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:12:51.408078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Getting quotas for user a6c953ff2f774041a7d50f53033ee124 and project da1a7d63a1a048df9cdf8e86a26b4086. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:12:51.445137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:12:51.454182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:12:51.472803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:51.488011 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ff5cde3b-041c-4a0f-825b-3f2953622886 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1683 microversion: 2.1 time: 0.952060 Aug 06 21:12:51.491688 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2169/4219] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:50 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1683 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:51.543172 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e641ac2e-0a75-4278-b6f1-aedbaf391aeb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.337184 Aug 06 21:12:51.549912 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2051/4220] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:12:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:12:51.552500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:51.553645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] [instance: 09a90fe4-8b15-4d15-b524-16b72c4d9374] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:51.559178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a4cd28b0-94f5-48ba-83e1-d3ed7a9f98bc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:51.560709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a4cd28b0-94f5-48ba-83e1-d3ed7a9f98bc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:51.592453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:51.596819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:51.597458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:51.603915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:51.604622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:51.605235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:51.641102 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] HTTP exception thrown: Instance 09a90fe4-8b15-4d15-b524-16b72c4d9374 could not be found. Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Request method failure captured: Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 HTTP/1.1 Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tj5tu3ZhYIjRY_9lKjVS3BfY1fzEks0Q3RHGqlD27wtxteCeavFTr3BqC1ej4sMMehZt0CLE81_9voolb_lD6mIonyGmnPDjHySm6F19FbMvVF_Mfs0D5sWaIevgdGZ8jQyDOrXKd78M6k1OffkPy8NMJl7MjLUBdcbAtPisUJIKc8 Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: b39a59bd658147feaa89b79ae9ebe3af Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ListServerFiltersTestJSON-1006080117 Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b39a59bd658147feaa89b79ae9ebe3af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b39a59bd658147feaa89b79ae9ebe3af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b39a59bd658147feaa89b79ae9ebe3af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b39a59bd658147feaa89b79ae9ebe3af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ListServerFiltersTestJSON-1006080117 Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: b39a59bd658147feaa89b79ae9ebe3af Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1006080117 Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ListServerFiltersTestJSON-1006080117-project Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 23f007a900b143c2ab6521003d025035 Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ListServerFiltersTestJSON-1006080117-project Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 09a90fe4-8b15-4d15-b524-16b72c4d9374 could not be found. Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '09a90fe4-8b15-4d15-b524-16b72c4d9374'} Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a90fe4-8b15-4d15-b524-16b72c4d9374 could not be found. Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a90fe4-8b15-4d15-b524-16b72c4d9374 could not be found. Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:51.644024 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:51.648310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:51.648310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:51.648310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:51.648310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:51.648310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:51.648310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a90fe4-8b15-4d15-b524-16b72c4d9374 could not be found. Aug 06 21:12:51.648310 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:12:51.652910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] Returning 404 to user: Instance 09a90fe4-8b15-4d15-b524-16b72c4d9374 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:51.658501 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5be7c731-fd44-48cb-adb7-776effef5400 tempest-ListServerFiltersTestJSON-1006080117 tempest-ListServerFiltersTestJSON-1006080117-project] 10.222.0.33 "GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374" status: 404 len: 111 microversion: 2.1 time: 0.116108 Aug 06 21:12:51.659719 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2170/4221] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:51 2022] GET /compute/v2.1/servers/09a90fe4-8b15-4d15-b524-16b72c4d9374 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:12:51.843202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a4cd28b0-94f5-48ba-83e1-d3ed7a9f98bc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:51.864319 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a4cd28b0-94f5-48ba-83e1-d3ed7a9f98bc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1217 microversion: 2.1 time: 0.312615 Aug 06 21:12:51.865445 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2052/4222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:51 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1217 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:52.516389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:52.517663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:52.540047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:52.541823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:52.543051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:52.544125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:52.544785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:52.545416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:52.887969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:52.891507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:52.908048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:52.910484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:52.911151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:52.912737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:52.921487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:52.922188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:53.044489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:53.053860 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-63992f32-40f1-4a15-b562-9c06187cccf8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1683 microversion: 2.1 time: 0.542057 Aug 06 21:12:53.072857 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2171/4223] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:52 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1683 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:53.138755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:53.167488 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3d0b5e4b-cc0e-4c26-9771-2b4d0df3cc0f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1269 microversion: 2.1 time: 0.277117 Aug 06 21:12:53.168332 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2053/4224] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:52 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1269 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:53.420201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1273848813", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c08e52fc-aab5-48dd-94e2-7ca909bf5d7b"}], "security_groups": [{"name": "tempest-securitygroup--1071831317"}], "key_name": "tempest-keypair-683625295", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:53.580589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:12:53.650755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] validate_networks() for [('c08e52fc-aab5-48dd-94e2-7ca909bf5d7b', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:12:54.080248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:54.081619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:54.090721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:54.092054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:54.092768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:54.093736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:54.094452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:54.095161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:54.557118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:12:54.558040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:12:54.558521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:12:54.558975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:12:54.559679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:12:54.579166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:54.580239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:54.580859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:54.581819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:54.582973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:54.583840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:54.615327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:12:54.623490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for user 9b8463a42f2642aaba586380391de6fd and project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:12:54.643784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:12:54.646796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:12:54.694252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:54.705425 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a5246b47-90d7-48c0-bbcb-1669f5ab4467 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1683 microversion: 2.1 time: 0.628971 Aug 06 21:12:54.706018 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2054/4225] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:54 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1683 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:54.716041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:54.721044 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-99f37421-8715-418e-8865-18b39daed170 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.305034 Aug 06 21:12:54.727056 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2172/4226] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:12:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:12:54.735329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:54.736579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f5a6aa4b-53b6-4f6b-98f0-0ce7b31694a8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:54.737320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f5a6aa4b-53b6-4f6b-98f0-0ce7b31694a8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:54.757907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:54.758414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:54.759682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:54.760445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:54.760910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:54.761345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:54.876612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f5a6aa4b-53b6-4f6b-98f0-0ce7b31694a8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:54.890559 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f5a6aa4b-53b6-4f6b-98f0-0ce7b31694a8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1238 microversion: 2.1 time: 0.159650 Aug 06 21:12:54.903826 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2173/4227] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:54 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1238 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:55.075671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:55.096646 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4fa3eea8-fa85-4a2e-b52d-5e60d433861d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1275 microversion: 2.1 time: 0.385684 Aug 06 21:12:55.098853 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2055/4228] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:54 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1275 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:55.733284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:55.733984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:55.762703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:55.764602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:55.765327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:55.767117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:55.768886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:55.771026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:55.877518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:55.907152 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e6f4493-96e0-4248-bbe3-ec5571fe6fdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1615 microversion: 2.1 time: 0.179439 Aug 06 21:12:55.923265 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2174/4229] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:55 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1615 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:55.927178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:55.927837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:55.946099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:55.946693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:55.947142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:55.947855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:55.948551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:55.949139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:56.120183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:56.120821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:56.131835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:56.133621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:56.135860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:56.138495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:56.139039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:56.141241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:56.358789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:56.372250 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb7d871b-3972-4373-9274-b23989825fdf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1290 microversion: 2.1 time: 0.461471 Aug 06 21:12:56.374844 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2056/4230] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:55 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1290 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:56.492054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-6cc038bb-0095-44f5-9962-555d7e96ed6d req-4f5c19c2-fcf4-4229-8646-72bf8207f9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac", "name": "network-vif-deleted", "tag": "f1f90627-f550-4959-aa15-41f896172104"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:12:56.515830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6cc038bb-0095-44f5-9962-555d7e96ed6d req-4f5c19c2-fcf4-4229-8646-72bf8207f9f8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:56.519045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6cc038bb-0095-44f5-9962-555d7e96ed6d req-4f5c19c2-fcf4-4229-8646-72bf8207f9f8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:56.520300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6cc038bb-0095-44f5-9962-555d7e96ed6d req-4f5c19c2-fcf4-4229-8646-72bf8207f9f8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:56.564216 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-6cc038bb-0095-44f5-9962-555d7e96ed6d req-4f5c19c2-fcf4-4229-8646-72bf8207f9f8 service nova] Creating event network-vif-deleted:f1f90627-f550-4959-aa15-41f896172104 for instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac on nch1-master-1 Aug 06 21:12:56.577817 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-6cc038bb-0095-44f5-9962-555d7e96ed6d req-4f5c19c2-fcf4-4229-8646-72bf8207f9f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089314 Aug 06 21:12:56.580482 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2057/4231] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:12:56.934031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:56.935138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:56.952655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:56.953154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:56.953594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:56.958323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:56.958875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:56.959322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:57.043253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:57.043744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:57.044356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:57.048053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lazy-loading 'fault' on Instance uuid 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:57.164090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:57.200725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:57.203444 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6ed64ed-b65c-455d-aded-2ceeec66315c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1317 microversion: 2.1 time: 1.083432 Aug 06 21:12:57.210639 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ea10df76-11ed-4394-b728-33c0aebd5c04 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 200 len: 1332 microversion: 2.1 time: 0.281834 Aug 06 21:12:57.214832 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2058/4233] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:56 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 1332 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:57.218962 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2175/4233] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:56 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1317 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:57.394980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:57.395531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:57.408028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:57.408533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:57.408979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:57.409699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:57.410160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:57.410613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:57.545993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:57.556349 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a92d0de4-3838-41be-a47f-92e2a61937a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1296 microversion: 2.1 time: 0.165409 Aug 06 21:12:57.560055 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2059/4234] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:57 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1296 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:58.225685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:58.233407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:58.235140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:58.235835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:58.250043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:58.250951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:58.255309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:58.255778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:58.257712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:58.257841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:58.258288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:58.259069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:58.261303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:58.262359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:58.265409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:58.267617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:58.308444 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac HTTP/1.1 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac'} Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:12:58.310824 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:58.314675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:12:58.314675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:12:58.314675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:12:58.314675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:12:58.314675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:12:58.314675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:12:58.314675 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:12:58.316217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:12:58.317265 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-64cc4f08-a621-4f81-ade9-c5c69b8c4a1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 404 len: 111 microversion: 2.1 time: 0.086387 Aug 06 21:12:58.318368 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2060/4235] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:58 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:12:58.327218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a027355e-8378-47a0-bd3b-591a5c781a79 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '.version_select at 0x7f729cfa20d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:58.372995 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a027355e-8378-47a0-bd3b-591a5c781a79 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234818718" status: 202 len: 0 microversion: 2.1 time: 0.049025 Aug 06 21:12:58.374605 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2061/4236] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:12:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234818718 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:12:58.583467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:58.584150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:58.590779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:58.591489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:58.592132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:58.593191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:58.600345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:58.601473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:58.764566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:58.773598 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9dc26a89-654e-49bf-aee4-0afd34e1d7de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1317 microversion: 2.1 time: 0.552561 Aug 06 21:12:58.779519 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2176/4237] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:58 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:12:58.869128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:12:58.877774 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a1c5be3b-6fac-4fd2-ba1a-fbcc0fb00501 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1296 microversion: 2.1 time: 0.300650 Aug 06 21:12:58.878633 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2062/4238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:58 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1296 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:12:59.667497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:59.669064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:59.680017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:59.680987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:59.681629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:59.683172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:59.683826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:59.684455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:59.802131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:59.802862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:59.811690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:59.812192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:59.812817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:59.813549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:12:59.814015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:12:59.814450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:12:59.816810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lazy-loading 'services' on Instance uuid 2fd012aa-4178-47e4-81cd-a975a14958df {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:12:59.923960 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aea6d555-02cf-4470-8990-837add916c5b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-volume_attachments/da21e4cb-8f2e-4146-9204-b6a84bccd68b" status: 202 len: 0 microversion: 2.1 time: 0.262971 Aug 06 21:12:59.925313 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2177/4239] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Aug 6 21:12:59 2022] DELETE /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-volume_attachments/da21e4cb-8f2e-4146-9204-b6a84bccd68b => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:12:59.953972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:12:59.955444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:12:59.991832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:00.006960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:00.010418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:00.015151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:00.017317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:00.019955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:00.132446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:00.154257 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-09aac84f-2e2b-4220-a44b-44ef6d1a145f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1296 microversion: 2.1 time: 0.211253 Aug 06 21:13:00.156012 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2178/4240] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:59 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:00.171883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2db91f9f-a090-44b1-ad19-e0420ecb5d48 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:00.175065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2db91f9f-a090-44b1-ad19-e0420ecb5d48 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:00.184490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db91f9f-a090-44b1-ad19-e0420ecb5d48 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:00.185234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db91f9f-a090-44b1-ad19-e0420ecb5d48 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:00.187239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db91f9f-a090-44b1-ad19-e0420ecb5d48 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:00.188501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db91f9f-a090-44b1-ad19-e0420ecb5d48 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:00.189185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db91f9f-a090-44b1-ad19-e0420ecb5d48 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:00.189829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2db91f9f-a090-44b1-ad19-e0420ecb5d48 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:00.197929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:00.240354 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2db91f9f-a090-44b1-ad19-e0420ecb5d48 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082041 Aug 06 21:13:00.241317 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2179/4241] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:13:00 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:00.249066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d91ab219-d7ac-448a-858c-b2541dcd0810 req-ccbf6b66-1ac1-42bc-9f5f-7803a7f69153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "055adb26-af45-4bb0-9f79-7eba67aa0fb8", "tag": "f6e6506f-eb32-403c-9cbf-f685723261e1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:00.261682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d91ab219-d7ac-448a-858c-b2541dcd0810 req-ccbf6b66-1ac1-42bc-9f5f-7803a7f69153 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:00.262469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d91ab219-d7ac-448a-858c-b2541dcd0810 req-ccbf6b66-1ac1-42bc-9f5f-7803a7f69153 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:00.264209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d91ab219-d7ac-448a-858c-b2541dcd0810 req-ccbf6b66-1ac1-42bc-9f5f-7803a7f69153 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:00.281015 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d91ab219-d7ac-448a-858c-b2541dcd0810 req-ccbf6b66-1ac1-42bc-9f5f-7803a7f69153 service nova] Creating event network-changed:f6e6506f-eb32-403c-9cbf-f685723261e1 for instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 on nch2-master-1 Aug 06 21:13:00.287963 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d91ab219-d7ac-448a-858c-b2541dcd0810 req-ccbf6b66-1ac1-42bc-9f5f-7803a7f69153 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045260 Aug 06 21:13:00.290991 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2180/4242] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:00.778987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:00.793889 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2ab6793a-01fb-4c5c-ac61-6991b09471db tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1317 microversion: 2.1 time: 0.996255 Aug 06 21:13:00.794830 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2063/4243] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:12:59 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1317 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:01.180169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:01.182477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:01.195239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.196166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.197341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.198152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.198999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.199591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.254009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a518449d-a595-47df-8f50-dbcd33836cb5 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:01.256251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a518449d-a595-47df-8f50-dbcd33836cb5 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:01.274366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a518449d-a595-47df-8f50-dbcd33836cb5 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.275739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a518449d-a595-47df-8f50-dbcd33836cb5 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.278026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a518449d-a595-47df-8f50-dbcd33836cb5 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.279946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a518449d-a595-47df-8f50-dbcd33836cb5 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.280756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a518449d-a595-47df-8f50-dbcd33836cb5 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.281523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a518449d-a595-47df-8f50-dbcd33836cb5 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.344019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:01.371362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:01.381928 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a518449d-a595-47df-8f50-dbcd33836cb5 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131998 Aug 06 21:13:01.394017 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2064/4244] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:13:01 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:13:01.547549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:01.552728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:01.568313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.569075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.569733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.570822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.571766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.573036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.622341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:13:01.656238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:01.665683 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d7d2deeb-3d62-4e21-b216-198ea734ddbe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1364 microversion: 2.1 time: 0.490201 Aug 06 21:13:01.675897 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2181/4245] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:01 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1364 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:01.764357 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-acf9ea3a-1196-4f8d-a535-04899d1c4186 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 204 len: 0 microversion: 2.1 time: 0.218270 Aug 06 21:13:01.766940 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2065/4246] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:13:01 2022] DELETE /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:13:01.777308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:01.777851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:01.790407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.792133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.793577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.795475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.797089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.798754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.816928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:01.817649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:01.830528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.831080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.831527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.832251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:01.832710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:01.839302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:01.857583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:02.401551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:02.415266 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c0ae4ff2-f251-4309-ba6e-92c563a29fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1317 microversion: 2.1 time: 0.600681 Aug 06 21:13:02.415904 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2066/4247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:01 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:02.703159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:02.703777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:02.716468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:02.717244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:02.717842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:02.718767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:02.719378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:02.719954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:02.870189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:02.878975 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f17a358-6ee0-4f7e-8f76-c32851df4406 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1682 microversion: 2.1 time: 1.107428 Aug 06 21:13:02.879583 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2182/4248] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:01 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1682 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:03.464749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:03.466222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:03.484879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:03.485827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:03.486449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:03.487400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:03.490217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:03.491921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:04.166470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:04.177226 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4f3c8bd5-1c64-40d0-a94f-7ca7d4a20899 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1317 microversion: 2.1 time: 0.745438 Aug 06 21:13:04.192151 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2183/4249] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:03 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1317 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:04.204542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:04.205270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:04.222921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:04.223740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:04.224368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:04.225254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:04.225874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:04.226449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:04.298197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:04.313408 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f222a9c1-a05c-4d8b-b0d3-fff1697069ec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1364 microversion: 2.1 time: 1.614574 Aug 06 21:13:04.315546 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2067/4250] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:02 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1364 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:04.537366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:04.552086 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-585159fb-cb0b-4436-87c4-209cefb40cad tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1682 microversion: 2.1 time: 0.357976 Aug 06 21:13:04.555316 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2184/4251] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:04 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1682 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:05.219026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:05.220120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:05.232309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:05.233580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:05.235105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:05.236201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:05.236981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:05.237966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:05.338434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:05.340052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:05.343523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:05.344592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:05.362638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:05.363179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:05.363640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:05.364391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:05.371277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:05.371828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:05.855446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:05.864343 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8864c9ca-fb6d-4574-bf6d-b549587536c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1364 microversion: 2.1 time: 0.530733 Aug 06 21:13:05.872239 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2185/4252] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:05 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1364 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:05.887244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:05.888102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:05.898042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:05.900818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:05.901439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:05.902331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:05.903712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:05.906045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:06.465458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:06.482825 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7d47739f-678e-4adf-a639-1119122f446b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1317 microversion: 2.1 time: 1.280911 Aug 06 21:13:06.486916 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2068/4253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:05 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1317 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:06.498259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-6c140355-e01e-4709-921f-dcb0a2337387 req-3925e2d2-630b-4803-9934-e30be473cd68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:06.526078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6c140355-e01e-4709-921f-dcb0a2337387 req-3925e2d2-630b-4803-9934-e30be473cd68 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:06.527270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6c140355-e01e-4709-921f-dcb0a2337387 req-3925e2d2-630b-4803-9934-e30be473cd68 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:06.529613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6c140355-e01e-4709-921f-dcb0a2337387 req-3925e2d2-630b-4803-9934-e30be473cd68 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:06.600316 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-6c140355-e01e-4709-921f-dcb0a2337387 req-3925e2d2-630b-4803-9934-e30be473cd68 service nova] Creating event network-changed:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:13:06.614906 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-6c140355-e01e-4709-921f-dcb0a2337387 req-3925e2d2-630b-4803-9934-e30be473cd68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124330 Aug 06 21:13:06.616973 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2069/4254] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:06.894805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:06.895514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:06.909444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:06.909960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:06.910537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:06.911297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:06.911843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:06.912304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:07.196202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:07.237753 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-947095f8-7272-409b-b443-8427e8185f71 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1682 microversion: 2.1 time: 1.344940 Aug 06 21:13:07.238906 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2186/4255] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:05 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1682 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:07.510799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:07.512607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:07.539040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:07.541674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:07.544050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:07.545136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:07.545840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:07.546529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:08.129892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:08.140846 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-05f8a93d-47e2-4a3a-b3c4-582d5a2978d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1317 microversion: 2.1 time: 0.640068 Aug 06 21:13:08.156407 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2187/4256] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:07 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1317 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:08.259929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:08.260614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:08.272352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:08.272846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:08.273286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:08.274764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:08.275852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:08.276282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:08.562960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:08.609584 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8107b7ce-c087-4f91-b82a-ba2b1d5e629b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1615 microversion: 2.1 time: 0.352698 Aug 06 21:13:08.611069 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2188/4257] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:08 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1615 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:08.671564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:08.689709 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33688502-4f38-4f44-9dbf-0b82d9b92015 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1364 microversion: 2.1 time: 1.799810 Aug 06 21:13:08.691327 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2070/4258] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:06 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1364 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:09.172157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:09.174755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:09.186347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:09.187755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:09.188431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:09.189656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:09.190414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:09.191086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:09.373741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-3ee77a6f-78a5-490a-b701-a3983311621c req-ebe493a2-a40c-45f6-9a39-418b60cfd61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd012aa-4178-47e4-81cd-a975a14958df", "name": "network-vif-deleted", "tag": "6320632a-4601-4bf8-8044-13763d5b0b11"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:09.417384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3ee77a6f-78a5-490a-b701-a3983311621c req-ebe493a2-a40c-45f6-9a39-418b60cfd61b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:09.418068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3ee77a6f-78a5-490a-b701-a3983311621c req-ebe493a2-a40c-45f6-9a39-418b60cfd61b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:09.420232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3ee77a6f-78a5-490a-b701-a3983311621c req-ebe493a2-a40c-45f6-9a39-418b60cfd61b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:09.447868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-3ee77a6f-78a5-490a-b701-a3983311621c req-ebe493a2-a40c-45f6-9a39-418b60cfd61b service nova] Creating event network-vif-deleted:6320632a-4601-4bf8-8044-13763d5b0b11 for instance 2fd012aa-4178-47e4-81cd-a975a14958df on nch1-master-1 Aug 06 21:13:09.469305 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-3ee77a6f-78a5-490a-b701-a3983311621c req-ebe493a2-a40c-45f6-9a39-418b60cfd61b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099244 Aug 06 21:13:09.470663 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2071/4259] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:13:09.641180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:09.642146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:09.667728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:09.668776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:09.672543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:09.675133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:09.677359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:09.684074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:09.744154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:09.745153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:09.747163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:09.748746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lazy-loading 'fault' on Instance uuid 2fd012aa-4178-47e4-81cd-a975a14958df {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:13:09.872336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:09.920786 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-005edfd6-17e2-4a7f-8509-bf0ede03f8bd tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 200 len: 1332 microversion: 2.1 time: 0.287225 Aug 06 21:13:09.921424 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2072/4260] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:09 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 1332 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:09.932077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:09.933614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:09.962960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:09.963828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:09.964725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:09.967160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:09.967907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:09.968571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:10.284865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:10.297541 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-400cc7e6-b165-4e2f-a213-6b4651ab3deb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1317 microversion: 2.1 time: 1.134248 Aug 06 21:13:10.311589 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2189/4261] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:09 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1317 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:10.539297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-15246f9a-542c-4206-8386-605bdcc8cb3d req-66a450eb-67bd-4e21-95f1-f169d8af42cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055adb26-af45-4bb0-9f79-7eba67aa0fb8", "name": "network-vif-plugged", "status": "completed", "tag": "f6e6506f-eb32-403c-9cbf-f685723261e1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:10.563430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-15246f9a-542c-4206-8386-605bdcc8cb3d req-66a450eb-67bd-4e21-95f1-f169d8af42cf service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:10.567003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-15246f9a-542c-4206-8386-605bdcc8cb3d req-66a450eb-67bd-4e21-95f1-f169d8af42cf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:10.567527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-15246f9a-542c-4206-8386-605bdcc8cb3d req-66a450eb-67bd-4e21-95f1-f169d8af42cf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:10.620231 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-15246f9a-542c-4206-8386-605bdcc8cb3d req-66a450eb-67bd-4e21-95f1-f169d8af42cf service nova] Creating event network-vif-plugged:f6e6506f-eb32-403c-9cbf-f685723261e1 for instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 on nch2-master-1 Aug 06 21:13:10.632617 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-15246f9a-542c-4206-8386-605bdcc8cb3d req-66a450eb-67bd-4e21-95f1-f169d8af42cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097229 Aug 06 21:13:10.635594 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2190/4262] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:13:10.950493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:10.951428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:10.965544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:10.966298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:10.967024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:10.967899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:10.968516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:10.970933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:11.014074 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df HTTP/1.1 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '2fd012aa-4178-47e4-81cd-a975a14958df'} Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:11.016108 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:11.019973 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:11.019973 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:11.019973 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:11.019973 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:13:11.019973 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:13:11.019973 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:13:11.019973 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:11.021859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:11.023013 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7fc366df-577e-4558-aac2-d5f7680c8759 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 404 len: 111 microversion: 2.1 time: 0.076820 Aug 06 21:13:11.029846 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2191/4263] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:10 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:13:11.042332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12bcbba2-1fd5-41a3-93c7-33109991514b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '.version_select at 0x7f72a3566430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:11.080515 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12bcbba2-1fd5-41a3-93c7-33109991514b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100226103" status: 202 len: 0 microversion: 2.1 time: 0.049114 Aug 06 21:13:11.085620 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2192/4264] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:13:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100226103 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:13:11.187821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:11.197733 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-95738b7a-586b-4810-abf2-a1f16435ba59 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1364 microversion: 2.1 time: 1.272197 Aug 06 21:13:11.198321 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2073/4265] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:09 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1364 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:11.325594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:11.326385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:11.334877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:11.336078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:11.336878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:11.337941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:11.338871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:11.340243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:11.905665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:11.944638 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7ca17ac1-5753-47b9-963e-5c52309b0b42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1317 microversion: 2.1 time: 0.623172 Aug 06 21:13:11.953766 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2193/4266] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:11 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:12.224928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:12.225762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:12.256072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:12.260701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:12.261615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:12.264409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:12.266192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:12.267207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:12.973972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:12.974677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:12.984869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:12.985339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:12.988768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:12.990580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:12.991461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:12.993356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:13.243742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:13.259311 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-357ebadc-b00b-4cfc-a7fc-1fdef454ce9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1364 microversion: 2.1 time: 1.040570 Aug 06 21:13:13.262739 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2074/4267] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:12 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1364 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:13.948750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:13.958866 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-891dd514-6663-4925-a094-00a8e459d9e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.988811 Aug 06 21:13:13.970837 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2194/4268] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:12 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:14.193462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-579317890", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:14.281083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:14.281697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:14.284299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] validate_networks() for [('c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:13:14.295764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:14.296473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:14.297091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:14.297959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:14.298595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:14.299175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:15.376443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:15.391496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-551d7d39-c14c-4c08-9b43-f2174ff60248 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1364 microversion: 2.1 time: 1.114104 Aug 06 21:13:15.401323 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2195/4269] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:14 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1364 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:15.414828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6c4c014b-62f8-44c5-af15-a4cee71abaca tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: .version_select at 0x7f72a34909d0>, body: {"keypair": {"name": "tempest-keypair-545693225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzoA4qEC+Uh7NuOWe04ivhtwUnKfoF0mffE4G5sp9qFkpQ7EqAh5hYGUmOSM8Z6c2lJTaBJbeBfEv4aP4p1/VB/x8jNYxvTXuQeL70B4Rllue/Pd+HVqqRKuWXhcywKPw=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:15.451807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6c4c014b-62f8-44c5-af15-a4cee71abaca tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for project f4980bb21b59412ca004d8069525d3b9. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:13:15.478919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6c4c014b-62f8-44c5-af15-a4cee71abaca tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for user 1d7b9e27983940dcaf0e92f62273c588 and project f4980bb21b59412ca004d8069525d3b9. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:13:15.532276 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6c4c014b-62f8-44c5-af15-a4cee71abaca tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.138514 Aug 06 21:13:15.533727 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2196/4270] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:13:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:16.329768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:13:16.330929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:13:16.331597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:13:16.332196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:13:16.332767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:13:16.353389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:16.353898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:16.354348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:16.355350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:16.358168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:16.358890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:16.401118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Getting quotas for project da1a7d63a1a048df9cdf8e86a26b4086. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:13:16.407791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Getting quotas for user a6c953ff2f774041a7d50f53033ee124 and project da1a7d63a1a048df9cdf8e86a26b4086. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:13:16.417852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:16.419134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:16.440007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:16.441925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:16.443285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:16.447510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:16.448935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:16.449576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:16.454858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:13:16.457542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:13:16.559148 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46ffe52f-4885-42d9-b843-e650d7817eca tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369853 Aug 06 21:13:16.560081 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2075/4271] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:13:16.575152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b37fc018-7b14-4fbb-90fe-4a511a17e0f0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:16.575773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b37fc018-7b14-4fbb-90fe-4a511a17e0f0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:16.822828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b37fc018-7b14-4fbb-90fe-4a511a17e0f0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:16.835215 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b37fc018-7b14-4fbb-90fe-4a511a17e0f0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1216 microversion: 2.1 time: 0.262845 Aug 06 21:13:16.855197 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2076/4272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:16 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1216 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:17.542017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a3903fa9-0818-4401-9867-b7bed2c3aec1 req-dd3c2fbe-f570-4a1f-b36a-6d2e6562fa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "name": "network-vif-plugged", "status": "completed", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:17.573008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a3903fa9-0818-4401-9867-b7bed2c3aec1 req-dd3c2fbe-f570-4a1f-b36a-6d2e6562fa44 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:17.573996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a3903fa9-0818-4401-9867-b7bed2c3aec1 req-dd3c2fbe-f570-4a1f-b36a-6d2e6562fa44 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:17.575055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a3903fa9-0818-4401-9867-b7bed2c3aec1 req-dd3c2fbe-f570-4a1f-b36a-6d2e6562fa44 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:17.596146 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a3903fa9-0818-4401-9867-b7bed2c3aec1 req-dd3c2fbe-f570-4a1f-b36a-6d2e6562fa44 service nova] Creating event network-vif-plugged:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:13:17.603266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:17.606443 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a3903fa9-0818-4401-9867-b7bed2c3aec1 req-dd3c2fbe-f570-4a1f-b36a-6d2e6562fa44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072429 Aug 06 21:13:17.609376 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2077/4273] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:17.613033 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-100eb30f-3ee1-4c5b-8cd9-ca1e97e0600c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1364 microversion: 2.1 time: 1.199228 Aug 06 21:13:17.613604 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2197/4274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:16 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1364 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:17.865303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:17.867552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:17.879249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:17.879927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:17.881230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:17.882083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:17.883084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:17.884199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:18.090785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:18.108268 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-487a5e22-6be8-4bd8-9546-f82bf1f001e0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1212 microversion: 2.1 time: 0.244693 Aug 06 21:13:18.109660 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2078/4275] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:17 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1212 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:18.639488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:18.641546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:18.647053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:18.653328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:18.655192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:18.656665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:18.658605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:18.659300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:18.661678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:19.134965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:19.137348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:19.144123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:19.157908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:19.159169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:19.162409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:19.163625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:19.166173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:19.166970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:19.299081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:19.314946 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a47c268c-65e6-448a-93f6-7e608967ff7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1364 microversion: 2.1 time: 0.684371 Aug 06 21:13:19.317482 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2198/4276] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:18 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1364 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:19.366580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:19.374984 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e39c32f-6e53-4d27-a9f0-a6b4017aac51 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1274 microversion: 2.1 time: 0.247058 Aug 06 21:13:19.375597 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2079/4277] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:19 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:20.340841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:20.341567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:20.359624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:20.361703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:20.363691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:20.367831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:20.369724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:20.370192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:20.399482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:20.400974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:20.432991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:20.435082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:20.436963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:20.439418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:20.441584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:20.443971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:20.644691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:20.687314 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e6c5564-d583-42f2-bd38-b5aa8888a817 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1274 microversion: 2.1 time: 0.288510 Aug 06 21:13:20.689731 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2080/4278] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:20 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1274 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:20.971689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:20.975210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:20.985393 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f390f024-adf4-4472-9148-8e842a24fb74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1552 microversion: 2.1 time: 0.650271 Aug 06 21:13:21.001724 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2199/4279] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:20 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1552 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:21.007153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c5d46b0b-d671-4148-b87a-b369d29d5ee7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:21.008227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c5d46b0b-d671-4148-b87a-b369d29d5ee7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:21.015127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5d46b0b-d671-4148-b87a-b369d29d5ee7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:21.015983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5d46b0b-d671-4148-b87a-b369d29d5ee7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:21.016693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5d46b0b-d671-4148-b87a-b369d29d5ee7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:21.017655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5d46b0b-d671-4148-b87a-b369d29d5ee7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:21.018344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5d46b0b-d671-4148-b87a-b369d29d5ee7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:21.019032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c5d46b0b-d671-4148-b87a-b369d29d5ee7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:21.306124 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c5d46b0b-d671-4148-b87a-b369d29d5ee7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.302575 Aug 06 21:13:21.313856 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2081/4280] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:13:21 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/os-interface => generated 285 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:21.713906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:21.714533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:21.734407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:21.734938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:21.735384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:21.736100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:21.736558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:21.736987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:22.503552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:22.526988 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-27a271bd-7a26-4e11-9de4-91c6ed60041a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1316 microversion: 2.1 time: 0.817239 Aug 06 21:13:22.544166 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2200/4281] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:21 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:22.735113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1864487798", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "11f02bc6-d451-4dc2-ad2a-0d5c05e0c5fb"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:22.862172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] validate_networks() for [('11f02bc6-d451-4dc2-ad2a-0d5c05e0c5fb', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:13:23.170420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1321710653", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6095abc9-21e8-4e89-b536-00af77a125af"}], "security_groups": [{"name": "tempest-securitygroup--1572038488"}], "key_name": "tempest-keypair-545693225", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:23.512011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] validate_networks() for [('6095abc9-21e8-4e89-b536-00af77a125af', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:13:24.541615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:13:24.542354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:13:24.548840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:13:24.548840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:13:24.548840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:13:24.564900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:24.569424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:24.574348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:24.577770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:24.582536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:24.615600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:24.681625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Getting quotas for project dbf6e27c08c84eb780aee25318136435. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:13:24.694054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Getting quotas for user 950a8bbfd820444b9f85976f6609c864 and project dbf6e27c08c84eb780aee25318136435. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:13:24.731738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Going to run 3 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:13:24.738960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:13:24.791071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 8500f59e-75eb-445a-87a8-088776efa386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=9b32e2bb-2811-4e10-972c-e2e5908d1911,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:13:24.857339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=8500f59e-75eb-445a-87a8-088776efa386,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:13:24.967336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f221999-fdcb-4af4-8727-80b439dbeffd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.517961 Aug 06 21:13:24.975174 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2082/4282] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:13:24.981240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:24.982141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:24.989148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:24.989921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:24.990532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:24.991705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:24.992398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:24.993902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:25.306668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:13:25.307833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:13:25.308556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:13:25.309456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:13:25.310063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:13:25.363961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:25.366046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:25.371209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:25.372575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:25.376455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:25.376910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:25.488307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for project f4980bb21b59412ca004d8069525d3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:13:25.514463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for user 1d7b9e27983940dcaf0e92f62273c588 and project f4980bb21b59412ca004d8069525d3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:13:25.605953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:13:25.608312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:13:25.852285 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1872dcd3-eac9-419e-9780-6b0246680267 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.695729 Aug 06 21:13:25.864368 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2201/4283] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:13:25.869713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:25.886626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:25.887373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Searching by: {'deleted': False, 'project_id': 'dbf6e27c08c84eb780aee25318136435'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:13:25.910454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:25.912682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:25.913610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:25.914940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:25.915585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:25.916213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:25.971177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d6a2ed1-3851-467a-bfe0-091d5e85d73d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.105571 Aug 06 21:13:25.972242 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2202/4284] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:13:25 2022] GET /compute/v2.1/servers => generated 1018 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:25.985875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-671fba63-a3f6-46d1-810e-e73899081b68 req-76b4a5fd-5d14-443f-93ce-becce969e2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65f4d33-d7b2-4bb6-a852-ba30292476c0", "tag": "0eae1991-ba76-4375-82db-4233f219e56b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:26.012998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-671fba63-a3f6-46d1-810e-e73899081b68 req-76b4a5fd-5d14-443f-93ce-becce969e2da service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:26.013772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-671fba63-a3f6-46d1-810e-e73899081b68 req-76b4a5fd-5d14-443f-93ce-becce969e2da service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:26.014525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-671fba63-a3f6-46d1-810e-e73899081b68 req-76b4a5fd-5d14-443f-93ce-becce969e2da service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:26.034941 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-671fba63-a3f6-46d1-810e-e73899081b68 req-76b4a5fd-5d14-443f-93ce-becce969e2da service nova] Creating event network-changed:0eae1991-ba76-4375-82db-4233f219e56b for instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 on nch2-master-1 Aug 06 21:13:26.047236 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-671fba63-a3f6-46d1-810e-e73899081b68 req-76b4a5fd-5d14-443f-93ce-becce969e2da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065411 Aug 06 21:13:26.053837 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2203/4285] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:26.064762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-69dcd3ec-08b8-48d5-95a8-75ef9e61dcd9 req-ff777dc9-a9dc-40ce-85f3-a08b40ff9ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:26.089765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-69dcd3ec-08b8-48d5-95a8-75ef9e61dcd9 req-ff777dc9-a9dc-40ce-85f3-a08b40ff9ed0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:26.092650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-69dcd3ec-08b8-48d5-95a8-75ef9e61dcd9 req-ff777dc9-a9dc-40ce-85f3-a08b40ff9ed0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:26.095339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-69dcd3ec-08b8-48d5-95a8-75ef9e61dcd9 req-ff777dc9-a9dc-40ce-85f3-a08b40ff9ed0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:26.129360 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-69dcd3ec-08b8-48d5-95a8-75ef9e61dcd9 req-ff777dc9-a9dc-40ce-85f3-a08b40ff9ed0 service nova] Creating event network-changed:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:13:26.140569 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-69dcd3ec-08b8-48d5-95a8-75ef9e61dcd9 req-ff777dc9-a9dc-40ce-85f3-a08b40ff9ed0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084855 Aug 06 21:13:26.144264 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2204/4286] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:26.154943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c7f7c7e0-5d3a-471b-b089-6420b0e19e78 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:26.159740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c7f7c7e0-5d3a-471b-b089-6420b0e19e78 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:26.587376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c7f7c7e0-5d3a-471b-b089-6420b0e19e78 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:26.602632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c7f7c7e0-5d3a-471b-b089-6420b0e19e78 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1241 microversion: 2.1 time: 0.455535 Aug 06 21:13:26.607701 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2205/4287] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:26 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1241 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:26.626825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e27a337e-c7c4-4dbf-a5b9-589b293bd25d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:26.627563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e27a337e-c7c4-4dbf-a5b9-589b293bd25d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:26.851750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e27a337e-c7c4-4dbf-a5b9-589b293bd25d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:26.871977 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e27a337e-c7c4-4dbf-a5b9-589b293bd25d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1223 microversion: 2.1 time: 0.252948 Aug 06 21:13:26.886676 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2206/4288] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:26 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1223 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:27.629014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:27.629699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:27.643856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:27.644355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:27.647353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:27.648204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:27.650161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:27.650651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:27.797482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:27.811947 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8331ded8-3597-49a5-91dd-22f60f043795 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1316 microversion: 2.1 time: 2.835280 Aug 06 21:13:27.812561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2083/4289] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:24 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1316 bytes in 2837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:27.905175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:27.906882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:27.934067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:27.937460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:27.938799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:27.942124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:27.943726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:27.946226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:27.969926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:28.283271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:28.331491 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ffaa1ddf-eab3-4d66-b991-018d86577b87 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1293 microversion: 2.1 time: 0.700404 Aug 06 21:13:28.347620 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2207/4290] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:27 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1293 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:28.666082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:28.681047 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ef910572-5e7d-471e-8ca2-ed2376cccae3 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1219 microversion: 2.1 time: 0.785331 Aug 06 21:13:28.706116 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2084/4291] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:27 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1219 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:28.834950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:28.836583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:28.843659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:28.863399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:28.864056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:28.864961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:28.870889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:28.878771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:29.293833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:29.304114 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-21a1c4fa-bccc-4cac-8248-44f550c40a1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1316 microversion: 2.1 time: 0.472840 Aug 06 21:13:29.305479 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2208/4292] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:28 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:29.361926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:29.368604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:29.389966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:29.390819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:29.392184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:29.393927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:29.395035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:29.395629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:29.639846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:29.665629 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b2d5f14d-f270-4d60-aec4-e42af155e6f8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1299 microversion: 2.1 time: 0.315416 Aug 06 21:13:29.677289 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2085/4293] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:29 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1299 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:29.703235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:29.703873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:29.722023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:29.724112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:29.725008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:29.725974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:29.726899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:29.727501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:29.928833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:29.951124 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ac2eebb7-131d-4c16-aed8-87087afd693a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1281 microversion: 2.1 time: 0.247919 Aug 06 21:13:29.968660 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2209/4294] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:29 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:30.329618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:30.330407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:30.338060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:30.338764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:30.339439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:30.340438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:30.340980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:30.341633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:30.700184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:30.701225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:30.717807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:30.718740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:30.719285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:30.720238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:30.720944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:30.721593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:30.847758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:30.859517 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9cadfcd3-6aca-478b-8050-46c5789db316 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1299 microversion: 2.1 time: 0.165489 Aug 06 21:13:30.860113 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2210/4295] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:30 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1299 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:30.976750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:30.978127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:30.985620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:30.986154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:30.986796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:30.987693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:30.988161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:30.988589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:31.024105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:31.032967 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1e87d17d-b764-4864-aa1c-a93f2cb185a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1316 microversion: 2.1 time: 0.707422 Aug 06 21:13:31.035207 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2086/4296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:30 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1316 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:31.148676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:31.161558 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d06f2155-5719-4239-87f7-f9a3fd5501a6 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1281 microversion: 2.1 time: 0.189650 Aug 06 21:13:31.162422 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2211/4297] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:30 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:31.907143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:31.910813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:31.951820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:31.952511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:31.953116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:31.954254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:31.954907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:31.955616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:32.060211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:32.061571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:32.095298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:32.096309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:32.105029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:32.123003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:32.126010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:32.128696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:32.129983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:32.131164 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-53ba26dd-2692-47fc-ab02-9fde622abea7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1299 microversion: 2.1 time: 0.247629 Aug 06 21:13:32.133775 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2087/4298] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:31 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:32.186030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:32.186891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:32.198409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:32.198936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:32.199379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:32.200108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:32.200566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:32.202840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:32.390664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:32.406498 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb3f9615-9ed4-497a-8b72-65ae6cf329a8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1281 microversion: 2.1 time: 0.224695 Aug 06 21:13:32.432839 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2088/4299] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:32 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:33.033356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:33.043005 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80f0c2a0-6d94-4655-8404-6e963dcb0694 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1316 microversion: 2.1 time: 0.991283 Aug 06 21:13:33.062856 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2212/4300] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:32 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1316 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:33.154376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:33.155290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:33.164343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:33.165216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:33.165748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:33.166594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:33.167145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:33.167658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:33.435405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:33.436333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:33.448316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:33.449858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:33.450511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:33.451868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:33.452482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:33.452916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:33.591206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:33.599448 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a938904-d166-4c77-8a25-6e7a5f75af5c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1281 microversion: 2.1 time: 0.173946 Aug 06 21:13:33.601851 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2213/4301] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:33 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:33.853405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:33.854955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f92c6ed3-7182-47c1-9832-94769a9a05e7 req-43abc6d0-f189-4078-9d38-1450f8f81122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65f4d33-d7b2-4bb6-a852-ba30292476c0", "name": "network-vif-plugged", "status": "completed", "tag": "0eae1991-ba76-4375-82db-4233f219e56b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:33.867229 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-efe19554-8b7b-42e7-a194-5ed6e2e90e1b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1367 microversion: 2.1 time: 0.713796 Aug 06 21:13:33.869616 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2089/4302] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:33 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1367 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:33.872385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f92c6ed3-7182-47c1-9832-94769a9a05e7 req-43abc6d0-f189-4078-9d38-1450f8f81122 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:33.873081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f92c6ed3-7182-47c1-9832-94769a9a05e7 req-43abc6d0-f189-4078-9d38-1450f8f81122 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:33.873708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f92c6ed3-7182-47c1-9832-94769a9a05e7 req-43abc6d0-f189-4078-9d38-1450f8f81122 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:33.892945 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f92c6ed3-7182-47c1-9832-94769a9a05e7 req-43abc6d0-f189-4078-9d38-1450f8f81122 service nova] Creating event network-vif-plugged:0eae1991-ba76-4375-82db-4233f219e56b for instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 on nch2-master-1 Aug 06 21:13:33.900699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f92c6ed3-7182-47c1-9832-94769a9a05e7 req-43abc6d0-f189-4078-9d38-1450f8f81122 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049456 Aug 06 21:13:33.901963 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2214/4303] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:13:34.071100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:34.071646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:34.084373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:34.084918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:34.087173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:34.087853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:34.090618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:34.091124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:34.622986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:34.624051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:34.631163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:34.632966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:34.633683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:34.635723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:34.637522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:34.638215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:34.643600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:34.711705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=14 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:34.758960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:34.770329 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-672144e5-c69d-4c53-963b-bc9fced424a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1316 microversion: 2.1 time: 0.703498 Aug 06 21:13:34.785388 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2090/4304] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:34 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:34.889851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:34.890886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:34.899060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:34.899942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:34.900946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:34.901925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:34.902670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:34.903338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:35.365474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:35.374188 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d0c9fc2e-ea87-4739-a26f-789fdea9b2b0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 0.756407 Aug 06 21:13:35.374776 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2215/4305] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:34 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:35.384538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-25cd3534-7e8a-427f-b7c0-94fefd544b69 req-d46cc202-514c-4427-8c71-834e3b5f9173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08", "tag": "f45dce22-429d-4b51-aaa5-cfdcccb364a4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:35.401855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-25cd3534-7e8a-427f-b7c0-94fefd544b69 req-d46cc202-514c-4427-8c71-834e3b5f9173 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:35.402819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-25cd3534-7e8a-427f-b7c0-94fefd544b69 req-d46cc202-514c-4427-8c71-834e3b5f9173 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:35.404030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-25cd3534-7e8a-427f-b7c0-94fefd544b69 req-d46cc202-514c-4427-8c71-834e3b5f9173 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:35.421168 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-25cd3534-7e8a-427f-b7c0-94fefd544b69 req-d46cc202-514c-4427-8c71-834e3b5f9173 service nova] Creating event network-changed:f45dce22-429d-4b51-aaa5-cfdcccb364a4 for instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 on nch1-master-1 Aug 06 21:13:35.428180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-25cd3534-7e8a-427f-b7c0-94fefd544b69 req-d46cc202-514c-4427-8c71-834e3b5f9173 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051601 Aug 06 21:13:35.431281 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2216/4306] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:35.456750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:35.465568 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a871b8fc-9cf6-4ac8-90a9-8b9f13f680fe tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1367 microversion: 2.1 time: 0.580587 Aug 06 21:13:35.479731 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2091/4307] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:34 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1367 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:35.794716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:35.795588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:35.802028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:35.802662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:35.803460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:35.805639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:35.806237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:35.806824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:35.925174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:36.222021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:36.230809 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb817bbe-6aa0-420d-9aa9-09154e9f6126 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1504 microversion: 2.1 time: 0.441498 Aug 06 21:13:36.231419 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2217/4308] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:35 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:36.251602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:36.254327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:36.263050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:36.264020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:36.264697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:36.266968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:36.267494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:36.268216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:36.299991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:13:36.405466 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e5b7b948-9950-4449-979a-0e35f5bfcd1d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 204 len: 0 microversion: 2.1 time: 0.157119 Aug 06 21:13:36.406634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:36.407419 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2092/4309] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:13:36 2022] DELETE /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:13:36.415199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:36.424362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:36.425390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:36.446387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:36.448027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:36.448656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:36.449705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:36.450609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:36.451671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:36.452433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:36.453296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:36.453997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:36.455511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:36.457147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:36.460617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:36.754702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:36.766034 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c0c3d044-03e2-4b8c-999a-d64358dc3c24 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 0.369598 Aug 06 21:13:36.767027 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2218/4310] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:36 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:36.786954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:36.788563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:36.797293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:36.797863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:36.798318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:36.800107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:36.800935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:36.801505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:36.856534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=14 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:37.032259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:37.043268 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8aecc68-fb18-4831-b552-b3e6ceec072a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1367 microversion: 2.1 time: 0.262597 Aug 06 21:13:37.057475 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2219/4311] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:36 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:37.110072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:37.123644 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f8bfb9a-0099-409b-bbf8-c5974a18f653 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1510 microversion: 2.1 time: 0.710154 Aug 06 21:13:37.124715 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2093/4312] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:36 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1510 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:37.467055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bdf560e7-6faa-4eb5-9da9-c664157152e7 req-b556a580-c86b-4017-ad00-86e2d8227ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8500f59e-75eb-445a-87a8-088776efa386", "tag": "5c47a6bb-0f59-405c-8c92-8556c9259127"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:37.497218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bdf560e7-6faa-4eb5-9da9-c664157152e7 req-b556a580-c86b-4017-ad00-86e2d8227ef2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:37.508515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bdf560e7-6faa-4eb5-9da9-c664157152e7 req-b556a580-c86b-4017-ad00-86e2d8227ef2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:37.509259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bdf560e7-6faa-4eb5-9da9-c664157152e7 req-b556a580-c86b-4017-ad00-86e2d8227ef2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:37.537313 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bdf560e7-6faa-4eb5-9da9-c664157152e7 req-b556a580-c86b-4017-ad00-86e2d8227ef2 service nova] Creating event network-changed:5c47a6bb-0f59-405c-8c92-8556c9259127 for instance 8500f59e-75eb-445a-87a8-088776efa386 on nch2-master-1 Aug 06 21:13:37.551161 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bdf560e7-6faa-4eb5-9da9-c664157152e7 req-b556a580-c86b-4017-ad00-86e2d8227ef2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090186 Aug 06 21:13:37.553049 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2220/4313] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:37.799864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-d8c308a1-352a-4131-a263-c199350ebcd8 req-d7481d4f-68bc-4c02-aa8b-0265c1dffbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b32e2bb-2811-4e10-972c-e2e5908d1911", "tag": "63cfc53c-0ba6-409d-98eb-324ff6cd5581"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:37.805577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:37.806215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:37.837189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:37.837708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:37.839323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d8c308a1-352a-4131-a263-c199350ebcd8 req-d7481d4f-68bc-4c02-aa8b-0265c1dffbe5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:37.842034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d8c308a1-352a-4131-a263-c199350ebcd8 req-d7481d4f-68bc-4c02-aa8b-0265c1dffbe5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:37.843356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:37.843934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-d8c308a1-352a-4131-a263-c199350ebcd8 req-d7481d4f-68bc-4c02-aa8b-0265c1dffbe5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:37.844178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:37.847412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:37.847899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:37.868748 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-d8c308a1-352a-4131-a263-c199350ebcd8 req-d7481d4f-68bc-4c02-aa8b-0265c1dffbe5 service nova] Creating event network-changed:63cfc53c-0ba6-409d-98eb-324ff6cd5581 for instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 on nch1-master-1 Aug 06 21:13:37.883004 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-d8c308a1-352a-4131-a263-c199350ebcd8 req-d7481d4f-68bc-4c02-aa8b-0265c1dffbe5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089465 Aug 06 21:13:37.884450 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2221/4314] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:13:38.064957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:38.068084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:38.095415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:38.103167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:38.104282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:38.105232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:38.106014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:38.107164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:38.584170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:38.593777 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac2bad93-db1b-4918-9820-925c69f7cc1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 0.805645 Aug 06 21:13:38.595266 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2094/4315] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:37 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:38.609333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:38.610688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:38.617951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:38.618703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:38.619150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:38.619863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:38.620326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:38.620756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:38.938564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:38.951936 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-81fc9301-cbc6-4165-a835-d36d1e6fa945 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1367 microversion: 2.1 time: 0.890961 Aug 06 21:13:38.972296 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2222/4316] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:38 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1367 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:39.494663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:39.511459 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0dcbdd90-45d2-4483-9f5a-15e326e9bd8a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1510 microversion: 2.1 time: 0.914927 Aug 06 21:13:39.512082 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2095/4317] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:38 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1510 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:39.617346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:39.618075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:39.635177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:39.635670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:39.636192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:39.636848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:39.637290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:39.637765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:39.977527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:39.979399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:39.998224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:39.999148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:40.000111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:40.001391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:40.002017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:40.002673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:40.148000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:40.152213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:40.160689 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a10a3fe-f068-4739-8e66-204c1dee4a7d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 0.547167 Aug 06 21:13:40.171456 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2223/4318] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:39 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:40.176501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c4cdd888-ba3e-4c13-9246-dea9f38c3258 req-c11e94c9-38d8-4131-acfd-460e2e21929b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3032571-71f1-4d19-be54-d92d912fa263", "tag": "b775e0de-7a5d-49e1-91d7-5d59753ba2d6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:40.187341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c4cdd888-ba3e-4c13-9246-dea9f38c3258 req-c11e94c9-38d8-4131-acfd-460e2e21929b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:40.187819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c4cdd888-ba3e-4c13-9246-dea9f38c3258 req-c11e94c9-38d8-4131-acfd-460e2e21929b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:40.188247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c4cdd888-ba3e-4c13-9246-dea9f38c3258 req-c11e94c9-38d8-4131-acfd-460e2e21929b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:40.200894 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c4cdd888-ba3e-4c13-9246-dea9f38c3258 req-c11e94c9-38d8-4131-acfd-460e2e21929b service nova] Creating event network-changed:b775e0de-7a5d-49e1-91d7-5d59753ba2d6 for instance b3032571-71f1-4d19-be54-d92d912fa263 on nch1-master-1 Aug 06 21:13:40.205758 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c4cdd888-ba3e-4c13-9246-dea9f38c3258 req-c11e94c9-38d8-4131-acfd-460e2e21929b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032872 Aug 06 21:13:40.206694 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2224/4319] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:40.545542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:40.546238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:40.564730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:40.565234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:40.565677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:40.566394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:40.566882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:40.567322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:40.672321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:40.681709 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a6ddde76-a753-4c5a-87e0-73bda281e58d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1367 microversion: 2.1 time: 0.712109 Aug 06 21:13:40.691354 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2096/4320] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:39 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1367 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:40.886013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:40.903138 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3c13143a-f3be-422c-93cb-9e92946885da tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 200 len: 1468 microversion: 2.1 time: 0.361639 Aug 06 21:13:40.903724 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2225/4321] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:40 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:41.187428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:41.188891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:41.206002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:41.207264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:41.211828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:41.213007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:41.215932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:41.217214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:41.421879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ebea15e2-62b3-45b2-a887-460a98e9b873 req-35ad8652-aa67-46bd-807f-75674c662077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08", "name": "network-vif-plugged", "status": "completed", "tag": "f45dce22-429d-4b51-aaa5-cfdcccb364a4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:41.443175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ebea15e2-62b3-45b2-a887-460a98e9b873 req-35ad8652-aa67-46bd-807f-75674c662077 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:41.443906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ebea15e2-62b3-45b2-a887-460a98e9b873 req-35ad8652-aa67-46bd-807f-75674c662077 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:41.444649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ebea15e2-62b3-45b2-a887-460a98e9b873 req-35ad8652-aa67-46bd-807f-75674c662077 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:41.470301 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ebea15e2-62b3-45b2-a887-460a98e9b873 req-35ad8652-aa67-46bd-807f-75674c662077 service nova] Creating event network-vif-plugged:f45dce22-429d-4b51-aaa5-cfdcccb364a4 for instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 on nch1-master-1 Aug 06 21:13:41.488441 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ebea15e2-62b3-45b2-a887-460a98e9b873 req-35ad8652-aa67-46bd-807f-75674c662077 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070055 Aug 06 21:13:41.489729 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2226/4322] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:41.713013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:41.713825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:41.724755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:41.734984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:41.735613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:41.736607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:41.737322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:41.737906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:41.835041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:41.850210 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d13a67f2-458b-44dd-b0ed-ebe957f76bc0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 0.668086 Aug 06 21:13:41.851227 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2097/4323] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:41 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:41.923918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:41.924830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:41.944687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:41.945456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:41.946080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:41.946987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:41.947598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:41.948181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:41.972739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 HTTP/1.1 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'b65f4d33-d7b2-4bb6-a852-ba30292476c0'} Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:41.974963 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:41.979151 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:41.979151 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:41.979151 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:41.979151 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:13:41.979151 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:13:41.979151 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:13:41.979151 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:41.983814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:41.985105 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9660420e-12ec-4e9b-a5ff-cc741ed5f032 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 404 len: 111 microversion: 2.1 time: 0.065095 Aug 06 21:13:41.997949 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2098/4324] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:41 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:13:42.003443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:42.004309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:42.024673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:42.025534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:42.026417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:42.027376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:42.028068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:42.028723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:42.547104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:42.555819 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-59602eee-c536-44c1-867c-9e115e28da8d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1367 microversion: 2.1 time: 0.847483 Aug 06 21:13:42.566590 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2227/4325] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:41 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1367 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:42.571020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-653d7736-b3da-4a60-a8dd-bb5ba0ca3795 req-4972ccea-ed29-4fd9-a8ee-4483904532a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65f4d33-d7b2-4bb6-a852-ba30292476c0", "name": "network-vif-deleted", "tag": "0eae1991-ba76-4375-82db-4233f219e56b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:42.591758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-653d7736-b3da-4a60-a8dd-bb5ba0ca3795 req-4972ccea-ed29-4fd9-a8ee-4483904532a7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:42.592517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-653d7736-b3da-4a60-a8dd-bb5ba0ca3795 req-4972ccea-ed29-4fd9-a8ee-4483904532a7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:42.593615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-653d7736-b3da-4a60-a8dd-bb5ba0ca3795 req-4972ccea-ed29-4fd9-a8ee-4483904532a7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:42.623014 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-653d7736-b3da-4a60-a8dd-bb5ba0ca3795 req-4972ccea-ed29-4fd9-a8ee-4483904532a7 service nova] Creating event network-vif-deleted:0eae1991-ba76-4375-82db-4233f219e56b for instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 on nch2-master-1 Aug 06 21:13:42.640482 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-653d7736-b3da-4a60-a8dd-bb5ba0ca3795 req-4972ccea-ed29-4fd9-a8ee-4483904532a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078560 Aug 06 21:13:42.641242 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2228/4326] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:42.877783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:42.878972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:42.893097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:42.893868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:42.894505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:42.895552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:42.896501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:42.898967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:42.940964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:42.951050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:42.959276 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bc864fd9-5723-4a75-a1f1-27c465fb575d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.959759 Aug 06 21:13:42.964413 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2099/4327] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:41 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:43.178744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-38f342ad-8c2c-490a-8388-627c0f78d9b5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-38f342ad-8c2c-490a-8388-627c0f78d9b5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 163 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": 12345, "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 12345 Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:13:43.182905 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-38f342ad-8c2c-490a-8388-627c0f78d9b5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:43.186926 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-38f342ad-8c2c-490a-8388-627c0f78d9b5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.009865 Aug 06 21:13:43.188277 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2100/4328] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:43 2022] POST /compute/v2.1/servers => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:13:43.195342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:43.196249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:43.203559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:43.204297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:43.204909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:43.205791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:43.206416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:43.207047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:43.365427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:43.375637 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6969f6a0-762c-40e5-98c5-4f6f95ef98a0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 0.503419 Aug 06 21:13:43.388189 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2229/4329] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:42 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:43.596434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:43.598004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:43.606919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:43.610324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:43.611356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:43.612295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:43.614275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:43.618592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:43.971301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:43.994285 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0440924b-e358-4cf2-b800-ebf1346cc96b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1367 microversion: 2.1 time: 0.397286 Aug 06 21:13:43.998386 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2230/4330] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:43 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:44.431520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:44.437337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:44.438440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:44.448080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:44.448949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:44.449617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:44.450734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:44.451492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:44.452393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:44.477148 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e1c5a9a3-084b-45bd-86cb-48cd2324b8ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.277392 Aug 06 21:13:44.479480 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2101/4331] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:43 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:44.516858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:44.519608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:44.530418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:44.531184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:44.532100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:44.533058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:44.533781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:44.534408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:44.913292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:44.935344 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6919157-5c94-4c29-a7f5-7d076df0a788 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 0.525910 Aug 06 21:13:44.950304 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2231/4332] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:44 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:44.955432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3d5785a4-7ab6-4e43-b6e5-37225e2eb725 req-251fad23-5f28-473b-b487-5582e0fab3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8500f59e-75eb-445a-87a8-088776efa386", "name": "network-vif-plugged", "status": "completed", "tag": "5c47a6bb-0f59-405c-8c92-8556c9259127"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:44.967503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3d5785a4-7ab6-4e43-b6e5-37225e2eb725 req-251fad23-5f28-473b-b487-5582e0fab3f0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:44.968265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3d5785a4-7ab6-4e43-b6e5-37225e2eb725 req-251fad23-5f28-473b-b487-5582e0fab3f0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:44.968868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3d5785a4-7ab6-4e43-b6e5-37225e2eb725 req-251fad23-5f28-473b-b487-5582e0fab3f0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:44.995268 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3d5785a4-7ab6-4e43-b6e5-37225e2eb725 req-251fad23-5f28-473b-b487-5582e0fab3f0 service nova] Creating event network-vif-plugged:5c47a6bb-0f59-405c-8c92-8556c9259127 for instance 8500f59e-75eb-445a-87a8-088776efa386 on nch2-master-1 Aug 06 21:13:45.002283 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3d5785a4-7ab6-4e43-b6e5-37225e2eb725 req-251fad23-5f28-473b-b487-5582e0fab3f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051118 Aug 06 21:13:45.003709 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2232/4333] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:45.028436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:45.030119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:45.047617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:45.048494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:45.049096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:45.050324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:45.050963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:45.051592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:45.422776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:45.446164 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-be2538a4-e301-4370-83f0-3e9c04746d3c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1558 microversion: 2.1 time: 0.426895 Aug 06 21:13:45.447100 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2233/4334] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:45 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1558 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:45.467394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9feb9e34-ff45-4cc7-aad8-46a705c8e591 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:45.467896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9feb9e34-ff45-4cc7-aad8-46a705c8e591 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:45.474218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9feb9e34-ff45-4cc7-aad8-46a705c8e591 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:45.474971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9feb9e34-ff45-4cc7-aad8-46a705c8e591 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:45.475702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9feb9e34-ff45-4cc7-aad8-46a705c8e591 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:45.476543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9feb9e34-ff45-4cc7-aad8-46a705c8e591 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:45.477069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9feb9e34-ff45-4cc7-aad8-46a705c8e591 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:45.477501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9feb9e34-ff45-4cc7-aad8-46a705c8e591 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:45.622320 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9feb9e34-ff45-4cc7-aad8-46a705c8e591 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158772 Aug 06 21:13:45.623419 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2234/4335] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:13:45 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:13:45.672887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:45.685955 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4bf2e0ab-0046-4e86-b392-11d89cf26ecc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.172943 Aug 06 21:13:45.690660 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2102/4336] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:44 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:45.959829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:45.960581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:45.972682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:45.976331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:45.978131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:45.978958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:45.980501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:45.982526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:46.898890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:46.911432 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-324059e0-9515-4f62-b503-48ac25646b80 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 0.957302 Aug 06 21:13:46.915181 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2235/4337] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:45 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:47.069699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-2f84a346-9793-4c0f-9fc9-549e587001b1 req-1554263a-640c-47a5-98ed-feb6cd6e1cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b32e2bb-2811-4e10-972c-e2e5908d1911", "name": "network-vif-plugged", "status": "completed", "tag": "63cfc53c-0ba6-409d-98eb-324ff6cd5581"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:47.088006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2f84a346-9793-4c0f-9fc9-549e587001b1 req-1554263a-640c-47a5-98ed-feb6cd6e1cd3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:47.089132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2f84a346-9793-4c0f-9fc9-549e587001b1 req-1554263a-640c-47a5-98ed-feb6cd6e1cd3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:47.091119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2f84a346-9793-4c0f-9fc9-549e587001b1 req-1554263a-640c-47a5-98ed-feb6cd6e1cd3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:47.108490 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-2f84a346-9793-4c0f-9fc9-549e587001b1 req-1554263a-640c-47a5-98ed-feb6cd6e1cd3 service nova] Creating event network-vif-plugged:63cfc53c-0ba6-409d-98eb-324ff6cd5581 for instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 on nch1-master-1 Aug 06 21:13:47.114762 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-2f84a346-9793-4c0f-9fc9-549e587001b1 req-1554263a-640c-47a5-98ed-feb6cd6e1cd3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050211 Aug 06 21:13:47.117731 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2103/4338] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:47.846155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74bc71b0-1cdf-4844-bb1c-9ca4c5039c79 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-575216398", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:47.936887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:47.937713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:47.949561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:47.964238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:47.965260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:47.968448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:47.969167 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-74bc71b0-1cdf-4844-bb1c-9ca4c5039c79 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Block Device a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7 is not bootable. Aug 06 21:13:47.970402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:47.972067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74bc71b0-1cdf-4844-bb1c-9ca4c5039c79 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 357 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-575216398", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: exception: Block Device a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7 is not bootable. Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-575216398', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7'}], 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7 is not bootable. Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:47.980804 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7 is not bootable. Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7 is not bootable. Aug 06 21:13:47.984668 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:47.988216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74bc71b0-1cdf-4844-bb1c-9ca4c5039c79 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Block Device a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7 is not bootable. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:47.989171 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74bc71b0-1cdf-4844-bb1c-9ca4c5039c79 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.147092 Aug 06 21:13:47.990198 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2236/4339] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:13:47.998738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:47.999453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:48.009868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:48.010452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:48.011012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:48.015657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:48.016435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:48.017254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:48.288553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:48.301816 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b68d88b3-a15f-4a80-b982-e745e25c1484 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.306678 Aug 06 21:13:48.318615 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2237/4340] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:47 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:48.343470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:48.344606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:48.367018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:48.369811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:48.371772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:48.372224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:48.375489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:48.378266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:48.378909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:48.613258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:48.630216 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd2ca183-0609-45bf-a2ab-1b6cc46dcf93 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.291436 Aug 06 21:13:48.632752 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2238/4341] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:48 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:49.149579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-a4d59c3a-921f-4f05-a3e3-76935e868eab req-1bee088e-eb37-4cd1-b3a7-b3e7bdb8deda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3032571-71f1-4d19-be54-d92d912fa263", "name": "network-vif-plugged", "status": "completed", "tag": "b775e0de-7a5d-49e1-91d7-5d59753ba2d6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:49.185383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a4d59c3a-921f-4f05-a3e3-76935e868eab req-1bee088e-eb37-4cd1-b3a7-b3e7bdb8deda service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:49.185890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a4d59c3a-921f-4f05-a3e3-76935e868eab req-1bee088e-eb37-4cd1-b3a7-b3e7bdb8deda service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:49.186334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a4d59c3a-921f-4f05-a3e3-76935e868eab req-1bee088e-eb37-4cd1-b3a7-b3e7bdb8deda service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:49.224835 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a4d59c3a-921f-4f05-a3e3-76935e868eab req-1bee088e-eb37-4cd1-b3a7-b3e7bdb8deda service nova] Creating event network-vif-plugged:b775e0de-7a5d-49e1-91d7-5d59753ba2d6 for instance b3032571-71f1-4d19-be54-d92d912fa263 on nch1-master-1 Aug 06 21:13:49.230704 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-a4d59c3a-921f-4f05-a3e3-76935e868eab req-1bee088e-eb37-4cd1-b3a7-b3e7bdb8deda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086250 Aug 06 21:13:49.232030 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2239/4342] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:13:49.264652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:49.278255 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-51757815-35d7-46b4-b90d-b7a0fe9094fc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 1.346288 Aug 06 21:13:49.281560 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2104/4343] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:47 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:50.155497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e313ebed-e651-4bc6-a5c5-103033002e79 req-d5d4516d-9f84-4707-b52d-5d6b399a9080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08", "tag": "f45dce22-429d-4b51-aaa5-cfdcccb364a4"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:50.237183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e313ebed-e651-4bc6-a5c5-103033002e79 req-d5d4516d-9f84-4707-b52d-5d6b399a9080 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:50.241714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e313ebed-e651-4bc6-a5c5-103033002e79 req-d5d4516d-9f84-4707-b52d-5d6b399a9080 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:50.242189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e313ebed-e651-4bc6-a5c5-103033002e79 req-d5d4516d-9f84-4707-b52d-5d6b399a9080 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:50.294338 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e313ebed-e651-4bc6-a5c5-103033002e79 req-d5d4516d-9f84-4707-b52d-5d6b399a9080 service nova] Creating event network-changed:f45dce22-429d-4b51-aaa5-cfdcccb364a4 for instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 on nch1-master-1 Aug 06 21:13:50.309611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:50.311441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:50.315518 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e313ebed-e651-4bc6-a5c5-103033002e79 req-d5d4516d-9f84-4707-b52d-5d6b399a9080 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164420 Aug 06 21:13:50.318124 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2240/4344] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:50.323770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:50.327343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:50.329215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:50.331137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:50.345905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:50.347073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:50.349005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:50.545381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c982951-167a-4572-a4de-c4d76a5b3591 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839969066", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5135514a-af3f-4057-893c-38dd4d85e4cd", "destination_type": "local"}, {"source_type": "volume", "uuid": "789975ac-83d5-4333-9996-bffa549e21f9", "destination_type": "invalid"}], "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c982951-167a-4572-a4de-c4d76a5b3591 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 495 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839969066", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5135514a-af3f-4057-893c-38dd4d85e4cd", "destination_type": "local"}, {"source_type": "volume", "uuid": "789975ac-83d5-4333-9996-bffa549e21f9", "destination_type": "invalid"}], "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1839969066', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '789975ac-83d5-4333-9996-bffa549e21f9', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'invalid' Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:50.550524 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 06 21:13:50.555103 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:50.558086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c982951-167a-4572-a4de-c4d76a5b3591 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:50.559229 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c982951-167a-4572-a4de-c4d76a5b3591 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018593 Aug 06 21:13:50.560591 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2241/4345] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:50 2022] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:13:50.575031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:50.576886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:50.597016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:50.598367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:50.599160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:50.601896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:50.602699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:50.604764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:51.004488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:51.033126 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3ded52e7-52ac-45ac-a5a9-4a907bedea1a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1323 microversion: 2.1 time: 0.733594 Aug 06 21:13:51.034337 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2105/4346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:50 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1323 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:51.333944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:51.343143 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ad6789f-4abd-4873-a165-fa374c855e82 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.777311 Aug 06 21:13:51.346060 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2242/4347] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:50 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:51.366726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:51.367898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:51.386896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:51.390504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:51.391247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:51.393440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:51.395990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:51.397702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:51.891450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:51.902615 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-386934ab-92bd-4324-be37-e88d63e01aaa tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.539864 Aug 06 21:13:51.914667 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2106/4348] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:51 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:52.058823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:52.059687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:52.073985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.074492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.074959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:52.075691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.076137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.076571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:52.119776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ae09549-52a7-4b03-993f-89adf2b1ed77 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-860644371", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ae09549-52a7-4b03-993f-89adf2b1ed77 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 491 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-860644371", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-860644371', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:52.125592 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 06 21:13:52.129353 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:52.139058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ae09549-52a7-4b03-993f-89adf2b1ed77 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:52.140694 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6ae09549-52a7-4b03-993f-89adf2b1ed77 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.026272 Aug 06 21:13:52.142062 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2107/4349] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:52 2022] POST /compute/v2.1/servers => generated 624 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:13:52.152940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:52.154076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:52.171416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.172191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.172922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:52.173896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.183721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.193150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:52.502519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:52.512419 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab425bf8-08b7-4780-a2a7-1d600b9a9ecd tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1515 microversion: 2.1 time: 0.458472 Aug 06 21:13:52.513000 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2243/4350] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:52 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1515 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:52.541484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:52.542233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 8500f59e-75eb-445a-87a8-088776efa386] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:52.556586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.557213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.557763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:52.558598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.559067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.559617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:52.579318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:52.590983 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d5c34fe-7a91-4815-8f77-d5cf66afa0b0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.443403 Aug 06 21:13:52.606888 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2108/4351] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:52 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:52.623728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:52.624447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:52.634145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.637127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.643260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:52.644334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.645014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.645653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:52.856679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:52.866896 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47fd724e-3c25-48d2-90d2-16f811ce86da tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386" status: 200 len: 1516 microversion: 2.1 time: 0.327522 Aug 06 21:13:52.868274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2244/4352] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:52 2022] GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:52.896512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:52.899812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:52.908481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.909430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.910127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:52.911266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:52.912005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:52.912792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:53.144028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:53.147716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:53.155062 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-16bfdea6-d3dd-4c6a-9ca0-3ebcd6d5be1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.532212 Aug 06 21:13:53.158689 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2109/4353] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:52 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:53.161375 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c324735b-33a8-4eb2-b380-fa8659f2c01c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911" status: 200 len: 1515 microversion: 2.1 time: 0.275374 Aug 06 21:13:53.162053 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2245/4354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:52 2022] GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:53.191037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:53.191570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:53.208025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:53.208534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:53.208979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:53.210429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:53.211070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:53.213770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:53.268110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:13:53.342899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0e66aa7-a987-4dd6-a0ea-81b50a7aa176 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0e66aa7-a987-4dd6-a0ea-81b50a7aa176 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 416 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:53.348567 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:13:53.354985 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:53.360108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0e66aa7-a987-4dd6-a0ea-81b50a7aa176 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:53.361374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d0e66aa7-a987-4dd6-a0ea-81b50a7aa176 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.026581 Aug 06 21:13:53.370528 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2246/4355] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:53 2022] POST /compute/v2.1/servers => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:13:53.383210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:53.385215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:53.414394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:53.416512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:53.417657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:53.419822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:53.420927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:53.422405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:53.450849 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ae2371c-581b-4592-ae55-fde60e9f09ec tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911" status: 204 len: 0 microversion: 2.1 time: 0.265588 Aug 06 21:13:53.455543 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2110/4356] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:13:53 2022] DELETE /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:13:53.504553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:53.505577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:53.536265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:53.536773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:53.538838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:53.541038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:53.541504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:53.548285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:53.864470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:53.875026 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4399c93d-31fa-4d5f-b2af-317851823c82 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911" status: 200 len: 1521 microversion: 2.1 time: 0.415906 Aug 06 21:13:53.875026 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2111/4357] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:53 2022] GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:54.012278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:54.017474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:54.026375 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ac8543ca-ef4e-408e-9fc5-df71943a04bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.653854 Aug 06 21:13:54.027008 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2247/4358] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:53 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:54.054272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:54.054660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:54.070187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:54.070187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:54.070187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:54.070187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:54.070723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:54.071522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:54.376237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:54.389926 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-581e4fd0-f749-40e4-bf4d-69ea9db026ab tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.343946 Aug 06 21:13:54.411338 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2112/4359] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:54 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:54.728080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc768949-a767-4ffc-a93c-dda6b4b2d24f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1988278117", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": -1, "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:54.775467 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-fc768949-a767-4ffc-a93c-dda6b4b2d24f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Flavor -1 could not be found. Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc768949-a767-4ffc-a93c-dda6b4b2d24f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 206 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1988278117", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": -1, "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: exception: Flavor -1 could not be found. Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1988278117', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': -1, 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:54.778244 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 06 21:13:54.782848 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:54.786814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc768949-a767-4ffc-a93c-dda6b4b2d24f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:54.788135 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fc768949-a767-4ffc-a93c-dda6b4b2d24f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.066358 Aug 06 21:13:54.789514 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2248/4360] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:54 2022] POST /compute/v2.1/servers => generated 73 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 06 21:13:54.803636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:54.804550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:54.820097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:54.820917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:54.821529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:54.822849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:54.823587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:54.824191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:54.900597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:54.901778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:54.919566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:54.920828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:54.921502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:54.922431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:54.923260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:54.923986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:55.293528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:55.306513 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e2a08c0f-cad9-4419-8ca9-2d66bd8579bc tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911" status: 200 len: 1521 microversion: 2.1 time: 0.413633 Aug 06 21:13:55.308174 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2249/4361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:54 2022] GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:13:55.863879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:55.877774 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-399fee23-328a-4240-a2fa-92553da35159 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.083312 Aug 06 21:13:55.893735 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2113/4362] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:54 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:55.902262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:55.902925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:55.923486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:55.924697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:55.926888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:55.929502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:55.930163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:55.931206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:56.227263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:56.236047 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-82c50333-7874-4dfd-a0bc-a274ac6e10d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.337556 Aug 06 21:13:56.241884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:56.242511 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2250/4363] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:55 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:56.255552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:56.270628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:56.271349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:56.272397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:56.273349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:56.273813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:56.274244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:56.329654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:56.330277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:56.344900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:56.345409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:56.345835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:56.357816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:56.358860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:56.359474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:56.683029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:56.696566 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb865bdc-7da9-49a9-9951-b7d4c441129c tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911" status: 200 len: 1521 microversion: 2.1 time: 0.371322 Aug 06 21:13:56.697153 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2251/4364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:56 2022] GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:56.702032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-641e67ee-7c81-47dc-acf4-9ef331866782 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-297925436", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-641e67ee-7c81-47dc-acf4-9ef331866782 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 172 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-297925436", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-297925436', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi -1 Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:13:56.719745 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 06 21:13:56.724427 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:56.729206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-641e67ee-7c81-47dc-acf4-9ef331866782 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:56.729206 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-641e67ee-7c81-47dc-acf4-9ef331866782 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.030017 Aug 06 21:13:56.729206 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2252/4365] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:56 2022] POST /compute/v2.1/servers => generated 145 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:13:56.754362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:56.755314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:56.766429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:56.768220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:56.768855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:56.770521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:56.771080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:56.776219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:56.963719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:56.975487 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-288bc18c-53c2-46cd-9bfd-92f1e08d290c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.741800 Aug 06 21:13:56.994625 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2114/4366] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:56 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:57.021346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-cdcb1d49-78c3-4e7e-bb09-bf6032f3dce9 req-2a2cc131-d1f7-458b-8c18-5df9395c6aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b32e2bb-2811-4e10-972c-e2e5908d1911", "name": "network-vif-deleted", "tag": "63cfc53c-0ba6-409d-98eb-324ff6cd5581"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:57.060902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cdcb1d49-78c3-4e7e-bb09-bf6032f3dce9 req-2a2cc131-d1f7-458b-8c18-5df9395c6aad service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.061409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cdcb1d49-78c3-4e7e-bb09-bf6032f3dce9 req-2a2cc131-d1f7-458b-8c18-5df9395c6aad service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.061852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-cdcb1d49-78c3-4e7e-bb09-bf6032f3dce9 req-2a2cc131-d1f7-458b-8c18-5df9395c6aad service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.098980 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-cdcb1d49-78c3-4e7e-bb09-bf6032f3dce9 req-2a2cc131-d1f7-458b-8c18-5df9395c6aad service nova] Creating event network-vif-deleted:63cfc53c-0ba6-409d-98eb-324ff6cd5581 for instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 on nch1-master-1 Aug 06 21:13:57.116736 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-cdcb1d49-78c3-4e7e-bb09-bf6032f3dce9 req-2a2cc131-d1f7-458b-8c18-5df9395c6aad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118702 Aug 06 21:13:57.121147 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2115/4367] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:57.134999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:57.136264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:57.150475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.151304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.151946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.152888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.154409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.155386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.293717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:57.314163 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-effbf80b-07ff-4e6d-927c-c3fd271ad2c1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.575924 Aug 06 21:13:57.315335 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2253/4368] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:56 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:57.339345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:57.341461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:57.348475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.349225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.350382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.351920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.352590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.353447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.384120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:57.394064 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e9f31737-b7e1-4bca-86b2-845a1421d758 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.271370 Aug 06 21:13:57.394710 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2116/4369] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:57 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:57.416495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:57.417427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:57.429159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.429938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.456005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.458355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.460477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.466028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.585042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:57.593712 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-548d0ff4-8b06-4099-8a76-7d97284eb424 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.258215 Aug 06 21:13:57.607130 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2254/4370] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:57 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:57.721226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:57.722097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:57.736732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.737892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.739338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.740824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.741614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.742920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.772205 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] HTTP exception thrown: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Request method failure captured: Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 HTTP/1.1 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlylbNjv3U6ffz4kT7amkDoESCMFhQ3VDblgwq8h2luDfEHOK4_oSIR7-Iz96prsMlKsTv5XunR1rN_YdQfub9CqO1ez9RZo8So1Fea_ura4ybygkDx8_k9LYQS6cHwjwc1RrQhZTn6k2e3obj0F1DV9q4t7HpvlIzm9vL7ZepetTI Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbf6e27c08c84eb780aee25318136435", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 950a8bbfd820444b9f85976f6609c864 Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '9b32e2bb-2811-4e10-972c-e2e5908d1911'} Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:57.776653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:57.781963 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:57.781963 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:57.781963 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:57.781963 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:57.781963 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:13:57.781963 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:13:57.781963 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:13:57.781963 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:57.784201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Returning 404 to user: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:57.785250 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-90c8fee2-2ee0-40b7-a3e1-2fc3867fcb58 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911" status: 404 len: 111 microversion: 2.1 time: 0.068674 Aug 06 21:13:57.786319 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2255/4371] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:57 2022] GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:13:57.797638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:57.804472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:57.805581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'dbf6e27c08c84eb780aee25318136435'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:13:57.813258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.813907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.814773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.815891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.816303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:57.816450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.816939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.832357 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a61591a2-352e-4dc5-bf40-f7255e863b96 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.420660 Aug 06 21:13:57.834263 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2117/4372] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:57 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:57.848111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1d75a6be-1ac4-43f6-ab1c-3509be970b92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1359540120", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:57.863967 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-1d75a6be-1ac4-43f6-ab1c-3509be970b92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1d75a6be-1ac4-43f6-ab1c-3509be970b92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 216 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1359540120", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1359540120', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:57.869037 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:57.873683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:57.873683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:57.873683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:57.873683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:13:57.873683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:13:57.873683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 06 21:13:57.873683 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:57.878582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1d75a6be-1ac4-43f6-ab1c-3509be970b92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:57.879973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1d75a6be-1ac4-43f6-ab1c-3509be970b92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.041491 Aug 06 21:13:57.883294 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2118/4373] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:57 2022] POST /compute/v2.1/servers => generated 123 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:13:57.898673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6e121a94-aa67-4ae8-99d0-5cc83424eedd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1308894398"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:57.901237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6e121a94-aa67-4ae8-99d0-5cc83424eedd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:57.922267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e121a94-aa67-4ae8-99d0-5cc83424eedd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.923235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e121a94-aa67-4ae8-99d0-5cc83424eedd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.926489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e121a94-aa67-4ae8-99d0-5cc83424eedd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.927483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e121a94-aa67-4ae8-99d0-5cc83424eedd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.929026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e121a94-aa67-4ae8-99d0-5cc83424eedd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:57.929692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e121a94-aa67-4ae8-99d0-5cc83424eedd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:57.942821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:13:57.961067 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8576395e-f528-41ce-9d9f-40b6db815ba7 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.169235 Aug 06 21:13:57.964329 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2256/4374] 10.222.0.33 () {58 vars in 1230 bytes} [Sat Aug 6 21:13:57 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:13:57.973107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:57.973829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:57.990746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:57.991942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.000905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:58.002367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:58.003049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.004519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:58.286038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:58.295796 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ecb13ac9-7436-4443-baee-477b757ae800 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.330384 Aug 06 21:13:58.320666 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2257/4375] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:57 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:58.329593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec250284-f57f-4a48-8d49-b7e12dc70ad0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:58.332446 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6e121a94-aa67-4ae8-99d0-5cc83424eedd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.445003 Aug 06 21:13:58.334832 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2119/4376] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:13:57 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec250284-f57f-4a48-8d49-b7e12dc70ad0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Request method failure captured: Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlylbNjv3U6ffz4kT7amkDoESCMFhQ3VDblgwq8h2luDfEHOK4_oSIR7-Iz96prsMlKsTv5XunR1rN_YdQfub9CqO1ez9RZo8So1Fea_ura4ybygkDx8_k9LYQS6cHwjwc1RrQhZTn6k2e3obj0F1DV9q4t7HpvlIzm9vL7ZepetTI Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbf6e27c08c84eb780aee25318136435", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 950a8bbfd820444b9f85976f6609c864 Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 06 21:13:58.336640 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 06 21:13:58.343255 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.346852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec250284-f57f-4a48-8d49-b7e12dc70ad0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:58.347963 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ec250284-f57f-4a48-8d49-b7e12dc70ad0 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.025798 Aug 06 21:13:58.348869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2258/4377] 10.222.0.33 () {58 vars in 1182 bytes} [Sat Aug 6 21:13:58 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:13:58.361334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:58.362680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:58.375417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:58.378148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.381735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:58.383131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:58.388709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.389619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:58.393526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:58.418594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:58.419326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Searching by: {'deleted': False, 'project_id': 'dbf6e27c08c84eb780aee25318136435'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:13:58.438112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:58.453400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.453913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:58.454776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:58.455255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.456005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:58.506459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:13:58.596839 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-db16a803-2fe7-4aba-b360-7b082d8c94b1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.216654 Aug 06 21:13:58.597535 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2259/4378] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:13:58 2022] GET /compute/v2.1/servers => generated 683 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:58.611575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:58.621434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:58.621895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.compute.servers [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Removing options 'limit' from query {{(pid=142461) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 06 21:13:58.622668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Searching by: {'deleted': False, 'project_id': 'dbf6e27c08c84eb780aee25318136435'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:13:58.630228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:58.631270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.631776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:58.632873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:58.633410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.634352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:58.716364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:13:58.760729 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-712c46ab-65ab-4804-9abe-40df515cf7f5 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.153717 Aug 06 21:13:58.774019 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2260/4379] 10.222.0.33 () {58 vars in 1144 bytes} [Sat Aug 6 21:13:58 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:13:58.781636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84b47a00-a126-46f6-bf0f-676460a91164 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84b47a00-a126-46f6-bf0f-676460a91164 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Request method failure captured: Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlylbNjv3U6ffz4kT7amkDoESCMFhQ3VDblgwq8h2luDfEHOK4_oSIR7-Iz96prsMlKsTv5XunR1rN_YdQfub9CqO1ez9RZo8So1Fea_ura4ybygkDx8_k9LYQS6cHwjwc1RrQhZTn6k2e3obj0F1DV9q4t7HpvlIzm9vL7ZepetTI Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbf6e27c08c84eb780aee25318136435", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 950a8bbfd820444b9f85976f6609c864 Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi '-1' Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 06 21:13:58.787629 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84b47a00-a126-46f6-bf0f-676460a91164 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-84b47a00-a126-46f6-bf0f-676460a91164 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.014314 Aug 06 21:13:58.792072 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2261/4380] 10.222.0.33 () {58 vars in 1142 bytes} [Sat Aug 6 21:13:58 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:13:58.800977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b06bddaa-8c54-44be-8ecb-c0c6e0a0a84e tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b06bddaa-8c54-44be-8ecb-c0c6e0a0a84e tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Request method failure captured: Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlylbNjv3U6ffz4kT7amkDoESCMFhQ3VDblgwq8h2luDfEHOK4_oSIR7-Iz96prsMlKsTv5XunR1rN_YdQfub9CqO1ez9RZo8So1Fea_ura4ybygkDx8_k9LYQS6cHwjwc1RrQhZTn6k2e3obj0F1DV9q4t7HpvlIzm9vL7ZepetTI Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbf6e27c08c84eb780aee25318136435", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 950a8bbfd820444b9f85976f6609c864 Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: action_args: {} Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'testing' Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 06 21:13:58.806806 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b06bddaa-8c54-44be-8ecb-c0c6e0a0a84e tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b06bddaa-8c54-44be-8ecb-c0c6e0a0a84e tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.011478 Aug 06 21:13:58.812784 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2262/4381] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:13:58 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:13:58.823326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab7dc5ad-468e-4547-906e-179a143b606a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:58.832664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab7dc5ad-468e-4547-906e-179a143b606a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:58.835443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab7dc5ad-468e-4547-906e-179a143b606a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'dbf6e27c08c84eb780aee25318136435'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:13:58.847055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:58.857417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.compute.servers [None req-ab7dc5ad-468e-4547-906e-179a143b606a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Flavor 'non_existing_flavor' could not be found {{(pid=142461) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 06 21:13:58.858471 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab7dc5ad-468e-4547-906e-179a143b606a tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.044484 Aug 06 21:13:58.858924 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7da0b134-f280-40f1-9003-06b316bcab4f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.516266 Aug 06 21:13:58.870585 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2263/4382] 10.222.0.33 () {58 vars in 1178 bytes} [Sat Aug 6 21:13:58 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:13:58.872719 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2120/4383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:58 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:13:58.881988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:58.885604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:58.886272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'dbf6e27c08c84eb780aee25318136435'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:13:58.898953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:58.899546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.900500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:58.901484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:58.902604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:58.903243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:59.060246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ab8713a-bf59-480c-8bbd-2f3a2f2510c2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1172309577", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "key_name": "tempest-key-1392347582", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:13:59.164273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-1ab8713a-bf59-480c-8bbd-2f3a2f2510c2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] validate_networks() for [('c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:13:59.400468 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-85bfbeaf-32f6-42ab-a134-631509b58072 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.529943 Aug 06 21:13:59.401043 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2264/4384] 10.222.0.33 () {58 vars in 1174 bytes} [Sat Aug 6 21:13:58 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:13:59.416297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:59.421632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:59.422311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'dbf6e27c08c84eb780aee25318136435'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:13:59.440124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:59.440629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:59.441071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:59.441799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:59.442829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:59.444003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:59.499688 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-1ab8713a-bf59-480c-8bbd-2f3a2f2510c2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Invalid key_name provided. Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ab8713a-bf59-480c-8bbd-2f3a2f2510c2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 247 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1172309577", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "key_name": "tempest-key-1392347582", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid key_name provided. Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1172309577', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'key_name': 'tempest-key-1392347582', 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1392347582 not found for user a6c953ff2f774041a7d50f53033ee124 Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:59.501775 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:13:59.505578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ab8713a-bf59-480c-8bbd-2f3a2f2510c2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid key_name provided. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:13:59.509023 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1ab8713a-bf59-480c-8bbd-2f3a2f2510c2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.449963 Aug 06 21:13:59.509947 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2121/4385] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:13:59 2022] POST /compute/v2.1/servers => generated 70 bytes in 455 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 06 21:13:59.532506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:59.533510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:13:59.549566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:59.550373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:59.552172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:59.554019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:59.556018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:59.557193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:59.591510 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-86b2fcc2-f89f-4bf9-9933-066cbda60ddf tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.180730 Aug 06 21:13:59.592096 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2265/4386] 10.222.0.33 () {58 vars in 1184 bytes} [Sat Aug 6 21:13:59 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:13:59.610998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:13:59.626125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:59.627885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Searching by: {'deleted': False, 'project_id': 'dbf6e27c08c84eb780aee25318136435'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:13:59.644829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:59.645364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:59.648000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:59.653285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:59.653840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:59.654437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:13:59.707408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:13:59.777251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:13:59.786309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:13:59.787576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:13:59.788203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.045771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:00.065014 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0ddcb9b9-5000-4381-8fbf-f523f5493bfe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.547912 Aug 06 21:14:00.066853 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2122/4387] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:13:59 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:00.096199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:00.101864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:00.126790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.134111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.135504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.136964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.140981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.142063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.207470 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a42e8e67-44fb-45fd-a6a4-c86137a1234d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.606960 Aug 06 21:14:00.208059 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2266/4388] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:13:59 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:00.236050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-54201e9d-2b69-41fd-9562-ce2ad7450a32 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:00.248958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-54201e9d-2b69-41fd-9562-ce2ad7450a32 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:00.250128 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-54201e9d-2b69-41fd-9562-ce2ad7450a32 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.018734 Aug 06 21:14:00.259146 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2267/4389] 10.222.0.33 () {58 vars in 1178 bytes} [Sat Aug 6 21:14:00 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:14:00.266174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:00.271882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:00.272969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Searching by: {'deleted': False, 'project_id': 'dbf6e27c08c84eb780aee25318136435'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:14:00.278997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.279649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.280528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.281461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.282079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.282695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.320563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:14:00.378368 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6aca9759-6289-49ac-947c-3477484b0846 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.117474 Aug 06 21:14:00.380452 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2268/4390] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:14:00 2022] GET /compute/v2.1/servers => generated 683 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:14:00.424889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:00.426335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:00.444447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.450170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.451529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.453134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.454562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.456046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.523115 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] HTTP exception thrown: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Request method failure captured: Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 HTTP/1.1 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlylbNjv3U6ffz4kT7amkDoESCMFhQ3VDblgwq8h2luDfEHOK4_oSIR7-Iz96prsMlKsTv5XunR1rN_YdQfub9CqO1ez9RZo8So1Fea_ura4ybygkDx8_k9LYQS6cHwjwc1RrQhZTn6k2e3obj0F1DV9q4t7HpvlIzm9vL7ZepetTI Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbf6e27c08c84eb780aee25318136435", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 950a8bbfd820444b9f85976f6609c864 Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '9b32e2bb-2811-4e10-972c-e2e5908d1911'} Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:00.528868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:00.534153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Returning 404 to user: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:00.538609 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d8ab4040-dfa1-4be4-8169-e3d4479fc7f8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911" status: 404 len: 111 microversion: 2.1 time: 0.145678 Aug 06 21:14:00.538609 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2269/4391] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:14:00 2022] DELETE /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:14:00.557071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:00.560456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 8500f59e-75eb-445a-87a8-088776efa386] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:00.578017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.582974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.584112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.592044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.592956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.595662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.669158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 8500f59e-75eb-445a-87a8-088776efa386] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:14:00.723721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:00.739832 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-34c78944-6268-48a9-9b98-cf583a9a66a9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.654454 Aug 06 21:14:00.743494 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2123/4392] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:00 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:00.829959 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-88a2cd5a-3b54-41b1-838f-3d5b1182165d tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386" status: 204 len: 0 microversion: 2.1 time: 0.288206 Aug 06 21:14:00.833817 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2270/4393] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:14:00 2022] DELETE /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:14:00.842023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:00.842908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:00.859384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.860500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.862780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.867336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:00.867985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:00.869633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:00.961153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:14:00.966416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ecd348b9-251b-4ca4-8a3f-f34385297482 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1064115589", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:01.171692 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b3abe98-d969-41f8-9ec9-8d4d3efebc59 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 204 len: 0 microversion: 2.1 time: 0.335639 Aug 06 21:14:01.172385 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2124/4394] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:14:00 2022] DELETE /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:14:01.183311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:01.184038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 9b32e2bb-2811-4e10-972c-e2e5908d1911] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:01.190682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:01.191403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:01.199649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:01.200684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:01.201860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:01.202647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:01.232112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.security_group_api [None req-ecd348b9-251b-4ca4-8a3f-f34385297482 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Neutron security group does_not_exist not found {{(pid=142461) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 06 21:14:01.232718 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-ecd348b9-251b-4ca4-8a3f-f34385297482 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 06 21:14:01.242517 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] HTTP exception thrown: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Request method failure captured: Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 HTTP/1.1 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlylbNjv3U6ffz4kT7amkDoESCMFhQ3VDblgwq8h2luDfEHOK4_oSIR7-Iz96prsMlKsTv5XunR1rN_YdQfub9CqO1ez9RZo8So1Fea_ura4ybygkDx8_k9LYQS6cHwjwc1RrQhZTn6k2e3obj0F1DV9q4t7HpvlIzm9vL7ZepetTI Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbf6e27c08c84eb780aee25318136435", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 950a8bbfd820444b9f85976f6609c864 Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '9b32e2bb-2811-4e10-972c-e2e5908d1911'} Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.244214 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Returning 404 to user: Instance 9b32e2bb-2811-4e10-972c-e2e5908d1911 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:01.248283 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-052de83e-4cf9-424d-ae2a-d8cf9c1c1c2b tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911" status: 404 len: 111 microversion: 2.1 time: 0.068133 Aug 06 21:14:01.248893 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2125/4395] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:01 2022] GET /compute/v2.1/servers/9b32e2bb-2811-4e10-972c-e2e5908d1911 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:01.262615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:01.263258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 8500f59e-75eb-445a-87a8-088776efa386] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ecd348b9-251b-4ca4-8a3f-f34385297482 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 258 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1064115589", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1064115589', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 06 21:14:01.272953 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.277680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ecd348b9-251b-4ca4-8a3f-f34385297482 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:01.282136 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ecd348b9-251b-4ca4-8a3f-f34385297482 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.313984 Aug 06 21:14:01.282226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:01.282226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:01.282412 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2271/4396] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:14:00 2022] POST /compute/v2.1/servers => generated 106 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:14:01.289037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:01.289786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:01.291116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:01.292760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:01.293436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:01.299684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:01.306153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:01.307456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:01.308311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:01.309297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:01.310229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:01.313003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:01.355283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:01.612317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:01.623878 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-43b8bc0b-00db-4db6-a440-f97adce4cfbb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.340069 Aug 06 21:14:01.638680 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2272/4397] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:01 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:01.654489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:01.655764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:01.669577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:01.669577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:01.669577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:01.670026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:01.670925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:01.671067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:01.720498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:01.741060 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bcd07840-8108-4fd3-80b4-84388b7cd97f tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386" status: 200 len: 1522 microversion: 2.1 time: 0.485796 Aug 06 21:14:01.754793 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2126/4398] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:01 2022] GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:01.906766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:01.918308 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3cb4ad65-5065-450f-b9b3-154ec12dd935 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.271342 Aug 06 21:14:01.919371 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2273/4399] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:01 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:01.944784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c54d73a-af9a-4552-b72a-e23102583411 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:01.945301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0c54d73a-af9a-4552-b72a-e23102583411 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 8abc52f1-9394-4ad4-9c15-59c69fb59e72] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:01.959782 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0c54d73a-af9a-4552-b72a-e23102583411 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 8abc52f1-9394-4ad4-9c15-59c69fb59e72 could not be found. Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c54d73a-af9a-4552-b72a-e23102583411 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/8abc52f1-9394-4ad4-9c15-59c69fb59e72 HTTP/1.1 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 8abc52f1-9394-4ad4-9c15-59c69fb59e72 could not be found. Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '8abc52f1-9394-4ad4-9c15-59c69fb59e72'} Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8abc52f1-9394-4ad4-9c15-59c69fb59e72 could not be found. Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8abc52f1-9394-4ad4-9c15-59c69fb59e72 could not be found. Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.964323 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:01.970136 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.970136 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:01.970136 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:01.970136 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:01.970136 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:01.970136 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:01.970136 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8abc52f1-9394-4ad4-9c15-59c69fb59e72 could not be found. Aug 06 21:14:01.970136 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:01.974671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c54d73a-af9a-4552-b72a-e23102583411 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 8abc52f1-9394-4ad4-9c15-59c69fb59e72 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:01.977955 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c54d73a-af9a-4552-b72a-e23102583411 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8abc52f1-9394-4ad4-9c15-59c69fb59e72" status: 404 len: 111 microversion: 2.1 time: 0.037674 Aug 06 21:14:01.984759 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2127/4400] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:14:01 2022] DELETE /compute/v2.1/servers/8abc52f1-9394-4ad4-9c15-59c69fb59e72 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:01.995226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:01.995226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:02.008514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:02.010532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:02.011384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:02.013728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:02.014315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:02.014892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:02.505394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:02.528855 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b4eccdb1-54cf-41ca-8a3f-0e529bd7b25a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.543396 Aug 06 21:14:02.530205 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2274/4401] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:01 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:02.623295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:02.646928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:02.682305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:02.685165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:02.687833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:02.688772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:02.690204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:02.690694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:02.769837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:02.770622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 8500f59e-75eb-445a-87a8-088776efa386] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:02.784105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:02.790867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:02.792233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:02.794161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:02.804326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:02.805672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:03.171366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:03.186696 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eb087a8a-6ff2-42ac-8423-4facd8d9d520 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386" status: 200 len: 1522 microversion: 2.1 time: 0.423517 Aug 06 21:14:03.199478 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2275/4402] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:02 2022] GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:03.553844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:03.564041 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2c3f7755-33d1-4f6f-8c13-ba060ddba414 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.995900 Aug 06 21:14:03.575462 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2128/4403] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:02 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:03.601400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30a6706f-df66-4d44-880c-27e364c01809 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:03.601937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-30a6706f-df66-4d44-880c-27e364c01809 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Failed to fetch instance by id 9223372036854775808 {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 06 21:14:03.602474 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-30a6706f-df66-4d44-880c-27e364c01809 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30a6706f-df66-4d44-880c-27e364c01809 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 9223372036854775808 could not be found. Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '9223372036854775808'} Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:03.604106 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:03.608000 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:03.608000 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:03.608000 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:03.608000 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 06 21:14:03.608000 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:03.608000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30a6706f-df66-4d44-880c-27e364c01809 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:03.608000 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-30a6706f-df66-4d44-880c-27e364c01809 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.010191 Aug 06 21:14:03.608970 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2276/4404] 10.222.0.33 () {58 vars in 1188 bytes} [Sat Aug 6 21:14:03 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:14:03.619228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:03.622263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:03.636884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:03.637656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:03.638259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:03.639208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:03.650137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:03.650829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:03.813311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-379264e2-0c87-432f-b459-33bfeb3fd09d req-c7466984-a0a6-455e-8e66-9b110298f5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8500f59e-75eb-445a-87a8-088776efa386", "name": "network-vif-deleted", "tag": "5c47a6bb-0f59-405c-8c92-8556c9259127"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:03.850059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-379264e2-0c87-432f-b459-33bfeb3fd09d req-c7466984-a0a6-455e-8e66-9b110298f5d6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:03.852016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-379264e2-0c87-432f-b459-33bfeb3fd09d req-c7466984-a0a6-455e-8e66-9b110298f5d6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:03.852483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-379264e2-0c87-432f-b459-33bfeb3fd09d req-c7466984-a0a6-455e-8e66-9b110298f5d6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:03.906577 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-379264e2-0c87-432f-b459-33bfeb3fd09d req-c7466984-a0a6-455e-8e66-9b110298f5d6 service nova] Creating event network-vif-deleted:5c47a6bb-0f59-405c-8c92-8556c9259127 for instance 8500f59e-75eb-445a-87a8-088776efa386 on nch2-master-1 Aug 06 21:14:03.925841 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-379264e2-0c87-432f-b459-33bfeb3fd09d req-c7466984-a0a6-455e-8e66-9b110298f5d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121855 Aug 06 21:14:03.933017 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2277/4405] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:14:04.167535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-fda7f377-1956-472e-b84b-d0ab6e47f01d req-425ff14b-6b55-4bd9-a871-55a9644e3fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "name": "network-vif-plugged", "status": "completed", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:04.192284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fda7f377-1956-472e-b84b-d0ab6e47f01d req-425ff14b-6b55-4bd9-a871-55a9644e3fc4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:04.195352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fda7f377-1956-472e-b84b-d0ab6e47f01d req-425ff14b-6b55-4bd9-a871-55a9644e3fc4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:04.196959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fda7f377-1956-472e-b84b-d0ab6e47f01d req-425ff14b-6b55-4bd9-a871-55a9644e3fc4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:04.232364 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-fda7f377-1956-472e-b84b-d0ab6e47f01d req-425ff14b-6b55-4bd9-a871-55a9644e3fc4 service nova] Creating event network-vif-plugged:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:14:04.249699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-fda7f377-1956-472e-b84b-d0ab6e47f01d req-425ff14b-6b55-4bd9-a871-55a9644e3fc4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088297 Aug 06 21:14:04.252678 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2278/4406] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:14:04.274233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:04.276777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 8500f59e-75eb-445a-87a8-088776efa386] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:04.324432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:04.324984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:04.328428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:04.330002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:04.330490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:04.335710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:04.396170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:04.433570 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4833effc-62db-4f16-948a-6092eefb0356 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.809025 Aug 06 21:14:04.448871 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2129/4407] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:03 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:04.462591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:04.464478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:04.484402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:04.486211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:04.486850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:04.487435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:04.488243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:04.488751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:04.489548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:04.490781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:04.491156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lazy-loading 'fault' on Instance uuid 8500f59e-75eb-445a-87a8-088776efa386 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:14:04.494259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:04.606791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:04.626618 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a502aa2c-6e8a-425a-927e-6fa72f9e8b94 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386" status: 200 len: 1313 microversion: 2.1 time: 0.370344 Aug 06 21:14:04.631527 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2279/4408] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:04 2022] GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:05.110812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:05.124657 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-237f2402-e81d-4f38-88ed-0532494d19a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.667314 Aug 06 21:14:05.129497 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2130/4409] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:04 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:05.164539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75712fac-655f-4e58-a77a-d58e1849f9a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:05.167925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-75712fac-655f-4e58-a77a-d58e1849f9a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Failed to fetch instance by id -1 {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 06 21:14:05.169253 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-75712fac-655f-4e58-a77a-d58e1849f9a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance -1 could not be found. Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75712fac-655f-4e58-a77a-d58e1849f9a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance -1 could not be found. Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '-1'} Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:05.174360 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:05.179098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:05.179098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:05.179098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 06 21:14:05.179098 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.179098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75712fac-655f-4e58-a77a-d58e1849f9a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance -1 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:05.180253 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75712fac-655f-4e58-a77a-d58e1849f9a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.031979 Aug 06 21:14:05.181794 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2280/4410] 10.222.0.33 () {58 vars in 1137 bytes} [Sat Aug 6 21:14:05 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:14:05.194011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:05.195170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:05.207689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:05.209687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:05.210398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:05.211873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:05.213823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:05.214900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:05.656214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:05.657190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: 8500f59e-75eb-445a-87a8-088776efa386] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:05.676211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:05.687603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:05.695252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:05.699391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:05.703164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:05.708365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:05.761979 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] HTTP exception thrown: Instance 8500f59e-75eb-445a-87a8-088776efa386 could not be found. Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Request method failure captured: Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386 HTTP/1.1 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlylbNjv3U6ffz4kT7amkDoESCMFhQ3VDblgwq8h2luDfEHOK4_oSIR7-Iz96prsMlKsTv5XunR1rN_YdQfub9CqO1ez9RZo8So1Fea_ura4ybygkDx8_k9LYQS6cHwjwc1RrQhZTn6k2e3obj0F1DV9q4t7HpvlIzm9vL7ZepetTI Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbf6e27c08c84eb780aee25318136435", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 950a8bbfd820444b9f85976f6609c864 Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 8500f59e-75eb-445a-87a8-088776efa386 could not be found. Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '8500f59e-75eb-445a-87a8-088776efa386'} Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8500f59e-75eb-445a-87a8-088776efa386 could not be found. Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8500f59e-75eb-445a-87a8-088776efa386 could not be found. Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.799663 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:05.804960 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.804960 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:05.804960 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:05.804960 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:05.804960 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:05.804960 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:05.804960 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8500f59e-75eb-445a-87a8-088776efa386 could not be found. Aug 06 21:14:05.804960 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:05.806143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Returning 404 to user: Instance 8500f59e-75eb-445a-87a8-088776efa386 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:05.807526 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f023de8-0788-4841-97cc-55de84d4b261 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386" status: 404 len: 111 microversion: 2.1 time: 0.155444 Aug 06 21:14:05.809648 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2281/4411] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:05 2022] GET /compute/v2.1/servers/8500f59e-75eb-445a-87a8-088776efa386 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:14:05.832259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-14b532ac-7760-4a7e-900a-4268b1f4cc30 req-7c75fc37-d270-4ff9-932f-c7ffd43d3fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3032571-71f1-4d19-be54-d92d912fa263", "name": "network-vif-deleted", "tag": "b775e0de-7a5d-49e1-91d7-5d59753ba2d6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:05.856565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-14b532ac-7760-4a7e-900a-4268b1f4cc30 req-7c75fc37-d270-4ff9-932f-c7ffd43d3fe5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:05.858411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-14b532ac-7760-4a7e-900a-4268b1f4cc30 req-7c75fc37-d270-4ff9-932f-c7ffd43d3fe5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:05.858923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-14b532ac-7760-4a7e-900a-4268b1f4cc30 req-7c75fc37-d270-4ff9-932f-c7ffd43d3fe5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:05.893422 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-14b532ac-7760-4a7e-900a-4268b1f4cc30 req-7c75fc37-d270-4ff9-932f-c7ffd43d3fe5 service nova] Creating event network-vif-deleted:b775e0de-7a5d-49e1-91d7-5d59753ba2d6 for instance b3032571-71f1-4d19-be54-d92d912fa263 on nch1-master-1 Aug 06 21:14:05.907267 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-14b532ac-7760-4a7e-900a-4268b1f4cc30 req-7c75fc37-d270-4ff9-932f-c7ffd43d3fe5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084614 Aug 06 21:14:05.910231 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2282/4412] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:14:05.924436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:05.929102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:05.953922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:05.959218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:05.959218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:05.961252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:05.964234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:05.964779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:06.046327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:06.062202 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-31300a27-95ad-4232-8358-bbaa0f1d93be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.874307 Aug 06 21:14:06.064783 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2131/4413] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:05 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:06.087254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:06.090362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:06.123770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:06.125007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:06.126621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:06.127904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:06.130135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:06.133868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:06.182360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '950a8bbfd820444b9f85976f6609c864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6e27c08c84eb780aee25318136435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:06.192762 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0eca2394-46d9-4a82-9718-302e2153e9c8 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 200 len: 1308 microversion: 2.1 time: 0.280745 Aug 06 21:14:06.205051 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2283/4414] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:05 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:06.509602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:06.522774 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b019401-74f3-4991-96ee-650ce6c275a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.440727 Aug 06 21:14:06.531482 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2132/4415] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:06 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:06.559247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6ae92a0-0a68-476d-a285-5334e26f07d3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:06.559951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d6ae92a0-0a68-476d-a285-5334e26f07d3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 8d5f9874-3133-403b-9634-e9782bf21f0d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:06.570040 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-d6ae92a0-0a68-476d-a285-5334e26f07d3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 8d5f9874-3133-403b-9634-e9782bf21f0d could not be found. Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6ae92a0-0a68-476d-a285-5334e26f07d3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/8d5f9874-3133-403b-9634-e9782bf21f0d/action HTTP/1.1 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 19 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: {"forceDelete": {}} Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 8d5f9874-3133-403b-9634-e9782bf21f0d could not be found. Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '8d5f9874-3133-403b-9634-e9782bf21f0d', 'body': {'forceDelete': {}}} Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d5f9874-3133-403b-9634-e9782bf21f0d could not be found. Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d5f9874-3133-403b-9634-e9782bf21f0d could not be found. Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:06.586787 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:06.591420 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:06.591420 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:06.591420 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d5f9874-3133-403b-9634-e9782bf21f0d could not be found. Aug 06 21:14:06.591420 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:06.593703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6ae92a0-0a68-476d-a285-5334e26f07d3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 8d5f9874-3133-403b-9634-e9782bf21f0d could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:06.594625 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d6ae92a0-0a68-476d-a285-5334e26f07d3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/8d5f9874-3133-403b-9634-e9782bf21f0d/action" status: 404 len: 111 microversion: 2.1 time: 0.051140 Aug 06 21:14:06.598593 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2284/4416] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:06 2022] POST /compute/v2.1/servers/8d5f9874-3133-403b-9634-e9782bf21f0d/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:14:06.606131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:06.606791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:06.624946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:06.626002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:06.626832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:06.629057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:06.633895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:06.636034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:07.085333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:07.094232 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-38f0bdb8-c015-44be-9529-7d72f7cf6402 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.492841 Aug 06 21:14:07.095655 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2133/4417] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:06 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:07.117486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:07.118095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:07.128449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:07.129682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:07.131337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:07.132145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:07.132768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:07.133374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:07.217100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:07.218370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] [instance: b3032571-71f1-4d19-be54-d92d912fa263] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:07.227228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:07.230668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:07.231290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:07.232210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:07.234704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:07.235351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:07.280244 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] HTTP exception thrown: Instance b3032571-71f1-4d19-be54-d92d912fa263 could not be found. Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Request method failure captured: Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 HTTP/1.1 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlylbNjv3U6ffz4kT7amkDoESCMFhQ3VDblgwq8h2luDfEHOK4_oSIR7-Iz96prsMlKsTv5XunR1rN_YdQfub9CqO1ez9RZo8So1Fea_ura4ybygkDx8_k9LYQS6cHwjwc1RrQhZTn6k2e3obj0F1DV9q4t7HpvlIzm9vL7ZepetTI Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbf6e27c08c84eb780aee25318136435", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbf6e27c08c84eb780aee25318136435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: dbf6e27c08c84eb780aee25318136435 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1478055545 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 950a8bbfd820444b9f85976f6609c864 Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ListServersNegativeTestJSON-1478055545-project Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance b3032571-71f1-4d19-be54-d92d912fa263 could not be found. Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'b3032571-71f1-4d19-be54-d92d912fa263'} Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3032571-71f1-4d19-be54-d92d912fa263 could not be found. Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3032571-71f1-4d19-be54-d92d912fa263 could not be found. Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.285259 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3032571-71f1-4d19-be54-d92d912fa263 could not be found. Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] Returning 404 to user: Instance b3032571-71f1-4d19-be54-d92d912fa263 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:07.289964 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fdd942a5-2cf4-4131-b2da-c533cafc38e1 tempest-ListServersNegativeTestJSON-1478055545 tempest-ListServersNegativeTestJSON-1478055545-project] 10.222.0.33 "GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263" status: 404 len: 111 microversion: 2.1 time: 0.073971 Aug 06 21:14:07.296657 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2134/4418] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:07 2022] GET /compute/v2.1/servers/b3032571-71f1-4d19-be54-d92d912fa263 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:07.454690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:07.466421 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-84ba1cca-876e-4a01-a06d-c89dabeee40a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.353022 Aug 06 21:14:07.477306 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2285/4419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:07 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:07.500009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dde09737-f43a-4868-a03e-99572441aa16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:07.502442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dde09737-f43a-4868-a03e-99572441aa16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 68818c19-76fb-4719-99d5-4e1601057a47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:07.515648 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-dde09737-f43a-4868-a03e-99572441aa16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 68818c19-76fb-4719-99d5-4e1601057a47 could not be found. Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dde09737-f43a-4868-a03e-99572441aa16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/68818c19-76fb-4719-99d5-4e1601057a47/action HTTP/1.1 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 39 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: {"os-getConsoleOutput": {"length": 10}} Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 68818c19-76fb-4719-99d5-4e1601057a47 could not be found. Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '68818c19-76fb-4719-99d5-4e1601057a47', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68818c19-76fb-4719-99d5-4e1601057a47 could not be found. Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68818c19-76fb-4719-99d5-4e1601057a47 could not be found. Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.529488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:07.534184 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:07.534184 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:07.534184 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:07.534184 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:07.534184 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68818c19-76fb-4719-99d5-4e1601057a47 could not be found. Aug 06 21:14:07.534184 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:07.540734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dde09737-f43a-4868-a03e-99572441aa16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 68818c19-76fb-4719-99d5-4e1601057a47 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:07.543512 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dde09737-f43a-4868-a03e-99572441aa16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/68818c19-76fb-4719-99d5-4e1601057a47/action" status: 404 len: 111 microversion: 2.1 time: 0.048178 Aug 06 21:14:07.549874 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2135/4420] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:07 2022] POST /compute/v2.1/servers/68818c19-76fb-4719-99d5-4e1601057a47/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:07.567515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:07.568383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:07.582139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:07.582855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:07.585959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:07.588656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:07.590495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:07.591114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:08.233664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:08.247665 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-95be2c62-b5f6-4300-a2dd-a05a72e1c4b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.695449 Aug 06 21:14:08.250003 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2286/4421] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:07 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:08.286311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:08.287250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:08.312481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:08.315703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:08.322756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:08.325550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:08.332457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:08.333076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:08.913096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:08.922413 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0cc3597c-806c-46b2-b7d4-a08fc32b092a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.639925 Aug 06 21:14:08.935837 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2136/4422] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:08 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:08.944567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-873c99b9-4054-482f-ad99-919abd7179dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:08.945201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-873c99b9-4054-482f-ad99-919abd7179dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: ce369e62-127c-4898-a53c-0e1de8bc84ab] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:08.953052 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-873c99b9-4054-482f-ad99-919abd7179dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance ce369e62-127c-4898-a53c-0e1de8bc84ab could not be found. Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-873c99b9-4054-482f-ad99-919abd7179dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ce369e62-127c-4898-a53c-0e1de8bc84ab HTTP/1.1 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ce369e62-127c-4898-a53c-0e1de8bc84ab could not be found. Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ce369e62-127c-4898-a53c-0e1de8bc84ab'} Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce369e62-127c-4898-a53c-0e1de8bc84ab could not be found. Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce369e62-127c-4898-a53c-0e1de8bc84ab could not be found. Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:08.964880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:08.969671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:08.969671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:08.969671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:08.969671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce369e62-127c-4898-a53c-0e1de8bc84ab could not be found. Aug 06 21:14:08.969671 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:08.969671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-873c99b9-4054-482f-ad99-919abd7179dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance ce369e62-127c-4898-a53c-0e1de8bc84ab could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:08.969671 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-873c99b9-4054-482f-ad99-919abd7179dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/ce369e62-127c-4898-a53c-0e1de8bc84ab" status: 404 len: 111 microversion: 2.1 time: 0.026037 Aug 06 21:14:08.986711 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2287/4423] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:08 2022] GET /compute/v2.1/servers/ce369e62-127c-4898-a53c-0e1de8bc84ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:09.003810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:09.004519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:09.021412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:09.022126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:09.024144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:09.027571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:09.028126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:09.029806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:09.046386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:09.507212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:09.529444 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7d02f923-6a53-406b-815f-8718db248e86 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.536029 Aug 06 21:14:09.530044 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2137/4424] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:08 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:09.559383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:09.560236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:09.575899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:09.579156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:09.579811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:09.583561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:09.584982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:09.585614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:09.768400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:10.102437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:10.112322 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-57cd08c8-5d4b-44cf-9aa1-c31935c3e215 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.557592 Aug 06 21:14:10.126740 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2288/4425] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:09 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:10.460277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3d37af6-47f9-4c46-8c2e-8f65742d77bf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1925942903", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3d37af6-47f9-4c46-8c2e-8f65742d77bf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 238 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1925942903", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1925942903', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:10.494398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3d37af6-47f9-4c46-8c2e-8f65742d77bf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:10.498763 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f3d37af6-47f9-4c46-8c2e-8f65742d77bf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.049378 Aug 06 21:14:10.500425 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2138/4426] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:14:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:14:10.512667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:10.514019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:10.516677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=14 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:10.528596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:10.542809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:10.543358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:10.547401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:10.549249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:10.550257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:11.373414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:11.389209 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c4795982-d18a-4507-b68c-d88ef722096a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.884308 Aug 06 21:14:11.389823 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2289/4427] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:10 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:11.416489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:11.417389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:11.434903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:11.435396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:11.439548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:11.440328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:11.445424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:11.445879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:11.926833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:11.962977 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-107be310-3931-4087-9603-b4afc9533ebd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.550017 Aug 06 21:14:11.970825 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2139/4428] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:11 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:12.066849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d23441b-c654-493f-8fa9-1f9f46a97fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1320962683", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d23441b-c654-493f-8fa9-1f9f46a97fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 235 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1320962683", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1320962683', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:12.073982 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d23441b-c654-493f-8fa9-1f9f46a97fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d23441b-c654-493f-8fa9-1f9f46a97fe4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.014778 Aug 06 21:14:12.082377 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2290/4429] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:14:12 2022] POST /compute/v2.1/servers => generated 133 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:14:12.092214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:12.092873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:12.115936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:12.118926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:12.121861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:12.125142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:12.127311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:12.129733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:13.183657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:13.199186 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7221030c-926e-40b9-a47d-498c171e2709 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.117167 Aug 06 21:14:13.200679 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2140/4430] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:12 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:13.231160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:13.231892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:13.263557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:13.265074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:13.266854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:13.271264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:13.273203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:13.273668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:13.573209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:13.596454 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-db7db49b-d2a3-4487-b902-368f7181c2a1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.375641 Aug 06 21:14:13.597572 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2291/4431] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:13 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:13.619548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e88d6113-a1fa-4c71-bad8-d5578b4f885a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:13.620573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e88d6113-a1fa-4c71-bad8-d5578b4f885a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: a8e604e8-d699-453f-9310-8e6de27b6db8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:13.626615 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-e88d6113-a1fa-4c71-bad8-d5578b4f885a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance a8e604e8-d699-453f-9310-8e6de27b6db8 could not be found. Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e88d6113-a1fa-4c71-bad8-d5578b4f885a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/a8e604e8-d699-453f-9310-8e6de27b6db8/action HTTP/1.1 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 13 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: {"pause": {}} Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance a8e604e8-d699-453f-9310-8e6de27b6db8 could not be found. Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'a8e604e8-d699-453f-9310-8e6de27b6db8', 'body': {'pause': {}}} Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e604e8-d699-453f-9310-8e6de27b6db8 could not be found. Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e604e8-d699-453f-9310-8e6de27b6db8 could not be found. Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:13.631488 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:13.638604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:13.638604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:13.638604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e604e8-d699-453f-9310-8e6de27b6db8 could not be found. Aug 06 21:14:13.638604 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:13.639552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e88d6113-a1fa-4c71-bad8-d5578b4f885a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance a8e604e8-d699-453f-9310-8e6de27b6db8 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:13.640698 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e88d6113-a1fa-4c71-bad8-d5578b4f885a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/a8e604e8-d699-453f-9310-8e6de27b6db8/action" status: 404 len: 111 microversion: 2.1 time: 0.026452 Aug 06 21:14:13.642014 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2141/4432] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:13 2022] POST /compute/v2.1/servers/a8e604e8-d699-453f-9310-8e6de27b6db8/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:13.652949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:13.653904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:13.681745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:13.684563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:13.685692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:13.687851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:13.690584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:13.694251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:14.127674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:14.145420 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8ccfada9-dcc5-4a1c-85b3-99a941cdfc14 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.498495 Aug 06 21:14:14.150845 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2292/4433] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:13 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:14.173859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:14.179356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:14.198819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:14.200428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:14.202171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:14.206762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:14.208955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:14.209901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:15.338951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:15.354408 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0cc884b3-1f8f-4cca-86e5-98db2d33ca92 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.185232 Aug 06 21:14:15.362669 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2142/4434] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:14 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:15.383958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b15ebfda-232b-4091-bee0-42356a781b22 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:15.384507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b15ebfda-232b-4091-bee0-42356a781b22 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:15.387306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:15.398026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b15ebfda-232b-4091-bee0-42356a781b22 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:15.398523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b15ebfda-232b-4091-bee0-42356a781b22 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:15.399040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b15ebfda-232b-4091-bee0-42356a781b22 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:15.400106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b15ebfda-232b-4091-bee0-42356a781b22 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:15.400660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b15ebfda-232b-4091-bee0-42356a781b22 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:15.401057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b15ebfda-232b-4091-bee0-42356a781b22 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:15.567412 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b15ebfda-232b-4091-bee0-42356a781b22 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.187460 Aug 06 21:14:15.572492 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2293/4435] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:15 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:14:15.576726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:15.577353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:15.588283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:15.588885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:15.593260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:15.596690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:15.597239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:15.597726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:16.308841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:16.321966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-77476ade-e8dd-4d6c-a37f-4f0f40cf2e1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1510 microversion: 2.1 time: 0.748024 Aug 06 21:14:16.322925 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2143/4436] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:15 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1510 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:17.352963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:17.353518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:17.369823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:17.382987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:17.383770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:17.384736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:17.385388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:17.386003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:18.208456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:18.221397 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a0f5229e-2554-4038-86e2-5c6f6fa3a650 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1490 microversion: 2.1 time: 0.875728 Aug 06 21:14:18.222000 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2294/4437] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:17 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1490 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:18.249505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:18.251074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:18.272714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:18.281717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:18.282238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:18.283051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:18.284129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:18.285522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:18.341369 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Cannot 'pause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state paused Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action HTTP/1.1 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 13 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: {"pause": {}} Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: exception: Cannot 'pause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state paused Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8', 'body': {'pause': {}}} Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 in vm_state paused. Cannot pause while the instance is in this state. Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state paused Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:18.344810 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:18.350436 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:18.350436 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:18.350436 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:18.350436 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state paused Aug 06 21:14:18.350436 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:18.350436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 409 to user: Cannot 'pause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state paused {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:18.350436 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a4b5bb27-6b11-4a4f-8bb3-9ea91e07fc0c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 409 len: 143 microversion: 2.1 time: 0.104084 Aug 06 21:14:18.350436 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2144/4438] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:18 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 143 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:14:18.356770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b097e470-f3d9-4099-8d7b-83bbe08b1d1e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:18.357400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b097e470-f3d9-4099-8d7b-83bbe08b1d1e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:18.371360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b097e470-f3d9-4099-8d7b-83bbe08b1d1e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:18.373270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b097e470-f3d9-4099-8d7b-83bbe08b1d1e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:18.374396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b097e470-f3d9-4099-8d7b-83bbe08b1d1e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:18.376393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b097e470-f3d9-4099-8d7b-83bbe08b1d1e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:18.378348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b097e470-f3d9-4099-8d7b-83bbe08b1d1e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:18.378999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b097e470-f3d9-4099-8d7b-83bbe08b1d1e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:18.418866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:18.546792 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b097e470-f3d9-4099-8d7b-83bbe08b1d1e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.191980 Aug 06 21:14:18.551626 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2295/4439] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:18 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:14:18.559302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:18.560213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:18.578301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:18.584975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:18.589100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:18.592480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:18.594718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:18.596519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:18.962917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:18.978045 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c59c6802-cd61-43d0-a25b-f9e4f36817c0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1497 microversion: 2.1 time: 0.423126 Aug 06 21:14:18.979122 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2145/4440] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:18 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1497 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:20.004478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:20.006241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:20.014491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:20.032629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:20.033122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:20.033962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:20.034452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:20.034935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:20.433405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:20.449774 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53dfe2d5-48a3-4e45-9661-b21052ea15a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.445048 Aug 06 21:14:20.453021 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2296/4441] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:19 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:20.480393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:20.481168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:20.487215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:20.497285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:20.497780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:20.503148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:20.503900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:20.504380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:20.505081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:20.788319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:20.806321 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-376254c8-9d30-4c65-aab7-0f0ceddc1d5a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.322814 Aug 06 21:14:20.807106 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2146/4442] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:20 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:20.828699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:20.831494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:20.844647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:20.845483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:20.846385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:20.848609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:20.849459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:20.850704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:20.870952 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0/action HTTP/1.1 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 28 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: {"reboot": {"type": "SOFT"}} Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'b65f4d33-d7b2-4bb6-a852-ba30292476c0', 'body': {'reboot': {'type': 'SOFT'}}} Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:20.876262 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:20.881932 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:20.884920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:20.886048 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a05932c9-fc65-456c-bafa-e686c43d35b2 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0/action" status: 404 len: 111 microversion: 2.1 time: 0.062748 Aug 06 21:14:20.886901 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2297/4443] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:20 2022] POST /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:20.897068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:20.901411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:20.913056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:20.914273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:20.915896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:20.918915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:20.919791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:20.921691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:21.310666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:21.326984 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8b76f97-a5cd-447f-ba76-769c1e125957 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.435406 Aug 06 21:14:21.327591 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2147/4444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:20 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:21.353717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:21.354358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:21.376730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:21.377322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:21.380897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:21.381708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:21.385743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:21.391986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:22.440543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:22.449836 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b65c4d37-f07a-4ea1-8d8f-1ad3c55b7a2e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.102920 Aug 06 21:14:22.464879 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2298/4445] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:21 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:22.486724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfe12b2f-7c07-4c66-800f-06992ec93cf9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:22.490146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dfe12b2f-7c07-4c66-800f-06992ec93cf9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: ce663dd4-19e9-4800-9970-539c25e73f46] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:22.516078 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-dfe12b2f-7c07-4c66-800f-06992ec93cf9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance ce663dd4-19e9-4800-9970-539c25e73f46 could not be found. Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfe12b2f-7c07-4c66-800f-06992ec93cf9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/ce663dd4-19e9-4800-9970-539c25e73f46/action HTTP/1.1 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 28 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: {"reboot": {"type": "SOFT"}} Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance ce663dd4-19e9-4800-9970-539c25e73f46 could not be found. Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ce663dd4-19e9-4800-9970-539c25e73f46', 'body': {'reboot': {'type': 'SOFT'}}} Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce663dd4-19e9-4800-9970-539c25e73f46 could not be found. Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce663dd4-19e9-4800-9970-539c25e73f46 could not be found. Aug 06 21:14:22.518160 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:22.522772 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:22.522772 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:22.522772 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:22.522772 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:22.522772 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:22.522772 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:22.522772 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:22.522772 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce663dd4-19e9-4800-9970-539c25e73f46 could not be found. Aug 06 21:14:22.522772 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:22.525478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfe12b2f-7c07-4c66-800f-06992ec93cf9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance ce663dd4-19e9-4800-9970-539c25e73f46 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:22.534686 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfe12b2f-7c07-4c66-800f-06992ec93cf9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/ce663dd4-19e9-4800-9970-539c25e73f46/action" status: 404 len: 111 microversion: 2.1 time: 0.051906 Aug 06 21:14:22.536910 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2148/4446] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:22 2022] POST /compute/v2.1/servers/ce663dd4-19e9-4800-9970-539c25e73f46/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:22.545528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:22.546483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:22.557847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:22.559131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:22.560286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:22.563688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:22.564438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:22.565132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:23.186587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:23.199843 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-244c4865-35da-41ff-92b7-2e3cda1350b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.658550 Aug 06 21:14:23.200639 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2299/4447] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:22 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:23.228695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:23.229638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:23.265268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:23.266107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:23.266924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:23.267987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:23.268620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:23.269226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:23.477994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e29b22f-4e8d-4158-aa6f-2b8f7fc2580d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:23.479419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4e29b22f-4e8d-4158-aa6f-2b8f7fc2580d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:23.494385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e29b22f-4e8d-4158-aa6f-2b8f7fc2580d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:23.501249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e29b22f-4e8d-4158-aa6f-2b8f7fc2580d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:23.503225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e29b22f-4e8d-4158-aa6f-2b8f7fc2580d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:23.503921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e29b22f-4e8d-4158-aa6f-2b8f7fc2580d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:23.504921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e29b22f-4e8d-4158-aa6f-2b8f7fc2580d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:23.508384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e29b22f-4e8d-4158-aa6f-2b8f7fc2580d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:23.580642 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e29b22f-4e8d-4158-aa6f-2b8f7fc2580d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/ips" status: 200 len: 151 microversion: 2.1 time: 0.106669 Aug 06 21:14:23.591274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2300/4448] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:14:23 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/ips => generated 151 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:14:23.727234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:23.741410 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f86c1edc-8f9c-4298-bb61-17e83699406b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.517576 Aug 06 21:14:23.742323 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2149/4449] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:23 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:23.766384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:23.774882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:23.792440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:23.793194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:23.793856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:23.794610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:23.795955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:23.796681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:23.851688 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0/action HTTP/1.1 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 65 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'b65f4d33-d7b2-4bb6-a852-ba30292476c0', 'body': {'rebuild': {'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd'}}} Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 06 21:14:23.858113 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:14:23.863247 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:23.867229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:23.870746 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2fddf9c0-5ddd-44a3-9a3b-f42561243183 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0/action" status: 404 len: 111 microversion: 2.1 time: 0.108231 Aug 06 21:14:23.873001 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2301/4450] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:23 2022] POST /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0/action => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:14:23.881907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:23.883347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:23.906122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:23.907535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:23.909293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:23.910442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:23.913038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:23.913576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:24.578249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:24.601890 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-58b912b6-66e0-49e9-9b1b-ffe9e005b464 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.725567 Aug 06 21:14:24.622993 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2150/4451] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:23 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:24.639350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:24.640362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:24.651293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:24.651878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:24.652418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:24.653922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:24.654607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:24.655189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:25.654208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b81c5333-f008-4583-82c7-c840c0efc2d1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce9057e2-c953-4b6c-ab01-a1beb7796115"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:25.656926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b81c5333-f008-4583-82c7-c840c0efc2d1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:25.704922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b81c5333-f008-4583-82c7-c840c0efc2d1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:25.711038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b81c5333-f008-4583-82c7-c840c0efc2d1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:25.712224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b81c5333-f008-4583-82c7-c840c0efc2d1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:25.713355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b81c5333-f008-4583-82c7-c840c0efc2d1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:25.713835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b81c5333-f008-4583-82c7-c840c0efc2d1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:25.714278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b81c5333-f008-4583-82c7-c840c0efc2d1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:25.773470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:25.807154 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ea34fd30-c19b-4b59-97cb-74889e772e81 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.173059 Aug 06 21:14:25.812915 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2302/4452] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:24 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:25.845531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-995edf4a-3a25-42ef-a07b-05c7f87ff5fe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:25.877656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-995edf4a-3a25-42ef-a07b-05c7f87ff5fe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 7622e470-9f40-4481-8e49-5b2e4e38e436] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:25.915065 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-995edf4a-3a25-42ef-a07b-05c7f87ff5fe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 7622e470-9f40-4481-8e49-5b2e4e38e436 could not be found. Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-995edf4a-3a25-42ef-a07b-05c7f87ff5fe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/7622e470-9f40-4481-8e49-5b2e4e38e436/action HTTP/1.1 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 65 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 7622e470-9f40-4481-8e49-5b2e4e38e436 could not be found. Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7622e470-9f40-4481-8e49-5b2e4e38e436', 'body': {'rebuild': {'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd'}}} Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7622e470-9f40-4481-8e49-5b2e4e38e436 could not be found. Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 06 21:14:25.925782 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7622e470-9f40-4481-8e49-5b2e4e38e436 could not be found. Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7622e470-9f40-4481-8e49-5b2e4e38e436 could not be found. Aug 06 21:14:25.931411 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:25.935414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-995edf4a-3a25-42ef-a07b-05c7f87ff5fe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 7622e470-9f40-4481-8e49-5b2e4e38e436 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:25.939691 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-995edf4a-3a25-42ef-a07b-05c7f87ff5fe tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/7622e470-9f40-4481-8e49-5b2e4e38e436/action" status: 404 len: 111 microversion: 2.1 time: 0.109165 Aug 06 21:14:25.944379 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2303/4453] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:25 2022] POST /compute/v2.1/servers/7622e470-9f40-4481-8e49-5b2e4e38e436/action => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:25.967056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:25.970274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:25.995710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:25.996640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:25.997874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:26.000257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:26.013003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:26.016480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:26.525416 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b81c5333-f008-4583-82c7-c840c0efc2d1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.874497 Aug 06 21:14:26.528907 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2151/4454] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:14:25 2022] POST /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:14:26.794559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:26.805658 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc0e0880-9136-4f04-8bcd-e6aec22d2f44 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.858302 Aug 06 21:14:26.806253 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2304/4455] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:25 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:26.831127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:26.831945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:26.864954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:26.868698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:26.871524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:26.874111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:26.874912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:26.881539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:28.024821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:28.036137 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c0435d4e-9449-445d-8c67-0422ea479c7e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.209765 Aug 06 21:14:28.037099 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2152/4456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:26 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:28.058688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-990f9b21-ddfa-481d-9c3a-2e444c8207f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:28.059897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-990f9b21-ddfa-481d-9c3a-2e444c8207f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: bb251804-bfa4-4f69-aa71-e22145fd6268] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:28.082393 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-990f9b21-ddfa-481d-9c3a-2e444c8207f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance bb251804-bfa4-4f69-aa71-e22145fd6268 could not be found. Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-990f9b21-ddfa-481d-9c3a-2e444c8207f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/bb251804-bfa4-4f69-aa71-e22145fd6268/action HTTP/1.1 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 15 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: {"restore": {}} Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance bb251804-bfa4-4f69-aa71-e22145fd6268 could not be found. Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'bb251804-bfa4-4f69-aa71-e22145fd6268', 'body': {'restore': {}}} Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb251804-bfa4-4f69-aa71-e22145fd6268 could not be found. Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb251804-bfa4-4f69-aa71-e22145fd6268 could not be found. Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:28.084029 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:28.093382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:28.093382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:28.093382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb251804-bfa4-4f69-aa71-e22145fd6268 could not be found. Aug 06 21:14:28.093382 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:28.093382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-990f9b21-ddfa-481d-9c3a-2e444c8207f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance bb251804-bfa4-4f69-aa71-e22145fd6268 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:28.093382 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-990f9b21-ddfa-481d-9c3a-2e444c8207f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/bb251804-bfa4-4f69-aa71-e22145fd6268/action" status: 404 len: 111 microversion: 2.1 time: 0.031748 Aug 06 21:14:28.093382 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2305/4457] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:28 2022] POST /compute/v2.1/servers/bb251804-bfa4-4f69-aa71-e22145fd6268/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:28.098578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:28.099470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:28.113420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:28.114490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:28.114961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:28.124510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:28.125014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:28.125478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:28.836901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:28.845406 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d94ae7fd-7c70-42da-9843-c5d1b1cbd0a6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.752380 Aug 06 21:14:28.846363 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2153/4458] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:28 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:28.871870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:28.872701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:28.884178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:28.884725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:28.885314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:28.886356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:28.886972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:28.887506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:29.013376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:29.014332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:29.028472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:29.029843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:29.032295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:29.033319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:29.034774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:29.036709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:29.508406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:29.527440 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9fa31277-dd9d-4756-b00a-661e3e27fb10 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.659820 Aug 06 21:14:29.529306 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2306/4459] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:28 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:29.550721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:29.552823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:29.561126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:29.561932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:29.562535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:29.563525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:29.564220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:29.565000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:29.596627 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Cannot 'restore' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action HTTP/1.1 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 15 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: {"restore": {}} Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: exception: Cannot 'restore' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8', 'body': {'restore': {}}} Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 in vm_state active. Cannot restore while the instance is in this state. Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:29.599438 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:29.604021 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:29.604021 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:29.604021 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:29.604021 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:14:29.604021 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:29.620022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 409 to user: Cannot 'restore' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:29.623773 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-99cf81e1-d55c-4276-9b4d-764ff15bd9cb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 409 len: 145 microversion: 2.1 time: 0.077421 Aug 06 21:14:29.629323 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2307/4460] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:29 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 145 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:14:29.639359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:29.640378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:29.650390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:29.651223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:29.651848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:29.652747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:29.653377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:29.654038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:29.740728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:29.751337 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b767f91-634d-48ba-99b6-7451f704a2ac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.741260 Aug 06 21:14:29.752413 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2154/4461] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:29 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:29.777895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c44ea4a7-2256-40a4-a75f-23e3e4df2d28 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-402224972"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:29.800613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c44ea4a7-2256-40a4-a75f-23e3e4df2d28 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:29.830428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44ea4a7-2256-40a4-a75f-23e3e4df2d28 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:29.833164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44ea4a7-2256-40a4-a75f-23e3e4df2d28 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:29.841046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44ea4a7-2256-40a4-a75f-23e3e4df2d28 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:29.842314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44ea4a7-2256-40a4-a75f-23e3e4df2d28 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:29.843045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44ea4a7-2256-40a4-a75f-23e3e4df2d28 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:29.843709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44ea4a7-2256-40a4-a75f-23e3e4df2d28 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:29.902742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:30.038397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:30.051718 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5a083585-8461-48f7-9605-c525631fb28b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.416797 Aug 06 21:14:30.052028 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2308/4462] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:29 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:30.085922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:30.086657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:30.103701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:30.104737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:30.110276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:30.111232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:30.113237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:30.115321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:30.272499 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c44ea4a7-2256-40a4-a75f-23e3e4df2d28 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.498989 Aug 06 21:14:30.279542 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2155/4463] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:29 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 06 21:14:30.563686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:30.577622 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c004996e-d6a4-4497-acfe-efb796a70ea3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.498700 Aug 06 21:14:30.579351 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2309/4464] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:30 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:30.597608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce9057e2-c953-4b6c-ab01-a1beb7796115"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:30.602329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22f5843b-cccf-4eb9-907c-9dff01becb5b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:30.602641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:30.603006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-22f5843b-cccf-4eb9-907c-9dff01becb5b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 11402758-8486-4734-9b85-504bd520cada] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:30.619490 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-22f5843b-cccf-4eb9-907c-9dff01becb5b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 11402758-8486-4734-9b85-504bd520cada could not be found. Aug 06 21:14:30.625445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22f5843b-cccf-4eb9-907c-9dff01becb5b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/11402758-8486-4734-9b85-504bd520cada/action HTTP/1.1 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 14 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: {"resume": {}} Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 11402758-8486-4734-9b85-504bd520cada could not be found. Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '11402758-8486-4734-9b85-504bd520cada', 'body': {'resume': {}}} Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11402758-8486-4734-9b85-504bd520cada could not be found. Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11402758-8486-4734-9b85-504bd520cada could not be found. Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:30.626300 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:30.631188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:30.631188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:30.631188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11402758-8486-4734-9b85-504bd520cada could not be found. Aug 06 21:14:30.631188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.631938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:30.632435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22f5843b-cccf-4eb9-907c-9dff01becb5b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 11402758-8486-4734-9b85-504bd520cada could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:30.632990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:30.633714 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22f5843b-cccf-4eb9-907c-9dff01becb5b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/11402758-8486-4734-9b85-504bd520cada/action" status: 404 len: 111 microversion: 2.1 time: 0.037983 Aug 06 21:14:30.637241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:30.638043 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2310/4465] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:30 2022] POST /compute/v2.1/servers/11402758-8486-4734-9b85-504bd520cada/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:30.638370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:30.639062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:30.649214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:30.649843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:30.686985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:30.689867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:30.691237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:30.693345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:30.702135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:30.705217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:30.797040 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Invalid volume: volume ce9057e2-c953-4b6c-ab01-a1beb7796115 is already attached to instances: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments HTTP/1.1 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 74 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: {"volumeAttachment": {"volumeId": "ce9057e2-c953-4b6c-ab01-a1beb7796115"}} Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid volume: volume ce9057e2-c953-4b6c-ab01-a1beb7796115 is already attached to instances: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'server_id': 'e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08', 'body': {'volumeAttachment': {'volumeId': 'ce9057e2-c953-4b6c-ab01-a1beb7796115'}}} Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce9057e2-c953-4b6c-ab01-a1beb7796115 is already attached to instances: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:30.801787 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce9057e2-c953-4b6c-ab01-a1beb7796115 is already attached to instances: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce9057e2-c953-4b6c-ab01-a1beb7796115 is already attached to instances: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 Aug 06 21:14:30.807562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:30.809258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 400 to user: Invalid volume: volume ce9057e2-c953-4b6c-ab01-a1beb7796115 is already attached to instances: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:30.811455 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8a587188-3416-4d30-8548-9801a18f6f6c tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.219133 Aug 06 21:14:30.813975 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2156/4466] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:14:30 2022] POST /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments => generated 174 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:14:30.900675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:30.902040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:30.911151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:30.912190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:30.913364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:30.914310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:30.914976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:30.915635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:31.097400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lazy-loading 'services' on Instance uuid e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:14:31.219240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:31.233176 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ec7fb851-dc54-4a95-8547-e835cdbcb8be tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.592584 Aug 06 21:14:31.234416 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2311/4467] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:30 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:31.268223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:31.268937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:31.293612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:31.295669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:31.297260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:31.298978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:31.299698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:31.301946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:31.306255 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-02412645-d158-41db-ae44-f2964cf68fbc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments/ce9057e2-c953-4b6c-ab01-a1beb7796115" status: 202 len: 0 microversion: 2.1 time: 0.411476 Aug 06 21:14:31.307300 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2157/4468] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Aug 6 21:14:30 2022] DELETE /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments/ce9057e2-c953-4b6c-ab01-a1beb7796115 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:14:31.327934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0caa56d3-0846-4a25-851d-12e5b68f6f4e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:31.330343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0caa56d3-0846-4a25-851d-12e5b68f6f4e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:31.362088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0caa56d3-0846-4a25-851d-12e5b68f6f4e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:31.362881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0caa56d3-0846-4a25-851d-12e5b68f6f4e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:31.364197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0caa56d3-0846-4a25-851d-12e5b68f6f4e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:31.365124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0caa56d3-0846-4a25-851d-12e5b68f6f4e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:31.365770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0caa56d3-0846-4a25-851d-12e5b68f6f4e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:31.367391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0caa56d3-0846-4a25-851d-12e5b68f6f4e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:31.446164 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0caa56d3-0846-4a25-851d-12e5b68f6f4e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133715 Aug 06 21:14:31.452804 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2158/4469] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:14:31 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:14:31.784020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:31.803735 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee1d376e-7e58-437b-ae09-12052a669dcc tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.541868 Aug 06 21:14:31.804858 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2312/4470] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:31 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:31.825326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:31.825917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:31.832567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:31.833589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:31.834214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:31.835153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:31.835777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:31.836378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:31.866004 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Cannot 'resume' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action HTTP/1.1 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 14 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: {"resume": {}} Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: exception: Cannot 'resume' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8', 'body': {'resume': {}}} Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 in vm_state active. Cannot resume while the instance is in this state. Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:31.868562 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:31.873525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:31.873525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:31.873525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:31.873525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:14:31.873525 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:31.875485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 409 to user: Cannot 'resume' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:31.876560 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-62681a18-5376-45a1-a0fd-3813c7a96ee7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 409 len: 144 microversion: 2.1 time: 0.056025 Aug 06 21:14:31.877671 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2159/4471] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:31 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 144 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:14:31.888636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:31.889161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:31.895851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:31.896356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:31.897425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:31.898582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:31.899340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:31.900026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:32.181131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:32.196757 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2346510-f543-4a65-a9bb-0b6afb8b0962 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.309804 Aug 06 21:14:32.199115 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2313/4472] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:31 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:32.225983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:32.227063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:32.264666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:32.265142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:32.265600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:32.266349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:32.276238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:32.277586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:32.464214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3141940-a687-44c3-9e52-79fb90e784eb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:32.467029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f3141940-a687-44c3-9e52-79fb90e784eb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:32.481187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3141940-a687-44c3-9e52-79fb90e784eb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:32.482683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3141940-a687-44c3-9e52-79fb90e784eb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:32.483329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3141940-a687-44c3-9e52-79fb90e784eb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:32.485981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3141940-a687-44c3-9e52-79fb90e784eb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:32.486705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3141940-a687-44c3-9e52-79fb90e784eb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:32.487306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3141940-a687-44c3-9e52-79fb90e784eb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:32.576028 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3141940-a687-44c3-9e52-79fb90e784eb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116044 Aug 06 21:14:32.577127 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2314/4473] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:14:32 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:14:32.680966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:32.681995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:32.696008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:32.696746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:32.698096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:32.702502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:32.702943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:32.703393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:32.752950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:14:32.774188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:32.893001 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6006d94d-c7bc-410d-a13e-b68274e434ea tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 204 len: 0 microversion: 2.1 time: 0.216940 Aug 06 21:14:32.894575 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2315/4474] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:14:32 2022] DELETE /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:14:32.916770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:32.919760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:32.937776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:32.938297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:32.940773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:32.943490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:32.944855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:32.946658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:33.330694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:33.352255 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c183f9b8-0a04-485a-995a-4180f6af90cf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.134151 Aug 06 21:14:33.354993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:33.360011 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2160/4475] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:32 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:33.370642 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3eede9fc-7106-431a-aa4f-8762653268e6 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1683 microversion: 2.1 time: 0.468927 Aug 06 21:14:33.373141 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2316/4476] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:32 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1683 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:33.700255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9d2160cc-e466-4a48-bb51-74814981f1e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9d2160cc-e466-4a48-bb51-74814981f1e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 160 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f"}]}} Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': '', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'networks': [{'uuid': 'c8ed5f95-2ddd-4dc3-8b1a-12fab1f2286f'}]}}} Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi '' Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:14:33.715364 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:14:33.719577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9d2160cc-e466-4a48-bb51-74814981f1e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:33.721497 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9d2160cc-e466-4a48-bb51-74814981f1e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.038247 Aug 06 21:14:33.728197 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2161/4477] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:14:33 2022] POST /compute/v2.1/servers => generated 108 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:14:33.737613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:33.738795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:33.759001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:33.759793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:33.761721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:33.763449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:33.767436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:33.774777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:34.123801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:34.134567 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6be17716-43e9-438c-8645-89d249be4ba4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.403888 Aug 06 21:14:34.141006 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2317/4478] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:33 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:34.435447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1932351179", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:34.600295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] validate_networks() for [('cd1d4a4a-ec38-48a7-8916-5b401e33551a', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:14:34.625032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0582a954-59d8-4dda-b6b1-91eb9fcd6f50 req-60ca8553-aaff-422e-a89b-8359c8ec968c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "name": "network-vif-unplugged", "status": "completed", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:34.664494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0582a954-59d8-4dda-b6b1-91eb9fcd6f50 req-60ca8553-aaff-422e-a89b-8359c8ec968c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:34.665382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0582a954-59d8-4dda-b6b1-91eb9fcd6f50 req-60ca8553-aaff-422e-a89b-8359c8ec968c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:34.668706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0582a954-59d8-4dda-b6b1-91eb9fcd6f50 req-60ca8553-aaff-422e-a89b-8359c8ec968c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:34.710955 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0582a954-59d8-4dda-b6b1-91eb9fcd6f50 req-60ca8553-aaff-422e-a89b-8359c8ec968c service nova] Creating event network-vif-unplugged:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:14:34.729392 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0582a954-59d8-4dda-b6b1-91eb9fcd6f50 req-60ca8553-aaff-422e-a89b-8359c8ec968c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.584543 Aug 06 21:14:34.731502 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2318/4479] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:14:34.762430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:34.764813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:34.774624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:34.775354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:34.776043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:34.776941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:34.778502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:34.780609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:35.206853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:35.219427 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-341f0e82-bfe8-4f7f-baf9-246b10795f40 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.481539 Aug 06 21:14:35.220055 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2319/4480] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:34 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:35.234588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:35.239411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:35.248530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:35.249150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:35.249632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:35.250374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:35.250895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:35.251350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:35.780208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:35.807957 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ec77116-2e0b-4f9e-a05b-597705f8085d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1683 microversion: 2.1 time: 0.586697 Aug 06 21:14:35.808906 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2320/4481] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:35 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1683 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:35.815055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cbb5183-71e1-4958-a25b-35b90e18061f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:35.815778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5cbb5183-71e1-4958-a25b-35b90e18061f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 047975cb-cb9c-4dfb-bc50-3047203316be] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:35.824713 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5cbb5183-71e1-4958-a25b-35b90e18061f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 047975cb-cb9c-4dfb-bc50-3047203316be could not be found. Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cbb5183-71e1-4958-a25b-35b90e18061f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/047975cb-cb9c-4dfb-bc50-3047203316be/action HTTP/1.1 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 14 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: {"shelve": {}} Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 047975cb-cb9c-4dfb-bc50-3047203316be could not be found. Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '047975cb-cb9c-4dfb-bc50-3047203316be', 'body': {'shelve': {}}} Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 047975cb-cb9c-4dfb-bc50-3047203316be could not be found. Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 047975cb-cb9c-4dfb-bc50-3047203316be could not be found. Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:35.834001 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:35.838897 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:35.838897 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:35.838897 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 047975cb-cb9c-4dfb-bc50-3047203316be could not be found. Aug 06 21:14:35.838897 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:35.841465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cbb5183-71e1-4958-a25b-35b90e18061f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 047975cb-cb9c-4dfb-bc50-3047203316be could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:35.842965 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5cbb5183-71e1-4958-a25b-35b90e18061f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/047975cb-cb9c-4dfb-bc50-3047203316be/action" status: 404 len: 111 microversion: 2.1 time: 0.032430 Aug 06 21:14:35.844271 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2321/4482] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:35 2022] POST /compute/v2.1/servers/047975cb-cb9c-4dfb-bc50-3047203316be/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:35.889157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:35.890974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:35.924943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:35.929002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:35.930089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:35.935448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:35.936309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:35.937087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:36.252332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:36.266899 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-248aaf29-bc73-4da7-ac0d-d2e4f7fa8577 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.391307 Aug 06 21:14:36.268317 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2322/4483] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:35 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:36.317021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:36.321632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:36.348164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:36.348648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:36.349093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:36.349814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:36.350275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:36.350751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:36.858055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:36.881356 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c6f1a66b-992d-413c-8fbb-3ab60263b716 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.586762 Aug 06 21:14:36.882894 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2323/4484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:36 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:36.918428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:36.921156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:36.935206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:36.937442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:36.937988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:36.940549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:36.941120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:36.946242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:37.372843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:37.389079 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1fbd0587-6c35-4f30-848c-f1e3b995e120 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1683 microversion: 2.1 time: 0.484665 Aug 06 21:14:37.405848 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2324/4485] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:36 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1683 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:37.429327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:37.431981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:37.452665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:37.454088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:37.455479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:37.457485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:37.461451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:37.462230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:37.532350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lazy-loading 'flavor' on Instance uuid 055adb26-af45-4bb0-9f79-7eba67aa0fb8 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:14:38.000308 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d7e0dc6-8ef3-4c19-bff3-67ef47fcf4f4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.590285 Aug 06 21:14:38.001677 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2325/4486] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:14:37 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:14:38.038837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:38.056644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:38.082533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:38.085264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:38.086704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:38.087718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:38.103010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:38.103721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:38.297623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:14:38.298158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:14:38.298826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:14:38.299540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:14:38.300071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:14:38.339183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:38.344674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:38.345220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:38.346058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:38.355218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:38.359485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:38.477114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Getting quotas for project b62ccbeb57bc4acebcba07ac1f82ae22. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:14:38.498261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Getting quotas for user 3597dc51e1ae4d80a4bd648fcf3e31bc and project b62ccbeb57bc4acebcba07ac1f82ae22. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:14:38.520219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:14:38.524664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:14:38.617260 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0fa0874c-7cec-45dc-8960-6d439394bf55 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.717852 Aug 06 21:14:38.626246 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2162/4487] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:14:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 4729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:14:38.632023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:38.640153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:38.649947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:38.653430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:38.654832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:38.656474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:38.657454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:38.658391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:38.659132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:38.684028 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d431042-bd3b-4315-9d58-300f83049e91 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.670556 Aug 06 21:14:38.686068 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2326/4488] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:38 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:38.720474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8aee51fc-5452-444d-8451-9cbb48e5c6e8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:38.721511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8aee51fc-5452-444d-8451-9cbb48e5c6e8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:38.934885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8aee51fc-5452-444d-8451-9cbb48e5c6e8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:38.948796 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8aee51fc-5452-444d-8451-9cbb48e5c6e8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1214 microversion: 2.1 time: 0.260938 Aug 06 21:14:38.949612 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2327/4489] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:38 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:39.430213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:39.444333 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-14430973-a2a1-4441-ac1f-1d329cb8b01d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1683 microversion: 2.1 time: 0.816105 Aug 06 21:14:39.446978 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2163/4490] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:38 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1683 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:39.712804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:39.714172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:39.750002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:39.750574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:39.751110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:39.751846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:39.754838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:39.757970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:40.004285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-60f2d0f8-2715-4486-9e6f-49bcd6bcb98e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:40.007567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-60f2d0f8-2715-4486-9e6f-49bcd6bcb98e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:40.376489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60f2d0f8-2715-4486-9e6f-49bcd6bcb98e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:40.390456 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-60f2d0f8-2715-4486-9e6f-49bcd6bcb98e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1214 microversion: 2.1 time: 0.420371 Aug 06 21:14:40.395084 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2164/4491] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:39 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1214 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:40.474774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:40.475738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:40.486004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:40.487711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:40.488789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:40.490520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:40.494357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:40.496823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:40.912015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:40.937885 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2c44e4d8-1296-42fd-9adb-35290bba6800 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 200 len: 1615 microversion: 2.1 time: 0.468088 Aug 06 21:14:40.943222 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2165/4492] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:40 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 1615 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:41.335111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-da088b39-47e1-433f-92e2-6074645eba46 req-40b39ff5-b0ca-46e4-a913-2367bb252ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08", "name": "network-vif-deleted", "tag": "f45dce22-429d-4b51-aaa5-cfdcccb364a4"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:41.353684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-da088b39-47e1-433f-92e2-6074645eba46 req-40b39ff5-b0ca-46e4-a913-2367bb252ac7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:41.354515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-da088b39-47e1-433f-92e2-6074645eba46 req-40b39ff5-b0ca-46e4-a913-2367bb252ac7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:41.355130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-da088b39-47e1-433f-92e2-6074645eba46 req-40b39ff5-b0ca-46e4-a913-2367bb252ac7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:41.370591 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-da088b39-47e1-433f-92e2-6074645eba46 req-40b39ff5-b0ca-46e4-a913-2367bb252ac7 service nova] Creating event network-vif-deleted:f45dce22-429d-4b51-aaa5-cfdcccb364a4 for instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 on nch1-master-1 Aug 06 21:14:41.377616 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-da088b39-47e1-433f-92e2-6074645eba46 req-40b39ff5-b0ca-46e4-a913-2367bb252ac7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.419783 Aug 06 21:14:41.379595 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2166/4493] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:14:41.419598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:41.420536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:41.440276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:41.441029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:41.443416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:41.444379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:41.448632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:41.450013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:41.947704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:41.960060 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3cb1c502-fec0-4286-a9a7-06df520567c3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 2.253375 Aug 06 21:14:41.963905 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2328/4494] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:39 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 2259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:41.999435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:42.001425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:42.025147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:42.026046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:42.026710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:42.028980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:42.030531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:42.032148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:42.038005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:42.040013 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bba9d2fe-715b-4912-80dc-e0393d355ed3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1272 microversion: 2.1 time: 0.624085 Aug 06 21:14:42.058467 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2167/4495] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:41 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1272 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:42.085801 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 HTTP/1.1 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08'} Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:14:42.090349 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-09967e8a-7b4a-4efb-98f5-a6ff8a2c64cc tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 404 len: 111 microversion: 2.1 time: 0.114376 Aug 06 21:14:42.094868 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2329/4496] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:41 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:14:42.105090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d6a53083-27dd-4b4a-b0cc-af70b1c90854 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '.version_select at 0x7f729d34d1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:42.152917 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d6a53083-27dd-4b4a-b0cc-af70b1c90854 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545693225" status: 202 len: 0 microversion: 2.1 time: 0.052515 Aug 06 21:14:42.155269 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2168/4497] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545693225 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:14:42.186822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2633519c-155a-4932-ba4a-f914042bca03 req-594f2801-c7a7-4f08-9f5f-9393329875ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "name": "network-vif-plugged", "status": "completed", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:42.222126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2633519c-155a-4932-ba4a-f914042bca03 req-594f2801-c7a7-4f08-9f5f-9393329875ad service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:42.224148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2633519c-155a-4932-ba4a-f914042bca03 req-594f2801-c7a7-4f08-9f5f-9393329875ad service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:42.224790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2633519c-155a-4932-ba4a-f914042bca03 req-594f2801-c7a7-4f08-9f5f-9393329875ad service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:42.266995 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2633519c-155a-4932-ba4a-f914042bca03 req-594f2801-c7a7-4f08-9f5f-9393329875ad service nova] Creating event network-vif-plugged:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:14:42.281805 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2633519c-155a-4932-ba4a-f914042bca03 req-594f2801-c7a7-4f08-9f5f-9393329875ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099299 Aug 06 21:14:42.282945 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2330/4498] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:14:42.989903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:42.990569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:43.001848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:43.002708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:43.003337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:43.004668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:43.005305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:43.005907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:43.066679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:43.068425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:43.091569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:43.092082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:43.092532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:43.094382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:43.096208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:43.099484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:43.377820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:43.398909 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c19e0ae1-5166-4008-95e1-624b739e5047 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.410864 Aug 06 21:14:43.406844 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2169/4499] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:42 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:44.428705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:44.429356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:44.457006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:44.462174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:44.464961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:44.465825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:44.468669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:44.470430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:44.778308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:44.790116 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ab7a0a6-ff78-4c72-993f-4eda9da78ce8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1314 microversion: 2.1 time: 1.728442 Aug 06 21:14:44.807133 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2331/4500] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:43 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1314 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:44.909803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:44.921662 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a2f52610-9991-43f6-8741-85a6ba52e3e9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.497895 Aug 06 21:14:44.924430 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2170/4501] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:44 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:45.490052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc2e0615-57b9-40bb-9e60-eafe890d97a4 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: .version_select at 0x7f729d5f5c10>, body: {"keypair": {"name": "tempest-keypair-464483257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdqbU3ejBhpeHiZ+zPRY9ACGWWXNEZ104L62I21qdkiMmq2JrkcmInTonVmRQolC8F7WNOAs1Gxl7TpQ+6XFYdiKs19csVBZCYl+FiGXkBF7JYzZE+7yStyp0YlpNZQDg=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:45.512275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:45.551468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-fc2e0615-57b9-40bb-9e60-eafe890d97a4 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for project f4980bb21b59412ca004d8069525d3b9. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:14:45.602297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-fc2e0615-57b9-40bb-9e60-eafe890d97a4 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for user 1d7b9e27983940dcaf0e92f62273c588 and project f4980bb21b59412ca004d8069525d3b9. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:14:45.714580 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fc2e0615-57b9-40bb-9e60-eafe890d97a4 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.229415 Aug 06 21:14:45.716246 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2332/4502] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:14:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:14:45.823083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:45.824046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:45.844469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:45.845422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:45.845880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:45.849379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:45.850509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:45.852221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:45.954174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:45.954834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:45.971636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:45.972769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:45.981211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:45.982156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:45.982690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:45.990485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:46.463434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:46.499868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b8573441-3792-4e26-8aee-cfbcd6b646f1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1314 microversion: 2.1 time: 0.685104 Aug 06 21:14:46.504053 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2171/4503] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:45 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:47.524908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:47.526278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:47.538783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:47.539636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:47.548554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:47.549882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:47.550263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:47.550743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:47.921817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:47.938770 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-23f16aaf-6db0-4f18-b942-246431754c42 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 1.989097 Aug 06 21:14:47.947766 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2333/4504] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:45 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:48.183587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:48.204662 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c1870611-6e9d-4c8a-bf0c-2db6dd16aaf7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1314 microversion: 2.1 time: 0.681377 Aug 06 21:14:48.207881 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2172/4505] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:47 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:48.969187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:48.970917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:49.004016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:49.008853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:49.009355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:49.016485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:49.017948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:49.019741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:49.040288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:49.229826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:49.230423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:49.249960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:49.253014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:49.254052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:49.263065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:49.263966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:49.264461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:49.265841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:49.731642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:49.750898 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1307707f-eb93-41fe-8adf-52d61f62406a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.783570 Aug 06 21:14:49.751493 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2334/4506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:48 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:50.051614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2d0be23d-b1c0-4a9f-8021-ffad0165150b req-f4d168a4-f7b4-4d1f-8c54-d5d60b2480c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43b2eca-4991-4b9f-909d-d310ed5fb4ea", "tag": "c15d1bcb-8372-4258-b1e0-493a7500e693"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:50.085600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2d0be23d-b1c0-4a9f-8021-ffad0165150b req-f4d168a4-f7b4-4d1f-8c54-d5d60b2480c9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:50.086102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2d0be23d-b1c0-4a9f-8021-ffad0165150b req-f4d168a4-f7b4-4d1f-8c54-d5d60b2480c9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:50.086618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2d0be23d-b1c0-4a9f-8021-ffad0165150b req-f4d168a4-f7b4-4d1f-8c54-d5d60b2480c9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:50.134023 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2d0be23d-b1c0-4a9f-8021-ffad0165150b req-f4d168a4-f7b4-4d1f-8c54-d5d60b2480c9 service nova] Creating event network-changed:c15d1bcb-8372-4258-b1e0-493a7500e693 for instance f43b2eca-4991-4b9f-909d-d310ed5fb4ea on nch2-master-1 Aug 06 21:14:50.164230 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2d0be23d-b1c0-4a9f-8021-ffad0165150b req-f4d168a4-f7b4-4d1f-8c54-d5d60b2480c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.396298 Aug 06 21:14:50.171969 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2335/4507] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:14:50.388489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:50.776642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:50.777595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:50.798249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:50.806242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:50.808092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:50.808891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:50.814529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:50.815326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:51.331750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:51.341081 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c687725d-15c3-4983-8aa7-60720e1ab5ef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1314 microversion: 2.1 time: 2.116086 Aug 06 21:14:51.357131 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2173/4508] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:49 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1314 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:51.555237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:51.564205 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-124ce0da-1b92-4dea-bc9b-7ea3de559961 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.793935 Aug 06 21:14:51.565123 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2336/4509] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:50 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:52.379903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:52.381116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:52.385424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:52.395008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:52.406603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:52.410654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:52.412468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:52.419582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:52.420229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:52.589610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:52.590245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:52.602736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:52.610634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:52.611345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:52.616585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:52.617316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:52.620297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:53.154432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:53.167877 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16fd3e46-089d-4e95-8d01-039ffdb11171 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.582225 Aug 06 21:14:53.174714 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2337/4510] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:52 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:53.236906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:53.256494 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a84a345-755c-4a62-b167-db60d9ef212d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1314 microversion: 2.1 time: 0.881012 Aug 06 21:14:53.257106 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2174/4511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:52 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:54.199176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:54.200114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:54.235882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:54.236411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:54.236868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:54.246479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:54.257474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:54.260420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:54.278114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:54.279399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:54.292901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:54.303684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:54.304872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:54.306915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:54.311532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:54.313354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:54.388112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:54.801533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:54.810271 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a0a6cb01-8952-41de-9356-e039acc974a0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.616744 Aug 06 21:14:54.829558 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2338/4512] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:54 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:54.946589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1251173083", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6095abc9-21e8-4e89-b536-00af77a125af"}], "security_groups": [{"name": "tempest-securitygroup--2140434772"}], "key_name": "tempest-keypair-464483257", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:55.055409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:55.064019 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-05beac41-1286-447c-8ca7-0dee3e54bd94 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1314 microversion: 2.1 time: 0.790104 Aug 06 21:14:55.064628 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2175/4513] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:54 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:55.214027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] validate_networks() for [('6095abc9-21e8-4e89-b536-00af77a125af', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:14:55.624180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:14:55.835633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:55.837359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:55.857697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:55.861389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:55.864238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:55.866161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:55.866912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:55.868164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:56.363271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:56.372107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:14:56.374523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:14:56.375410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:14:56.376015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:14:56.376618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:14:56.406243 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-590537fa-630f-4e3c-9903-d05e28709b1a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.575229 Aug 06 21:14:56.409154 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2176/4514] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:55 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:56.426931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:56.431378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:56.432165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:56.433792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:56.435043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:56.436710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:56.436928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:56.439847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:56.471342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:56.478807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:56.484588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:56.485452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:56.485945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:56.486397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:56.517934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for project f4980bb21b59412ca004d8069525d3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:14:56.546258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Getting quotas for user 1d7b9e27983940dcaf0e92f62273c588 and project f4980bb21b59412ca004d8069525d3b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:14:56.599240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:14:56.601695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:14:56.813711 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-023872d4-19d3-49a5-8d8c-fb75bad6f23e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.871311 Aug 06 21:14:56.822837 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2339/4515] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:14:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:14:56.849028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-9030c069-96eb-4c74-895b-1d89d94fb931 req-eced8c60-7e8e-4f7e-8f83-7dfb9671d993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43b2eca-4991-4b9f-909d-d310ed5fb4ea", "name": "network-vif-plugged", "status": "completed", "tag": "c15d1bcb-8372-4258-b1e0-493a7500e693"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:14:56.890080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9030c069-96eb-4c74-895b-1d89d94fb931 req-eced8c60-7e8e-4f7e-8f83-7dfb9671d993 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:56.897300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9030c069-96eb-4c74-895b-1d89d94fb931 req-eced8c60-7e8e-4f7e-8f83-7dfb9671d993 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:56.898126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9030c069-96eb-4c74-895b-1d89d94fb931 req-eced8c60-7e8e-4f7e-8f83-7dfb9671d993 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:56.921863 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-9030c069-96eb-4c74-895b-1d89d94fb931 req-eced8c60-7e8e-4f7e-8f83-7dfb9671d993 service nova] Creating event network-vif-plugged:c15d1bcb-8372-4258-b1e0-493a7500e693 for instance f43b2eca-4991-4b9f-909d-d310ed5fb4ea on nch2-master-1 Aug 06 21:14:56.933227 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-9030c069-96eb-4c74-895b-1d89d94fb931 req-eced8c60-7e8e-4f7e-8f83-7dfb9671d993 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105313 Aug 06 21:14:56.935677 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2340/4516] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:14:56.950400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7a50959f-34b5-4148-a8f5-f2cc5eaa199b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:56.951556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7a50959f-34b5-4148-a8f5-f2cc5eaa199b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:56.955507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:56.971873 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cbc1f025-93f2-4a27-917f-bbe37d8f6601 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1314 microversion: 2.1 time: 0.558100 Aug 06 21:14:56.973457 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2177/4517] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:56 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:57.443332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:57.444168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:57.494379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:57.499347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:57.504114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:57.507565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:57.513623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:57.514101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:57.553334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7a50959f-34b5-4148-a8f5-f2cc5eaa199b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:57.564583 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7a50959f-34b5-4148-a8f5-f2cc5eaa199b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1241 microversion: 2.1 time: 0.626052 Aug 06 21:14:57.581835 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2341/4518] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:56 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1241 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:57.999781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:58.001709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:58.018012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:58.018986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:58.021087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:58.023357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:58.024988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:58.026037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:58.203856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:58.225703 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-380cfcd6-54e4-4ac2-8b18-83b98869c3e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.797834 Aug 06 21:14:58.226336 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2178/4519] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:57 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:58.592242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:58.593761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:58.623250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:58.626641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:58.629401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:58.633285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:58.633848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:58.634380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:58.881359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:58.899385 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1d94b6af-34a4-43f3-b7ec-5ff95699fe35 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1293 microversion: 2.1 time: 0.313073 Aug 06 21:14:58.900168 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2179/4520] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:58 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1293 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:14:58.903918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:14:58.913392 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53f85e36-521b-43be-8f7f-fe2f4784d3a8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1314 microversion: 2.1 time: 0.917494 Aug 06 21:14:58.913991 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2342/4521] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:57 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:14:59.257556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:59.261566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:59.286834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:59.294169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:59.298912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:59.301512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:59.306307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:59.312758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:59.921547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:14:59.922159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:14:59.946498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:59.947039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:59.947496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:14:59.948231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:14:59.948702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:14:59.949141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:00.043789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:00.058354 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3f0d922c-5921-4511-b3af-71e4d648bfc0 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1532 microversion: 2.1 time: 0.809486 Aug 06 21:15:00.061843 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2180/4522] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:59 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1532 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:00.080687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:00.087939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:00.105152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:00.105152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:00.105152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:00.105152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:00.118473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:00.121112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:00.292328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:00.303214 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-407ca007-40e0-400d-88c9-5e1fbeaaa561 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1299 microversion: 2.1 time: 0.385520 Aug 06 21:15:00.303821 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2343/4523] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:14:59 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1299 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:00.559637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:00.573012 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b64d5893-7f05-4e6a-9bee-c9d17e4d0c58 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1500 microversion: 2.1 time: 0.509570 Aug 06 21:15:00.574875 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2181/4524] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:00 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1500 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:00.600566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:00.603279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:00.619503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:00.625181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:00.629494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:00.630618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:00.631383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:00.636578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:00.739545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lazy-loading 'flavor' on Instance uuid f43b2eca-4991-4b9f-909d-d310ed5fb4ea {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:15:01.070428 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1dfdeb5c-4982-41c4-9ee1-596ef592b348 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "POST /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea/action" status: 200 len: 32 microversion: 2.1 time: 0.474311 Aug 06 21:15:01.081380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:01.082565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:01.088394 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2344/4525] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:15:00 2022] POST /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea/action => generated 32 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:15:01.102933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:01.115789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:01.117946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:01.121802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:01.124354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:01.125551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:01.126396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:01.128428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:01.189313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:01.196142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:01.199133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:01.210206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:01.210790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:01.211257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:01.632325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:01.644166 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2543dac2-0a8e-416a-97e9-f41dda193e7b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.566813 Aug 06 21:15:01.649259 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2182/4526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:01 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:01.657826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:01.658832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:01.675882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:01.676905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:01.680561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:01.682472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:01.683050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:01.683620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:01.881768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:01.891211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-27a6ccfb-f7f5-4f28-ab22-ea568baecc43 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1299 microversion: 2.1 time: 0.240624 Aug 06 21:15:01.895531 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2183/4527] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:01 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:02.629583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f038f949-ad37-46f1-ba68-efc74806945b req-2164fc6a-3b95-4a1f-8730-8668e7da3f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055adb26-af45-4bb0-9f79-7eba67aa0fb8", "name": "network-vif-plugged", "status": "completed", "tag": "f6e6506f-eb32-403c-9cbf-f685723261e1"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:02.706757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f038f949-ad37-46f1-ba68-efc74806945b req-2164fc6a-3b95-4a1f-8730-8668e7da3f66 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:02.708086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f038f949-ad37-46f1-ba68-efc74806945b req-2164fc6a-3b95-4a1f-8730-8668e7da3f66 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:02.712479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f038f949-ad37-46f1-ba68-efc74806945b req-2164fc6a-3b95-4a1f-8730-8668e7da3f66 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:02.773538 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f038f949-ad37-46f1-ba68-efc74806945b req-2164fc6a-3b95-4a1f-8730-8668e7da3f66 service nova] Creating event network-vif-plugged:f6e6506f-eb32-403c-9cbf-f685723261e1 for instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 on nch2-master-1 Aug 06 21:15:02.785984 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f038f949-ad37-46f1-ba68-efc74806945b req-2164fc6a-3b95-4a1f-8730-8668e7da3f66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163358 Aug 06 21:15:02.790929 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2184/4528] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:02.824521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:02.826718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:02.828416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:02.835654 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-21deb490-7b4f-444e-a4dd-3673e92e6f33 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1532 microversion: 2.1 time: 1.742441 Aug 06 21:15:02.836331 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2345/4529] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:01 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1532 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:02.861329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:02.866114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:02.870676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:02.871505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:02.872224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:02.872880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:02.916694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:02.917570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:02.930095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:02.937900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:02.944179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:02.946529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:02.951052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:02.952634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:03.728232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:03.746716 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-94ad63e3-5bf8-421e-8aff-91b5d8b77513 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1367 microversion: 2.1 time: 0.833763 Aug 06 21:15:03.750763 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2346/4530] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:02 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1367 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:03.857097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:03.857641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:03.872748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:03.873256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:03.873716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:03.874485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:03.874980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:03.875413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:04.172402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:04.188196 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a957b4b-941a-49a6-b623-3a71570101a4 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 1.395572 Aug 06 21:15:04.188795 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2185/4531] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:02 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:04.776948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:04.781008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:04.815513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:04.819421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:04.820727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:04.824511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:04.835614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:04.837715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:05.597318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:05.606366 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c212c5d3-0130-4ef4-ba6c-2a50985c1f11 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1367 microversion: 2.1 time: 0.837834 Aug 06 21:15:05.609473 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2186/4532] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:04 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1367 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:05.637670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:05.655130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:05.665887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:05.667357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:05.668002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:05.668898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:05.669637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:05.670604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:05.727152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:05.747562 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-db9c78ea-5e09-4984-8647-9aaf621d098b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 1.893837 Aug 06 21:15:05.751123 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2347/4533] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:03 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:05.763859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:05.766342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:05.781027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:05.782714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:05.783943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:05.788178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:05.790023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:05.790911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:06.489466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:06.545200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:06.561422 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e78d0bc-4ee5-4aec-afab-542aa4af64f2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.808201 Aug 06 21:15:06.566727 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2348/4534] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:05 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:06.581564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-25e43273-5abb-4f15-b38f-1d7244efc83f req-66260f85-0032-4a1c-85bd-d7a7a44276a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab005513-d0f6-45c7-8bb8-17eee78e7056", "tag": "e6707ae7-d35e-43da-9a05-da3cd40b4212"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:06.615938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-25e43273-5abb-4f15-b38f-1d7244efc83f req-66260f85-0032-4a1c-85bd-d7a7a44276a7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:06.616880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-25e43273-5abb-4f15-b38f-1d7244efc83f req-66260f85-0032-4a1c-85bd-d7a7a44276a7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:06.617321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-25e43273-5abb-4f15-b38f-1d7244efc83f req-66260f85-0032-4a1c-85bd-d7a7a44276a7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:06.658980 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-25e43273-5abb-4f15-b38f-1d7244efc83f req-66260f85-0032-4a1c-85bd-d7a7a44276a7 service nova] Creating event network-changed:e6707ae7-d35e-43da-9a05-da3cd40b4212 for instance ab005513-d0f6-45c7-8bb8-17eee78e7056 on nch1-master-1 Aug 06 21:15:06.710984 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-25e43273-5abb-4f15-b38f-1d7244efc83f req-66260f85-0032-4a1c-85bd-d7a7a44276a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139540 Aug 06 21:15:06.716602 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2349/4535] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:06.756352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:06.760895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:06.771247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:06.772117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:06.772773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:06.773810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:06.774721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:06.775388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:06.800441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:06.816020 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-60ad27ad-4422-4a07-8fe4-577fb227c7fc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 1.199587 Aug 06 21:15:06.826712 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2187/4536] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:05 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:06.841163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:06.850841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:06.858899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:06.859624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:06.860563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:06.861442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:06.862140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:06.862780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:07.254081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:07.257151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:07.267544 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-612c25f0-0237-404c-b440-25633224357d tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1367 microversion: 2.1 time: 0.548364 Aug 06 21:15:07.283311 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a28b2085-c753-4ae1-8087-364c414539ec tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 0.451288 Aug 06 21:15:07.283983 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2350/4537] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:06 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:07.290250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d921478-13bc-4085-888a-7f51e918c5a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-799776133"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:07.292972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d921478-13bc-4085-888a-7f51e918c5a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:07.294991 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2188/4538] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:06 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:07.300517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d921478-13bc-4085-888a-7f51e918c5a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:07.301015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d921478-13bc-4085-888a-7f51e918c5a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:07.302019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d921478-13bc-4085-888a-7f51e918c5a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:07.302441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d921478-13bc-4085-888a-7f51e918c5a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:07.302938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d921478-13bc-4085-888a-7f51e918c5a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:07.304144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d921478-13bc-4085-888a-7f51e918c5a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:07.554751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:07.567020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:07.588723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:07.590255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:07.612408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:07.613910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:07.625342 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d921478-13bc-4085-888a-7f51e918c5a7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.339718 Aug 06 21:15:07.626655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:07.626873 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2351/4539] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:15:07 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 06 21:15:07.638053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:07.641922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:07.643473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:07.644239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:07.644769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:07.659180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:07.661053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:07.682802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:07.688546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:07.689404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:07.691337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:08.038254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:08.047261 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33562b57-4734-4299-a870-a29c320e2030 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.463909 Aug 06 21:15:08.055742 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2189/4540] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:07 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:08.291463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:08.292374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:08.309244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:08.310060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:08.310806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:08.311693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:08.312313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:08.312902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:08.352101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:08.368062 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1412a7de-6dca-4455-859d-c0bf9d6b57c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.731633 Aug 06 21:15:08.371769 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2352/4541] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:07 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:08.397763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:08.400887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:08.422856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:08.430430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:08.431299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:08.432321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:08.433100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:08.433747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:08.690694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:08.699766 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9d2bc266-81df-4e02-9487-664a82eb0758 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1367 microversion: 2.1 time: 0.412078 Aug 06 21:15:08.704374 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2190/4542] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:08 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:09.081481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:09.082262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:09.089245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:09.102155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:09.102832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:09.103700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:09.105771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:09.106323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:09.121105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:09.132223 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8a812b29-28df-4302-975e-93bc22143f02 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 0.758208 Aug 06 21:15:09.135413 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2353/4543] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:08 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:09.400313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:09.402285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:09.430509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:09.438101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:09.440669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:09.459173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:09.462292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:09.465917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:09.478476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:09.496491 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a1912519-3099-47d6-b446-50508583e597 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.418939 Aug 06 21:15:09.498460 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2191/4544] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:09 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:09.728796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:09.729697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:09.765061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:09.772477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:09.776290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:09.781465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:09.785069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:09.788358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:09.894276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:10.126317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:10.140308 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-147e26cf-4183-4f69-8f21-3734c542d5c1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.744768 Aug 06 21:15:10.140828 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2354/4545] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:09 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:10.164577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:10.167687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:10.184347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:10.185134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:10.185734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:10.186647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:10.187257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:10.191141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:10.500558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:10.518828 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c48ffba4-aa5a-4bf5-89d8-392b8471b9c3 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1367 microversion: 2.1 time: 0.798008 Aug 06 21:15:10.520168 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2192/4546] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:09 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1367 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:10.529532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:10.537085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:10.549043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:10.553299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:10.554231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:10.555482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:10.556923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:10.558508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:10.993599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:11.015712 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e30880df-c491-4fe6-81fe-9db5042683e0 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.494157 Aug 06 21:15:11.042956 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2193/4547] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:10 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:11.054858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7eaee923-68e4-4f99-a129-37b4cc64991c req-001472b5-80c6-4ad5-b29e-ea7e9d8eb4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "name": "network-vif-unplugged", "status": "completed", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:11.071816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7eaee923-68e4-4f99-a129-37b4cc64991c req-001472b5-80c6-4ad5-b29e-ea7e9d8eb4b4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:11.073611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7eaee923-68e4-4f99-a129-37b4cc64991c req-001472b5-80c6-4ad5-b29e-ea7e9d8eb4b4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:11.075274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7eaee923-68e4-4f99-a129-37b4cc64991c req-001472b5-80c6-4ad5-b29e-ea7e9d8eb4b4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:11.094048 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7eaee923-68e4-4f99-a129-37b4cc64991c req-001472b5-80c6-4ad5-b29e-ea7e9d8eb4b4 service nova] Creating event network-vif-unplugged:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:15:11.108845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7eaee923-68e4-4f99-a129-37b4cc64991c req-001472b5-80c6-4ad5-b29e-ea7e9d8eb4b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063647 Aug 06 21:15:11.110604 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2194/4548] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:11.164908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:11.165925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:11.183623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:11.184686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:11.185792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:11.186970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:11.187648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:11.188306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:11.250871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:11.270896 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9963cc06-bee6-4a5a-b409-ce34db6e77a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 1.112978 Aug 06 21:15:11.284739 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2355/4549] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:10 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:11.541777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:11.543044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:11.557651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:11.558409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:11.559474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:11.561573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:11.564863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:11.565673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:11.604882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:11.637187 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cdb7ed43-ea39-4560-90f3-55eb240d90d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1688 microversion: 2.1 time: 0.476526 Aug 06 21:15:11.655786 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2195/4550] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:11 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1688 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:12.046740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:12.047470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:12.064024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:12.067439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:12.070174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:12.072522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:12.075780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:12.076555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:12.598880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:12.610465 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-245f53e6-cf57-4ffc-92e3-cbb0072a5f4a tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1367 microversion: 2.1 time: 1.073722 Aug 06 21:15:12.612260 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2356/4551] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:11 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1367 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:12.640990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:12.642333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:12.662902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:12.686342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:12.687170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:12.688160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:12.697009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:12.698751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:12.775648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:12.788005 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3f379455-01a7-4931-8a3e-01003556e81e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.746413 Aug 06 21:15:12.789326 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2196/4552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:12 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:12.804398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:12.805180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:12.823685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:12.824486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:12.825087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:12.825964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:12.827085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:12.827677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:13.453127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:13.467565 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d2e9921d-a633-410d-9757-da6f61adb878 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 0.852211 Aug 06 21:15:13.484570 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2357/4553] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:12 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:13.636743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:13.638695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:13.649065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:13.653071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:13.653760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:13.654878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:13.661191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:13.661931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:14.167655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:14.192432 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-55308638-a51b-4548-8b79-fa92cf5a5116 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1367 microversion: 2.1 time: 0.562877 Aug 06 21:15:14.206251 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2358/4554] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:13 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1367 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:14.222365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:14.225987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:14.245352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:14.247430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:14.248899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:14.250266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:14.255042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:14.255716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:14.411638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:14.421264 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f73597bc-b51c-4ce2-95ff-0839c51e5c06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 1.630546 Aug 06 21:15:14.430870 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2197/4555] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:12 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:14.493927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:14.494572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:14.505100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:14.505636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:14.508637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:14.509390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:14.512474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:14.513011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:14.646194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:14.659505 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65a1d40d-0bff-4f0f-b454-76ae4f7c39c3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.451674 Aug 06 21:15:14.663462 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2359/4556] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:14 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:14.962049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-60e8dab1-6b71-4b4d-b24a-48c9d3996ac8 req-936f67e5-da78-4246-abba-f88e1d7eb08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab005513-d0f6-45c7-8bb8-17eee78e7056", "name": "network-vif-plugged", "status": "completed", "tag": "e6707ae7-d35e-43da-9a05-da3cd40b4212"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:14.993353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-60e8dab1-6b71-4b4d-b24a-48c9d3996ac8 req-936f67e5-da78-4246-abba-f88e1d7eb08b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:14.993852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-60e8dab1-6b71-4b4d-b24a-48c9d3996ac8 req-936f67e5-da78-4246-abba-f88e1d7eb08b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:14.994296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-60e8dab1-6b71-4b4d-b24a-48c9d3996ac8 req-936f67e5-da78-4246-abba-f88e1d7eb08b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:15.043088 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-60e8dab1-6b71-4b4d-b24a-48c9d3996ac8 req-936f67e5-da78-4246-abba-f88e1d7eb08b service nova] Creating event network-vif-plugged:e6707ae7-d35e-43da-9a05-da3cd40b4212 for instance ab005513-d0f6-45c7-8bb8-17eee78e7056 on nch1-master-1 Aug 06 21:15:15.065542 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-60e8dab1-6b71-4b4d-b24a-48c9d3996ac8 req-936f67e5-da78-4246-abba-f88e1d7eb08b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106594 Aug 06 21:15:15.066199 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2360/4557] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:15:15.116055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:15.146050 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-67387273-9514-471c-bbf5-80fe1c852a35 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 0.653059 Aug 06 21:15:15.146739 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2198/4558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:14 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:15.230235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:15.231671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:15.257976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:15.260220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:15.260860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:15.264653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:15.265405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:15.265853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:15.457353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:15.458025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:15.516233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:15.516755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:15.517214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:15.518170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:15.552376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:15.553254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:15.816876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:15.832503 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-61d97f85-21cf-456d-82f3-e7a8e389f87b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1367 microversion: 2.1 time: 0.609819 Aug 06 21:15:15.835675 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2361/4559] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:15 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1367 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:15.850519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:15.851479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:15.858799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:15.861006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:15.862526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:15.863506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:15.864977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:15.865605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:15.866269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:16.355241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:16.367745 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fd3442f3-2e44-480b-b83a-0dee076ec5a1 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.528278 Aug 06 21:15:16.383879 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2362/4560] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:15 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:16.406158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:16.415104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:16.442395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:16.442938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:16.446715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:16.447578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:16.449241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:16.449683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:17.032352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:17.049942 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e8fdec0f-c94b-451a-b62e-4abe6bd5808d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 0.656133 Aug 06 21:15:17.051907 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2363/4561] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:16 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:17.068355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:17.069344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:17.086338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:17.087293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:17.088079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:17.089163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:17.089862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:17.090608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:17.241684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:17.252942 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f62abaed-9151-4b5e-92a1-edce74ac0017 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 1.799672 Aug 06 21:15:17.268013 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2199/4562] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:15 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:17.405451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:17.412636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:17.413261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:17.417626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-19f141b3-f0b8-4960-a19a-471284e5f705 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1558 microversion: 2.1 time: 0.363117 Aug 06 21:15:17.423324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:17.423324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:17.423661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:17.431977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:17.437903 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2364/4563] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:17 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1558 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:17.441339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:17.444414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:17.445115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53fa657c-9846-40ca-b928-adc815007b07 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:17.445838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-53fa657c-9846-40ca-b928-adc815007b07 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:17.455840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53fa657c-9846-40ca-b928-adc815007b07 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:17.456870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53fa657c-9846-40ca-b928-adc815007b07 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:17.457639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53fa657c-9846-40ca-b928-adc815007b07 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:17.459172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53fa657c-9846-40ca-b928-adc815007b07 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:17.459959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53fa657c-9846-40ca-b928-adc815007b07 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:17.461561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53fa657c-9846-40ca-b928-adc815007b07 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:17.910355 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53fa657c-9846-40ca-b928-adc815007b07 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.471123 Aug 06 21:15:17.913300 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2365/4564] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:15:17 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-interface => generated 285 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:18.076115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:18.076838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:18.092203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:18.096947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:18.098282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:18.106620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:18.107255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:18.112621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:19.688303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:19.705702 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-babdfc63-d983-4dbf-a9ac-e285e829891f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 1.634581 Aug 06 21:15:19.708244 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2366/4565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:18 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:19.713578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:19.714413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:19.743532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:19.744308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:19.747440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:19.748891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:19.749570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:19.752578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:19.809730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:19.828539 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72d8401d-ccec-4acd-b990-ba38e41d3832 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 2.419206 Aug 06 21:15:19.830673 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2200/4566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:17 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 2425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:19.855155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-0f9b952c-cab2-4302-b2ff-0028383ba49f req-988733d5-0ba9-4ae8-b63e-86d2e03876f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "name": "network-vif-plugged", "status": "completed", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:19.899952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0f9b952c-cab2-4302-b2ff-0028383ba49f req-988733d5-0ba9-4ae8-b63e-86d2e03876f0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:19.899952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0f9b952c-cab2-4302-b2ff-0028383ba49f req-988733d5-0ba9-4ae8-b63e-86d2e03876f0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:19.899952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0f9b952c-cab2-4302-b2ff-0028383ba49f req-988733d5-0ba9-4ae8-b63e-86d2e03876f0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:19.952060 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-0f9b952c-cab2-4302-b2ff-0028383ba49f req-988733d5-0ba9-4ae8-b63e-86d2e03876f0 service nova] Creating event network-vif-plugged:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:15:19.975276 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-0f9b952c-cab2-4302-b2ff-0028383ba49f req-988733d5-0ba9-4ae8-b63e-86d2e03876f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142631 Aug 06 21:15:19.982271 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2201/4567] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:20.516073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:20.538560 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-366d5ba4-4a96-4bba-9222-b1f77d929943 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.828544 Aug 06 21:15:20.540465 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2367/4568] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:19 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:20.729716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:20.734067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:20.773523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:20.777636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:20.779585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:20.781574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:20.783946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:20.784891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:20.852894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:20.855409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:20.886205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:20.889829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:20.893860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:20.895400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:20.897672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:20.901127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:21.451570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:21.459019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:21.477576 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7de86410-62c3-4014-b6a7-7dfea433ebb7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.630848 Aug 06 21:15:21.480939 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2368/4569] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:20 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:21.561534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:21.562243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:21.590440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:21.599058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:21.600540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:21.606307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:21.608313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:21.608789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:22.124370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:22.140386 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6506f2e-306c-46eb-b087-24d727c4b255 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.580917 Aug 06 21:15:22.141932 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2369/4570] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:21 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:22.504471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:22.505104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:22.525698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:22.528721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:22.529202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:22.529965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:22.538228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:22.538736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:23.214890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:23.226216 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fdfc7c4e-5bdf-4363-b3bb-f27f3a208ce7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.727313 Aug 06 21:15:23.227843 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2370/4571] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:22 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:23.247972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:23.254413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:23.277197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:23.278653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:23.279953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:23.282418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:23.290455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:23.291301 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c69b77ac-89c0-4ef9-a140-620ca1d84156 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 2.564259 Aug 06 21:15:23.292215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:23.292921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:23.295161 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2202/4572] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:20 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 2572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:23.641332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:23.662051 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-779a7efa-e96e-4eee-bced-c8dd339e9f39 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.432555 Aug 06 21:15:23.675395 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2371/4573] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:23 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:24.247934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:24.249136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:24.260828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=58 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:24.268488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:24.269439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:24.270169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:24.272553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:24.274219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:24.274974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:24.318946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:24.319569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:24.338716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:24.339575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:24.340217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:24.341235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:24.342456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:24.343100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:24.765495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:24.784176 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1aa64577-23cd-4b28-8a34-85b9f74b928c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 0.460134 Aug 06 21:15:24.798666 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2372/4574] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:24 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:24.798666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:24.801112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:24.815800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:24.818456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:24.819061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:24.819830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:24.822455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:24.823040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:25.062495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:25.071127 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d393a44e-5929-444b-b21d-05d512f0ccf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.283165 Aug 06 21:15:25.090944 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2373/4575] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:24 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:25.474591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:25.490212 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-842a5c58-9e1e-477f-a4c8-e4ace0cd477e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 1.246029 Aug 06 21:15:25.490879 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2203/4576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:24 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:25.520961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b18aed7d-d217-409b-af25-93c60bf7681a req-cc6ac763-5a2a-43bf-a094-e8a7295b0a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab005513-d0f6-45c7-8bb8-17eee78e7056", "tag": "e6707ae7-d35e-43da-9a05-da3cd40b4212"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:25.536282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b18aed7d-d217-409b-af25-93c60bf7681a req-cc6ac763-5a2a-43bf-a094-e8a7295b0a2f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:25.548427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b18aed7d-d217-409b-af25-93c60bf7681a req-cc6ac763-5a2a-43bf-a094-e8a7295b0a2f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:25.559282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b18aed7d-d217-409b-af25-93c60bf7681a req-cc6ac763-5a2a-43bf-a094-e8a7295b0a2f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:25.577585 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b18aed7d-d217-409b-af25-93c60bf7681a req-cc6ac763-5a2a-43bf-a094-e8a7295b0a2f service nova] Creating event network-changed:e6707ae7-d35e-43da-9a05-da3cd40b4212 for instance ab005513-d0f6-45c7-8bb8-17eee78e7056 on nch1-master-1 Aug 06 21:15:25.587454 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b18aed7d-d217-409b-af25-93c60bf7681a req-cc6ac763-5a2a-43bf-a094-e8a7295b0a2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084268 Aug 06 21:15:25.603970 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2374/4577] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:15:25.806730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:25.807474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:25.817814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:25.824404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:25.825208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:25.826490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:25.836208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:25.837075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:26.100033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:26.100755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:26.126456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:26.126992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:26.127452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:26.128179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:26.128640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:26.129071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:26.653512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:26.693224 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a308980f-cafd-437c-b3bb-2495ea146983 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.600697 Aug 06 21:15:26.697483 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2375/4578] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:26 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:26.706469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:26.707914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:26.737769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:26.738316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:26.750586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:26.752263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:26.752827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:26.753344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:27.318818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:27.332258 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-12de24da-ab9a-4c5a-b5b8-38d0811dd30d tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1527 microversion: 2.1 time: 1.529715 Aug 06 21:15:27.349350 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2204/4579] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:25 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1527 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:27.417736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:27.428041 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-55ba9218-1fdf-4bd7-806d-29a38a31d18b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.728140 Aug 06 21:15:27.444274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2376/4580] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:26 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:27.717729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:27.718529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:27.726603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:27.734819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:27.735975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:27.737034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:27.737630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:27.738173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:28.356268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:28.356782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:28.375390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:28.375928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:28.376985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:28.377988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:28.384410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:28.394478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:28.394961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:28.409485 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f52cc386-b931-4e30-96f3-1b7f33393b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.680398 Aug 06 21:15:28.410161 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2205/4581] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:27 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:28.451200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:28.452826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:28.475483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:28.475827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:28.484898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:28.486205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:28.492124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:28.492880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:28.917631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:28.930247 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9c298032-e9b3-40be-a314-a15c3a7958b9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.482763 Aug 06 21:15:28.932277 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2206/4582] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:28 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:29.159517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:29.170972 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-674b1639-e492-45ee-aea9-b3f5f95cd153 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1509 microversion: 2.1 time: 0.818328 Aug 06 21:15:29.174844 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2377/4583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:28 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1509 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:29.436745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:29.437580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:29.451120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:29.455985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:29.459260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:29.461138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:29.461736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:29.463587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:29.954281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:29.955131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:29.967372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:29.967874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:29.968317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:29.969032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:29.970271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:29.973675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:30.270633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:30.279217 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fa069c7c-4ebd-4cbb-aa54-b49e7346c923 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.847980 Aug 06 21:15:30.294932 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2207/4584] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:29 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:30.304190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:30.305230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:30.312995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:30.314237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:30.315160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:30.316069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:30.316719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:30.317406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:30.398356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:30.412882 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc70a01b-595b-4dbc-86b2-49a1f4846fc6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.463369 Aug 06 21:15:30.413876 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2378/4585] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:29 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:31.311211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:31.312784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:31.328059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:31.330614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:31.331302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:31.333324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:31.334759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:31.345880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:31.843247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:31.856741 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9bef1553-5a66-4d02-a608-c61d4159847a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1509 microversion: 2.1 time: 1.560377 Aug 06 21:15:31.858066 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2208/4586] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:30 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1509 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:31.868664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:31.872253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:31.886236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:31.888151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:31.895176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:31.896497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:31.897149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:31.897766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:32.011290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:32.057221 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ad3823f5-3eb6-4ef8-8e38-a261eaa426c7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.751373 Aug 06 21:15:32.058620 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2379/4587] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:31 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:32.509544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2bbeb475-d80d-4632-ab49-11735b43601b req-049195c4-a851-484a-a97a-c7fd6bb65ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055adb26-af45-4bb0-9f79-7eba67aa0fb8", "name": "network-vif-unplugged", "status": "completed", "tag": "f6e6506f-eb32-403c-9cbf-f685723261e1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:32.542517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2bbeb475-d80d-4632-ab49-11735b43601b req-049195c4-a851-484a-a97a-c7fd6bb65ff6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:32.543466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2bbeb475-d80d-4632-ab49-11735b43601b req-049195c4-a851-484a-a97a-c7fd6bb65ff6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:32.544304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2bbeb475-d80d-4632-ab49-11735b43601b req-049195c4-a851-484a-a97a-c7fd6bb65ff6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:32.585460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:32.601448 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-60cef181-f7f1-49f0-8115-4f0fa4f8eaef tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1506 microversion: 2.1 time: 0.739619 Aug 06 21:15:32.601804 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2bbeb475-d80d-4632-ab49-11735b43601b req-049195c4-a851-484a-a97a-c7fd6bb65ff6 service nova] Creating event network-vif-unplugged:f6e6506f-eb32-403c-9cbf-f685723261e1 for instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 on nch2-master-1 Aug 06 21:15:32.602393 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2209/4588] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:31 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:32.633452 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2bbeb475-d80d-4632-ab49-11735b43601b req-049195c4-a851-484a-a97a-c7fd6bb65ff6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141735 Aug 06 21:15:32.638136 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2380/4589] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 06 21:15:32.884026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:32.884679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:32.895427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:32.895912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:32.896486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:32.897103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:32.897576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:32.898022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:32.937015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:33.081328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:33.082432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:33.091738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:33.097103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:33.097889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:33.098921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:33.099647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:33.100328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:33.434366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:33.452663 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e8f63884-8ca8-4139-b928-0a2f11d28f3a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.375384 Aug 06 21:15:33.453926 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2381/4590] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:33 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:33.460462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1131127637", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "18083762-3e6b-4178-981c-7204fa68e3c9"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:33.552436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] validate_networks() for [('18083762-3e6b-4178-981c-7204fa68e3c9', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:15:33.930606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:33.947830 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-73163db5-1866-4751-8993-cd38e20753a3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1452 microversion: 2.1 time: 1.067782 Aug 06 21:15:33.948559 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2210/4591] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:32 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1452 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:33.962726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:33.963656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:33.990353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:33.992124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:33.994615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:33.995653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:34.000115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:34.002165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:34.872040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:34.906369 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ca0a015f-9e81-4be3-98b9-61cf6308680b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1486 microversion: 2.1 time: 0.951293 Aug 06 21:15:34.907383 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2211/4592] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:33 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1486 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:34.927778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:34.941573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:34.959431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:34.965020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:34.965844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:34.966842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:34.967765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:34.968425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:35.019787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:15:35.020964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:15:35.022238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:15:35.023040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:15:35.023722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:15:35.043680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:35.044560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:35.045727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:35.046855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:35.053197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:35.054603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:35.081724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Getting quotas for project 15407d6e47c34f588e162af6a190fd99. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:15:35.089793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Getting quotas for user c9a290f680dc4b5bbec2010d82ed7e27 and project 15407d6e47c34f588e162af6a190fd99. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:15:35.115220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:15:35.118584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:15:35.190152 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a980b9ac-f18c-4443-9fe0-3e956dcd25cf tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.734805 Aug 06 21:15:35.191240 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2382/4593] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:15:35.207670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:35.208946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:35.224273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:35.224805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:35.233273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:35.234162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:35.234688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:35.235172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:35.601387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:35.618596 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8b04ee55-8a78-4331-96bf-825870b39f93 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1683 microversion: 2.1 time: 0.421820 Aug 06 21:15:35.619533 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2383/4594] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:35 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1683 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:35.634657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-712158481", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:35.667727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:35.681574 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f5cdf0f-48d5-4c4e-9495-9b6a7c8c9106 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1452 microversion: 2.1 time: 0.771527 Aug 06 21:15:35.685017 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2212/4595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:34 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1452 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:35.722941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4f40356-155c-484a-bc7d-e8923e3eea8a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:35.725134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f4f40356-155c-484a-bc7d-e8923e3eea8a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:35.903472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] validate_networks() for [('cd1d4a4a-ec38-48a7-8916-5b401e33551a', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:15:36.046394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f4f40356-155c-484a-bc7d-e8923e3eea8a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:36.057684 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f4f40356-155c-484a-bc7d-e8923e3eea8a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1214 microversion: 2.1 time: 0.370473 Aug 06 21:15:36.061779 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2213/4596] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:35 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:36.081836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:36.082885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:36.093113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:36.093945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:36.096348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:36.099215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:36.099949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:36.100604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:36.187660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lazy-loading 'flavor' on Instance uuid 055adb26-af45-4bb0-9f79-7eba67aa0fb8 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:15:36.226282 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Cannot 'shelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state shelved_offloaded Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action HTTP/1.1 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 14 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: {"shelve": {}} Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: exception: Cannot 'shelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state shelved_offloaded Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8', 'body': {'shelve': {}}} Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 06 21:15:36.229610 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state shelved_offloaded Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state shelved_offloaded Aug 06 21:15:36.236135 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:15:36.239549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 409 to user: Cannot 'shelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state shelved_offloaded {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:15:36.240734 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a902859d-648a-4beb-95b1-0b8762379abf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 409 len: 155 microversion: 2.1 time: 0.164396 Aug 06 21:15:36.246258 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2214/4597] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:15:36 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 155 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:15:36.254484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:36.255396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:36.263193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:36.264049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:36.264703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:36.265723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:36.267339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:36.269577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:36.402814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=142462) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 21:15:36.622312 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-85deedc8-6ba0-42f1-bcf0-642b1edd54c4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.372859 Aug 06 21:15:36.625053 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2215/4598] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:15:36 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:15:36.636698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:36.638135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:36.646794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:36.647420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:36.648187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:36.649076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:36.649718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:36.650312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:37.633595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:15:37.634138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:15:37.635446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:15:37.636242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:15:37.636890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:15:37.660105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:37.660775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:37.661844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:37.664165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:37.665162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:37.665854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:37.667020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:37.679605 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ccda24a5-b24b-4971-bebe-74eb4f9309d4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1460 microversion: 2.1 time: 1.050583 Aug 06 21:15:37.680743 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2216/4599] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:36 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1460 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:37.695618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:37.697278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:37.706256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:37.711000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:37.711718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:37.712725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:37.713512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:37.714178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:37.736068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Getting quotas for project b62ccbeb57bc4acebcba07ac1f82ae22. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:15:37.755807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Getting quotas for user 3597dc51e1ae4d80a4bd648fcf3e31bc and project b62ccbeb57bc4acebcba07ac1f82ae22. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:15:37.770777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:15:37.774577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:15:37.935609 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-89a7b781-f914-4ac0-a2c0-1187022d57d3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.313250 Aug 06 21:15:37.937152 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2384/4600] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:15:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:15:37.966586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:37.974806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:37.987430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:37.988722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:37.991553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:37.992595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:37.995058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:37.995737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:38.585522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:38.605940 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eb942158-52af-4dd7-b540-7912681e34f9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.923832 Aug 06 21:15:38.607078 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2217/4601] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:37 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:38.634695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:38.637525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:38.654032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:38.654539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:38.655223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:38.655950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:38.656417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:38.656892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:38.788229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:38.801735 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f75a427-e63b-404d-86f2-b8a3e8f6253e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1272 microversion: 2.1 time: 0.857425 Aug 06 21:15:38.804332 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2385/4602] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:37 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1272 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:38.816294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:38.817149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:38.833826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:38.834474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:38.841727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:38.842965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:38.843761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:38.846464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:38.860167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:38.898475 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-752f05b6-66a5-408f-8942-1f1fd02c5674 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1217 microversion: 2.1 time: 0.289483 Aug 06 21:15:38.921113 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2218/4603] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:38 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1217 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:38.937249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:38.937999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:38.950011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:38.950794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:38.951402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:38.952294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:38.952919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:38.953512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:39.291351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:39.299820 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e44cdadf-8cad-4f4e-83d2-abe048730a92 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.379718 Aug 06 21:15:39.311275 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2219/4604] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:38 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:39.378566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:39.389521 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3cecef53-639c-490f-8e67-71160d3d92f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1462 microversion: 2.1 time: 0.583843 Aug 06 21:15:39.390326 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2386/4605] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:38 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1462 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:39.825249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:39.825869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:39.834032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:39.835011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:39.835643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:39.837017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:39.837714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:39.838356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:39.937503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:39.939935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:39.956116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:39.957177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:39.960657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:39.962122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:39.963320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:39.965943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:40.130087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:40.138063 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3b4082a0-bf21-4482-81e5-507ef9b05971 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1271 microversion: 2.1 time: 0.206432 Aug 06 21:15:40.142943 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2387/4606] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:39 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:40.416799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:40.418567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:40.435837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:40.437153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:40.444015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:40.446439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:40.447518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:40.448393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:40.456753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:40.487332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:40.506252 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-436006b6-9aa3-47dd-8175-eb7f7f9a8b04 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1314 microversion: 2.1 time: 0.685558 Aug 06 21:15:40.509309 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2220/4607] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:39 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:40.822905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:40.823529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:40.839384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:40.839848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:40.840259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:40.841155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:40.841614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:40.842235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:41.084350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:41.095199 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-972950a8-896f-4ad4-aa5e-ea4f058b4d71 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.685812 Aug 06 21:15:41.111594 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2388/4608] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:40 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:41.164736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:41.165468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:41.172086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:41.173342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:41.173989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:41.175010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:41.176229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:41.176829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:41.222118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:41.233174 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-76776842-9cc8-49d0-9b76-1b818b156038 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.414133 Aug 06 21:15:41.233902 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2221/4609] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:40 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:41.254467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:41.255332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:41.261501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:41.261992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:41.262429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:41.263426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:41.263953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:41.264580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:41.331785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:41.342437 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0768dbb3-a07f-4ff9-a9ec-85a2b820482a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1271 microversion: 2.1 time: 0.182544 Aug 06 21:15:41.343323 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2389/4610] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:41 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:41.529654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:41.530695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:41.538991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:41.539646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:41.540165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:41.541143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:41.541684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:41.542212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:41.766777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:41.776196 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b8c59c42-9340-4242-9318-8c17572c6bf8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.526035 Aug 06 21:15:41.777427 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2222/4611] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:41 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:41.797658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:41.798716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:41.818233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:41.829405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:41.830038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:41.831034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:41.831597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:41.832099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:42.007865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:42.024169 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b08db28-0438-4177-8ae8-9ae030378350 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1314 microversion: 2.1 time: 0.497822 Aug 06 21:15:42.034953 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2390/4612] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:41 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:42.043251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-231355b3-d282-4a5a-ae33-5beb9290a1e3 req-41206bba-8268-44ba-9435-5b91688f38e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "name": "network-vif-unplugged", "status": "completed", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:42.054605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-231355b3-d282-4a5a-ae33-5beb9290a1e3 req-41206bba-8268-44ba-9435-5b91688f38e0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:42.055420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-231355b3-d282-4a5a-ae33-5beb9290a1e3 req-41206bba-8268-44ba-9435-5b91688f38e0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:42.056095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-231355b3-d282-4a5a-ae33-5beb9290a1e3 req-41206bba-8268-44ba-9435-5b91688f38e0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:42.069825 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-231355b3-d282-4a5a-ae33-5beb9290a1e3 req-41206bba-8268-44ba-9435-5b91688f38e0 service nova] Creating event network-vif-unplugged:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:15:42.075742 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-231355b3-d282-4a5a-ae33-5beb9290a1e3 req-41206bba-8268-44ba-9435-5b91688f38e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039212 Aug 06 21:15:42.076561 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2391/4613] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:42.119962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:42.120693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:42.128279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:42.129107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:42.129782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:42.130874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:42.132188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:42.132851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:42.695186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:42.705629 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b414e44e-84ab-43ef-b940-668991c60e58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.912323 Aug 06 21:15:42.707171 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2223/4614] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:41 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:42.712725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-fbdcabeb-e262-456b-9b9e-dedffc3e0c22 req-0c403f97-25c7-41c4-98b4-7c911fd6f512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459d01c8-10f7-49cd-9bb5-eadc062b33e6", "tag": "3b8846fa-a651-4ef6-a8a4-6bb4b28cc05b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:42.734328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fbdcabeb-e262-456b-9b9e-dedffc3e0c22 req-0c403f97-25c7-41c4-98b4-7c911fd6f512 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:42.735585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fbdcabeb-e262-456b-9b9e-dedffc3e0c22 req-0c403f97-25c7-41c4-98b4-7c911fd6f512 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:42.739149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fbdcabeb-e262-456b-9b9e-dedffc3e0c22 req-0c403f97-25c7-41c4-98b4-7c911fd6f512 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:42.756568 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-fbdcabeb-e262-456b-9b9e-dedffc3e0c22 req-0c403f97-25c7-41c4-98b4-7c911fd6f512 service nova] Creating event network-changed:3b8846fa-a651-4ef6-a8a4-6bb4b28cc05b for instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 on nch2-master-1 Aug 06 21:15:42.761663 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-fbdcabeb-e262-456b-9b9e-dedffc3e0c22 req-0c403f97-25c7-41c4-98b4-7c911fd6f512 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052887 Aug 06 21:15:42.762924 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2224/4615] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:42.771909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-70c939ab-1f38-4644-bb52-82f6b60a5f14 req-5b8bb0f0-b008-4c9b-8fe2-6484fdaaa7ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "055adb26-af45-4bb0-9f79-7eba67aa0fb8", "tag": "f6e6506f-eb32-403c-9cbf-f685723261e1"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:42.790291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-70c939ab-1f38-4644-bb52-82f6b60a5f14 req-5b8bb0f0-b008-4c9b-8fe2-6484fdaaa7ae service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:42.790898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-70c939ab-1f38-4644-bb52-82f6b60a5f14 req-5b8bb0f0-b008-4c9b-8fe2-6484fdaaa7ae service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:42.791323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-70c939ab-1f38-4644-bb52-82f6b60a5f14 req-5b8bb0f0-b008-4c9b-8fe2-6484fdaaa7ae service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:42.809386 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-70c939ab-1f38-4644-bb52-82f6b60a5f14 req-5b8bb0f0-b008-4c9b-8fe2-6484fdaaa7ae service nova] Creating event network-changed:f6e6506f-eb32-403c-9cbf-f685723261e1 for instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 on nch1-master-1 Aug 06 21:15:42.816526 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-70c939ab-1f38-4644-bb52-82f6b60a5f14 req-5b8bb0f0-b008-4c9b-8fe2-6484fdaaa7ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051776 Aug 06 21:15:42.817024 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2225/4616] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:42.822169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:42.822912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:42.835453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:42.835965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:42.836406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:42.837793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:42.838358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:42.838997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:42.998098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:43.010985 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b1a9d937-05c3-4c64-84ce-bbbc225c8413 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.894663 Aug 06 21:15:43.012645 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2392/4617] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:42 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:43.031158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d647a2cf-87b3-4d57-8b23-724f2fff682e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:43.034208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d647a2cf-87b3-4d57-8b23-724f2fff682e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:43.043769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d647a2cf-87b3-4d57-8b23-724f2fff682e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:43.044563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d647a2cf-87b3-4d57-8b23-724f2fff682e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:43.045211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d647a2cf-87b3-4d57-8b23-724f2fff682e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:43.046138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d647a2cf-87b3-4d57-8b23-724f2fff682e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:43.046841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d647a2cf-87b3-4d57-8b23-724f2fff682e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:43.047730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d647a2cf-87b3-4d57-8b23-724f2fff682e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:43.193325 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d647a2cf-87b3-4d57-8b23-724f2fff682e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.172647 Aug 06 21:15:43.194615 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2393/4618] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:15:43 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:15:43.223415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:43.229859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:43.238857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:43.239695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:43.240246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:43.241091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:43.241747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:43.242281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:43.364283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:43.377127 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2136e28b-6a6d-4eb7-a34e-7c3007978d86 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 0.558783 Aug 06 21:15:43.378080 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2226/4619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:42 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:43.385335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:43.386212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:43.394203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:43.396234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:43.396941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:43.397918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:43.398663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:43.399526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:43.743373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:43.816368 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3bffda3b-3d6b-4702-aabb-1a55ba1cf5ea tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1314 microversion: 2.1 time: 0.620269 Aug 06 21:15:43.816973 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2394/4620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:43 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:43.924658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:43.932648 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c68a23e3-d166-4047-8bf4-88de33a39161 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1672 microversion: 2.1 time: 0.553250 Aug 06 21:15:43.933551 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2227/4621] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:43 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1672 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:44.034179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:44.035093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:44.043233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:44.043993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:44.044604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:44.045504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:44.046132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:44.046752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:44.376236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:44.385726 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab21a9e0-b72f-42e6-9588-b6cdca4bf8f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.356096 Aug 06 21:15:44.386480 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2395/4622] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:44 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:44.397931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:44.398591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:44.405476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:44.406961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:44.407809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:44.408729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:44.409452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:44.409891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:44.430821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:44.857847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:44.861387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:44.874809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:44.877027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:44.877881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:44.879121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:44.880285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:44.880916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:44.970719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:44.989644 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b5ad67c-38fb-4dc7-a946-fd7ce05d38d8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 0.591030 Aug 06 21:15:44.991118 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2228/4623] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:44 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:44.997069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:44.998569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:45.007452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:45.008196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:45.008790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:45.009532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:45.009993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:45.010422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:45.944343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:45.978119 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-535ec5a0-0d60-4ea2-ad61-e23b85d36b00 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1672 microversion: 2.1 time: 0.985516 Aug 06 21:15:45.979879 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2229/4624] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:44 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1672 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:45.992314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:45.993347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:46.017242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:46.018219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:46.019150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:46.020545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:46.021435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:46.022475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:46.074706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:46.281996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:46.298364 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e13c0949-717f-48e1-9234-b84412f9fc81 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1314 microversion: 2.1 time: 1.443426 Aug 06 21:15:46.314265 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2396/4625] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:44 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1314 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:46.349820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:46.350900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:46.361037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:46.385088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:46.390044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:46.393332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:46.395405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:46.399944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:46.401882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:46.899777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:46.927087 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-359ba8ba-4c00-4a8a-8003-83b346eade85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 0.609790 Aug 06 21:15:46.941458 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2397/4626] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:46 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:46.946607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-89ee288c-cde3-4995-af06-0e3df9749391 req-3bec13f5-22e3-43ce-84dd-45f8525eaed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f4667c-3b67-49b3-b70d-3c6a1864b45c", "tag": "cd5731a2-b1fc-49ff-96d6-c1f71292cdad"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:46.983405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-89ee288c-cde3-4995-af06-0e3df9749391 req-3bec13f5-22e3-43ce-84dd-45f8525eaed2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:46.983904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-89ee288c-cde3-4995-af06-0e3df9749391 req-3bec13f5-22e3-43ce-84dd-45f8525eaed2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:46.984344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-89ee288c-cde3-4995-af06-0e3df9749391 req-3bec13f5-22e3-43ce-84dd-45f8525eaed2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:47.063340 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-89ee288c-cde3-4995-af06-0e3df9749391 req-3bec13f5-22e3-43ce-84dd-45f8525eaed2 service nova] Creating event network-changed:cd5731a2-b1fc-49ff-96d6-c1f71292cdad for instance 22f4667c-3b67-49b3-b70d-3c6a1864b45c on nch1-master-1 Aug 06 21:15:47.091828 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-89ee288c-cde3-4995-af06-0e3df9749391 req-3bec13f5-22e3-43ce-84dd-45f8525eaed2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148922 Aug 06 21:15:47.098742 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2398/4627] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:47.121966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:47.123400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:47.148049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:47.149562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:47.150188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:47.151284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:47.152126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:47.152730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:47.700156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:47.767208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=12 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:48.102948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:48.134918 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-29eb4c25-d582-4d8f-ad92-8e3b295993bd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 1.032540 Aug 06 21:15:48.135762 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2399/4628] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:47 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:48.153105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:48.154205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:48.165558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:48.170776 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36d464f9-c2ed-4701-a089-afd5a1a2657b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 2.189296 Aug 06 21:15:48.179695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:48.179695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:48.179695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:48.179695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:48.179695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:48.179695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:48.189483 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2230/4629] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:45 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:48.195789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:48.196639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:48.203398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:48.204313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:48.204930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:48.205822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:48.206446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:48.207084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:48.694942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:48.710341 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a18840d-a8ae-45a0-b378-ff1b240d83e3 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 0.515635 Aug 06 21:15:48.711909 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2231/4630] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:48 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:48.728193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c26130f6-92b9-4a67-823e-e3e14e4b359f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:48.733902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c26130f6-92b9-4a67-823e-e3e14e4b359f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:48.745161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c26130f6-92b9-4a67-823e-e3e14e4b359f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:48.746229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c26130f6-92b9-4a67-823e-e3e14e4b359f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:48.747168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c26130f6-92b9-4a67-823e-e3e14e4b359f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:48.748973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c26130f6-92b9-4a67-823e-e3e14e4b359f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:48.750727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c26130f6-92b9-4a67-823e-e3e14e4b359f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:48.751564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c26130f6-92b9-4a67-823e-e3e14e4b359f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:48.880523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:48.915992 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8cac3c8d-7966-43c1-b906-81de39e56365 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1314 microversion: 2.1 time: 0.772992 Aug 06 21:15:48.921384 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2400/4631] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:48 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:48.945952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-50636ec3-c9f1-4b23-b60e-752bf6616240 req-2ee046cf-72d9-4eef-9b65-494cccc20f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459d01c8-10f7-49cd-9bb5-eadc062b33e6", "name": "network-vif-plugged", "status": "completed", "tag": "3b8846fa-a651-4ef6-a8a4-6bb4b28cc05b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:48.973100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-50636ec3-c9f1-4b23-b60e-752bf6616240 req-2ee046cf-72d9-4eef-9b65-494cccc20f33 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:48.976314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-50636ec3-c9f1-4b23-b60e-752bf6616240 req-2ee046cf-72d9-4eef-9b65-494cccc20f33 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:48.977116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-50636ec3-c9f1-4b23-b60e-752bf6616240 req-2ee046cf-72d9-4eef-9b65-494cccc20f33 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:49.001393 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-50636ec3-c9f1-4b23-b60e-752bf6616240 req-2ee046cf-72d9-4eef-9b65-494cccc20f33 service nova] Creating event network-vif-plugged:3b8846fa-a651-4ef6-a8a4-6bb4b28cc05b for instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 on nch2-master-1 Aug 06 21:15:49.009748 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-50636ec3-c9f1-4b23-b60e-752bf6616240 req-2ee046cf-72d9-4eef-9b65-494cccc20f33 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085752 Aug 06 21:15:49.011454 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2401/4632] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:49.090899 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c26130f6-92b9-4a67-823e-e3e14e4b359f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 200 len: 322 microversion: 2.1 time: 0.375478 Aug 06 21:15:49.091560 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2232/4633] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:15:48 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:49.104153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:49.106382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:49.124697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:49.130672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:49.132323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:49.134597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:49.136680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:49.139292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:49.211324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:49.212080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:49.226017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:49.226831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:49.227464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:49.228344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:49.228963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:49.229549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:49.570469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:49.586437 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f9be357-e537-48dc-9ae3-1ed336efa508 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.486593 Aug 06 21:15:49.587270 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2402/4634] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:49 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:49.621810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:49.622075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:49.636323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:49.638614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:49.639446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:49.641977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:49.645011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:49.645689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:49.877116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:49.895728 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-22411691-c66e-46ee-a70d-ba52281ba76e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.696871 Aug 06 21:15:49.897458 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2233/4635] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:49 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:49.919963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:49.920990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:49.963025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:49.963968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:49.972844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:49.974077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:49.981741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:49.994056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:50.286631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:50.294534 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9e592980-0ea9-4e15-8fcf-6fe58884c43f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.677216 Aug 06 21:15:50.298234 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2403/4636] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:49 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:50.304373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:50.305193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:50.312015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:50.313239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:50.327333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:50.329072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:50.329714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:50.330309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:50.805850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:50.807040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:50.818951 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a60c588d-715a-4898-aad6-ec0118f5cfab tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1314 microversion: 2.1 time: 0.519325 Aug 06 21:15:50.819559 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2404/4637] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:50 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:50.820892 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4fb54ea5-e673-447c-85dc-4ddeb0676e15 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 0.920753 Aug 06 21:15:50.836128 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2234/4638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:49 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:50.845497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:50.846209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:50.856265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:50.856772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:50.857214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:50.857934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:50.858393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:50.858869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:50.924320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:50.925483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:50.940840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:50.941339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:50.941787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:50.946782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:50.947593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:50.948219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:51.257230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:51.261883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:51.266593 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3db4c3ab-b671-4a96-b88f-50cbdf752b06 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.434544 Aug 06 21:15:51.267696 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2405/4639] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:50 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:51.277614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:51.287352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:51.288778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:51.294869 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6b7bbe9e-2ecd-4f6d-96cb-add8f7eaffc1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.376135 Aug 06 21:15:51.295962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:51.296527 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2235/4640] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:50 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:51.297549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:51.298273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:51.299618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:51.300074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:51.301039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:51.598534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:51.607572 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd043810-3ef1-4ce3-ac76-3d5a4aded219 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.324439 Aug 06 21:15:51.608155 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2406/4641] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:51 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:51.764966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1142903269", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c08e52fc-aab5-48dd-94e2-7ca909bf5d7b"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:51.844056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:51.845373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:51.846521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] validate_networks() for [('c08e52fc-aab5-48dd-94e2-7ca909bf5d7b', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:15:51.856041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:51.856852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:51.857533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:51.858613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:51.859347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:51.860378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:52.380894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:52.392265 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-00eb44ac-6b65-411a-9515-08bbe627071f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1499 microversion: 2.1 time: 0.554928 Aug 06 21:15:52.392964 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2407/4642] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:51 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1499 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:52.398114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:52.399056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:52.405702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:52.406841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:52.407673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:52.429959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:52.430897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:52.433580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:52.852588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:52.902420 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-10625881-1831-48fb-aef8-0225121de681 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 0.480296 Aug 06 21:15:52.916659 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2408/4643] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:52 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:52.924909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:52.928046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:52.943607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:52.946175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:52.946947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:52.947918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:52.950304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:52.951054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:53.324612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:53.343285 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b5a1424e-31ec-4bcf-bf63-8b477729be76 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.423876 Aug 06 21:15:53.359696 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2409/4644] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:52 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:53.770231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c9f81c7e-c150-476d-9b44-b9597404e583 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:53.771253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c9f81c7e-c150-476d-9b44-b9597404e583 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:53.788778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f81c7e-c150-476d-9b44-b9597404e583 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:53.790125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f81c7e-c150-476d-9b44-b9597404e583 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:53.792312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f81c7e-c150-476d-9b44-b9597404e583 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:53.798406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f81c7e-c150-476d-9b44-b9597404e583 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:53.800405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f81c7e-c150-476d-9b44-b9597404e583 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:53.802229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f81c7e-c150-476d-9b44-b9597404e583 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:53.876281 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c9f81c7e-c150-476d-9b44-b9597404e583 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/ips" status: 200 len: 151 microversion: 2.1 time: 0.514068 Aug 06 21:15:53.877061 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2410/4645] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:15:53 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/ips => generated 151 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:53.908342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:53.909271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:53.916326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:53.917209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:53.918026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:53.919083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:53.919715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:53.920313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:53.974854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:15:54.184862 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-15c46902-998f-4ef3-9908-29f72a033788 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "DELETE /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 204 len: 0 microversion: 2.1 time: 0.306672 Aug 06 21:15:54.185476 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2411/4646] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:15:53 2022] DELETE /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:15:54.197461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:54.200156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:54.222835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:54.223901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:54.227654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:54.228792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:54.234976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:54.235998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:54.403976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:15:54.405473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:15:54.406776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:15:54.407615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:15:54.409712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:15:54.415134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:54.434330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:54.435263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:54.435953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:54.439287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:54.440036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:54.442847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:54.510947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:15:54.528944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for user 9b8463a42f2642aaba586380391de6fd and project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:15:54.565242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:15:54.570796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:15:54.647971 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c04805bf-155b-4361-bc36-7f6fb027e4fa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.886279 Aug 06 21:15:54.654106 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2236/4647] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:15:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:15:54.654913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:54.656094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:54.664693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:54.666224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:54.666959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:54.669126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:54.675441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:54.677084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:54.759014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:54.775014 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-db51e21e-986c-4f5c-9ab8-b6b01ae81164 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 0.587949 Aug 06 21:15:54.775714 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2412/4648] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:54 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:54.793712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:54.794650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:54.814079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:54.814865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:54.822366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:54.823351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:54.824143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:54.824936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:55.066072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:55.076613 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92626578-46d8-467a-8f0f-7365a61dbb47 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.299916 Aug 06 21:15:55.077225 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2413/4649] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:54 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:55.085437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-952d4e8e-f250-41c3-9dbd-ea807eb55776 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:55.088944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-952d4e8e-f250-41c3-9dbd-ea807eb55776 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:55.266329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-952d4e8e-f250-41c3-9dbd-ea807eb55776 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:55.281873 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-952d4e8e-f250-41c3-9dbd-ea807eb55776 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1215 microversion: 2.1 time: 0.203159 Aug 06 21:15:55.285886 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2414/4650] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:55 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:55.729911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f0868e9-efe4-443a-9f7a-d54aa132983f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5bfb584-14c9-43da-b272-f3971601f570"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:55.732558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f0868e9-efe4-443a-9f7a-d54aa132983f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:55.749021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f0868e9-efe4-443a-9f7a-d54aa132983f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:55.754770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f0868e9-efe4-443a-9f7a-d54aa132983f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:55.755599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f0868e9-efe4-443a-9f7a-d54aa132983f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:55.761410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f0868e9-efe4-443a-9f7a-d54aa132983f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:55.768925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f0868e9-efe4-443a-9f7a-d54aa132983f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:55.769871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f0868e9-efe4-443a-9f7a-d54aa132983f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:55.932666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:55.944411 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-49195dcc-72a9-479d-bb16-e2a88f83c990 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1505 microversion: 2.1 time: 1.294277 Aug 06 21:15:55.950088 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2237/4651] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:54 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1505 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:55.957933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:55.964812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:55.982137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:55.983074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:55.983715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:55.987067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:55.987968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:55.989241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:56.356906 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f0868e9-efe4-443a-9f7a-d54aa132983f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "POST /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631175 Aug 06 21:15:56.372833 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2415/4652] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:15:55 2022] POST /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-volume_attachments => generated 194 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:15:56.378595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:56.384143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:56.398498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:56.400993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:56.401672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:56.404894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:56.406763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:56.407601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:57.016699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:57.029306 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-34048a1e-d02e-41ce-a48a-39e4f2ac0483 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.661287 Aug 06 21:15:57.046601 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2416/4653] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:56 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:57.046601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:57.046601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:57.061072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:57.067884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:57.068600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:57.069775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:57.070758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:57.071485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:57.150796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:57.166504 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9fb0613b-bea5-483f-92c6-5c16d1aaf18e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 1.214427 Aug 06 21:15:57.175456 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2238/4654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:55 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:57.186217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e67746e1-3a88-4a29-995c-041e361448f6 req-04bc024a-407c-442d-96ef-bbb2bb43d569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f4667c-3b67-49b3-b70d-3c6a1864b45c", "name": "network-vif-plugged", "status": "completed", "tag": "cd5731a2-b1fc-49ff-96d6-c1f71292cdad"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:57.199675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e67746e1-3a88-4a29-995c-041e361448f6 req-04bc024a-407c-442d-96ef-bbb2bb43d569 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:57.200099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e67746e1-3a88-4a29-995c-041e361448f6 req-04bc024a-407c-442d-96ef-bbb2bb43d569 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:57.200615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e67746e1-3a88-4a29-995c-041e361448f6 req-04bc024a-407c-442d-96ef-bbb2bb43d569 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:57.219159 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e67746e1-3a88-4a29-995c-041e361448f6 req-04bc024a-407c-442d-96ef-bbb2bb43d569 service nova] Creating event network-vif-plugged:cd5731a2-b1fc-49ff-96d6-c1f71292cdad for instance 22f4667c-3b67-49b3-b70d-3c6a1864b45c on nch1-master-1 Aug 06 21:15:57.225744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e67746e1-3a88-4a29-995c-041e361448f6 req-04bc024a-407c-442d-96ef-bbb2bb43d569 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047994 Aug 06 21:15:57.227143 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2239/4655] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:57.236523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:57.237655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:57.247977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:57.249210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:57.249937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:57.251099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:57.251792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:57.253992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:57.564796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:57.584653 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9818af34-98aa-4c32-a569-7ba6bbe84fac tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1273 microversion: 2.1 time: 0.549337 Aug 06 21:15:57.585303 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2417/4656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:57 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1273 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:58.061144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:58.062740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:58.071683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:58.072373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:58.073035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:58.073982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:58.074966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:58.075700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:58.116244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:58.129265 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7c90181-bce1-49bc-b783-46ea3d3d5a7a tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1505 microversion: 2.1 time: 0.898878 Aug 06 21:15:58.129897 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2240/4657] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:57 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1505 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:58.196682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:58.198499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:58.208304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:58.208906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:58.209455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:58.210241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:58.210837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:58.211414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:58.373362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:58.382423 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca15d169-daff-4f19-9230-4aa335f7c393 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.326233 Aug 06 21:15:58.383441 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2418/4658] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:58 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:58.605543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:58.608627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:58.617366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:58.618172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:58.618961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:58.620041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:58.620661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:58.621259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:58.653697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:58.663295 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f266377-3f9b-4e9d-abd7-0ae69bdfba09 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 0.471488 Aug 06 21:15:58.663902 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2241/4659] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:58 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:58.683800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-28585568-9ae4-46f1-b7c5-656a19e3020b req-b8c0787e-30c7-467f-8580-36a8f1e7936a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459d01c8-10f7-49cd-9bb5-eadc062b33e6", "name": "network-vif-deleted", "tag": "3b8846fa-a651-4ef6-a8a4-6bb4b28cc05b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:15:58.705210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-28585568-9ae4-46f1-b7c5-656a19e3020b req-b8c0787e-30c7-467f-8580-36a8f1e7936a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:58.706536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-28585568-9ae4-46f1-b7c5-656a19e3020b req-b8c0787e-30c7-467f-8580-36a8f1e7936a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:58.707832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-28585568-9ae4-46f1-b7c5-656a19e3020b req-b8c0787e-30c7-467f-8580-36a8f1e7936a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:58.750975 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-28585568-9ae4-46f1-b7c5-656a19e3020b req-b8c0787e-30c7-467f-8580-36a8f1e7936a service nova] Creating event network-vif-deleted:3b8846fa-a651-4ef6-a8a4-6bb4b28cc05b for instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 on nch2-master-1 Aug 06 21:15:58.757973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-28585568-9ae4-46f1-b7c5-656a19e3020b req-b8c0787e-30c7-467f-8580-36a8f1e7936a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091625 Aug 06 21:15:58.759102 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2242/4660] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:15:58.775458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:58.786538 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08ba0e3f-ccf2-4d1c-b971-93f5bef6ac71 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1273 microversion: 2.1 time: 0.184960 Aug 06 21:15:58.787153 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2419/4661] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:58 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:59.152838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:59.153957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:59.185100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:59.186367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:59.187212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:59.188944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:59.189924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:59.190536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:59.302409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:59.303524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:59.303983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:59.304459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lazy-loading 'fault' on Instance uuid 459d01c8-10f7-49cd-9bb5-eadc062b33e6 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:15:59.406155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:59.407371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:59.420678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:59.422033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:59.423499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:59.423971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:59.424727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:59.425196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:59.425901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:59.444090 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b331362-af0c-4c39-b20f-68ab542b5c2f tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 200 len: 1304 microversion: 2.1 time: 0.295122 Aug 06 21:15:59.445337 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2243/4662] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:59 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 1304 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:15:59.688349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:59.688915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:59.695039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:59.695529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:59.695969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:59.696673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:59.697182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:59.697555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:59.857764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:59.862058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:15:59.877394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:15:59.886344 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4d617e51-0674-4e52-a23e-2f6a21739c7e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1313 microversion: 2.1 time: 0.205380 Aug 06 21:15:59.886947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-827c4a38-f082-4b53-9c22-64a28052968e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.485314 Aug 06 21:15:59.899272 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2244/4663] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:59 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:15:59.906916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:15:59.907710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:15:59.914492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:59.915206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:59.915816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:59.916699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:15:59.917313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:15:59.917913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:15:59.919572 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2420/4664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:59 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:00.343722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:00.349488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0afce4f0-a689-4525-b14e-b4ebe2d00fe8 req-d5543b9c-6a4c-4789-99e2-f12989f5805a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade0065c-362a-4494-9132-39a8c1acbb47", "tag": "a59da8c6-0e1b-4bc8-a3d3-940d4cb2cce8"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:00.354933 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb75e997-49e4-4b1f-a1e6-933d17431996 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1315 microversion: 2.1 time: 0.454185 Aug 06 21:16:00.355761 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2245/4665] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:15:59 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:00.367251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0afce4f0-a689-4525-b14e-b4ebe2d00fe8 req-d5543b9c-6a4c-4789-99e2-f12989f5805a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:00.367760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0afce4f0-a689-4525-b14e-b4ebe2d00fe8 req-d5543b9c-6a4c-4789-99e2-f12989f5805a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:00.369244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0afce4f0-a689-4525-b14e-b4ebe2d00fe8 req-d5543b9c-6a4c-4789-99e2-f12989f5805a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:00.388020 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0afce4f0-a689-4525-b14e-b4ebe2d00fe8 req-d5543b9c-6a4c-4789-99e2-f12989f5805a service nova] Creating event network-changed:a59da8c6-0e1b-4bc8-a3d3-940d4cb2cce8 for instance ade0065c-362a-4494-9132-39a8c1acbb47 on nch2-master-1 Aug 06 21:16:00.393860 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0afce4f0-a689-4525-b14e-b4ebe2d00fe8 req-d5543b9c-6a4c-4789-99e2-f12989f5805a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049150 Aug 06 21:16:00.394474 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2421/4666] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:00.466915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:00.467544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 459d01c8-10f7-49cd-9bb5-eadc062b33e6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:00.480482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:00.480988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:00.481435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:00.482160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:00.482652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:00.483090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:00.512382 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] HTTP exception thrown: Instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 could not be found. Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Request method failure captured: Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 HTTP/1.1 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tny-Kbq4Fu4q9EeKN3EtV1dRMNSVwE4dchhVYwzDMzQwf-UDSk-SzIskwIOCJnBXz3XLPwDUdocQM1mSrY7ig2YTi3B3mkqP4IxfSuTadopEU6cg8Gvi3KtRH3XPNeHxBVV65Ds1FyPzCuc2rq7qO5g8d9VqOJ5kyUVjslO54rjfDM Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 15407d6e47c34f588e162af6a190fd99 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesActionsTest-686134703 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/15407d6e47c34f588e162af6a190fd99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_15407d6e47c34f588e162af6a190fd99", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15407d6e47c34f588e162af6a190fd99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15407d6e47c34f588e162af6a190fd99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesActionsTest-686134703 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 15407d6e47c34f588e162af6a190fd99 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesActionsTest-686134703 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesActionsTest-686134703-project Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: c9a290f680dc4b5bbec2010d82ed7e27 Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesActionsTest-686134703-project Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 could not be found. Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '459d01c8-10f7-49cd-9bb5-eadc062b33e6'} Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 could not be found. Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 could not be found. Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:00.516341 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:00.521835 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:00.521835 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:00.521835 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:00.521835 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:00.521835 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:00.521835 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 could not be found. Aug 06 21:16:00.521835 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:00.524491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Returning 404 to user: Instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:00.528404 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d368378-5650-4a5e-a3ac-378b3342d706 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6" status: 404 len: 111 microversion: 2.1 time: 0.065013 Aug 06 21:16:00.539578 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2246/4667] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:00 2022] GET /compute/v2.1/servers/459d01c8-10f7-49cd-9bb5-eadc062b33e6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:00.676969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-336100198", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "18083762-3e6b-4178-981c-7204fa68e3c9"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:00.748111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] validate_networks() for [('18083762-3e6b-4178-981c-7204fa68e3c9', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:16:00.912816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:00.913985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:00.927116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:00.927845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:00.928452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:00.932911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:00.934315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:00.935523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.279860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:01.283195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:01.291252 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c9422c51-5734-4007-8339-0a3bf5436f85 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1498 microversion: 2.1 time: 0.382988 Aug 06 21:16:01.292502 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2247/4668] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:00 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1498 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:01.294172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:16:01.294652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:16:01.295260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:16:01.296178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:16:01.296733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:16:01.298844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:01.299718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:01.306476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.307462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.308333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.309187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.309760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.310449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.313266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.313950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.314603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.315990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.316466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.317787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.344418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Getting quotas for project 15407d6e47c34f588e162af6a190fd99. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:16:01.351560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Getting quotas for user c9a290f680dc4b5bbec2010d82ed7e27 and project 15407d6e47c34f588e162af6a190fd99. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:16:01.366687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:16:01.369098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:16:01.421519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-560ff3c4-685a-43d2-8780-775f0b8a949e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750601 Aug 06 21:16:01.422188 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2422/4669] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:16:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:16:01.432820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:01.433483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:01.444090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.445513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.446596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.446820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.447697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.448285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.574775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lazy-loading 'services' on Instance uuid ab005513-d0f6-45c7-8bb8-17eee78e7056 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:16:01.599290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:01.614160 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f9b64bb4-59cb-492a-803d-ef13f2562140 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.320245 Aug 06 21:16:01.615421 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2248/4670] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:01 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:01.631648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:01.646676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:01.655265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.656937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.657927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.659495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.660378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.661292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.702757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lazy-loading 'flavor' on Instance uuid 22f4667c-3b67-49b3-b70d-3c6a1864b45c {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:16:01.708989 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-760133e1-87af-44db-b0bb-8f545ac01142 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-volume_attachments/b5bfb584-14c9-43da-b272-f3971601f570" status: 202 len: 0 microversion: 2.1 time: 0.282359 Aug 06 21:16:01.708989 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2423/4671] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Aug 6 21:16:01 2022] DELETE /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-volume_attachments/b5bfb584-14c9-43da-b272-f3971601f570 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:16:01.716545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:01.717410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:01.725227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.726053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.726736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.728648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:01.729804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:01.730467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:01.922578 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2049ca62-6f4e-4a0d-8f8b-42f9fc88d4cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "POST /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c/action" status: 200 len: 32 microversion: 2.1 time: 0.305331 Aug 06 21:16:01.927762 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2249/4672] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:01 2022] POST /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c/action => generated 32 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:16:01.929923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-035e333b-6236-4c17-9365-9221da574c74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:01.930944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-035e333b-6236-4c17-9365-9221da574c74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:02.044256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-035e333b-6236-4c17-9365-9221da574c74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:02.055471 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-035e333b-6236-4c17-9365-9221da574c74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1213 microversion: 2.1 time: 0.130806 Aug 06 21:16:02.056934 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2250/4673] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:01 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1213 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:02.063128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2c30ac37-1fff-49fc-8088-319c0e6e066e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:02.066002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2c30ac37-1fff-49fc-8088-319c0e6e066e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:02.075608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c30ac37-1fff-49fc-8088-319c0e6e066e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:02.076312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c30ac37-1fff-49fc-8088-319c0e6e066e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:02.076921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c30ac37-1fff-49fc-8088-319c0e6e066e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:02.078633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c30ac37-1fff-49fc-8088-319c0e6e066e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:02.079577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c30ac37-1fff-49fc-8088-319c0e6e066e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:02.080416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c30ac37-1fff-49fc-8088-319c0e6e066e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:02.167969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:02.169099 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2c30ac37-1fff-49fc-8088-319c0e6e066e tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110705 Aug 06 21:16:02.175982 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2251/4674] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:16:02 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:02.178447 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f265f3fd-3b5d-479c-9b80-7344de15083a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1315 microversion: 2.1 time: 0.470105 Aug 06 21:16:02.185040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:02.186486 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2424/4675] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:01 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:02.186753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:02.195540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:02.196245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:02.196543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:02.197322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:02.197791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:02.198230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:02.340363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3cd271dc-05b7-468c-b515-1a6bede619d3 req-729807f9-7126-4c53-8d00-94d2be17d2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055adb26-af45-4bb0-9f79-7eba67aa0fb8", "name": "network-vif-plugged", "status": "completed", "tag": "f6e6506f-eb32-403c-9cbf-f685723261e1"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:02.360173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3cd271dc-05b7-468c-b515-1a6bede619d3 req-729807f9-7126-4c53-8d00-94d2be17d2c3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:02.363021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3cd271dc-05b7-468c-b515-1a6bede619d3 req-729807f9-7126-4c53-8d00-94d2be17d2c3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:02.363520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3cd271dc-05b7-468c-b515-1a6bede619d3 req-729807f9-7126-4c53-8d00-94d2be17d2c3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:02.387810 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3cd271dc-05b7-468c-b515-1a6bede619d3 req-729807f9-7126-4c53-8d00-94d2be17d2c3 service nova] Creating event network-vif-plugged:f6e6506f-eb32-403c-9cbf-f685723261e1 for instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 on nch1-master-1 Aug 06 21:16:02.401995 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3cd271dc-05b7-468c-b515-1a6bede619d3 req-729807f9-7126-4c53-8d00-94d2be17d2c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065507 Aug 06 21:16:02.406140 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2425/4676] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:16:02.583564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:02.599545 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-34c57247-9285-4f27-9a3b-90da4cd819c6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.420174 Aug 06 21:16:02.601241 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2252/4677] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:02 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:02.639143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:02.642301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:02.650798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:02.651326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:02.651834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:02.652716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:02.653179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:02.653602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.013400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:03.027991 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-64e2aeb3-b6a1-4cd7-9bbe-f6a10666093f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.394181 Aug 06 21:16:03.045807 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2426/4678] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:02 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:03.076423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:03.077042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:03.085276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.085777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.086229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.087799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.089355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.090259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.182978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-265dc6bd-dac7-4273-b9a9-6456ae7f880b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:03.185821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-265dc6bd-dac7-4273-b9a9-6456ae7f880b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:03.192852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-265dc6bd-dac7-4273-b9a9-6456ae7f880b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.193895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-265dc6bd-dac7-4273-b9a9-6456ae7f880b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.195593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-265dc6bd-dac7-4273-b9a9-6456ae7f880b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.196557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-265dc6bd-dac7-4273-b9a9-6456ae7f880b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.197477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-265dc6bd-dac7-4273-b9a9-6456ae7f880b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.201476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:03.207523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-265dc6bd-dac7-4273-b9a9-6456ae7f880b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.216637 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d56455dd-4084-4d42-a1c2-2e88558d1315 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1271 microversion: 2.1 time: 0.142333 Aug 06 21:16:03.219868 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2253/4679] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:03 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:03.239354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:03.240361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:03.247839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.248670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.249369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.250299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.250997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.251660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.255704 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-265dc6bd-dac7-4273-b9a9-6456ae7f880b tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077801 Aug 06 21:16:03.256983 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2427/4680] 10.222.0.33 () {58 vars in 1302 bytes} [Sat Aug 6 21:16:03 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:16:03.339593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:03.340507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:03.348628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.349138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.349588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.350379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.350874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.351310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.379605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:16:03.550222 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8a715086-9451-4edc-9234-81d27c602bdf tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 204 len: 0 microversion: 2.1 time: 0.214345 Aug 06 21:16:03.551913 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2428/4681] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:03 2022] DELETE /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:16:03.573009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:03.576842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:03.592718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.597595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.598252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.599344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.603597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.604309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.621963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:03.635951 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1279e085-9323-4ef9-9216-15c75dfe2c1d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1315 microversion: 2.1 time: 0.400249 Aug 06 21:16:03.637111 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2254/4682] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:03 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:03.658473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:03.659490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:03.676903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.677415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.677862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:03.679190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:03.679658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:03.680208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:04.049030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:04.058658 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4edecdc7-e422-4101-b7c1-37d52dd1e3ed tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.419938 Aug 06 21:16:04.059418 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2255/4683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:03 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:04.065709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:04.066628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:04.074233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:04.074965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:04.075475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:04.076261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:04.076798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:04.077988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:04.207638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:04.220183 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-911cb9ca-71d5-4177-821b-7cbb95e54a61 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1683 microversion: 2.1 time: 0.661224 Aug 06 21:16:04.221247 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2429/4684] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:03 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1683 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:04.242212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:04.242891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:04.254013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:04.254532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:04.255002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:04.255718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:04.256182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:04.256614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:04.361580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:04.363292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:04.372237 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1e242d8c-4a53-4555-b4b7-40f79ea56473 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.311386 Aug 06 21:16:04.373845 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2256/4685] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:04 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:04.375837 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9df6bbba-e33c-490b-99d0-1fdb41a1f782 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1271 microversion: 2.1 time: 0.138854 Aug 06 21:16:04.376695 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2430/4686] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:04 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:04.682395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:04.683328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:04.688990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:04.702897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:04.704388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:04.706041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:04.707530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:04.708504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:04.709358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:05.083217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:05.083839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:05.106239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:05.106787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:05.107249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:05.107989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:05.108554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:05.109257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:05.495803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:05.518796 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-90217db6-1a9d-4385-953a-4c30b31cb4b5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1315 microversion: 2.1 time: 0.853435 Aug 06 21:16:05.519687 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2257/4687] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:04 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1315 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:05.526933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:05.537207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:05.562508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:05.569416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:05.570064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:05.571040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:05.571724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:05.572458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:05.741261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:05.751117 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e2136aff-7b04-46aa-8381-96c09db2a313 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.672438 Aug 06 21:16:05.767857 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2431/4688] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:05 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:05.772841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:05.773472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:05.785399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:05.785916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:05.786378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:05.787153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:05.787621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:05.788060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:05.957781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:05.967211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2fe3e1ba-85a8-4f81-96d9-10ad68a306d9 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1683 microversion: 2.1 time: 0.443649 Aug 06 21:16:05.967881 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2258/4689] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:05 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1683 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:05.975016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:05.982636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:05.995758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:05.997824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:05.998578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:06.001134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:06.006895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:06.007420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:06.270321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:06.289469 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-145e0284-6078-4ddc-ac0c-cdaefdc058b9 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1518 microversion: 2.1 time: 0.520001 Aug 06 21:16:06.290305 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2432/4690] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:05 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1518 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:06.390535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:06.403835 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-54fc4a6f-a1e3-467f-a62b-9b659dbddb74 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1313 microversion: 2.1 time: 0.433418 Aug 06 21:16:06.408665 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2259/4691] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:05 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:06.560410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:06.564967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:06.573334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:06.576046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:06.576906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:06.577987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:06.580202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:06.580904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:06.581523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:06.662344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-61c1762a-f46d-402c-92d6-38aeb62f0e7f req-0db35ffc-e66c-4a20-8ff8-dc70155cf5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade0065c-362a-4494-9132-39a8c1acbb47", "name": "network-vif-plugged", "status": "completed", "tag": "a59da8c6-0e1b-4bc8-a3d3-940d4cb2cce8"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:06.674983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-61c1762a-f46d-402c-92d6-38aeb62f0e7f req-0db35ffc-e66c-4a20-8ff8-dc70155cf5c5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:06.676686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-61c1762a-f46d-402c-92d6-38aeb62f0e7f req-0db35ffc-e66c-4a20-8ff8-dc70155cf5c5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:06.678611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-61c1762a-f46d-402c-92d6-38aeb62f0e7f req-0db35ffc-e66c-4a20-8ff8-dc70155cf5c5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:06.709897 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-61c1762a-f46d-402c-92d6-38aeb62f0e7f req-0db35ffc-e66c-4a20-8ff8-dc70155cf5c5 service nova] Creating event network-vif-plugged:a59da8c6-0e1b-4bc8-a3d3-940d4cb2cce8 for instance ade0065c-362a-4494-9132-39a8c1acbb47 on nch2-master-1 Aug 06 21:16:06.716981 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-61c1762a-f46d-402c-92d6-38aeb62f0e7f req-0db35ffc-e66c-4a20-8ff8-dc70155cf5c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060784 Aug 06 21:16:06.718250 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2260/4692] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:06.775658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:06.776735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:06.784634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:06.785413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:06.786085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:06.788031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:06.788974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:06.789808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:06.958524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:06.969459 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b2e29235-8810-442a-9428-9182d7b8fff0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1315 microversion: 2.1 time: 0.425534 Aug 06 21:16:06.985568 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2433/4693] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:06 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:06.990978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:06.992002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:07.001163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:07.002093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:07.002768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:07.003848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:07.004696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:07.006432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:07.162359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:07.176468 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2302b2b1-7e11-40a7-b185-7a78d5671199 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1615 microversion: 2.1 time: 0.189377 Aug 06 21:16:07.196934 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2434/4694] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:06 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1615 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:07.210065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e93e4add-9e4d-46db-8f63-cf94628b8c13 req-859b5922-0e6a-40ab-a047-a253e660a307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e0dd54b-c337-46f7-93dd-8b031d29e40a", "tag": "ec40edbf-5643-41b9-9f40-2182f325978d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:07.235239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e93e4add-9e4d-46db-8f63-cf94628b8c13 req-859b5922-0e6a-40ab-a047-a253e660a307 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:07.235881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e93e4add-9e4d-46db-8f63-cf94628b8c13 req-859b5922-0e6a-40ab-a047-a253e660a307 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:07.236432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e93e4add-9e4d-46db-8f63-cf94628b8c13 req-859b5922-0e6a-40ab-a047-a253e660a307 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:07.249924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:07.261670 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-929cec40-9cbd-49b4-bb5b-a9f5e0f9cc6b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.491342 Aug 06 21:16:07.283954 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2261/4695] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:06 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:07.292689 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e93e4add-9e4d-46db-8f63-cf94628b8c13 req-859b5922-0e6a-40ab-a047-a253e660a307 service nova] Creating event network-changed:ec40edbf-5643-41b9-9f40-2182f325978d for instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a on nch2-master-1 Aug 06 21:16:07.310469 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e93e4add-9e4d-46db-8f63-cf94628b8c13 req-859b5922-0e6a-40ab-a047-a253e660a307 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109362 Aug 06 21:16:07.312387 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2435/4696] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:07.319717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:07.320792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:07.337220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:07.337970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:07.338626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:07.339625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:07.340321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:07.341525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:07.430341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:07.439353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:07.449448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:07.450398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:07.452255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:07.453394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:07.454175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:07.454934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:07.665465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:07.681372 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3944ac5e-fc3b-4cfc-8fbd-b3b0eda88c9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.370000 Aug 06 21:16:07.684822 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2262/4697] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:07 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:07.712172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:07.715084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:07.730952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:07.731796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:07.732402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:07.733874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:07.735050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:07.735652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.011606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:08.026084 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-032515b0-c7eb-40f4-b8a2-a3aaed70164f tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.322211 Aug 06 21:16:08.039568 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2263/4698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:07 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:08.075272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:08.082664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:08.094781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:08.101236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.102742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.103588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.111479 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b0822ec-ad6a-4d54-98f9-3d509b193ab1 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1313 microversion: 2.1 time: 0.685633 Aug 06 21:16:08.112318 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2436/4699] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:07 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:08.124739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.124739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.124739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.130123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:08.142478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:08.152032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:08.157977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.166942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.167918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.168835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.170602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.174489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.417047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:08.428110 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-715778c6-a693-4bee-b52d-296b8df386be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1315 microversion: 2.1 time: 0.386973 Aug 06 21:16:08.429771 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2264/4700] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:08 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:08.454593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:08.455218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:08.473464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.477040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.482102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.483181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.484255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.484987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.586058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.586819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.587428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.589522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lazy-loading 'fault' on Instance uuid ab005513-d0f6-45c7-8bb8-17eee78e7056 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:16:08.660768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7b9e27983940dcaf0e92f62273c588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4980bb21b59412ca004d8069525d3b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:08.693925 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4562f3ec-28b2-4271-9c9f-258e6223c415 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 200 len: 1331 microversion: 2.1 time: 0.249062 Aug 06 21:16:08.694569 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2265/4701] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:08 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 1331 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:08.720184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:08.720820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:08.725441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:08.736343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.737130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.737712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.738342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:08.740297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.740826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.741371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.743234 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-513f0451-e415-4dad-b783-c5b71cdc5e38 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.616909 Aug 06 21:16:08.773410 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2437/4702] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:08 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:08.782946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ad8ea16-2b67-49bb-b77c-abaaff67aa8e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:08.802708 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-8ad8ea16-2b67-49bb-b77c-abaaff67aa8e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 4305c9b4-7427-4ac3-b3ba-c04b3406ba8a has no mapping to a cell. Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ad8ea16-2b67-49bb-b77c-abaaff67aa8e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/4305c9b4-7427-4ac3-b3ba-c04b3406ba8a/action HTTP/1.1 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 15 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: {"os-stop": {}} Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4305c9b4-7427-4ac3-b3ba-c04b3406ba8a has no mapping to a cell. Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4305c9b4-7427-4ac3-b3ba-c04b3406ba8a', 'body': {'os-stop': {}}} Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 4305c9b4-7427-4ac3-b3ba-c04b3406ba8a has no mapping to a cell. Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:08.826653 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4305c9b4-7427-4ac3-b3ba-c04b3406ba8a has no mapping to a cell. Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4305c9b4-7427-4ac3-b3ba-c04b3406ba8a has no mapping to a cell. Aug 06 21:16:08.832337 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:08.834021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ad8ea16-2b67-49bb-b77c-abaaff67aa8e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 4305c9b4-7427-4ac3-b3ba-c04b3406ba8a has no mapping to a cell. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:08.835098 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8ad8ea16-2b67-49bb-b77c-abaaff67aa8e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/4305c9b4-7427-4ac3-b3ba-c04b3406ba8a/action" status: 404 len: 117 microversion: 2.1 time: 0.060590 Aug 06 21:16:08.836318 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2438/4703] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:08 2022] POST /compute/v2.1/servers/4305c9b4-7427-4ac3-b3ba-c04b3406ba8a/action => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:08.847140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:08.848030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:08.867817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.868333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.868778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:08.869503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:08.869961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:08.870387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.114733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:09.125267 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9651f139-8bca-4f31-8647-5f1c5f3c6e4c tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.416408 Aug 06 21:16:09.126428 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2266/4704] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:08 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:09.144355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:09.145182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:09.152492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.153334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.153792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.154471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.158318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.158754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.178155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:09.209932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-30103236-cd53-456d-a09a-ca4fa34d9093 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.351314 Aug 06 21:16:09.213236 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2439/4705] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:08 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:09.234858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:09.235488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:09.248438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.249486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.253353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.254121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.254626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.258413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.486643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:09.507843 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0df02e6e-1516-408c-b307-68cf3770501b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1313 microversion: 2.1 time: 0.379444 Aug 06 21:16:09.521409 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2267/4706] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:09 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:09.521409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1518724e-1a77-4212-a489-8e9abe7cb32f req-2d70a279-5cc1-4e44-a5bd-8ab3c328af08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab005513-d0f6-45c7-8bb8-17eee78e7056", "name": "network-vif-deleted", "tag": "e6707ae7-d35e-43da-9a05-da3cd40b4212"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:09.524093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:09.538877 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0f6b67bf-e553-4209-ae2e-2ff82e73f763 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.307042 Aug 06 21:16:09.540970 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2440/4707] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:09 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:09.548859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1518724e-1a77-4212-a489-8e9abe7cb32f req-2d70a279-5cc1-4e44-a5bd-8ab3c328af08 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.550330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:09.551235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1518724e-1a77-4212-a489-8e9abe7cb32f req-2d70a279-5cc1-4e44-a5bd-8ab3c328af08 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.551674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1518724e-1a77-4212-a489-8e9abe7cb32f req-2d70a279-5cc1-4e44-a5bd-8ab3c328af08 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.554752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:09.571625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.572935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.573393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.574137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.574624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.575059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.584025 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1518724e-1a77-4212-a489-8e9abe7cb32f req-2d70a279-5cc1-4e44-a5bd-8ab3c328af08 service nova] Creating event network-vif-deleted:e6707ae7-d35e-43da-9a05-da3cd40b4212 for instance ab005513-d0f6-45c7-8bb8-17eee78e7056 on nch1-master-1 Aug 06 21:16:09.597301 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1518724e-1a77-4212-a489-8e9abe7cb32f req-2d70a279-5cc1-4e44-a5bd-8ab3c328af08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084398 Aug 06 21:16:09.600919 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2268/4708] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:09.630367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-294ecc8b-8f10-4143-ae30-ed9d3782e2b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:09.631208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-294ecc8b-8f10-4143-ae30-ed9d3782e2b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:09.643283 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-294ecc8b-8f10-4143-ae30-ed9d3782e2b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7 could not be found. Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-294ecc8b-8f10-4143-ae30-ed9d3782e2b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7/action HTTP/1.1 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 15 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: {"suspend": {}} Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7 could not be found. Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7', 'body': {'suspend': {}}} Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7 could not be found. Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7 could not be found. Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:09.652937 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:09.658961 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:09.658961 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:09.658961 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7 could not be found. Aug 06 21:16:09.658961 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.658961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-294ecc8b-8f10-4143-ae30-ed9d3782e2b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:09.658961 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-294ecc8b-8f10-4143-ae30-ed9d3782e2b4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7/action" status: 404 len: 111 microversion: 2.1 time: 0.052639 Aug 06 21:16:09.658961 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2269/4709] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:09 2022] POST /compute/v2.1/servers/9c0b47b6-0534-4f1a-9a00-b8d048e5f4d7/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:09.667484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:09.671626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:09.690213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.690213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.690854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.691985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.692682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.693170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.854426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:09.872335 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-79299527-fecb-4d51-8155-1be8061c6f8d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1502 microversion: 2.1 time: 0.326137 Aug 06 21:16:09.887830 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2441/4710] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:09 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1502 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:09.907046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:09.908530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:09.918838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.920171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.923394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.924174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.924650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.925083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.938621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:09.948251 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dba05d3c-6732-453a-b1be-baa551f24d2b tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.287407 Aug 06 21:16:09.956246 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 HTTP/1.1 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ab005513-d0f6-45c7-8bb8-17eee78e7056'} Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:09.958648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.962915 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:09.962915 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:09.962915 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:09.962915 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:09.962915 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:09.962915 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:09.962915 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:09.965100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:09.966261 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-de742bf1-6305-48b1-a66f-f01e01720690 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 404 len: 111 microversion: 2.1 time: 0.077333 Aug 06 21:16:09.967370 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2442/4711] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:09 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:09.968752 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2270/4712] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:09 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:09.983774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:09.984532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0c51cd7-3461-4439-bd05-227d57ff97da tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:09.984836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:09.991465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.991973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.992429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.993158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.993625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.994073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:09.994829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c51cd7-3461-4439-bd05-227d57ff97da tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:09.995536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c51cd7-3461-4439-bd05-227d57ff97da tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:09.996220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0c51cd7-3461-4439-bd05-227d57ff97da tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.059761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d0c51cd7-3461-4439-bd05-227d57ff97da tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Going to try to stop instance {{(pid=142461) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 21:16:10.116459 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d0c51cd7-3461-4439-bd05-227d57ff97da tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47/action" status: 202 len: 0 microversion: 2.1 time: 0.146906 Aug 06 21:16:10.117572 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2443/4713] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:09 2022] POST /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:16:10.124453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f983da9-fc8f-4201-ab61-bf6e9c302d92 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '.version_select at 0x7f729d956040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:10.160633 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f983da9-fc8f-4201-ab61-bf6e9c302d92 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-464483257" status: 202 len: 0 microversion: 2.1 time: 0.041504 Aug 06 21:16:10.161934 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2444/4714] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:16:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-464483257 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:16:10.173920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:10.176634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:10.187578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.189749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.190402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.191664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.192360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.193359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.429170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:10.443035 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-29da3a30-85a6-4b21-8497-74296fcbce15 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.472861 Aug 06 21:16:10.444254 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2271/4715] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:09 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:10.448152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:10.460501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:10.466771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.467556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.468191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.469073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.469690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.470305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.715574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:10.735734 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc7d33f7-bd56-4dbd-81db-e7bc5ca1e09a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.572242 Aug 06 21:16:10.737871 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2445/4716] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:10 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:10.756046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:10.756988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:10.769203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.770071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.771335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.772566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.773259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.773761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.809885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lazy-loading 'flavor' on Instance uuid 055adb26-af45-4bb0-9f79-7eba67aa0fb8 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:16:10.881196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:10.895644 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b3ce9182-bf4e-4481-bd07-c14be8197f2d tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.450852 Aug 06 21:16:10.915223 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2272/4717] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:10 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:10.928739 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e8310b32-5aab-49c1-910a-c16766a8b6dd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.189253 Aug 06 21:16:10.932559 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2446/4718] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:10 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:16:10.941990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:10.948659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:10.955238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:10.963242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:10.970078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.970810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.971457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.972809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.973522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.974362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.978251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.981995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.982503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:10.984347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:10.984842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:10.986049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:11.198223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:11.215415 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36fef32c-9305-4e74-bfbb-fa57af440b12 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1313 microversion: 2.1 time: 0.298292 Aug 06 21:16:11.216335 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2273/4719] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:10 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:11.332940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:11.359310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:11.420508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:11.435383 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-662d0f14-b9e2-4a4f-a4c0-fd414de3ef46 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1513 microversion: 2.1 time: 0.501253 Aug 06 21:16:11.439030 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2447/4720] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:10 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1513 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:11.758943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:11.759586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:11.776418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:11.779490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:11.782103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:11.784172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:11.786954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:11.787666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:11.918715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:11.920086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:11.946976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:11.956573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:11.957128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:11.958355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:11.958922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:11.959561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:12.049622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:12.214071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:12.229162 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a1b46ed8-1206-45e3-934a-fda1a6fef724 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.313614 Aug 06 21:16:12.230001 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2448/4721] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:11 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:12.243961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:12.245367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:12.252944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:12.253596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:12.254646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:12.255478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:12.256127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:12.256670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:12.449391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:12.474077 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-643484fd-1ab4-4096-9116-0cfa9c1d1fa3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1313 microversion: 2.1 time: 0.233886 Aug 06 21:16:12.474828 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2449/4722] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:12 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:12.487098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:12.488032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:12.503399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:12.503976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:12.504358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:12.505099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:12.505569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:12.506005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:12.870695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:12.888508 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d0f6efe6-532e-4762-90bf-b8c57b0aba16 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1496 microversion: 2.1 time: 0.402642 Aug 06 21:16:12.908187 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2450/4723] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:12 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1496 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:12.914843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:12.915488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:12.923190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:12.924588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:12.925277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:12.926464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:12.927133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:12.927415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:12.928289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:12.940442 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d1dcc8d-717e-4d58-868d-b1489a4bc0e9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 1.186662 Aug 06 21:16:12.942929 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2274/4724] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:11 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:12.975827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lazy-loading 'flavor' on Instance uuid 055adb26-af45-4bb0-9f79-7eba67aa0fb8 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:16:12.992081 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Cannot 'suspend' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state suspended Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action HTTP/1.1 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 15 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: {"suspend": {}} Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: exception: Cannot 'suspend' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state suspended Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8', 'body': {'suspend': {}}} Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 06 21:16:12.994214 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state suspended Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state suspended Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 409 to user: Cannot 'suspend' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state suspended {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-51dbd138-3909-4f37-a3e2-3b13c58b439c tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 409 len: 148 microversion: 2.1 time: 0.085668 Aug 06 21:16:13.003981 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2451/4725] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:12 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 148 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 06 21:16:13.005616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-195021c2-9545-4155-a3d9-de7f6b837aaf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:13.005967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-195021c2-9545-4155-a3d9-de7f6b837aaf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:13.012461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-195021c2-9545-4155-a3d9-de7f6b837aaf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.012959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-195021c2-9545-4155-a3d9-de7f6b837aaf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.013404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-195021c2-9545-4155-a3d9-de7f6b837aaf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.015421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-195021c2-9545-4155-a3d9-de7f6b837aaf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.015902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-195021c2-9545-4155-a3d9-de7f6b837aaf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.016338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-195021c2-9545-4155-a3d9-de7f6b837aaf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.122429 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-195021c2-9545-4155-a3d9-de7f6b837aaf tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.120133 Aug 06 21:16:13.122943 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2275/4726] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:13 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:16:13.146203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:13.149991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:13.171356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:13.174093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.175135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.177167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:13.179337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.180317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.184158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.184859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.196585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.197924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.198605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.215288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.215784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.219219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.258144 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 HTTP/1.1 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ab005513-d0f6-45c7-8bb8-17eee78e7056'} Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:13.260932 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.266713 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.284169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:13.286238 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6555dd31-3147-4028-a593-22421413634f tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 404 len: 111 microversion: 2.1 time: 0.125175 Aug 06 21:16:13.288824 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2276/4727] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:13 2022] DELETE /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:13.307861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:13.309178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:13.324493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:13.326613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.327828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.329088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.331414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.332079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.332724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.529185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:13.541943 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f2b4e016-f979-4deb-999e-0406e7719c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1502 microversion: 2.1 time: 0.409705 Aug 06 21:16:13.542787 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2452/4728] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:13 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:13.565372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:13.572827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: ab005513-d0f6-45c7-8bb8-17eee78e7056] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:13.583015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.585801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.586532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.587724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.588889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.589660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.613788 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 HTTP/1.1 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ab005513-d0f6-45c7-8bb8-17eee78e7056'} Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:13.616003 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance ab005513-d0f6-45c7-8bb8-17eee78e7056 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d114780b-e399-4531-8d88-e8431ae402f2 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056" status: 404 len: 111 microversion: 2.1 time: 0.062043 Aug 06 21:16:13.620059 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2453/4729] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:13 2022] GET /compute/v2.1/servers/ab005513-d0f6-45c7-8bb8-17eee78e7056 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:13.625440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:13.626269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:13.635134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.635842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.637934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:13.639858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:13.640865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:13.641483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:14.040147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:14.052717 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1038a62c-1fa8-4e13-9003-6602afd03ca2 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1313 microversion: 2.1 time: 0.432935 Aug 06 21:16:14.053751 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2454/4730] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:13 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:14.066934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:14.069418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:14.085511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:14.087642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:14.089220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:14.094801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:14.100417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:14.101120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:14.107298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:14.158866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:14.199299 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a85a44c1-8f7e-4c01-b06d-f0b2b58a9294 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.908352 Aug 06 21:16:14.223054 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2277/4731] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:13 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:14.412542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:14.421510 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22c207e9-367a-4019-b75a-1dc864d14d0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.365634 Aug 06 21:16:14.435959 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2455/4732] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:14 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:14.565381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:14.566179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:14.582187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:14.582731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:14.583178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:14.583908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:14.584358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:14.584790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:14.922125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:14.943068 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-26f8da42-6e2c-4067-86f4-b41e9df8efe1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1502 microversion: 2.1 time: 0.378044 Aug 06 21:16:14.945080 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2278/4733] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:14 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1502 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:14.971302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:14.971823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:14.979294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:14.984950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:14.987334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:14.989618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:14.991162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:14.991783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.037251 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 HTTP/1.1 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08'} Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:15.039572 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:15.043598 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8ee320ef-ad18-4d96-a9fa-832bc512b819 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 404 len: 111 microversion: 2.1 time: 0.075326 Aug 06 21:16:15.046355 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2456/4734] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:14 2022] DELETE /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:15.054257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:15.055374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:15.073058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.073641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.074659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.075416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.075893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.076390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.078725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:15.079376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:15.098156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.100690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.101323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.103551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.105774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.106411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.109536 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 HTTP/1.1 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08'} Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:15.114199 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.121148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.121148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:15.121148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:15.121148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:15.121148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:15.121148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. Aug 06 21:16:15.121148 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.121148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:15.124856 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1788798b-99d8-4c3d-929a-44cadf68c391 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08" status: 404 len: 111 microversion: 2.1 time: 0.067044 Aug 06 21:16:15.125494 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2279/4735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:15 2022] GET /compute/v2.1/servers/e859e19b-7779-4a6f-8eb1-6dc6b1ad8a08 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:15.151688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1112ec3c-f1db-41d3-ba52-b50912455162 req-13545cb0-4961-480b-a08c-d1cf6bb2b84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0dd54b-c337-46f7-93dd-8b031d29e40a", "name": "network-vif-plugged", "status": "completed", "tag": "ec40edbf-5643-41b9-9f40-2182f325978d"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:15.188163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1112ec3c-f1db-41d3-ba52-b50912455162 req-13545cb0-4961-480b-a08c-d1cf6bb2b84f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.189287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1112ec3c-f1db-41d3-ba52-b50912455162 req-13545cb0-4961-480b-a08c-d1cf6bb2b84f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.189890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1112ec3c-f1db-41d3-ba52-b50912455162 req-13545cb0-4961-480b-a08c-d1cf6bb2b84f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.204862 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1112ec3c-f1db-41d3-ba52-b50912455162 req-13545cb0-4961-480b-a08c-d1cf6bb2b84f service nova] Creating event network-vif-plugged:ec40edbf-5643-41b9-9f40-2182f325978d for instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a on nch2-master-1 Aug 06 21:16:15.212034 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1112ec3c-f1db-41d3-ba52-b50912455162 req-13545cb0-4961-480b-a08c-d1cf6bb2b84f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063755 Aug 06 21:16:15.213490 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2280/4736] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:15.219739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:15.220696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:15.245572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.246092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.246562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.247306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.247770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.251098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.288853 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac HTTP/1.1 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac'} Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:15.291138 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ade08de6-23d1-47ff-9115-8d7ed71c1edb tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 404 len: 111 microversion: 2.1 time: 0.078031 Aug 06 21:16:15.295102 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2281/4737] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:15 2022] DELETE /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:15.299085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:15.299711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:15.312016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.312530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.313360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.313698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.314167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.314628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.508448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:15.517845 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fbc3e214-85d3-4590-a3b6-c1ebdbcc126d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1313 microversion: 2.1 time: 0.445306 Aug 06 21:16:15.524181 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2457/4738] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:15 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:15.533645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:15.534591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:15.546889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.551194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.551763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.555321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.555960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.556513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.587208 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac HTTP/1.1 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac'} Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:15.593223 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.597497 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:15.597497 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:15.597497 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:15.597497 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:15.597497 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:15.597497 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. Aug 06 21:16:15.597497 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:15.600181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance 1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:15.601308 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-880f180d-6a3e-4d14-906f-34204e3b4fb7 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac" status: 404 len: 111 microversion: 2.1 time: 0.076004 Aug 06 21:16:15.602110 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2458/4739] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:15 2022] GET /compute/v2.1/servers/1e64bdab-ff7d-4c4b-8c38-d3f708c9d9ac => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:15.615703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:15.616570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:15.630469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.631600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.632239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.633308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.634026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.634776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.725886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:15.737641 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-92964f34-8d49-444b-a637-2cf090053e61 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.443072 Aug 06 21:16:15.747752 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2282/4740] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:15 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:15.956935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:15.966816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:15.967145 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee7bded1-acc6-4237-b672-02785c88bd12 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.363601 Aug 06 21:16:15.969218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:15.969755 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2459/4741] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:15 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:15.987273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.987782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.988231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:15.989019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:15.989483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:15.989920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.259069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:16.266317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:16.287237 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c9faf19-1da5-48a4-8ba2-d9d108430167 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.325099 Aug 06 21:16:16.291572 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2283/4742] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:15 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:16.319816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:16.321782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:16.336178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.336967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.338823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.339881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.341252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.341871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.548259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:16.549440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:16.558608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.559967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.560633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.562491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.563170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.563973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.635156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:16.647336 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2c70c666-c629-42a0-95c4-d3e8ac46e9de tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.335145 Aug 06 21:16:16.650714 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2460/4743] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:16 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:16.675799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76382b06-e0c1-4e1e-8c77-9ea142c1480e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:16.676729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76382b06-e0c1-4e1e-8c77-9ea142c1480e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 80305e80-58ff-4e54-a65a-a9ecc923e887] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:16.695496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-76382b06-e0c1-4e1e-8c77-9ea142c1480e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 80305e80-58ff-4e54-a65a-a9ecc923e887 could not be found. Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76382b06-e0c1-4e1e-8c77-9ea142c1480e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/80305e80-58ff-4e54-a65a-a9ecc923e887/action HTTP/1.1 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 15 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: {"unpause": {}} Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 80305e80-58ff-4e54-a65a-a9ecc923e887 could not be found. Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '80305e80-58ff-4e54-a65a-a9ecc923e887', 'body': {'unpause': {}}} Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80305e80-58ff-4e54-a65a-a9ecc923e887 could not be found. Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80305e80-58ff-4e54-a65a-a9ecc923e887 could not be found. Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:16.697771 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:16.703031 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:16.703031 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:16.703031 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80305e80-58ff-4e54-a65a-a9ecc923e887 could not be found. Aug 06 21:16:16.703031 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:16.707256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76382b06-e0c1-4e1e-8c77-9ea142c1480e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 80305e80-58ff-4e54-a65a-a9ecc923e887 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:16.708437 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-76382b06-e0c1-4e1e-8c77-9ea142c1480e tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/80305e80-58ff-4e54-a65a-a9ecc923e887/action" status: 404 len: 111 microversion: 2.1 time: 0.038416 Aug 06 21:16:16.712358 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2461/4744] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:16 2022] POST /compute/v2.1/servers/80305e80-58ff-4e54-a65a-a9ecc923e887/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:16.722477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:16.732727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:16.770147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.771549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.773877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.776087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.777961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.782275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.879364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:16.890110 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-489ea1e5-d9a8-4348-a1aa-c31b39bbfee3 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1313 microversion: 2.1 time: 0.349320 Aug 06 21:16:16.891919 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2284/4745] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:16 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:16.897222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:16.898159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:16.905565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.906367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.907097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.908047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.908933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.909596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.944411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:16.954295 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a694d9bf-0dad-411e-9d31-5bbff624e4cd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.235559 Aug 06 21:16:16.955471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2462/4746] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:16 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:16.963298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:16.964303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:16.973010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.973804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.974476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.975476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:16.976139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:16.976776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:16.998520 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df HTTP/1.1 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '2fd012aa-4178-47e4-81cd-a975a14958df'} Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:17.000701 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.005504 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.009396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:17.011866 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-98e032e1-13df-4ffb-83ca-54db2b2fffa1 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 404 len: 111 microversion: 2.1 time: 0.053786 Aug 06 21:16:17.018018 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2463/4747] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:16 2022] DELETE /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:17.025222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:17.026038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:17.033300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.034113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.035110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.036300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.037032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.037635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.258596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:17.270590 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ea606b93-653c-41d3-a8a6-7c91b3506686 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.377069 Aug 06 21:16:17.285170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:17.285515 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2285/4748] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:16 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:17.288730 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2dabebec-234a-4d26-8640-3f785dfb4794 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.269038 Aug 06 21:16:17.291396 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2464/4749] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:17 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:17.301775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:17.302755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] [instance: 2fd012aa-4178-47e4-81cd-a975a14958df] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:17.308579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:17.309176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:17.311789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.313281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.313899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.314486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.314989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.315494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.324996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.325497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.325938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.327323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.327792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.328222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.341023 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] HTTP exception thrown: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Request method failure captured: Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df HTTP/1.1 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tjIg1qCO5skLAdF1bHHorT18WK3naJj4NatutKTawifraMBficPrZhdbbkKXVFko34X_86_ezI3bWJcWnk5RxiuexiGyPvWbKj74HM9mMIi8wsY_J3n9KydzJneozMHAa0sZGL8vB9Xhob1iF10js_YN9oJ7atOh5u9cAuOzXb6kTQ Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4980bb21b59412ca004d8069525d3b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4980bb21b59412ca004d8069525d3b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: f4980bb21b59412ca004d8069525d3b9 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1196263590 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 1d7b9e27983940dcaf0e92f62273c588 Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeNegativeTest-1196263590-project Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '2fd012aa-4178-47e4-81cd-a975a14958df'} Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:17.347057 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.352477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:17.352477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:17.352477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:17.352477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:17.352477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:17.352477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. Aug 06 21:16:17.352477 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.365144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] Returning 404 to user: Instance 2fd012aa-4178-47e4-81cd-a975a14958df could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:17.366448 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c3fe277a-0f7d-4e30-98c3-5579d9259bd8 tempest-AttachVolumeNegativeTest-1196263590 tempest-AttachVolumeNegativeTest-1196263590-project] 10.222.0.33 "GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df" status: 404 len: 111 microversion: 2.1 time: 0.073215 Aug 06 21:16:17.367904 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2465/4750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:17 2022] GET /compute/v2.1/servers/2fd012aa-4178-47e4-81cd-a975a14958df => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:17.376224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:17.377650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:17.386129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.386932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.387563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.388468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.390472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.391512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.432664 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Cannot 'unpause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action HTTP/1.1 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 15 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: {"unpause": {}} Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: exception: Cannot 'unpause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8', 'body': {'unpause': {}}} Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 in vm_state active. Cannot unpause while the instance is in this state. Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:17.441685 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:17.449628 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:17.449628 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:17.449628 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:17.449628 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:16:17.449628 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:17.449628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 409 to user: Cannot 'unpause' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:17.449628 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee515b31-e7eb-4dd8-a386-2b1009dc2537 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 409 len: 145 microversion: 2.1 time: 0.074284 Aug 06 21:16:17.449628 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2466/4751] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:17 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 145 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:16:17.460569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:17.463947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:17.472992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.473494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.473935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.474982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.475198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.475721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.702284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:17.719181 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ba6c0e7-20eb-4be9-924a-47f53539c246 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.429383 Aug 06 21:16:17.721640 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2286/4752] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:17 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:17.801849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:17.811846 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80613ef0-d6df-41ae-b7ba-6cf11371cf60 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.361386 Aug 06 21:16:17.812600 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2467/4753] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:17 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:17.837560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:17.838441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:17.847311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.847913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.848460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.849254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.849950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.850481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.912998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:17.913757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:17.920454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.921206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.921833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:17.922661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:17.923294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:17.923810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:18.130335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:18.142344 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6bdb64ac-6568-4268-8284-cc4fdb91e34d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1497 microversion: 2.1 time: 0.234050 Aug 06 21:16:18.143407 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2468/4754] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:17 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1497 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:18.297984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:18.299062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:18.314117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:18.315999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:18.316749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:18.319827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:18.320752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:18.321560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:18.538509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:18.549901 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-285cd50d-ff79-4e91-8073-c025e4b2a302 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.718646 Aug 06 21:16:18.550821 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2287/4755] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:17 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:18.565611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:18.574664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b7c2596b-e06b-4027-a691-3ce9b4cde8a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:18.575272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b7c2596b-e06b-4027-a691-3ce9b4cde8a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 7379d636-2dbc-45b9-b626-62857d73f794] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:18.592365 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0736eb86-c894-42e5-9510-5f00e0c16162 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.299535 Aug 06 21:16:18.594782 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b7c2596b-e06b-4027-a691-3ce9b4cde8a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 7379d636-2dbc-45b9-b626-62857d73f794 could not be found. Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b7c2596b-e06b-4027-a691-3ce9b4cde8a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/7379d636-2dbc-45b9-b626-62857d73f794/action HTTP/1.1 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 18 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: {"unshelve": null} Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 7379d636-2dbc-45b9-b626-62857d73f794 could not be found. Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7379d636-2dbc-45b9-b626-62857d73f794', 'body': {'unshelve': None}} Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7379d636-2dbc-45b9-b626-62857d73f794 could not be found. Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7379d636-2dbc-45b9-b626-62857d73f794 could not be found. Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:18.596392 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7379d636-2dbc-45b9-b626-62857d73f794 could not be found. Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b7c2596b-e06b-4027-a691-3ce9b4cde8a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 7379d636-2dbc-45b9-b626-62857d73f794 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:18.600766 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b7c2596b-e06b-4027-a691-3ce9b4cde8a7 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/7379d636-2dbc-45b9-b626-62857d73f794/action" status: 404 len: 111 microversion: 2.1 time: 0.027218 Aug 06 21:16:18.601710 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2469/4756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:18 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:18.601795 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2288/4757] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:18 2022] POST /compute/v2.1/servers/7379d636-2dbc-45b9-b626-62857d73f794/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:18.620517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:18.621712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:18.629459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:18.630212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:18.630853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:18.631904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:18.632879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:18.633535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:18.744190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:18.744811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:18.762930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:18.763691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:18.766329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:18.767284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:18.767744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:18.768400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:18.885604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:18.895278 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-93e39f3f-c192-412a-9d31-114ebf2842b6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.283673 Aug 06 21:16:18.899027 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2470/4758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:18 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:18.916768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:18.917505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:18.929894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:18.930456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:18.930974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:18.936794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:18.939747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:18.944890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:18.986440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:16:19.094882 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e7f1e700-4c15-4c5b-a799-bc8375cc075d tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 204 len: 0 microversion: 2.1 time: 0.191580 Aug 06 21:16:19.096147 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2471/4759] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:18 2022] DELETE /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:16:19.121048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:19.121791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:19.135491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.136000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.136448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:19.137179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.137644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.138076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:19.151831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:19.161044 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46c21227-183a-437e-9c28-1f2b99cca86c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.420517 Aug 06 21:16:19.167177 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2289/4760] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:18 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:19.175755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:19.183570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:19.197252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.203644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.204659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:19.205622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.206320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.207016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:19.636793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:19.651604 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a3d3223a-8ed2-4d39-b85c-9dbb1cbd76e4 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.553198 Aug 06 21:16:19.653608 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2472/4761] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:19 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:19.662213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:19.664333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:19.680678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.681501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.682646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:19.684903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.686662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.687490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:19.748128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:19.758299 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1f1677b6-b2f3-4806-998c-8b0a7b07567b tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1503 microversion: 2.1 time: 0.589654 Aug 06 21:16:19.759561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2290/4762] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:19 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1503 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:19.767510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:19.768741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:19.799358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.799877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.800790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:19.801717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.803258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.803883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:19.851766 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Cannot 'unshelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action HTTP/1.1 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 18 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: {"unshelve": null} Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: exception: Cannot 'unshelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8', 'body': {'unshelve': None}} Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 in vm_state active. Cannot unshelve while the instance is in this state. Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 21:16:19.854016 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active Aug 06 21:16:19.859826 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:19.869774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 409 to user: Cannot 'unshelve' instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 while it is in vm_state active {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:19.871812 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99feef4c-13e3-4659-9d27-46f4ad050960 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action" status: 409 len: 146 microversion: 2.1 time: 0.110160 Aug 06 21:16:19.872744 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2291/4763] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:19 2022] POST /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8/action => generated 146 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:16:19.885906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:19.887448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:19.904248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.905885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.906590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:19.908065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:19.908856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:19.909748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:20.036520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:20.052194 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0f016aa6-b40d-4f65-bdd2-5a9f7ee1de4e tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.394432 Aug 06 21:16:20.053172 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2473/4764] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:19 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:20.171943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:20.186023 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-af667c5f-f43e-4e24-91cc-88f9096a9dcd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.308110 Aug 06 21:16:20.195086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:20.195709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:20.199227 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2292/4765] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:19 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:20.205983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:20.205983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:20.206396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:20.207150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:20.207965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:20.208107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:20.211076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:20.211792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:20.212608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:20.219578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:20.220255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:20.220924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:20.221750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:20.222423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:20.223008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:20.448359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:20.459322 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3860f13b-8695-4970-98a5-753f6d50b543 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.253957 Aug 06 21:16:20.459903 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2293/4766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:20 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:20.486201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32801b4e-a857-488a-b2d1-d5b78398b278 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-781179738_updated"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:20.489208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-32801b4e-a857-488a-b2d1-d5b78398b278 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 5d3b3fa2-dd55-4163-9d3a-2112bf560ab4] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:20.497655 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-32801b4e-a857-488a-b2d1-d5b78398b278 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 5d3b3fa2-dd55-4163-9d3a-2112bf560ab4 could not be found. Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32801b4e-a857-488a-b2d1-d5b78398b278 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/servers/5d3b3fa2-dd55-4163-9d3a-2112bf560ab4 HTTP/1.1 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 80 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-781179738_updated"}} Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 5d3b3fa2-dd55-4163-9d3a-2112bf560ab4 could not be found. Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '5d3b3fa2-dd55-4163-9d3a-2112bf560ab4', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-781179738_updated'}}} Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d3b3fa2-dd55-4163-9d3a-2112bf560ab4 could not be found. Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 06 21:16:20.499398 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d3b3fa2-dd55-4163-9d3a-2112bf560ab4 could not be found. Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d3b3fa2-dd55-4163-9d3a-2112bf560ab4 could not be found. Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32801b4e-a857-488a-b2d1-d5b78398b278 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 5d3b3fa2-dd55-4163-9d3a-2112bf560ab4 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-32801b4e-a857-488a-b2d1-d5b78398b278 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "PUT /compute/v2.1/servers/5d3b3fa2-dd55-4163-9d3a-2112bf560ab4" status: 404 len: 111 microversion: 2.1 time: 0.019340 Aug 06 21:16:20.509395 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2294/4767] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:16:20 2022] PUT /compute/v2.1/servers/5d3b3fa2-dd55-4163-9d3a-2112bf560ab4 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:20.518657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:20.518657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:20.522042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:20.522508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:20.523040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:20.523755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:20.524193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:20.524768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:20.726537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:20.738499 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1017e001-5631-4113-92ab-894b3f89b4c5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.549433 Aug 06 21:16:20.740934 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2474/4768] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:20 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:20.784689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:20.785600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:20.792248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:20.792918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:20.793518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:20.794414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:20.795600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:20.796200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:21.006572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:21.023594 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-74b1365c-0779-48d0-b596-e7fa056f3497 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.514812 Aug 06 21:16:21.025125 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2295/4769] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:20 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:21.051014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:21.052160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:21.062973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:21.063663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:21.064270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:21.066216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:21.068403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:21.069603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:21.160554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:21.188981 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e1a7939-0931-42a0-b0bd-73a0c8cf4228 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1503 microversion: 2.1 time: 0.404218 Aug 06 21:16:21.189642 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2475/4770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:20 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1503 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:21.200519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:21.202481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:21.213298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:21.213806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:21.214251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:21.214985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:21.221252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:21.222496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:21.524860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:21.527162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:21.535204 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a15a6622-79f7-4c3a-b5f0-3673e9d4b4bd tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.490473 Aug 06 21:16:21.539475 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2296/4771] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:21 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:21.554571 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0f8b3e82-4d94-46a0-8f77-774a1ef99ca5 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.350601 Aug 06 21:16:21.554571 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2476/4772] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:21 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:21.560459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac5b0d97-3615-4fc4-8c9a-57d96796f3eb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac5b0d97-3615-4fc4-8c9a-57d96796f3eb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: request: PUT /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 HTTP/1.1 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 280 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:21.565613 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac5b0d97-3615-4fc4-8c9a-57d96796f3eb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:21.570075 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ac5b0d97-3615-4fc4-8c9a-57d96796f3eb tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "PUT /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 400 len: 619 microversion: 2.1 time: 0.013256 Aug 06 21:16:21.577829 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2477/4773] 10.222.0.33 () {60 vars in 1257 bytes} [Sat Aug 6 21:16:21 2022] PUT /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:16:21.591238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:21.592497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:21.605188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:21.605885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:21.606409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:21.607172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:21.607650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:21.608088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:21.734121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-eb7cea5b-0197-4198-aace-4dc0c97345c7 req-140f1ca1-7600-4a0f-938c-08531297433c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0dd54b-c337-46f7-93dd-8b031d29e40a", "name": "network-vif-deleted", "tag": "ec40edbf-5643-41b9-9f40-2182f325978d"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:21.757274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-eb7cea5b-0197-4198-aace-4dc0c97345c7 req-140f1ca1-7600-4a0f-938c-08531297433c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:21.763106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-eb7cea5b-0197-4198-aace-4dc0c97345c7 req-140f1ca1-7600-4a0f-938c-08531297433c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:21.764674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-eb7cea5b-0197-4198-aace-4dc0c97345c7 req-140f1ca1-7600-4a0f-938c-08531297433c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:21.797967 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-eb7cea5b-0197-4198-aace-4dc0c97345c7 req-140f1ca1-7600-4a0f-938c-08531297433c service nova] Creating event network-vif-deleted:ec40edbf-5643-41b9-9f40-2182f325978d for instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a on nch2-master-1 Aug 06 21:16:21.809559 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-eb7cea5b-0197-4198-aace-4dc0c97345c7 req-140f1ca1-7600-4a0f-938c-08531297433c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079711 Aug 06 21:16:21.814675 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2478/4774] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:16:21.830229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:21.836042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:21.859053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:21.859774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:21.860785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:21.861750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:21.862394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:21.864415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:22.131614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:22.142635 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d1afe058-1304-471c-8a7a-128d0f10254d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.325706 Aug 06 21:16:22.143967 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2479/4775] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:21 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:22.224380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:22.225263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:22.232980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:22.243135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:22.255108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:22.257735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:22.260961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:22.262736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:22.263347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:22.348622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:22.349128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:22.349575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:22.350042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lazy-loading 'fault' on Instance uuid 3e0dd54b-c337-46f7-93dd-8b031d29e40a {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:16:22.414586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9a290f680dc4b5bbec2010d82ed7e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15407d6e47c34f588e162af6a190fd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:22.426744 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba23fec5-4ea3-4ebf-b18e-9e634668c87e tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 200 len: 1303 microversion: 2.1 time: 0.210859 Aug 06 21:16:22.428731 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2480/4776] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:22 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 1303 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:22.565966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:22.566623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:22.572925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:22.573724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:22.574179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:22.575092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:22.575720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:22.576164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:22.736813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:22.758803 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-48da9c82-2aba-491e-8705-12276e7fbbb3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 1.182489 Aug 06 21:16:22.759734 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2297/4777] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:21 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:22.784847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:22.785413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:22.794114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:22.798997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:22.799667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:22.801009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:22.801663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:22.803209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:22.835681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:22.844751 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f104f1f5-28aa-45da-9863-8a46d69c12ff tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.282759 Aug 06 21:16:22.858712 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2481/4778] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:22 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:23.164222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:23.165335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:23.179957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:23.181908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:23.183105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:23.187628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:23.191220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:23.193291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:23.210652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:23.227485 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4278336f-1428-47ef-a17a-70cbfe0e6392 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.447043 Aug 06 21:16:23.233854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2298/4779] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:22 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:23.254128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d7575a6b-8993-4de6-98be-a50163c6e4f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d7575a6b-8993-4de6-98be-a50163c6e4f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: request: PUT /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 HTTP/1.1 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 24 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": ""}} Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8', 'body': {'server': {'name': ''}}} Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi '' Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:16:23.265170 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 06 21:16:23.269540 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.275351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d7575a6b-8993-4de6-98be-a50163c6e4f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:23.279099 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d7575a6b-8993-4de6-98be-a50163c6e4f3 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "PUT /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 400 len: 108 microversion: 2.1 time: 0.030372 Aug 06 21:16:23.282186 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2299/4780] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:16:23 2022] PUT /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:16:23.312620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:23.313337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:23.363321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:23.366847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:23.367351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:23.368129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:23.368600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:23.369035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:23.917705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:23.934712 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a45ccad-83f1-42ef-ad3b-ec6c0d34b8d5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1505 microversion: 2.1 time: 0.642741 Aug 06 21:16:23.936096 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2300/4781] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:23 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:23.944864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:23.945769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] [instance: 3e0dd54b-c337-46f7-93dd-8b031d29e40a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:23.957021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:23.957815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:23.958699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:23.959435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:23.959896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:23.960321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:23.983553 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] HTTP exception thrown: Instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a could not be found. Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Request method failure captured: Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a HTTP/1.1 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tny-Kbq4Fu4q9EeKN3EtV1dRMNSVwE4dchhVYwzDMzQwf-UDSk-SzIskwIOCJnBXz3XLPwDUdocQM1mSrY7ig2YTi3B3mkqP4IxfSuTadopEU6cg8Gvi3KtRH3XPNeHxBVV65Ds1FyPzCuc2rq7qO5g8d9VqOJ5kyUVjslO54rjfDM Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 15407d6e47c34f588e162af6a190fd99 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesActionsTest-686134703 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/15407d6e47c34f588e162af6a190fd99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_15407d6e47c34f588e162af6a190fd99", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15407d6e47c34f588e162af6a190fd99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/15407d6e47c34f588e162af6a190fd99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesActionsTest-686134703 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 15407d6e47c34f588e162af6a190fd99 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesActionsTest-686134703 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesActionsTest-686134703-project Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: c9a290f680dc4b5bbec2010d82ed7e27 Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesActionsTest-686134703-project Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a could not be found. Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '3e0dd54b-c337-46f7-93dd-8b031d29e40a'} Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a could not be found. Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a could not be found. Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:23.985758 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a could not be found. Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] Returning 404 to user: Instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b750d271-1696-4205-98b2-eb184f7feec4 tempest-VolumesActionsTest-686134703 tempest-VolumesActionsTest-686134703-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a" status: 404 len: 111 microversion: 2.1 time: 0.049921 Aug 06 21:16:23.990243 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2301/4782] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:23 2022] GET /compute/v2.1/servers/3e0dd54b-c337-46f7-93dd-8b031d29e40a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:24.000916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:24.001555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:24.009248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:24.009915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:24.010371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:24.011124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:24.012411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:24.012844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:24.129573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:24.144647 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67bb1d64-bf48-4255-a726-fc5926de0064 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.984334 Aug 06 21:16:24.148522 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2482/4783] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:23 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:24.588065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:24.597031 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2525e7b8-88aa-43fe-9178-00f5e74f8942 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.608003 Aug 06 21:16:24.597427 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2302/4784] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:23 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:25.179697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:25.181030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:25.215169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:25.216334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:25.221086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:25.223442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:25.224332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:25.225016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:25.629267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:25.633854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:25.642787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:25.643380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:25.647843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:25.648861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:25.649534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:25.650156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:25.764727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:25.776731 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee8857a3-467f-42cb-9b1a-433a1804b51b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.607643 Aug 06 21:16:25.778404 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2483/4785] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:25 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:26.176053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:26.188581 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d54418db-cd9b-4de0-a4f3-dc1d98058b9f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.572820 Aug 06 21:16:26.189856 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2303/4786] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:25 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:26.543548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:26.544790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:26.561400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:26.567265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:26.567982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:26.570938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:26.571639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:26.576673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:26.611386 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 HTTP/1.1 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'b65f4d33-d7b2-4bb6-a852-ba30292476c0'} Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:26.621047 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.626812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.629474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:26.630608 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-483dadd6-4f25-48fe-aacb-55fc378ef6f6 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 404 len: 111 microversion: 2.1 time: 0.092111 Aug 06 21:16:26.635042 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2484/4787] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:26 2022] DELETE /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:26.644424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:26.645365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: b65f4d33-d7b2-4bb6-a852-ba30292476c0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:26.658520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:26.659406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:26.665400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:26.666597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:26.669011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:26.670335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:26.692368 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 HTTP/1.1 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'b65f4d33-d7b2-4bb6-a852-ba30292476c0'} Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:26.695925 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.704689 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:26.704689 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:26.704689 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:26.704689 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:26.704689 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:26.704689 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. Aug 06 21:16:26.704689 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:26.706864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance b65f4d33-d7b2-4bb6-a852-ba30292476c0 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:26.708755 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6b0cd4b0-1344-4193-8f6a-f3ed97e02c2a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0" status: 404 len: 111 microversion: 2.1 time: 0.069184 Aug 06 21:16:26.710113 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2304/4788] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:26 2022] GET /compute/v2.1/servers/b65f4d33-d7b2-4bb6-a852-ba30292476c0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:26.719242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:26.719727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:26.735960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:26.737394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:26.739139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:26.740401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:26.743571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:26.744404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:26.803027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:26.803648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:26.816939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:26.818232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:26.822845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:26.823745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:16:26.824191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:26.824866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:26.825498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:26.850710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:27.023992 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ee05304-beaf-4c3f-874c-f39ba52a22e1 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "DELETE /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 204 len: 0 microversion: 2.1 time: 0.309316 Aug 06 21:16:27.024921 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2485/4789] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:26 2022] DELETE /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:16:27.041358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:27.046705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:27.061706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:27.065293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:27.066110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:27.070636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:27.073579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:27.074403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:27.701855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:27.730575 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-49b2838a-bf11-460b-9050-2c6d245b45e5 tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 0.695010 Aug 06 21:16:27.732082 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2486/4790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:27 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:27.759139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:27.760314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:27.768729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:27.769659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:27.770275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:27.771234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:27.772060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:27.772707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:27.805033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:27.814622 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4ed86ce1-3788-4c72-9497-5a60e34f9c9c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 1.016268 Aug 06 21:16:27.833163 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2305/4791] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:26 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:27.983681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:27.991685 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a6495a68-c2c6-4bc1-8226-1fa178e83273 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.242204 Aug 06 21:16:27.993097 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2487/4792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:27 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:28.758376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:28.761179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:28.805428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:28.806831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:28.807311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:28.821649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:28.822150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:28.823742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:28.840218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:28.840935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:28.853825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:28.855462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:28.859386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:28.860697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:28.861241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:28.862146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:29.361310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:29.370315 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa24e358-c0d1-4ad0-a545-acfbfc865fad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.535219 Aug 06 21:16:29.375232 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2488/4793] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:28 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:29.392001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:29.392818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:29.417288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:29.418155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:29.418996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:29.422460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:29.423069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:29.423763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:29.926607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:29.946423 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9966888-a872-4802-9df9-ac261c0643f6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.568018 Aug 06 21:16:29.959871 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2489/4794] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:29 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:30.400768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:30.401847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:30.435251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:30.438974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:30.440250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:30.444158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:30.445382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:30.448232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:30.579877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6c953ff2f774041a7d50f53033ee124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1a7d63a1a048df9cdf8e86a26b4086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:30.600222 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5365010e-15bb-4157-acef-27a56e34a7ee tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 200 len: 1511 microversion: 2.1 time: 1.847796 Aug 06 21:16:30.601709 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2306/4795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:28 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 1511 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:30.816660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-4f82d7dc-9ce6-486d-b7cb-b33cff2a2942 req-9ecde998-6cd9-4b48-889a-f2f624708d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055adb26-af45-4bb0-9f79-7eba67aa0fb8", "name": "network-vif-deleted", "tag": "f6e6506f-eb32-403c-9cbf-f685723261e1"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:30.851383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4f82d7dc-9ce6-486d-b7cb-b33cff2a2942 req-9ecde998-6cd9-4b48-889a-f2f624708d04 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:30.851907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4f82d7dc-9ce6-486d-b7cb-b33cff2a2942 req-9ecde998-6cd9-4b48-889a-f2f624708d04 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:30.852357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4f82d7dc-9ce6-486d-b7cb-b33cff2a2942 req-9ecde998-6cd9-4b48-889a-f2f624708d04 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:30.904032 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-4f82d7dc-9ce6-486d-b7cb-b33cff2a2942 req-9ecde998-6cd9-4b48-889a-f2f624708d04 service nova] Creating event network-vif-deleted:f6e6506f-eb32-403c-9cbf-f685723261e1 for instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 on nch1-master-1 Aug 06 21:16:30.908092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:30.920164 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6d492b52-1294-4038-833f-3bf1b676ad0c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.524360 Aug 06 21:16:30.920546 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-4f82d7dc-9ce6-486d-b7cb-b33cff2a2942 req-9ecde998-6cd9-4b48-889a-f2f624708d04 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108068 Aug 06 21:16:30.921195 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2490/4796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:30 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:30.934719 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2307/4797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:30.979326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:30.979908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:31.002385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:31.002938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:31.003386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:31.007168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:31.007651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:31.008092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:31.032860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:31.623516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:31.625349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] [instance: 055adb26-af45-4bb0-9f79-7eba67aa0fb8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:31.647811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:31.648688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:31.649889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:31.650879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:31.651517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:31.652130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:31.711559 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] HTTP exception thrown: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 could not be found. Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Request method failure captured: Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 HTTP/1.1 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlPMDw8vmZ8LjoeD5gtvIrQAzqhBvDmr0JD2W6S_VjlxEAUlAIk30WnkRQtxN73QqLeyBRYr2I4TZyXMdahQKCqcOhvqhtsRnkRsemmcZ_MGCjqsJY0LkXwkEltEi-PNhIyP54CgLd3Wfn_isRvmeBedBf3j3VvOQfM0aJBREJ3588 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da1a7d63a1a048df9cdf8e86a26b4086", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da1a7d63a1a048df9cdf8e86a26b4086"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: da1a7d63a1a048df9cdf8e86a26b4086 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-391655129 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a6c953ff2f774041a7d50f53033ee124 Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-391655129-project Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 could not be found. Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '055adb26-af45-4bb0-9f79-7eba67aa0fb8'} Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 could not be found. Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 could not be found. Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:31.713779 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:31.721197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:31.721197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:31.721197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:31.721197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:31.721197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:31.721197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 could not be found. Aug 06 21:16:31.721197 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:31.723680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] Returning 404 to user: Instance 055adb26-af45-4bb0-9f79-7eba67aa0fb8 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:31.724817 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a51c77a0-ae81-4153-b243-f071048add9a tempest-ServersNegativeTestJSON-391655129 tempest-ServersNegativeTestJSON-391655129-project] 10.222.0.33 "GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8" status: 404 len: 111 microversion: 2.1 time: 0.107206 Aug 06 21:16:31.725947 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2308/4798] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:31 2022] GET /compute/v2.1/servers/055adb26-af45-4bb0-9f79-7eba67aa0fb8 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:16:31.772642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:31.791292 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f9b85574-ec81-4331-90ab-18a7341c119f tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.816612 Aug 06 21:16:31.793218 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2491/4799] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:30 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:31.942147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:31.943238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:31.972860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:31.977860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:31.978426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:31.979392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:31.979859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:31.984074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:32.823547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:32.824172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:32.853034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:32.854094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:32.855087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:32.860825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:32.863206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:32.866167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:32.991576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:33.012202 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d42f8d6-c1db-4427-b3af-5a5d20b171cb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 1.074158 Aug 06 21:16:33.012804 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2309/4800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:31 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:33.261115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:33.272836 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c4e5122e-9060-445d-926b-d622b7d616a2 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.454080 Aug 06 21:16:33.289245 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2492/4801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:32 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:34.036839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:34.037572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:34.048926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:34.049419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:34.049860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:34.051323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:34.053394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:34.055803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:34.297918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:34.298539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:34.323452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:34.323961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:34.324417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:34.325149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:34.325764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:34.326187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:34.682309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:34.709855 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-934b855a-a50f-449d-a220-c91147a3ac36 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1512 microversion: 2.1 time: 0.677420 Aug 06 21:16:34.718030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2310/4802] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:34 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1512 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:34.960339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:34.973863 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-25ec5578-6dd3-47c2-954b-2ce7a520c590 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1484 microversion: 2.1 time: 0.680460 Aug 06 21:16:34.975780 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2493/4803] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:34 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1484 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:35.006100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-027f7785-3479-4a99-a1f2-3cbc8da976cb tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:35.007486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-027f7785-3479-4a99-a1f2-3cbc8da976cb tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:35.030434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-027f7785-3479-4a99-a1f2-3cbc8da976cb tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:35.036737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-027f7785-3479-4a99-a1f2-3cbc8da976cb tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:35.037438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-027f7785-3479-4a99-a1f2-3cbc8da976cb tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:35.040688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-027f7785-3479-4a99-a1f2-3cbc8da976cb tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:35.042078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-027f7785-3479-4a99-a1f2-3cbc8da976cb tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:35.042794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-027f7785-3479-4a99-a1f2-3cbc8da976cb tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:35.217023 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-027f7785-3479-4a99-a1f2-3cbc8da976cb tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "POST /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c/action" status: 202 len: 0 microversion: 2.1 time: 0.220584 Aug 06 21:16:35.223422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2311/4804] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:34 2022] POST /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:16:35.227992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:35.229374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:35.260703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:35.261242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:35.261684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:35.262450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:35.275851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:35.276388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:35.669751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:35.697020 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37ebcefe-a1c6-4e5b-bdde-0741fd11cf66 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1492 microversion: 2.1 time: 0.472324 Aug 06 21:16:35.698539 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2494/4805] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:35 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1492 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:35.738499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:35.739277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:35.765954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:35.771359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:35.772142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:35.772916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:35.773443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:35.773956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:36.727176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:36.728214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:36.755338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:36.757397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:36.759716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:36.764348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:36.767392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:36.769434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:37.043697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:37.053682 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bea6d496-8eda-450e-9886-c629a35a99d2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1489 microversion: 2.1 time: 1.319965 Aug 06 21:16:37.072078 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2312/4806] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:35 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1489 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:37.080632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d19f4b55-548a-4e0b-af93-895efeeaec49 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:37.084858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d19f4b55-548a-4e0b-af93-895efeeaec49 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:37.092997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d19f4b55-548a-4e0b-af93-895efeeaec49 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:37.093736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d19f4b55-548a-4e0b-af93-895efeeaec49 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:37.094930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d19f4b55-548a-4e0b-af93-895efeeaec49 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:37.095894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d19f4b55-548a-4e0b-af93-895efeeaec49 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:37.097908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d19f4b55-548a-4e0b-af93-895efeeaec49 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:37.098530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d19f4b55-548a-4e0b-af93-895efeeaec49 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:37.170298 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d19f4b55-548a-4e0b-af93-895efeeaec49 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 200 len: 176 microversion: 2.1 time: 0.091368 Aug 06 21:16:37.178519 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2313/4807] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:16:37 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 176 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:37.187593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:37.189021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:37.201240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:37.202023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:37.202690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:37.204002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:37.205567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:37.206333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:37.213916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:37.227509 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f99bc82-29db-4eca-b195-e1dbb84c6fdf tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1492 microversion: 2.1 time: 0.507573 Aug 06 21:16:37.235677 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2495/4808] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:36 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1492 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:38.257848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:38.259479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:38.286048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:38.287365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:38.293297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:38.294875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:38.298907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:38.299547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:39.260497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:39.280488 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9862617f-2083-46c4-b0eb-efcbb67f671f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 2.099766 Aug 06 21:16:39.305005 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2314/4809] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:37 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:39.323848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:39.324772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:39.341278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:39.342076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:39.345749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:39.346563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:39.347299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:39.347751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:39.456592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:39.473374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5c36fe87-d6ac-4bd9-a597-0f582ecfa1c9 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1492 microversion: 2.1 time: 1.221197 Aug 06 21:16:39.474312 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2496/4810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:38 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1492 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:40.105622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:40.130620 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dbd4a49d-0225-4b8d-9c90-eaae359751f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.810926 Aug 06 21:16:40.161227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:40.162189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:40.168490 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2315/4811] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:39 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:40.172822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:40.176584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:40.177232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:40.178182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:40.186316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:40.196971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:40.503491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:40.504594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:40.525370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:40.525883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:40.526337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:40.527100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:40.527570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:40.528009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:40.922447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:40.933812 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ca79dc14-3fca-407e-bb29-d01ef3b28e49 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1498 microversion: 2.1 time: 0.437846 Aug 06 21:16:40.934638 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2316/4812] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:40 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1498 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:40.940378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:40.959256 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3fef56b0-493c-47e6-a196-24f3022c638c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.806244 Aug 06 21:16:40.964479 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2497/4813] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:40 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:40.965904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:40.966758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:40.989295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:40.990340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:41.005671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:41.007334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:41.015048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:41.016246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:41.016881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:41.017468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:41.019450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:41.019961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:41.020414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:41.021140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:41.021610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:41.022051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:41.175833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:16:41.458945 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d6941bb5-6aa5-4119-8d9f-81dc43a3e468 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 204 len: 0 microversion: 2.1 time: 0.495101 Aug 06 21:16:41.468072 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2317/4814] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:40 2022] DELETE /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:16:41.482341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:41.483187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:41.496796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:41.498900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:41.499370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:41.500117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:41.500586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:41.501037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:41.715501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:41.737982 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f44c4fb-51f8-426f-8133-74b0f007b5be tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.755642 Aug 06 21:16:41.740595 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2498/4815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:40 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:42.171362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-331897268", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c08e52fc-aab5-48dd-94e2-7ca909bf5d7b"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:42.204403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:42.224449 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-168f25fa-8fa5-4b10-8e11-604e3218a1ba tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.753675 Aug 06 21:16:42.226670 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2318/4816] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:41 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:42.364997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] validate_networks() for [('c08e52fc-aab5-48dd-94e2-7ca909bf5d7b', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:16:43.249432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:43.250075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:43.274878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:43.284429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:43.288412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:43.298447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:43.299322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:43.309206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:43.760396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:43.769578 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ed91ac17-0e59-44a0-963d-91ac93e7cad6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 0.526237 Aug 06 21:16:43.788144 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2319/4817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:43 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:44.081535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:16:44.081535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:16:44.081535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:16:44.081535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:16:44.081535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:16:44.105952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:44.106533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:44.107042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:44.107798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:44.108269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:44.108727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:44.197327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:16:44.214254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for user 9b8463a42f2642aaba586380391de6fd and project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:16:44.268349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:16:44.274069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:16:44.421019 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6b24debf-2433-4725-bdc3-28c6fd28940d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.265195 Aug 06 21:16:44.427522 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2499/4818] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:16:44.439736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b07ec60-f9a7-4d98-9a2a-74749d21e3ea tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:44.440569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7b07ec60-f9a7-4d98-9a2a-74749d21e3ea tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:44.460435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:44.799802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:44.801148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:44.819726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:44.825393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:44.826207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:44.828489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:44.829163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:44.831075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:45.055309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7b07ec60-f9a7-4d98-9a2a-74749d21e3ea tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:45.069197 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b07ec60-f9a7-4d98-9a2a-74749d21e3ea tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1214 microversion: 2.1 time: 0.632425 Aug 06 21:16:45.079501 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2320/4819] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:44 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1214 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:46.099806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:46.100608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:46.113667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:46.114374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:46.115501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:46.123982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:46.124774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:46.128271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:46.373813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:46.387278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:46.393218 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c07aa5ff-1b1e-4132-9bae-e052c2cffe9e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1210 microversion: 2.1 time: 0.303638 Aug 06 21:16:46.400031 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2321/4820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:46 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1210 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:46.543399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d9a9b6e7-7dc2-4c1a-b27d-406802f69b5e req-e4629075-72b3-4140-bedc-7ef0ff1fa0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f4667c-3b67-49b3-b70d-3c6a1864b45c", "name": "network-vif-deleted", "tag": "cd5731a2-b1fc-49ff-96d6-c1f71292cdad"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:46.597594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d9a9b6e7-7dc2-4c1a-b27d-406802f69b5e req-e4629075-72b3-4140-bedc-7ef0ff1fa0f9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:46.599416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d9a9b6e7-7dc2-4c1a-b27d-406802f69b5e req-e4629075-72b3-4140-bedc-7ef0ff1fa0f9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:46.604376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d9a9b6e7-7dc2-4c1a-b27d-406802f69b5e req-e4629075-72b3-4140-bedc-7ef0ff1fa0f9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:46.633887 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d9a9b6e7-7dc2-4c1a-b27d-406802f69b5e req-e4629075-72b3-4140-bedc-7ef0ff1fa0f9 service nova] Creating event network-vif-deleted:cd5731a2-b1fc-49ff-96d6-c1f71292cdad for instance 22f4667c-3b67-49b3-b70d-3c6a1864b45c on nch1-master-1 Aug 06 21:16:46.634060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:46.646330 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-083821e1-d483-4e63-b7af-cd53edf2b7e6 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1504 microversion: 2.1 time: 1.852633 Aug 06 21:16:46.648357 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2500/4821] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:44 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1504 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:46.666900 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d9a9b6e7-7dc2-4c1a-b27d-406802f69b5e req-e4629075-72b3-4140-bedc-7ef0ff1fa0f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127379 Aug 06 21:16:46.668830 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2322/4822] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:16:47.423865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:47.424493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:47.455259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:47.464263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:47.467468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:47.469068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:47.471126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:47.472404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:47.672864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:47.683921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:47.707657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:47.710504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:47.711136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:47.711975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:47.712593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:47.714087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:47.805705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:47.814827 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a4662fb7-46ff-4be4-b214-703b9c012968 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1266 microversion: 2.1 time: 0.397983 Aug 06 21:16:47.819632 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2501/4823] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:47 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1266 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:47.825458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:47.826467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:47.827170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:47.827761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lazy-loading 'fault' on Instance uuid 22f4667c-3b67-49b3-b70d-3c6a1864b45c {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:16:47.928087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:47.943415 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-20f93666-7a4e-44f9-b5cb-83b2f5ba72c7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 200 len: 1303 microversion: 2.1 time: 0.277236 Aug 06 21:16:47.946951 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2323/4824] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:47 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 1303 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:48.840235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:48.843874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:48.864185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:48.864921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:48.865541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:48.866769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:48.867421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:48.868021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:48.973801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:48.975061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: 22f4667c-3b67-49b3-b70d-3c6a1864b45c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:49.008379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:49.009714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:49.016299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:49.021227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:49.024046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:49.027616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:49.111091 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] HTTP exception thrown: Instance 22f4667c-3b67-49b3-b70d-3c6a1864b45c could not be found. Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Request method failure captured: Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c HTTP/1.1 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tm5xq1TD1p2eO_E474oVX6FFhRFpPTl8Y2vWGOsVhXi2jtPgMUa0n2_iyAJEiEpdE_oQR0CTzbF4opCFZXB85oBUZjoKDV1Vf6BpEYPGcCu0Gni_twVHqUQXIqheyI5Sw3dHlwQkw1chxcAsfTf1tdGeYoUPtI-6fP2WrokOB1Ae88 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: b62ccbeb57bc4acebcba07ac1f82ae22 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerRescueTestJSON-2030890567 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b62ccbeb57bc4acebcba07ac1f82ae22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b62ccbeb57bc4acebcba07ac1f82ae22", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b62ccbeb57bc4acebcba07ac1f82ae22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b62ccbeb57bc4acebcba07ac1f82ae22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerRescueTestJSON-2030890567 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: b62ccbeb57bc4acebcba07ac1f82ae22 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerRescueTestJSON-2030890567 Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerRescueTestJSON-2030890567-project Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3597dc51e1ae4d80a4bd648fcf3e31bc Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerRescueTestJSON-2030890567-project Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 22f4667c-3b67-49b3-b70d-3c6a1864b45c could not be found. Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '22f4667c-3b67-49b3-b70d-3c6a1864b45c'} Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f4667c-3b67-49b3-b70d-3c6a1864b45c could not be found. Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f4667c-3b67-49b3-b70d-3c6a1864b45c could not be found. Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:49.112851 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:49.117972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:49.117972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:49.117972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:49.117972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:49.117972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:49.117972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f4667c-3b67-49b3-b70d-3c6a1864b45c could not be found. Aug 06 21:16:49.117972 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:16:49.121500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Returning 404 to user: Instance 22f4667c-3b67-49b3-b70d-3c6a1864b45c could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:49.125196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:49.127515 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2bd85d5a-ff4c-44c2-a50f-246eb55cc61a tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c" status: 404 len: 111 microversion: 2.1 time: 0.158905 Aug 06 21:16:49.130806 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2324/4825] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:48 2022] GET /compute/v2.1/servers/22f4667c-3b67-49b3-b70d-3c6a1864b45c => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:16:49.147274 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67d441c5-1ef1-47d3-9ceb-5f2c867cc823 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1272 microversion: 2.1 time: 0.300182 Aug 06 21:16:49.152435 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2502/4826] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:48 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:49.171479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:49.175272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:49.217637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:49.223501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:49.226337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:49.232199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:49.233178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:49.237711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:49.347045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:16:49.507877 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-85746b03-ebdf-490a-b452-b59e51c0f113 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 204 len: 0 microversion: 2.1 time: 0.371819 Aug 06 21:16:49.509832 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2325/4827] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:16:49 2022] DELETE /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:16:49.518778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:49.519790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:49.531471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:49.532248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:49.534299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:49.536766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:49.538736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:49.539972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:50.172606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:50.179378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:50.200930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:50.201892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:50.204425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:50.205685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:50.208845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:50.211592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:50.644454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:50.653382 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a276b396-298b-4877-affe-f4c8892a8ed7 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1492 microversion: 2.1 time: 1.138763 Aug 06 21:16:50.657065 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2503/4828] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:49 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1492 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:51.685620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:51.687177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:51.704003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:51.704861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:51.705502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:51.706422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:51.707069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:51.707692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:51.940735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:51.950839 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bc0590af-76c9-47f5-abaf-58d3c43ae725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1314 microversion: 2.1 time: 1.781828 Aug 06 21:16:51.951439 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2326/4829] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:50 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1314 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:52.973716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:52.974462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:52.994858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:52.995399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:52.995842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:52.996637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:53.002285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:53.003013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:53.880070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:53.904981 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b0f0b52-aa1f-4750-90e3-eca02692b89b tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1492 microversion: 2.1 time: 2.228637 Aug 06 21:16:53.910728 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2504/4830] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:51 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1492 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:54.100158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c49728cf-4c74-428e-b43b-66ad15e54574 req-85b685d1-63bb-4d71-8b98-5b1206cd659e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6", "tag": "a753c87f-b490-45e1-b4a2-cbb9f73d1607"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:54.119375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:54.148386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c49728cf-4c74-428e-b43b-66ad15e54574 req-85b685d1-63bb-4d71-8b98-5b1206cd659e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:54.149534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c49728cf-4c74-428e-b43b-66ad15e54574 req-85b685d1-63bb-4d71-8b98-5b1206cd659e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:54.149985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c49728cf-4c74-428e-b43b-66ad15e54574 req-85b685d1-63bb-4d71-8b98-5b1206cd659e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:54.183501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:54.193019 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c49728cf-4c74-428e-b43b-66ad15e54574 req-85b685d1-63bb-4d71-8b98-5b1206cd659e service nova] Creating event network-changed:a753c87f-b490-45e1-b4a2-cbb9f73d1607 for instance 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 on nch2-master-1 Aug 06 21:16:54.208298 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c49728cf-4c74-428e-b43b-66ad15e54574 req-85b685d1-63bb-4d71-8b98-5b1206cd659e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112102 Aug 06 21:16:54.211542 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2505/4831] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:54.439910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:54.452791 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-085992b3-c048-40a8-8cc8-56bf32b02f73 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1314 microversion: 2.1 time: 1.483192 Aug 06 21:16:54.454250 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2327/4832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:52 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1314 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:54.937064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:54.945663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:54.961290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:54.965887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:54.974586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:54.976365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:54.977597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:54.981521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:54.983676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:55.479369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:55.482354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:55.485706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:16:55.503961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:55.504707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:55.505383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:55.507363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:55.508042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:55.509287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:55.609560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:55.626911 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a3595cc6-597b-494a-b2df-4ce847c26542 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1492 microversion: 2.1 time: 0.693689 Aug 06 21:16:55.647510 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2506/4833] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:54 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1492 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:56.653703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:56.654920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:56.671466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:56.683388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:56.687281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:56.688141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:56.688611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:56.689054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:56.740729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:56.776317 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23fc276d-221a-4e8b-a4e4-59edb1fde8af tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1314 microversion: 2.1 time: 1.303113 Aug 06 21:16:56.800520 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2328/4834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:55 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1314 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:16:56.808561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8d5016f5-71c1-47bd-9ae8-cb490e23e2e0 req-d63d89bd-e54a-4799-ad57-51c2a6750e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43b2eca-4991-4b9f-909d-d310ed5fb4ea", "name": "network-vif-deleted", "tag": "c15d1bcb-8372-4258-b1e0-493a7500e693"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:16:56.916076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8d5016f5-71c1-47bd-9ae8-cb490e23e2e0 req-d63d89bd-e54a-4799-ad57-51c2a6750e8a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:56.921909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8d5016f5-71c1-47bd-9ae8-cb490e23e2e0 req-d63d89bd-e54a-4799-ad57-51c2a6750e8a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:56.925432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8d5016f5-71c1-47bd-9ae8-cb490e23e2e0 req-d63d89bd-e54a-4799-ad57-51c2a6750e8a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:56.963039 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8d5016f5-71c1-47bd-9ae8-cb490e23e2e0 req-d63d89bd-e54a-4799-ad57-51c2a6750e8a service nova] Creating event network-vif-deleted:c15d1bcb-8372-4258-b1e0-493a7500e693 for instance f43b2eca-4991-4b9f-909d-d310ed5fb4ea on nch2-master-1 Aug 06 21:16:56.977385 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8d5016f5-71c1-47bd-9ae8-cb490e23e2e0 req-d63d89bd-e54a-4799-ad57-51c2a6750e8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172704 Aug 06 21:16:56.979135 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2329/4835] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:16:57.021379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3597dc51e1ae4d80a4bd648fcf3e31bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62ccbeb57bc4acebcba07ac1f82ae22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:57.056583 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-470192b2-1945-4077-8fe1-46ad029e4ae8 tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 200 len: 1450 microversion: 2.1 time: 0.406801 Aug 06 21:16:57.057667 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2507/4836] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:56 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 1450 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:16:57.802312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:57.803187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:57.824850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:57.826533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:57.829594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:57.831775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:57.833747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:57.835527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:58.081596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:16:58.084782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] [instance: f43b2eca-4991-4b9f-909d-d310ed5fb4ea] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:16:58.124010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:58.139672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:58.144388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:58.158898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:16:58.160348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:16:58.162302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:16:58.245038 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] HTTP exception thrown: Instance f43b2eca-4991-4b9f-909d-d310ed5fb4ea could not be found. Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Request method failure captured: Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea HTTP/1.1 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tm5xq1TD1p2eO_E474oVX6FFhRFpPTl8Y2vWGOsVhXi2jtPgMUa0n2_iyAJEiEpdE_oQR0CTzbF4opCFZXB85oBUZjoKDV1Vf6BpEYPGcCu0Gni_twVHqUQXIqheyI5Sw3dHlwQkw1chxcAsfTf1tdGeYoUPtI-6fP2WrokOB1Ae88 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: b62ccbeb57bc4acebcba07ac1f82ae22 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerRescueTestJSON-2030890567 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b62ccbeb57bc4acebcba07ac1f82ae22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b62ccbeb57bc4acebcba07ac1f82ae22", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b62ccbeb57bc4acebcba07ac1f82ae22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b62ccbeb57bc4acebcba07ac1f82ae22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerRescueTestJSON-2030890567 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: b62ccbeb57bc4acebcba07ac1f82ae22 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerRescueTestJSON-2030890567 Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerRescueTestJSON-2030890567-project Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3597dc51e1ae4d80a4bd648fcf3e31bc Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerRescueTestJSON-2030890567-project Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance f43b2eca-4991-4b9f-909d-d310ed5fb4ea could not be found. Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'f43b2eca-4991-4b9f-909d-d310ed5fb4ea'} Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f43b2eca-4991-4b9f-909d-d310ed5fb4ea could not be found. Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f43b2eca-4991-4b9f-909d-d310ed5fb4ea could not be found. Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:16:58.249702 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:58.259073 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:16:58.259073 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:16:58.259073 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:16:58.259073 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:16:58.259073 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:16:58.259073 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f43b2eca-4991-4b9f-909d-d310ed5fb4ea could not be found. Aug 06 21:16:58.259073 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:16:58.262473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] Returning 404 to user: Instance f43b2eca-4991-4b9f-909d-d310ed5fb4ea could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:16:58.269950 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-101f39aa-0b58-4901-b613-eec1afef22cd tempest-ServerRescueTestJSON-2030890567 tempest-ServerRescueTestJSON-2030890567-project] 10.222.0.33 "GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea" status: 404 len: 111 microversion: 2.1 time: 0.195795 Aug 06 21:16:58.271635 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2508/4837] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:58 2022] GET /compute/v2.1/servers/f43b2eca-4991-4b9f-909d-d310ed5fb4ea => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:16:59.515963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:16:59.525351 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7e84a000-bd05-4dd4-a833-c77fb6b74ab1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1314 microversion: 2.1 time: 1.728073 Aug 06 21:16:59.525960 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2330/4838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:16:57 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1314 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:00.555360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:00.565630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:00.578678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:00.591157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:00.594929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:00.596034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:00.596706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:00.597628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:01.272090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:01.280584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=99 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:01.282874 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2911bf50-cee5-4d69-93d8-39e66214da0a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1314 microversion: 2.1 time: 0.735904 Aug 06 21:17:01.311823 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2509/4839] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:00 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:02.312370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:02.313139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:02.329268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:02.335690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:02.339736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:02.342696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:02.356770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:02.358509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:03.971587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:03.979911 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e2d695b8-94aa-43ed-bba7-c76e625a040e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1314 microversion: 2.1 time: 1.672409 Aug 06 21:17:03.984935 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2331/4840] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:02 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1314 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:05.002750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:05.004157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:05.016927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:05.025794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:05.036622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:05.038345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:05.039446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:05.041014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:05.656395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:05.668007 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8c6071f-12ff-44b2-94e4-607425b73bb6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1314 microversion: 2.1 time: 0.669988 Aug 06 21:17:05.685423 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2510/4841] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:04 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:06.201357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-11331caf-a0b2-4e24-9bc8-99aa05cfc8e2 req-a2aed72c-a07f-4e1c-84d8-4f8c5bdd349f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6", "name": "network-vif-plugged", "status": "completed", "tag": "a753c87f-b490-45e1-b4a2-cbb9f73d1607"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:06.243945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-11331caf-a0b2-4e24-9bc8-99aa05cfc8e2 req-a2aed72c-a07f-4e1c-84d8-4f8c5bdd349f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:06.250942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-11331caf-a0b2-4e24-9bc8-99aa05cfc8e2 req-a2aed72c-a07f-4e1c-84d8-4f8c5bdd349f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:06.250942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-11331caf-a0b2-4e24-9bc8-99aa05cfc8e2 req-a2aed72c-a07f-4e1c-84d8-4f8c5bdd349f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:06.379055 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-11331caf-a0b2-4e24-9bc8-99aa05cfc8e2 req-a2aed72c-a07f-4e1c-84d8-4f8c5bdd349f service nova] Creating event network-vif-plugged:a753c87f-b490-45e1-b4a2-cbb9f73d1607 for instance 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 on nch2-master-1 Aug 06 21:17:06.429141 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-11331caf-a0b2-4e24-9bc8-99aa05cfc8e2 req-a2aed72c-a07f-4e1c-84d8-4f8c5bdd349f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220160 Aug 06 21:17:06.434540 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2332/4842] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:17:06.690319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:06.691227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:06.705121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:06.708635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:06.710833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:06.712237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:06.713726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:06.716043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:07.393622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:07.408106 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-662a363b-e5fc-40fc-a5a6-43c4d9cbd52a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1314 microversion: 2.1 time: 0.722402 Aug 06 21:17:07.409837 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2511/4843] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:06 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:08.430219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:08.430973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:08.447628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:08.448093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:08.448544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:08.450001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:08.450536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:08.451102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:09.818024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:09.832583 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-06e92d35-f797-464f-abe0-883dd6f81978 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1314 microversion: 2.1 time: 1.406548 Aug 06 21:17:09.852744 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2333/4844] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:08 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1314 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:10.877221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:10.878808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:10.911686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:10.912618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:10.918954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:10.920140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:10.922363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:10.924050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:11.590496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:11.599817 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a238e86-f334-43cf-870a-1dd1267995e7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1502 microversion: 2.1 time: 0.730271 Aug 06 21:17:11.609486 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2512/4845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:10 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1502 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:11.633722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b69c2cdf-e4d9-4907-bbe3-83f0c9dafe9d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:11.637222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b69c2cdf-e4d9-4907-bbe3-83f0c9dafe9d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:11.655586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b69c2cdf-e4d9-4907-bbe3-83f0c9dafe9d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:11.656310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b69c2cdf-e4d9-4907-bbe3-83f0c9dafe9d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:11.659454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b69c2cdf-e4d9-4907-bbe3-83f0c9dafe9d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:11.660558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b69c2cdf-e4d9-4907-bbe3-83f0c9dafe9d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:11.661260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b69c2cdf-e4d9-4907-bbe3-83f0c9dafe9d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:11.662339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b69c2cdf-e4d9-4907-bbe3-83f0c9dafe9d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:11.772723 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b69c2cdf-e4d9-4907-bbe3-83f0c9dafe9d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 14 microversion: 2.1 time: 0.144352 Aug 06 21:17:11.777589 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2334/4846] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:11 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:17:12.786946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-157275e3-0933-4f0a-a974-5fe62f40d60c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:12.794203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-157275e3-0933-4f0a-a974-5fe62f40d60c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:12.818223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-157275e3-0933-4f0a-a974-5fe62f40d60c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:12.819052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-157275e3-0933-4f0a-a974-5fe62f40d60c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:12.819725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-157275e3-0933-4f0a-a974-5fe62f40d60c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:12.828002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-157275e3-0933-4f0a-a974-5fe62f40d60c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:12.828936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-157275e3-0933-4f0a-a974-5fe62f40d60c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:12.829783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-157275e3-0933-4f0a-a974-5fe62f40d60c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:12.927784 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-157275e3-0933-4f0a-a974-5fe62f40d60c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 14 microversion: 2.1 time: 0.146822 Aug 06 21:17:12.929453 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2513/4847] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:12 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:17:13.942672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a0eb27a8-7836-428f-9485-3104f505fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:13.946168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a0eb27a8-7836-428f-9485-3104f505fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:13.966176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0eb27a8-7836-428f-9485-3104f505fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:13.967130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0eb27a8-7836-428f-9485-3104f505fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:13.969190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0eb27a8-7836-428f-9485-3104f505fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:13.971445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0eb27a8-7836-428f-9485-3104f505fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:13.972797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0eb27a8-7836-428f-9485-3104f505fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:13.973864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0eb27a8-7836-428f-9485-3104f505fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:14.077100 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a0eb27a8-7836-428f-9485-3104f505fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 14 microversion: 2.1 time: 0.139583 Aug 06 21:17:14.080652 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2514/4848] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:13 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:17:14.562862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-67a01799-91c5-4dcc-9011-f9611ad3c989 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'create', calling method: .version_select at 0x7f729d204550>, body: {"keypair": {"name": "tempest-keypair-1894272917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMlpp3qfwSVyconhxw3HqSGASjyBg945MQCoRz7SgZBMhtU9RkO8uUGIXfjQEeWW00/a5UiVClfhhKxBxmK98KQ80SPke0N3GurEL20BvoOGPMuu/NWU0hFJ+uTiYPU9w=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:14.584213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:14.640302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-67a01799-91c5-4dcc-9011-f9611ad3c989 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Getting quotas for project cfb3b91ed1294ea187812b7312601b27. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:17:14.679677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-67a01799-91c5-4dcc-9011-f9611ad3c989 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Getting quotas for user 65e64ff8f2b14f70b1b05327f691701e and project cfb3b91ed1294ea187812b7312601b27. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:17:14.804470 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-67a01799-91c5-4dcc-9011-f9611ad3c989 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.887596 Aug 06 21:17:14.817656 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2335/4849] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Aug 6 21:17:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 901 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 21:17:15.090801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd8f4794-3266-4b3d-bf85-8ff447aa2afe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:15.093978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd8f4794-3266-4b3d-bf85-8ff447aa2afe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:15.122501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd8f4794-3266-4b3d-bf85-8ff447aa2afe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:15.123724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd8f4794-3266-4b3d-bf85-8ff447aa2afe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:15.124460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd8f4794-3266-4b3d-bf85-8ff447aa2afe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:15.127138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd8f4794-3266-4b3d-bf85-8ff447aa2afe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:15.128302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd8f4794-3266-4b3d-bf85-8ff447aa2afe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:15.131635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd8f4794-3266-4b3d-bf85-8ff447aa2afe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:15.236199 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd8f4794-3266-4b3d-bf85-8ff447aa2afe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 14 microversion: 2.1 time: 0.151260 Aug 06 21:17:15.239994 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2515/4850] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:15 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:17:16.248931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28ccee25-b447-44dd-a5d1-8912c48c4725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:16.251291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-28ccee25-b447-44dd-a5d1-8912c48c4725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:16.277328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28ccee25-b447-44dd-a5d1-8912c48c4725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:16.277677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28ccee25-b447-44dd-a5d1-8912c48c4725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:16.278135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28ccee25-b447-44dd-a5d1-8912c48c4725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:16.278902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28ccee25-b447-44dd-a5d1-8912c48c4725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:16.279368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28ccee25-b447-44dd-a5d1-8912c48c4725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:16.279806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-28ccee25-b447-44dd-a5d1-8912c48c4725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:16.392503 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28ccee25-b447-44dd-a5d1-8912c48c4725 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 14 microversion: 2.1 time: 0.148094 Aug 06 21:17:16.396758 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2336/4851] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:16 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:17:17.408708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f1256403-accd-48de-b6e7-db504a2287cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:17.411172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f1256403-accd-48de-b6e7-db504a2287cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:17.431437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1256403-accd-48de-b6e7-db504a2287cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:17.433473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1256403-accd-48de-b6e7-db504a2287cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:17.435154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1256403-accd-48de-b6e7-db504a2287cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:17.437129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1256403-accd-48de-b6e7-db504a2287cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:17.445781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1256403-accd-48de-b6e7-db504a2287cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:17.447935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f1256403-accd-48de-b6e7-db504a2287cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:17.545614 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f1256403-accd-48de-b6e7-db504a2287cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 14 microversion: 2.1 time: 0.144288 Aug 06 21:17:17.546846 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2516/4852] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:17 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:17:18.560369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b39d7b32-97c4-48d9-afa7-456650d844d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:18.563293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b39d7b32-97c4-48d9-afa7-456650d844d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:18.593181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39d7b32-97c4-48d9-afa7-456650d844d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:18.598635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39d7b32-97c4-48d9-afa7-456650d844d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:18.599506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39d7b32-97c4-48d9-afa7-456650d844d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:18.602382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39d7b32-97c4-48d9-afa7-456650d844d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:18.603133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39d7b32-97c4-48d9-afa7-456650d844d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:18.605338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39d7b32-97c4-48d9-afa7-456650d844d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:18.662738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:18.695878 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b39d7b32-97c4-48d9-afa7-456650d844d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 14 microversion: 2.1 time: 0.141696 Aug 06 21:17:18.703541 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2337/4853] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:18 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:17:19.714889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-faba4ddb-9617-4bc0-9322-480c8c47497b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:19.730029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-faba4ddb-9617-4bc0-9322-480c8c47497b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:19.755464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faba4ddb-9617-4bc0-9322-480c8c47497b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:19.763530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faba4ddb-9617-4bc0-9322-480c8c47497b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:19.764000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faba4ddb-9617-4bc0-9322-480c8c47497b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:19.764763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faba4ddb-9617-4bc0-9322-480c8c47497b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:19.765231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faba4ddb-9617-4bc0-9322-480c8c47497b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:19.765664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-faba4ddb-9617-4bc0-9322-480c8c47497b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:19.888372 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-faba4ddb-9617-4bc0-9322-480c8c47497b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 14 microversion: 2.1 time: 0.177692 Aug 06 21:17:19.888596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2517/4854] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:19 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 21:17:20.903427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f4d2cb2-d798-4fe5-bcff-47e0396b2762 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:20.905353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f4d2cb2-d798-4fe5-bcff-47e0396b2762 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:20.956842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4d2cb2-d798-4fe5-bcff-47e0396b2762 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:20.958163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4d2cb2-d798-4fe5-bcff-47e0396b2762 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:20.961779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4d2cb2-d798-4fe5-bcff-47e0396b2762 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:20.966666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4d2cb2-d798-4fe5-bcff-47e0396b2762 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:20.967177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4d2cb2-d798-4fe5-bcff-47e0396b2762 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:20.971408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4d2cb2-d798-4fe5-bcff-47e0396b2762 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:21.091861 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f4d2cb2-d798-4fe5-bcff-47e0396b2762 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 14 microversion: 2.1 time: 0.194266 Aug 06 21:17:21.093235 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2338/4855] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:20 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 21:17:21.656877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-79854249", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57a9db63-1558-403c-8e4e-84bf972aa3e6"}], "security_groups": [{"name": "tempest-securitygroup--966728916"}], "key_name": "tempest-keypair-1894272917", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:21.981707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] validate_networks() for [('57a9db63-1558-403c-8e4e-84bf972aa3e6', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:17:22.109465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-124c9398-7168-40fd-88e6-c2c458ea859a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:22.112664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-124c9398-7168-40fd-88e6-c2c458ea859a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:22.130263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-124c9398-7168-40fd-88e6-c2c458ea859a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:22.131060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-124c9398-7168-40fd-88e6-c2c458ea859a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:22.132588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-124c9398-7168-40fd-88e6-c2c458ea859a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:22.133714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-124c9398-7168-40fd-88e6-c2c458ea859a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:22.136955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-124c9398-7168-40fd-88e6-c2c458ea859a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:22.137635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-124c9398-7168-40fd-88e6-c2c458ea859a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:22.254699 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-124c9398-7168-40fd-88e6-c2c458ea859a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action" status: 200 len: 8206 microversion: 2.1 time: 0.154241 Aug 06 21:17:22.255458 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2339/4856] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:22 2022] POST /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6/action => generated 8206 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:17:22.272414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:22.277202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:22.312807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:22.314363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:22.315373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:22.316350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:22.318457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:22.319157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:23.052869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:23.061951 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b9b3d842-f328-4e5d-af1b-b321beb42f40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.799185 Aug 06 21:17:23.062630 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2340/4857] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:22 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:23.108453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:23.109084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:23.119081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:23.119842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:23.123498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:23.124355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:23.124835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:23.125278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:23.513626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:17:23.514232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:17:23.514518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:17:23.514958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:17:23.515374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:17:23.540783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:23.541502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:23.542156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:23.543300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:23.543964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:23.551227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:23.593792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Getting quotas for project cfb3b91ed1294ea187812b7312601b27. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:17:23.608678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Getting quotas for user 65e64ff8f2b14f70b1b05327f691701e and project cfb3b91ed1294ea187812b7312601b27. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:17:23.643085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:17:23.645557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:17:23.754436 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f7768820-58c1-4c6b-86ff-89688d1d5b11 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.103592 Aug 06 21:17:23.755127 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2518/4858] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 21:17:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:17:23.767563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-64ab18fd-bec9-4dbd-b8ae-8e2216ea2949 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:23.768490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-64ab18fd-bec9-4dbd-b8ae-8e2216ea2949 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:23.930074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-64ab18fd-bec9-4dbd-b8ae-8e2216ea2949 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:23.941288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-64ab18fd-bec9-4dbd-b8ae-8e2216ea2949 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:23.944155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-64ab18fd-bec9-4dbd-b8ae-8e2216ea2949 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:23.953782 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-64ab18fd-bec9-4dbd-b8ae-8e2216ea2949 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1280 microversion: 2.20 time: 0.190224 Aug 06 21:17:23.956951 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2519/4859] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:23 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1280 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:17:24.432895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:24.444748 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c785485f-535d-4b8d-9ab4-1b9e0f9e162b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 1.340099 Aug 06 21:17:24.446263 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2341/4860] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:23 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:17:24.466599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:24.467490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:24.502729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:24.503271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:24.503741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:24.504853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:24.516697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:24.517347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:24.988501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:24.989385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:25.008824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:25.011320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:25.012084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:25.012694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:25.013670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:25.014297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:25.015075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:25.458131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:25.473288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:25.473997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:25.478711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:25.483911 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3488ed61-2c90-4ef3-a0a3-ec2558b0ee97 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 1.021991 Aug 06 21:17:25.484391 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aead945a-c16c-444d-a5ac-a1cb5a1b6d19 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1284 microversion: 2.20 time: 0.500828 Aug 06 21:17:25.486767 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2342/4861] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:24 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1284 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:17:25.489682 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2520/4862] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:24 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:25.506800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:25.507725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:25.516982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:25.520877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:25.521814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:25.524379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:25.527349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:25.528019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:25.852977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:25.862973 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4fb0d571-59b6-47a5-a590-300f3bfd1f9f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.358819 Aug 06 21:17:25.881954 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2343/4863] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:25 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:25.896049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:25.898697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:25.906463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:25.919092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:25.920575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:25.922078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:25.923088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:25.924976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:25.925974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:26.015132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Locking {{(pid=142461) lock /opt/stack/nova/nova/compute/api.py:4781}} Aug 06 21:17:26.123844 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da4b22f9-f5ee-4e8f-8457-2dc9068baabb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.239494 Aug 06 21:17:26.125697 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2521/4864] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:25 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:17:26.133862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:26.134591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:26.146443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:26.151313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:26.151821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:26.152586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:26.157065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:26.159966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:26.513376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:26.514011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:26.531115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:26.531973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:26.532763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:26.533662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:26.534505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:26.535145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:26.707450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:26.724529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:26.726513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:26.727900 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-88106f4e-bb57-452c-b393-5f0dddbe1ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1338 microversion: 2.20 time: 0.218695 Aug 06 21:17:26.728721 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2522/4865] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:26 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1338 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:17:26.848838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:26.861760 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-98049990-669d-4719-a0e3-eff02ca2ea2f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.732165 Aug 06 21:17:26.862807 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2344/4866] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:26 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:26.888983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b52e6218-bfdd-49f6-b882-d523a27475fe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:26.903144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b52e6218-bfdd-49f6-b882-d523a27475fe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:26.906641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b52e6218-bfdd-49f6-b882-d523a27475fe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:26.907321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b52e6218-bfdd-49f6-b882-d523a27475fe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:26.956858 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-b52e6218-bfdd-49f6-b882-d523a27475fe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] HTTP exception thrown: Instance e71d3632-d411-41b2-a821-54ef313a3279 is locked Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b52e6218-bfdd-49f6-b882-d523a27475fe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Request method failure captured: Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action HTTP/1.1 Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 15 Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlLrMLphZv01kMCsl_ADxfj1exGN5qj7bksI2CQDXCC5bOT2YoyjPmmNkwAa7sDhgUHz68BSQbQWlFxvxJJUo1Ik54iJqgpkEDeEBkgTYy-xfo6s4EM67H_dKHoDF0seGYVpiDQik6vZu6OMZxgJi_lMnRB4rJ88rWoOy1jEWQv98o Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9feea686598e4a0d90d716e00e3e290a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-985408345 Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 9b8463a42f2642aaba586380391de6fd Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: {"os-stop": {}} Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance e71d3632-d411-41b2-a821-54ef313a3279 is locked Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'e71d3632-d411-41b2-a821-54ef313a3279', 'body': {'os-stop': {}}} Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance e71d3632-d411-41b2-a821-54ef313a3279 is locked Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance e71d3632-d411-41b2-a821-54ef313a3279 is locked Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71d3632-d411-41b2-a821-54ef313a3279 is locked Aug 06 21:17:26.966714 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:17:26.975321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b52e6218-bfdd-49f6-b882-d523a27475fe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Returning 409 to user: Instance e71d3632-d411-41b2-a821-54ef313a3279 is locked {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:17:26.976453 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b52e6218-bfdd-49f6-b882-d523a27475fe tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 409 len: 107 microversion: 2.1 time: 0.092573 Aug 06 21:17:26.988603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:26.989524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:26.993067 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2523/4867] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:26 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 107 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 21:17:27.004194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:27.004714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:27.005172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:27.012823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:27.016927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:27.019097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:27.160077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Unlocking {{(pid=142462) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 06 21:17:27.264178 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-00fcb7e7-6001-4bbc-8fb5-fa2934b9d1f8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.279757 Aug 06 21:17:27.273219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a67660a1-6489-4e6b-8190-b026b1f8fb5c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:27.274824 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2345/4868] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:26 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:17:27.287700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a67660a1-6489-4e6b-8190-b026b1f8fb5c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:27.289908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a67660a1-6489-4e6b-8190-b026b1f8fb5c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:27.292278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a67660a1-6489-4e6b-8190-b026b1f8fb5c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:27.347231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a67660a1-6489-4e6b-8190-b026b1f8fb5c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Going to try to stop instance {{(pid=142461) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 21:17:27.429198 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a67660a1-6489-4e6b-8190-b026b1f8fb5c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.159186 Aug 06 21:17:27.431360 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2524/4869] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:27 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:17:27.445209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:27.446970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:27.465631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:27.466148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:27.466610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:27.467613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:27.468318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:27.468763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:27.769818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:27.772417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:27.784961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:27.791213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:27.792808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:27.794677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:27.796212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:27.798610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:27.878756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:27.892193 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-94975eea-a898-4dc3-a1ee-91d749227c1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.453287 Aug 06 21:17:27.893262 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2346/4870] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:27 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:28.735082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:28.754300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:28.763428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:28.765810 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d4e7097-6181-4a34-89ef-485167f9aeed tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1405 microversion: 2.20 time: 1.014264 Aug 06 21:17:28.769157 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2525/4871] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:27 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1405 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:17:28.914936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:28.916437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:28.928999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:28.930641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:28.933552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:28.934510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:28.937051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:28.937689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:29.791019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:29.793101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:29.810457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:29.811080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:29.811531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:29.812276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:29.814039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:29.814509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:29.903047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:29.975559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:29.993986 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-530fb3a8-402e-4b15-8654-b720e174190f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 1.082829 Aug 06 21:17:30.013925 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2347/4872] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:28 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:30.293119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ed90ef60-8817-4dc3-a835-bbb4bc149a24 req-bfef8461-6c19-4b8d-a59b-7c730f4c94c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb20bab-9b22-4671-b84c-7bc4eaf210e3", "tag": "f485cd9a-93ad-408a-96d5-4b3ca1a20ca3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:30.312190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ed90ef60-8817-4dc3-a835-bbb4bc149a24 req-bfef8461-6c19-4b8d-a59b-7c730f4c94c1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:30.312673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ed90ef60-8817-4dc3-a835-bbb4bc149a24 req-bfef8461-6c19-4b8d-a59b-7c730f4c94c1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:30.313118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ed90ef60-8817-4dc3-a835-bbb4bc149a24 req-bfef8461-6c19-4b8d-a59b-7c730f4c94c1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:30.340442 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ed90ef60-8817-4dc3-a835-bbb4bc149a24 req-bfef8461-6c19-4b8d-a59b-7c730f4c94c1 service nova] Creating event network-changed:f485cd9a-93ad-408a-96d5-4b3ca1a20ca3 for instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 on nch1-master-1 Aug 06 21:17:30.349140 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ed90ef60-8817-4dc3-a835-bbb4bc149a24 req-bfef8461-6c19-4b8d-a59b-7c730f4c94c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060719 Aug 06 21:17:30.350161 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2348/4873] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:17:30.438136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:30.453022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:30.461528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:30.465458 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a91a6334-c441-4a5c-b5ea-ddf660e153a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1405 microversion: 2.20 time: 0.675899 Aug 06 21:17:30.483100 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2526/4874] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:29 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1405 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:17:31.026227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:31.029869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:31.044992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:31.045535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:31.048384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:31.054604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:31.055115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:31.055568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:31.497018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:31.498412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:31.521149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:31.522094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:31.523763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:31.525072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:31.527263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:31.529096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:32.054979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:32.069854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:32.076433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:32.078775 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-31425993-5ea8-4827-a8f9-4bfb656d03aa tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1405 microversion: 2.20 time: 0.586432 Aug 06 21:17:32.079621 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2527/4875] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:31 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1405 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:17:32.206521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:32.218689 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-961c44e4-b7e4-420c-9c2a-b64c49c80eec tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 1.198441 Aug 06 21:17:32.219933 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2349/4876] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:31 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:33.106453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:33.107387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:33.127025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:33.127729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:33.128198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:33.129174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:33.129763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:33.130208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:33.241034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:33.242358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:33.258798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:33.263106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:33.271553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:33.272608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:33.274070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:33.274765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:33.572898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:33.710905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:33.724387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:33.726634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:33.728528 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eb367372-087e-428f-9e39-4f67574cbb8f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1405 microversion: 2.20 time: 0.625906 Aug 06 21:17:33.729920 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2528/4877] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:33 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1405 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:17:33.843539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:33.856981 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-91b681a9-7f6b-487f-a0dc-86da756a1dc6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.619396 Aug 06 21:17:33.859778 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2350/4878] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:33 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:34.756845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:34.757475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:34.760940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:34.769029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:34.778926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:34.779349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:34.780117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:34.780595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:34.781026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:34.890716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:34.891997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:34.907941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:34.910538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:34.913631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:34.914789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:34.917951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:34.919106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:35.432457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:35.446181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:35.450213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:35.450430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:35.453112 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-674107f5-aaeb-4666-8f2b-16cfb4249416 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1405 microversion: 2.20 time: 0.701468 Aug 06 21:17:35.453721 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2529/4879] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:34 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1405 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:17:35.473859 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3a78b4b5-e61e-45e4-ae75-f382d6519e53 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.590791 Aug 06 21:17:35.474262 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2351/4880] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:34 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:36.476322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:36.476937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:36.492128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:36.500880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:36.502293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:36.507560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:36.512655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:36.513531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:36.515754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:36.517679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:36.529236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:36.535014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:36.537145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:36.545059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:36.547204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:36.547871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:37.084285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:37.107060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:37.115881 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-103b48b1-5c3e-426f-8ea8-03dca323d4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.620462 Aug 06 21:17:37.123753 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2352/4881] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:36 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:37.231101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:37.269907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:37.279126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:37.283410 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1c7dff6b-a429-4bc2-8bf6-dcdb0efd23c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1405 microversion: 2.20 time: 0.811140 Aug 06 21:17:37.284999 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2530/4882] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:36 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1405 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:17:38.147966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:38.149172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:38.195411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:38.208043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:38.211277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:38.212129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:38.225415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:38.228823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:38.313252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:38.314143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:38.327196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:38.331798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:38.332579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:38.333574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:38.334279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:38.334980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:38.680291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:38.700211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:38.702281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:38.703681 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e8f8d1c-4a36-4713-a0df-34a50f9ac8b2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1405 microversion: 2.20 time: 0.394523 Aug 06 21:17:38.725211 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2531/4883] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:38 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:17:38.752061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:38.762069 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a13f4ad8-bc5d-4ea7-a6a5-13a39eef5331 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1657 microversion: 2.1 time: 0.625054 Aug 06 21:17:38.763436 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2353/4884] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:38 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1657 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:38.792417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-347e3257-5036-484a-87af-a0138e89421a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:38.809717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-347e3257-5036-484a-87af-a0138e89421a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:38.810442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-347e3257-5036-484a-87af-a0138e89421a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:38.810930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-347e3257-5036-484a-87af-a0138e89421a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:38.851112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-347e3257-5036-484a-87af-a0138e89421a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Going to try to start instance {{(pid=142461) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 21:17:38.918083 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-347e3257-5036-484a-87af-a0138e89421a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.137582 Aug 06 21:17:38.920791 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2532/4885] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:38 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:17:38.928941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:38.929567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:38.943002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:38.943450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:38.943907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:38.944641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:38.945168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:38.945591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:39.733084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:39.733930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:39.745319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:39.751512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:39.752106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:39.752967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:39.753570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:39.754336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:39.953384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:39.969787 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb500282-8adc-40c3-93d7-50d185f1e7ce tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1666 microversion: 2.1 time: 1.044800 Aug 06 21:17:39.970685 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2354/4886] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:38 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1666 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:40.261308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:40.280837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:40.291444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:40.293684 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-387b63c4-8cb2-4fc9-8a37-e792c0b8816a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1405 microversion: 2.20 time: 0.566979 Aug 06 21:17:40.294391 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2533/4887] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:39 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1405 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:17:40.995822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:40.996605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:41.012848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:41.013365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:41.013819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:41.014587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:41.015054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:41.015496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:41.318163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:41.321336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:41.322663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:41.328980 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b5ef213a-154a-40e4-8382-9c0936c4937c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1666 microversion: 2.1 time: 0.338154 Aug 06 21:17:41.333691 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2355/4888] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:40 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1666 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:41.354313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:41.357544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:41.358231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:41.361412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:41.363885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:41.374064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:41.409391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5655f9c5-4f78-4e73-8c29-9ca5cd5f3c84 req-a46cede2-9725-4577-a8ed-54c765ec8259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb20bab-9b22-4671-b84c-7bc4eaf210e3", "name": "network-vif-plugged", "status": "completed", "tag": "f485cd9a-93ad-408a-96d5-4b3ca1a20ca3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:41.421359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5655f9c5-4f78-4e73-8c29-9ca5cd5f3c84 req-a46cede2-9725-4577-a8ed-54c765ec8259 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:41.421896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5655f9c5-4f78-4e73-8c29-9ca5cd5f3c84 req-a46cede2-9725-4577-a8ed-54c765ec8259 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:41.422345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5655f9c5-4f78-4e73-8c29-9ca5cd5f3c84 req-a46cede2-9725-4577-a8ed-54c765ec8259 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:41.465962 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-5655f9c5-4f78-4e73-8c29-9ca5cd5f3c84 req-a46cede2-9725-4577-a8ed-54c765ec8259 service nova] Creating event network-vif-plugged:f485cd9a-93ad-408a-96d5-4b3ca1a20ca3 for instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 on nch1-master-1 Aug 06 21:17:41.482733 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5655f9c5-4f78-4e73-8c29-9ca5cd5f3c84 req-a46cede2-9725-4577-a8ed-54c765ec8259 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083966 Aug 06 21:17:41.489452 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2356/4889] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:17:42.355214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:42.355941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:42.372614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:42.376429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:42.377150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:42.378144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:42.380184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:42.382346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:42.594654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:42.604601 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5a18f4c2-b26b-4b58-bedd-494f1b664f84 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.254686 Aug 06 21:17:42.606065 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2357/4890] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:42 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:42.631110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:42.631738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:42.638651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:42.639557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:42.640188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:42.641103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:42.641841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:42.642438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:43.198641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:43.256120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:43.257821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:43.259119 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-29edad5a-d7e0-4e36-9198-7990fcffff6e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1405 microversion: 2.20 time: 1.942429 Aug 06 21:17:43.265849 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2534/4891] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:41 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1405 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:17:43.364340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:43.377011 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e30ed024-caab-40b5-b501-57cb3f12dcfa tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.754509 Aug 06 21:17:43.379822 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2358/4892] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:42 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:43.406380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:43.407420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:43.419758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:43.420606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:43.421219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:43.422930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:43.423575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:43.424460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:43.502335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Unlocking {{(pid=142461) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 06 21:17:43.607715 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-226c0e6f-fbc0-4bf1-853f-adbd7aca7371 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.206986 Aug 06 21:17:43.608505 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2535/4893] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:43 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:17:43.620105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:43.620759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:43.632859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:43.636162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:43.636592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:43.637352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:43.642923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:43.645745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:44.290273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:44.292221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:44.303797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:44.304572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:44.306579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:44.311473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:44.312626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:44.316724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:44.626745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:44.636954 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23cce516-82b4-436c-9e65-5a8f599a1293 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 1.022607 Aug 06 21:17:44.643346 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2359/4894] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:43 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:44.669744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:44.671071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:44.692397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:44.696121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:44.702401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:44.703496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:44.705752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:44.715981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:44.717179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:45.195053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:45.214132 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e29cf575-a363-42a1-9961-5c41a5f9b3bb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.547684 Aug 06 21:17:45.216193 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2360/4895] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:44 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:45.244490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:45.245481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:45.260634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:45.261572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:45.272557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:45.273634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:45.276521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:45.277209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:45.408883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:45.425479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:45.439530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:45.441100 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-59e0a260-46a0-4ee8-8041-21ba90e636fc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1597 microversion: 2.20 time: 1.156943 Aug 06 21:17:45.441850 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2536/4896] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:17:44 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1597 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:17:45.464602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5780cdc4-0f30-4092-bc3c-2674e91b8b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:45.465318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5780cdc4-0f30-4092-bc3c-2674e91b8b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:45.478210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5780cdc4-0f30-4092-bc3c-2674e91b8b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:45.479033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5780cdc4-0f30-4092-bc3c-2674e91b8b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:45.479647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5780cdc4-0f30-4092-bc3c-2674e91b8b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:45.489923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5780cdc4-0f30-4092-bc3c-2674e91b8b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:45.490703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5780cdc4-0f30-4092-bc3c-2674e91b8b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:45.491304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5780cdc4-0f30-4092-bc3c-2674e91b8b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:45.691040 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5780cdc4-0f30-4092-bc3c-2674e91b8b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.230257 Aug 06 21:17:45.691583 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2537/4897] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Aug 6 21:17:45 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 21:17:46.859018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:46.869211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6667a342-b347-4d81-b9bf-900deca1d8ad tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 1.634671 Aug 06 21:17:46.875878 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2361/4898] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:45 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:46.909123 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-55100ec5-719c-476e-93a3-b42ae2e5c3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:46.911084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-55100ec5-719c-476e-93a3-b42ae2e5c3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:46.937502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55100ec5-719c-476e-93a3-b42ae2e5c3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:46.942075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55100ec5-719c-476e-93a3-b42ae2e5c3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:46.943056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55100ec5-719c-476e-93a3-b42ae2e5c3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:46.945817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55100ec5-719c-476e-93a3-b42ae2e5c3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:46.947915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55100ec5-719c-476e-93a3-b42ae2e5c3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:46.950608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55100ec5-719c-476e-93a3-b42ae2e5c3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:47.111097 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-55100ec5-719c-476e-93a3-b42ae2e5c3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.208911 Aug 06 21:17:47.115390 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2538/4899] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:46 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:17:47.123892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:47.124586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:47.134038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:47.136859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:47.138822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:47.139577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:47.140045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:47.140482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:48.029746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:48.043679 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2a4d0d8a-59a1-4c63-b6b3-706888f3a321 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1675 microversion: 2.1 time: 0.925144 Aug 06 21:17:48.044753 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2362/4900] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:47 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1675 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:17:49.066931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:49.068163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:49.083104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:49.083854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:49.084482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:49.085483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:49.087565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:49.088398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:49.166564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:50.048233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:50.095519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2dce6175-cd4c-4db7-b978-5e1158ecc527 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1655 microversion: 2.1 time: 1.016156 Aug 06 21:17:50.098577 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2539/4901] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:49 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1655 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:50.122379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfc510f3-09d7-4e83-9837-8efd852836d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:50.123171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dfc510f3-09d7-4e83-9837-8efd852836d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:50.130334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc510f3-09d7-4e83-9837-8efd852836d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:50.131122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc510f3-09d7-4e83-9837-8efd852836d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:50.131760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc510f3-09d7-4e83-9837-8efd852836d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:50.132654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc510f3-09d7-4e83-9837-8efd852836d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:50.135720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc510f3-09d7-4e83-9837-8efd852836d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:50.136346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfc510f3-09d7-4e83-9837-8efd852836d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:50.323782 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfc510f3-09d7-4e83-9837-8efd852836d3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.205940 Aug 06 21:17:50.334536 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2363/4902] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:17:50 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:17:50.343392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:50.344031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:50.361578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7a5cbfa1-a8ed-41ab-93fa-262a94b5c099 req-5e4fa46e-4018-4900-a864-d7da4bf50edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb20bab-9b22-4671-b84c-7bc4eaf210e3", "tag": "f485cd9a-93ad-408a-96d5-4b3ca1a20ca3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:17:50.366182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:50.368959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:50.369081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:50.370152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:50.370657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:50.371097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:50.377840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7a5cbfa1-a8ed-41ab-93fa-262a94b5c099 req-5e4fa46e-4018-4900-a864-d7da4bf50edb service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:50.378973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7a5cbfa1-a8ed-41ab-93fa-262a94b5c099 req-5e4fa46e-4018-4900-a864-d7da4bf50edb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:50.379603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7a5cbfa1-a8ed-41ab-93fa-262a94b5c099 req-5e4fa46e-4018-4900-a864-d7da4bf50edb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:50.410704 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7a5cbfa1-a8ed-41ab-93fa-262a94b5c099 req-5e4fa46e-4018-4900-a864-d7da4bf50edb service nova] Creating event network-changed:f485cd9a-93ad-408a-96d5-4b3ca1a20ca3 for instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 on nch1-master-1 Aug 06 21:17:50.433651 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7a5cbfa1-a8ed-41ab-93fa-262a94b5c099 req-5e4fa46e-4018-4900-a864-d7da4bf50edb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089032 Aug 06 21:17:50.434962 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2364/4903] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:17:51.289060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:51.298411 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f8d269fb-b1bb-4242-aa9d-aa785acd8e8f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1662 microversion: 2.1 time: 0.958935 Aug 06 21:17:51.309661 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2540/4904] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:50 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1662 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:52.325934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:52.327041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:52.341775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:52.347290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:52.347840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:52.349928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:52.354250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:52.354745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:54.061917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:54.074159 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23ad06aa-be40-4a4c-a53b-707956f69a61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 1.755404 Aug 06 21:17:54.090578 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2365/4905] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:52 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:54.110343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:54.111695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:54.124830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:54.125646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:54.131508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:54.132796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:54.134878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:54.135390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:54.535116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:54.551506 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cdb99597-e7eb-4965-8f1d-f3f73047925e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.444790 Aug 06 21:17:54.553130 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2541/4906] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:54 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:54.581892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:54.583125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:54.613672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:54.614659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:54.615347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:54.619663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:54.620939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:54.621876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:55.290373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:55.299278 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b3ecf3ff-8e09-4136-a0fe-de9549401c87 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.722968 Aug 06 21:17:55.304070 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2366/4907] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:54 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:55.328864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:55.329476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:55.339363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:55.339859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:55.340304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:55.342529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:55.343580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:55.345232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:55.963656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:55.986610 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-465477ae-c1d9-488b-beb1-3def574fbc88 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.648440 Aug 06 21:17:55.987842 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2542/4908] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:55 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:56.013330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:56.013971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:56.028025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:56.030739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:56.031510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:56.032333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:56.035351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:56.035351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:56.489296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:56.498190 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f61ddf0-4021-4a55-aed5-2d3e026db934 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.490230 Aug 06 21:17:56.499079 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2367/4909] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:56 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:17:56.524614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:17:56.525811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:17:56.532810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=44 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:17:56.534409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:56.535239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:56.539436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:56.540865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:17:56.541713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:17:56.542317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:17:56.811218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:17:56.823181 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f22170b9-d935-4158-ba92-0f2c6b17d84b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.302257 Aug 06 21:17:56.828054 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2543/4910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:17:56 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:18:02.618458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3aa1c505-1489-4267-920f-780004c88e99 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Action: 'create', calling method: .version_select at 0x7f729c96a160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1024969963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIi4H67eaE3BfvzdQXowkVYc2v5y8nmArV2aoIYkxSBLD3tws2AaB62kBKCl1aSyXNjGC5AuLNz7Wv2J+sb18UOIIzB7Yo6QyxNJIddItKWd9OFTonuWCHgrSV+Tf7g1Q=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:18:02.661730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-3aa1c505-1489-4267-920f-780004c88e99 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Getting quotas for project 1f57cc6855ef4b98ad703de9bdc1e094. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:18:02.669514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-3aa1c505-1489-4267-920f-780004c88e99 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Getting quotas for user 7cd539be9e3b426d9eb5bdba4697f849 and project 1f57cc6855ef4b98ad703de9bdc1e094. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:18:02.723270 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3aa1c505-1489-4267-920f-780004c88e99 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.521542 Aug 06 21:18:02.730723 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2368/4911] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:18:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:18:06.591785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1978791923", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1024969963", "security_groups": [{"name": "tempest-secgroup-smoke-906283644"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "388ed432-95a5-46a1-87a7-48712572da6f"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:18:06.632118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:06.822038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=29 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:07.462412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] validate_networks() for [('388ed432-95a5-46a1-87a7-48712572da6f', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:18:09.015272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Getting quotas for project 1f57cc6855ef4b98ad703de9bdc1e094. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:18:09.022095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Getting quotas for user 7cd539be9e3b426d9eb5bdba4697f849 and project 1f57cc6855ef4b98ad703de9bdc1e094. Resources: dict_keys(['metadata_items']) {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:18:09.052985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:18:09.054355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:18:09.058274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:18:09.059282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:18:09.060061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:18:09.072511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:09.073099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:09.073856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:09.074665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:09.075358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:09.076022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:09.108500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Getting quotas for project 1f57cc6855ef4b98ad703de9bdc1e094. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:18:09.126210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Getting quotas for user 7cd539be9e3b426d9eb5bdba4697f849 and project 1f57cc6855ef4b98ad703de9bdc1e094. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:18:09.149634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:18:09.158026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:18:09.248278 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bb956bf6-41e3-4ddf-b8a4-876edbb457f2 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.660632 Aug 06 21:18:09.252958 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2544/4912] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:18:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 2666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:18:09.261046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8520538-c30e-4822-91e3-2d7226a3c649 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:09.262402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c8520538-c30e-4822-91e3-2d7226a3c649 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:09.274347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:09.422194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c8520538-c30e-4822-91e3-2d7226a3c649 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:09.429582 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8520538-c30e-4822-91e3-2d7226a3c649 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1303 microversion: 2.1 time: 0.173437 Aug 06 21:18:09.432615 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2369/4913] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:09 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:10.453232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:10.455039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:10.474784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:10.475482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:10.476070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:10.477967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:10.479289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:10.479883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:10.625441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:10.649891 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4220c2e4-c7df-41f1-8459-43ad0c2814f9 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1355 microversion: 2.1 time: 0.201064 Aug 06 21:18:10.655146 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2545/4914] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:10 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1355 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:11.679315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:11.680085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:11.694036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:11.694635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:11.695607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:11.696509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:11.699865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:11.700330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:11.947964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:11.956150 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-90087413-164f-455e-a02a-211cc2bb08d7 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1361 microversion: 2.1 time: 0.281390 Aug 06 21:18:11.957568 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2370/4915] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:11 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:12.980171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:12.980914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:13.001584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:13.002421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:13.003731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:13.008692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:13.012297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:13.013431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:13.455934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:13.465971 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-20468e02-718f-4c0d-9dc9-2e88458c760d tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1428 microversion: 2.1 time: 0.492087 Aug 06 21:18:13.479814 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2546/4916] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:12 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1428 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:14.489067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:14.492650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:14.527753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-fd793672-29e0-411b-94c9-40a0609f9354 req-9637668f-b30a-412b-b6f0-870677bc3d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec600a9-acec-4524-8be8-3e63c1c126b3", "tag": "4876cba1-7426-4ff2-a027-7850291ec025"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:18:14.535476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:14.541125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:14.545644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:14.548698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:14.549424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:14.550907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:14.563204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fd793672-29e0-411b-94c9-40a0609f9354 req-9637668f-b30a-412b-b6f0-870677bc3d8a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:14.563969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fd793672-29e0-411b-94c9-40a0609f9354 req-9637668f-b30a-412b-b6f0-870677bc3d8a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:14.567209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fd793672-29e0-411b-94c9-40a0609f9354 req-9637668f-b30a-412b-b6f0-870677bc3d8a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:14.608265 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-fd793672-29e0-411b-94c9-40a0609f9354 req-9637668f-b30a-412b-b6f0-870677bc3d8a service nova] Creating event network-changed:4876cba1-7426-4ff2-a027-7850291ec025 for instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 on nch2-master-1 Aug 06 21:18:14.625280 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-fd793672-29e0-411b-94c9-40a0609f9354 req-9637668f-b30a-412b-b6f0-870677bc3d8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107867 Aug 06 21:18:14.626421 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2547/4917] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:18:14.994284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:15.019064 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-65e742cd-aebb-4963-b7b6-72926c1719bb tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1428 microversion: 2.1 time: 0.536055 Aug 06 21:18:15.020066 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2371/4918] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:14 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1428 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:16.045434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:16.049856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:16.068175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:16.068697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:16.069152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:16.072611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:16.074091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:16.075066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:16.482077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:16.498583 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1be19b71-f1dd-4e54-a411-4e0ef1e75f79 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1428 microversion: 2.1 time: 0.458007 Aug 06 21:18:16.503421 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2548/4919] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:16 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1428 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:16.811017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-69a9e068-fdbd-465e-9557-2f1118a21349 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:18:16.814451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-69a9e068-fdbd-465e-9557-2f1118a21349 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:16.819404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:16.835028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69a9e068-fdbd-465e-9557-2f1118a21349 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:16.836049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69a9e068-fdbd-465e-9557-2f1118a21349 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:16.836718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69a9e068-fdbd-465e-9557-2f1118a21349 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:16.838967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69a9e068-fdbd-465e-9557-2f1118a21349 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:16.839635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69a9e068-fdbd-465e-9557-2f1118a21349 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:16.842399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69a9e068-fdbd-465e-9557-2f1118a21349 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:17.022259 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-69a9e068-fdbd-465e-9557-2f1118a21349 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.215184 Aug 06 21:18:17.033403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:17.033403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:17.034139 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2372/4920] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:18:16 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:18:17.043294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:17.044110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:17.044727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:17.058833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:17.059486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:17.060140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:17.523850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:17.524579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:17.539383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:17.542479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:17.543275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:17.544245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:17.546041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:17.546699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:17.775292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:17.791577 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-031536ac-8c65-4109-af19-8d0e7e552e42 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1672 microversion: 2.1 time: 0.763989 Aug 06 21:18:17.792885 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2549/4921] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:17 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1672 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:18:18.247336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:18.255215 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bda3d6f9-18f4-4b66-b0a2-659d7eebef4a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1428 microversion: 2.1 time: 0.737243 Aug 06 21:18:18.261301 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2373/4922] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:17 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1428 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:18:18.815569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:18.816552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:18.825926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:18.826429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:18.826922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:18.827679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:18.843173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:18.843695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:19.097077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:19.141803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:19.277256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:19.277887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:19.290607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:19.291136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:19.291674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:19.292355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:19.293311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:19.294006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:19.294694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:19.313072 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-41dcb368-5dac-4046-8427-11d2dcf28ef4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1672 microversion: 2.1 time: 0.494020 Aug 06 21:18:19.314076 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2550/4923] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:18 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1672 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:19.429709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:20.000360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:20.011825 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7dd4e16-7595-48e9-906e-7e52b271e5da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1428 microversion: 2.1 time: 0.738338 Aug 06 21:18:20.013195 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2374/4924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:19 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1428 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:20.325761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b5dcef3-7714-48ab-948a-41e0af8ef11a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:20.327043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9b5dcef3-7714-48ab-948a-41e0af8ef11a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:20.334141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:20.335556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:20.348173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:20.352590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b5dcef3-7714-48ab-948a-41e0af8ef11a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:20.354283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:20.354507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:20.355757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:20.356439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b5dcef3-7714-48ab-948a-41e0af8ef11a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:20.357168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:20.357854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b5dcef3-7714-48ab-948a-41e0af8ef11a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:20.358515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:20.359865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b5dcef3-7714-48ab-948a-41e0af8ef11a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:20.363691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b5dcef3-7714-48ab-948a-41e0af8ef11a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:20.364413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b5dcef3-7714-48ab-948a-41e0af8ef11a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:20.412235 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b5dcef3-7714-48ab-948a-41e0af8ef11a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/ips" status: 200 len: 152 microversion: 2.20 time: 0.091415 Aug 06 21:18:20.412828 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2551/4925] 10.222.0.33 () {60 vars in 1289 bytes} [Sat Aug 6 21:18:20 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/ips => generated 152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:18:20.764001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:20.778442 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ebde116f-f639-4c49-a396-b9b49407843d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.448229 Aug 06 21:18:20.779088 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2375/4926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:20 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:21.036611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:21.037917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:21.051622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:21.053323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:21.055322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:21.060246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:21.064033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:21.064693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:21.564999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a35f7b50-2309-4d86-846d-513c0fab8cd9 req-897459d6-15fc-4af8-b7bb-115b629bf97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec600a9-acec-4524-8be8-3e63c1c126b3", "name": "network-vif-plugged", "status": "completed", "tag": "4876cba1-7426-4ff2-a027-7850291ec025"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:18:21.587381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a35f7b50-2309-4d86-846d-513c0fab8cd9 req-897459d6-15fc-4af8-b7bb-115b629bf97b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:21.588273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a35f7b50-2309-4d86-846d-513c0fab8cd9 req-897459d6-15fc-4af8-b7bb-115b629bf97b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:21.589125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a35f7b50-2309-4d86-846d-513c0fab8cd9 req-897459d6-15fc-4af8-b7bb-115b629bf97b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:21.653193 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a35f7b50-2309-4d86-846d-513c0fab8cd9 req-897459d6-15fc-4af8-b7bb-115b629bf97b service nova] Creating event network-vif-plugged:4876cba1-7426-4ff2-a027-7850291ec025 for instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 on nch2-master-1 Aug 06 21:18:21.682376 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a35f7b50-2309-4d86-846d-513c0fab8cd9 req-897459d6-15fc-4af8-b7bb-115b629bf97b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117331 Aug 06 21:18:21.690390 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2376/4927] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:18:22.149994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:22.167476 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-842f32d3-80c9-4179-859f-fc966951f603 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1428 microversion: 2.1 time: 1.137020 Aug 06 21:18:22.168178 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2552/4928] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:21 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1428 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:22.587302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:18:22.587970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:22.600354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:22.601916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:22.602627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:22.603731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:22.608529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:22.620812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:22.662926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lazy-loading 'flavor' on Instance uuid 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:18:23.193735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:23.195846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:23.207931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:23.208666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:23.209300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:23.210808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:23.211459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:23.212071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:23.298256 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-09182a9b-de3c-4b85-8658-20933a2f196a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/action" status: 202 len: 0 microversion: 2.20 time: 0.717899 Aug 06 21:18:23.301905 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2377/4929] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 21:18:22 2022] POST /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:18:23.312637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:23.314752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:23.337428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:23.339979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:23.341528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:23.343180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:23.344048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:23.345339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:23.653868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:23.664254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:23.666592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:23.668155 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-edc1d97e-dd20-40bc-9642-63370d914715 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.361531 Aug 06 21:18:23.668935 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2378/4930] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:23 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:23.706652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:23.733789 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f98affe3-b114-4735-81e8-0fb2d39a19da tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1608 microversion: 2.1 time: 0.543877 Aug 06 21:18:23.738581 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2553/4931] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:23 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1608 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:18:23.757545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:23.758386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:23.772593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:23.776263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:23.776846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:23.780240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:23.782925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:23.783444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:24.307063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:24.317580 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d3924247-a9ce-4c93-a83d-e2df8fb52ad3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1608 microversion: 2.1 time: 0.565229 Aug 06 21:18:24.318364 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2379/4932] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:23 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1608 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:24.340968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:24.341699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:24.354779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:24.355888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:24.356914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:24.358233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:24.358922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:24.359515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:24.599610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:24.612296 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-14df1d0c-ad4d-4efa-9eeb-563bcfc87f17 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1608 microversion: 2.1 time: 0.276761 Aug 06 21:18:24.613372 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2554/4933] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:24 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1608 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:24.693956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:24.695692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:24.708098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:24.708791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:24.719519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:24.720169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:24.720613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:24.721060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:25.147974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:25.170986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:25.178824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:25.183512 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-91d61bee-c9a8-4e62-8e09-6bf4e9970508 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.492648 Aug 06 21:18:25.186403 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2380/4934] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:24 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:26.209117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:26.209868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:26.222705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:26.223433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:26.225338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:26.226898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:26.227426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:26.227891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:26.624359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:26.634980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:26.636798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:26.638312 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3daddec0-9d32-4f0a-8fe0-1ab8f08e921a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.433005 Aug 06 21:18:26.639488 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2555/4935] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:26 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:27.669775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:27.670499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:27.689196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:27.691352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:27.692039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:27.694035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:27.695426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:27.696040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:28.216301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:28.229346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:28.230944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:28.232151 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-01e48c9d-934d-4c97-8696-aba2192ded8e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.570553 Aug 06 21:18:28.237580 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2381/4936] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:27 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:28.457765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Calling method '.version_select at 0x7f729d6e2dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:28.458971 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:18:28.458971 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:18:28.460258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:28.460862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:28.461320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:28.488133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:28.492649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:28.493175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:28.519289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:28.519799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:28.520245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:28.548380 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-be23fdf1-a257-4ddb-964b-aaa43e4b0b34 tempest-PortsAdminExtendedAttrsTestJSON-1945522545 tempest-PortsAdminExtendedAttrsTestJSON-1945522545-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.377157 Aug 06 21:18:28.549658 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2556/4937] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:18:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:18:28.933998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-310e2db0-a62a-4938-a1c4-38ddcb9b3393 req-35ecfe67-b529-4c7f-8376-e0981265b6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec600a9-acec-4524-8be8-3e63c1c126b3", "tag": "4876cba1-7426-4ff2-a027-7850291ec025"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:18:28.954732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-310e2db0-a62a-4938-a1c4-38ddcb9b3393 req-35ecfe67-b529-4c7f-8376-e0981265b6a7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:28.955476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-310e2db0-a62a-4938-a1c4-38ddcb9b3393 req-35ecfe67-b529-4c7f-8376-e0981265b6a7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:28.956205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-310e2db0-a62a-4938-a1c4-38ddcb9b3393 req-35ecfe67-b529-4c7f-8376-e0981265b6a7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:28.971022 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-310e2db0-a62a-4938-a1c4-38ddcb9b3393 req-35ecfe67-b529-4c7f-8376-e0981265b6a7 service nova] Creating event network-changed:4876cba1-7426-4ff2-a027-7850291ec025 for instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 on nch2-master-1 Aug 06 21:18:28.980023 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-310e2db0-a62a-4938-a1c4-38ddcb9b3393 req-35ecfe67-b529-4c7f-8376-e0981265b6a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049202 Aug 06 21:18:28.981232 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2382/4938] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:18:29.274700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:29.275580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:29.294472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:29.296072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:29.299153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:29.300212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:29.300915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:29.301632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:29.903424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:29.938375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:29.947910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:29.949473 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9f85e28-4ba5-4b5b-8846-098bf8b6dd01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.679939 Aug 06 21:18:29.954133 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2557/4939] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:29 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:30.995120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:30.997276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:31.014129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:31.016839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:31.017297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:31.018918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:31.019382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:31.019815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:31.588846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:31.597784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:31.605748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:31.607444 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5adc1d1c-9bce-47f0-bd41-d10295daa8a9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.627794 Aug 06 21:18:31.608030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2383/4940] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:30 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:32.633542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:32.634876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:32.651562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:32.654128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:32.656395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:32.657899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:32.659214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:32.661799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:33.688372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:33.707579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:33.709294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:33.714123 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-140e7de7-3591-412b-9e4a-a0219ae274a0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 1.086720 Aug 06 21:18:33.719645 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2558/4941] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:32 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:34.742631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:34.749946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:34.757868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:34.758805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:34.759489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:34.760478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:34.761175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:34.761840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:35.271538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:35.275957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:35.290933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:35.292869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:35.294608 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-10998d91-5899-4d07-a14e-3a4ec8dd2221 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.557021 Aug 06 21:18:35.299076 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2384/4942] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:34 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:36.325261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:36.325882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:36.350668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:36.351654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:36.352308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:36.353217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:36.353916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:36.355000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:36.879849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:36.894908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=85 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:36.905380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:36.908480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:36.914065 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-645a1a17-c139-476d-902a-62f6ceac264d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.588993 Aug 06 21:18:36.916295 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2559/4943] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:36 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:37.943831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:37.944465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:37.953043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:37.953524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:37.953971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:37.954795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:37.955269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:37.955708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:38.130088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:38.141052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:38.143126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:38.144855 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-418c8f7f-2a66-4bc2-a3b0-6617096c81fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.205044 Aug 06 21:18:38.145607 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2385/4944] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:37 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:39.170081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:39.171379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:39.179362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:39.181413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:39.181864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:39.182479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:39.183396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:39.184016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:39.184616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:39.650318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:39.666206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:39.668907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:39.674480 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40fb3dec-965a-45b8-a049-ed7ebb3983d0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1743 microversion: 2.20 time: 0.509117 Aug 06 21:18:39.692755 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2560/4945] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:39 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1743 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:40.702355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:40.703195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:40.716151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:40.716821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:40.717377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:40.718989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:40.719567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:40.720113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:41.181166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:41.194125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:41.198267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:41.199711 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ae6b4e45-33de-4fc4-ad61-df0d6cb4721a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1743 microversion: 2.20 time: 0.505144 Aug 06 21:18:41.201479 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2386/4946] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:40 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1743 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:42.226228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:42.227033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:42.243762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:42.245818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:42.247687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:42.266321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:42.268241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:42.272845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:42.638890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:42.667776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:42.682630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:42.687168 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8525b34b-a140-43d9-9af7-7f437800bc2d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.467453 Aug 06 21:18:42.694789 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2561/4947] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:42 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:43.604808 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:18:43.605766 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:18:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:18:43.714525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:43.715899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:43.731392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:43.732910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:43.733681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:43.736282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:43.737459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:43.738968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:43.916578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-596950e2-93c8-4ad8-a294-6c05a4ccb985 req-9d64ca89-7474-4287-a127-1fe5874518d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb20bab-9b22-4671-b84c-7bc4eaf210e3", "name": "network-vif-plugged", "status": "completed", "tag": "f485cd9a-93ad-408a-96d5-4b3ca1a20ca3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:18:43.950413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-596950e2-93c8-4ad8-a294-6c05a4ccb985 req-9d64ca89-7474-4287-a127-1fe5874518d1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:43.952057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-596950e2-93c8-4ad8-a294-6c05a4ccb985 req-9d64ca89-7474-4287-a127-1fe5874518d1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:43.953254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-596950e2-93c8-4ad8-a294-6c05a4ccb985 req-9d64ca89-7474-4287-a127-1fe5874518d1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:43.985068 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-596950e2-93c8-4ad8-a294-6c05a4ccb985 req-9d64ca89-7474-4287-a127-1fe5874518d1 service nova] Creating event network-vif-plugged:f485cd9a-93ad-408a-96d5-4b3ca1a20ca3 for instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 on nch1-master-1 Aug 06 21:18:44.010242 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-596950e2-93c8-4ad8-a294-6c05a4ccb985 req-9d64ca89-7474-4287-a127-1fe5874518d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097844 Aug 06 21:18:44.012469 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2562/4948] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:18:44.541660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:44.557485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:44.560964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:44.569372 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c1453358-1538-4b22-9065-b4f1982252b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.858579 Aug 06 21:18:44.571826 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2387/4949] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:43 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:45.601503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:45.602390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:45.614141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:45.616470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:45.617019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:45.619121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:45.622770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:45.623592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:46.142813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:46.163818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:46.165808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:46.167295 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fba68d7f-658d-4842-bd44-3c4d6ebbae28 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.571763 Aug 06 21:18:46.168381 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2563/4950] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:45 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:47.194701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:47.195334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:47.199405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=32 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:18:47.209803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:47.210667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:47.213050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:47.214080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:47.214785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:47.215854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:47.230073 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:18:47.230309 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:18:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 (ip 10.222.0.33) !!! Aug 06 21:18:48.205111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:48.214686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:48.232538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:48.238114 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-234b43b2-4eeb-4488-bc6e-40afb6f5d507 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 1.048587 Aug 06 21:18:48.246438 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2388/4951] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:47 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:49.274083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:49.275926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:49.284606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:49.285625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:49.286295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:49.288087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:49.288798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:49.289546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:49.905111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:49.930793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:49.942783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:49.957343 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-88e5ed68-8ef5-4df7-ab70-a31d41b73151 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.684084 Aug 06 21:18:49.963455 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2564/4952] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:49 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:50.996543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:51.003943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:51.027577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:51.028475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:51.029121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:51.030050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:51.030792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:51.031711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:52.315612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:52.330487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:52.340420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:52.343727 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-67612d16-bda8-4df5-b82b-42e105e0e804 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 1.362662 Aug 06 21:18:52.350893 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2389/4953] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:50 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:52.923775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:52.925656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:52.937166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:52.951390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:52.952142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:52.953296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:52.953967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:52.954881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:53.376251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:53.376952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:53.404251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:53.407426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:53.411768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:53.418354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:53.419692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:53.421283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:54.102502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:54.116558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:54.118123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:54.119439 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfd8a2e4-18a9-4d12-ba2d-4b3f452b10da tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.748601 Aug 06 21:18:54.148779 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2390/4954] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:53 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:54.596521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:54.605405 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-583db8f0-2a58-470f-a497-50cf711cdce5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 1.685697 Aug 06 21:18:54.610641 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2565/4955] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:52 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:54.635226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:54.639154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:54.647930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:54.648748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:54.649380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:54.650339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:54.651118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:54.651722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:54.919724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:54.933336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e617f53f-d582-4d56-b41f-b56bc84aeb6d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.302967 Aug 06 21:18:54.934592 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2391/4956] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:54 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:54.955132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:54.955753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:54.968447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:54.968936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:54.970346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:54.972885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:54.973594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:54.980621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:55.146609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:55.152470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:55.170524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:55.173790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:55.187829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:55.199217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:55.201021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:55.201746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:55.648107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:55.669995 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-056dbfc2-a781-42a8-9797-742959500d58 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.716273 Aug 06 21:18:55.674861 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2566/4957] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:54 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:55.704688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:55.705697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:55.722918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:55.739038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:55.749740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:55.750713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:55.754031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:55.755455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:55.756676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:55.757287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:55.760745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:55.764311 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e2a0a06f-15e8-4ecf-b725-016d1c344116 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.626080 Aug 06 21:18:55.767448 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2392/4958] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:55 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:18:56.513366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:56.524160 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6ba9a654-2a0c-4dc7-9908-1149d559ebfc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.825818 Aug 06 21:18:56.527287 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2567/4959] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:55 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:18:56.772951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-546704800", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c08e52fc-aab5-48dd-94e2-7ca909bf5d7b"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:18:56.795374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:56.796781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:56.814951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:56.818920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:56.819468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:56.820298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:56.820837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:56.821332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:56.923684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] validate_networks() for [('c08e52fc-aab5-48dd-94e2-7ca909bf5d7b', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:18:57.517565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:57.531886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:57.533984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:57.539513 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47c3964b-3dda-4c3d-ba18-31f196dc8d3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.747738 Aug 06 21:18:57.542642 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2568/4960] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:56 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:18:58.570034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:58.570738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:18:58.585187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:58.585773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:58.586427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:58.587285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:58.587904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:58.588501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:59.203036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:18:59.203520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:18:59.204077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:18:59.204368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:18:59.204790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:18:59.225030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:59.225172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:59.225634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:59.226396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:18:59.226897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:59.227065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:18:59.227330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:18:59.267277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:59.273945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:18:59.275811 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c111a06-5f86-41d1-9823-e9d870de2a76 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.712144 Aug 06 21:18:59.276414 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2569/4961] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:18:58 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:18:59.301548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:18:59.310785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for user 9b8463a42f2642aaba586380391de6fd and project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:18:59.326422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:18:59.329162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:18:59.437661 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f81ae0ba-39a3-46de-9922-d976a2be9c40 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.670142 Aug 06 21:18:59.447499 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2393/4962] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:18:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:18:59.451818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-06bf5d59-3af8-4e70-9466-cdee489c23c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:18:59.452438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-06bf5d59-3af8-4e70-9466-cdee489c23c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:00.073555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-06bf5d59-3af8-4e70-9466-cdee489c23c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:00.083471 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-06bf5d59-3af8-4e70-9466-cdee489c23c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1214 microversion: 2.1 time: 0.634790 Aug 06 21:19:00.087178 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2570/4963] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:18:59 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1214 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:00.300210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:00.306096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:00.318944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:00.319803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:00.320681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:00.321669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:00.322361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:00.323142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:00.956859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:00.996661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:01.000096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:01.003701 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b40aeed-908d-4463-b66f-3d0a87d11051 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.707655 Aug 06 21:19:01.005561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2394/4964] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:00 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:01.111881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:01.113149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:01.122941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:01.124110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:01.124920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:01.125890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:01.126617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:01.127301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:01.239185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:01.251815 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f9b00a39-a82a-49dd-a609-9ad6f3c79874 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1266 microversion: 2.1 time: 0.144375 Aug 06 21:19:01.266871 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2571/4965] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:01 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:02.032326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:02.033201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:02.060364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:02.063491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:02.065694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:02.068080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:02.069953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:02.073140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:02.284743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:02.284743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:02.297604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:02.298173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:02.298654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:02.302691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:02.303455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:02.303942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:02.417009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:02.434516 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f35ce3e-afd5-4a0f-9c99-22f95ba9f15c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1272 microversion: 2.1 time: 0.154394 Aug 06 21:19:02.436315 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2572/4966] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:02 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:03.053337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:03.069696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:03.078788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:03.080320 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-60ae85eb-ea0a-4691-b35c-c863c21c8a4f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 1.056124 Aug 06 21:19:03.081826 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2395/4967] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:02 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:03.263320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6293e615-6c9e-4948-a695-d54e29e765c3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:03.266303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6293e615-6c9e-4948-a695-d54e29e765c3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:03.283640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6293e615-6c9e-4948-a695-d54e29e765c3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:03.284452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6293e615-6c9e-4948-a695-d54e29e765c3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:03.285098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6293e615-6c9e-4948-a695-d54e29e765c3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:03.287047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6293e615-6c9e-4948-a695-d54e29e765c3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:03.288823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6293e615-6c9e-4948-a695-d54e29e765c3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:03.289786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6293e615-6c9e-4948-a695-d54e29e765c3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:03.334765 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6293e615-6c9e-4948-a695-d54e29e765c3 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.082204 Aug 06 21:19:03.341752 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2573/4968] 10.222.0.33 () {58 vars in 1293 bytes} [Sat Aug 6 21:19:03 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3/os-server-password => generated 116 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:19:03.459100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:03.459725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:03.478165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:03.478924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:03.479703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:03.480507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:03.481238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:03.486752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:04.113095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:04.114447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:04.140586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:04.141794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:04.142427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:04.143389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:04.144309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:04.144946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:04.792201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:04.807731 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fdf24a75-6d39-4d46-b504-c9cab4778af1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1314 microversion: 2.1 time: 1.353847 Aug 06 21:19:04.812983 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2396/4969] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:03 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1314 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:05.625933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:05.649395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:05.657268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:05.660225 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7dde1588-afcb-40f5-8cb0-063f81130241 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 1.554109 Aug 06 21:19:05.682902 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2574/4970] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:04 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:05.882828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:05.884355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:05.906929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:05.908836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:05.910254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:05.912443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:05.917122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:05.920898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:06.394077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:06.397100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bfb9e388-647f-4730-96a8-c86ca9668668 req-de60a2a0-b9a4-4759-9d08-cf4ed531c6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4120d582-da95-45f9-bbcb-7711563329d9", "tag": "27954808-d1f9-4dd8-8b6d-0ed9c1aa7afa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:06.417286 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6e68b234-e2f1-4976-ba7c-40719680fa5e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1314 microversion: 2.1 time: 0.570029 Aug 06 21:19:06.422642 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2397/4971] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:05 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:06.430929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bfb9e388-647f-4730-96a8-c86ca9668668 req-de60a2a0-b9a4-4759-9d08-cf4ed531c6d9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:06.431487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bfb9e388-647f-4730-96a8-c86ca9668668 req-de60a2a0-b9a4-4759-9d08-cf4ed531c6d9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:06.432145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bfb9e388-647f-4730-96a8-c86ca9668668 req-de60a2a0-b9a4-4759-9d08-cf4ed531c6d9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:06.459394 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bfb9e388-647f-4730-96a8-c86ca9668668 req-de60a2a0-b9a4-4759-9d08-cf4ed531c6d9 service nova] Creating event network-changed:27954808-d1f9-4dd8-8b6d-0ed9c1aa7afa for instance 4120d582-da95-45f9-bbcb-7711563329d9 on nch1-master-1 Aug 06 21:19:06.469345 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bfb9e388-647f-4730-96a8-c86ca9668668 req-de60a2a0-b9a4-4759-9d08-cf4ed531c6d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079148 Aug 06 21:19:06.472122 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2575/4972] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:19:06.707633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:06.709132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:06.719341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:06.720484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:06.721017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:06.721835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:06.722317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:06.722900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:07.446325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:07.447066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:07.459186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:07.465565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:07.467428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:07.468667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:07.471884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:07.475516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:07.476780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:07.487624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:07.496139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:07.500672 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e35d8fd6-07b1-4dde-9534-aa8b1791f3a3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.797194 Aug 06 21:19:07.504286 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2398/4973] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:06 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:08.528569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:08.529953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:08.541090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:08.541878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:08.543371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:08.545331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:08.546026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:08.546695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:08.572328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:08.583013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=81 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:08.597058 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3b3bfa52-8af8-4143-9277-e72088bc9698 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1314 microversion: 2.1 time: 1.152813 Aug 06 21:19:08.601525 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2576/4974] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:07 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1314 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:08.829985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:08.845033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:08.855753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:08.857189 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-38e65fad-610d-409c-ace9-7c1bdd530199 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1738 microversion: 2.20 time: 0.333919 Aug 06 21:19:08.857789 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2399/4975] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:08 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:09.621674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:09.623197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:09.663674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=36 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:09.668614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:09.669742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:09.671880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:09.674217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:09.679061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:09.679815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:09.731471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=88 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:09.885161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:09.885875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:09.888006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:09.889282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:09.897903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:09.898418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:09.899147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:09.900115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:09.900796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:09.901444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:10.078245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:10.106819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:10.121907 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a6979eb4-5109-43ff-9567-fb98c0bb7651 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1314 microversion: 2.1 time: 0.504328 Aug 06 21:19:10.123827 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2577/4976] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:09 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:19:10.760870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:10.781260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:10.800399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:10.803897 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d4dedcd-3605-4ff8-877a-ad0ed3228592 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1720 microversion: 2.20 time: 0.921172 Aug 06 21:19:10.811466 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2400/4977] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:09 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1720 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:11.146414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:11.147277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:11.163482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:11.164869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:11.168234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:11.169874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:11.170644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:11.172609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:11.832729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:11.835626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:11.852479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:11.854143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:11.856598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:11.857817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:11.858651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:11.859379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:11.970992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:11.980858 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ea3496a1-3513-4779-9cc6-35e81b20a238 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1314 microversion: 2.1 time: 0.840675 Aug 06 21:19:11.982291 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2578/4978] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:11 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:12.087601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:12.101523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:12.103431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:12.104970 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1681eead-9942-4aa7-817a-1f8df92e7607 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1720 microversion: 2.20 time: 0.278649 Aug 06 21:19:12.116330 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2401/4979] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:11 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:19:13.006792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:13.008069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:13.019284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:13.020460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:13.021071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:13.021792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:13.022251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:13.022851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:13.137223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:13.138976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:13.150243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:13.151241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:13.152136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:13.153241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:13.153985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:13.155367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:13.446928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:13.476541 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-794c5572-47de-4f41-9c85-479cf78c6eca tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1314 microversion: 2.1 time: 0.471866 Aug 06 21:19:13.499003 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2579/4980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:13 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:13.508431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-1d082748-838f-4ded-86d3-f7e913b00add req-f72d84b7-7e3c-4847-816f-0e3589187d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4120d582-da95-45f9-bbcb-7711563329d9", "name": "network-vif-plugged", "status": "completed", "tag": "27954808-d1f9-4dd8-8b6d-0ed9c1aa7afa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:13.522317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1d082748-838f-4ded-86d3-f7e913b00add req-f72d84b7-7e3c-4847-816f-0e3589187d5d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:13.523080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1d082748-838f-4ded-86d3-f7e913b00add req-f72d84b7-7e3c-4847-816f-0e3589187d5d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:13.524428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1d082748-838f-4ded-86d3-f7e913b00add req-f72d84b7-7e3c-4847-816f-0e3589187d5d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:13.548927 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-1d082748-838f-4ded-86d3-f7e913b00add req-f72d84b7-7e3c-4847-816f-0e3589187d5d service nova] Creating event network-vif-plugged:27954808-d1f9-4dd8-8b6d-0ed9c1aa7afa for instance 4120d582-da95-45f9-bbcb-7711563329d9 on nch1-master-1 Aug 06 21:19:13.568363 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-1d082748-838f-4ded-86d3-f7e913b00add req-f72d84b7-7e3c-4847-816f-0e3589187d5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062140 Aug 06 21:19:13.569657 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2580/4981] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:19:13.704727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:13.715124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:13.717030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:13.718529 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-baef232c-62a2-406a-a207-ecacc8ebc947 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1723 microversion: 2.20 time: 0.586164 Aug 06 21:19:13.719116 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2402/4982] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:13 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1723 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:13.750215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f422b6fc-9b6c-4c2f-b4a8-7283c542ad5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ff735e5-1c13-4f4b-a375-3a73824d0945"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:13.753736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f422b6fc-9b6c-4c2f-b4a8-7283c542ad5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:13.761371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f422b6fc-9b6c-4c2f-b4a8-7283c542ad5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:13.762001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f422b6fc-9b6c-4c2f-b4a8-7283c542ad5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:13.762739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f422b6fc-9b6c-4c2f-b4a8-7283c542ad5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:13.763782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f422b6fc-9b6c-4c2f-b4a8-7283c542ad5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:13.765038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f422b6fc-9b6c-4c2f-b4a8-7283c542ad5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:13.765472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f422b6fc-9b6c-4c2f-b4a8-7283c542ad5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:14.124112 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f422b6fc-9b6c-4c2f-b4a8-7283c542ad5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.378920 Aug 06 21:19:14.133359 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2581/4983] 10.222.0.33 () {62 vars in 1364 bytes} [Sat Aug 6 21:19:13 2022] POST /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments => generated 188 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:19:14.287917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:14.289236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:14.302888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:14.303558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:14.306807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:14.307632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:14.308226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:14.309697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:14.347565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=142462) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 21:19:14.457304 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/action" status: 202 len: 0 microversion: 2.20 time: 0.178636 Aug 06 21:19:14.463602 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2403/4984] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 21:19:14 2022] POST /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:19:14.467245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:14.467869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:14.475931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:14.476925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:14.477436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:14.481969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:14.482289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:14.483352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:14.509941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:14.510746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:14.521536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:14.522428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:14.523107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:14.525076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:14.526359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:14.527311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:14.847268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:14.856658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:14.858183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:14.859420 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e7afa34-f4f9-4eeb-9421-4c3967987e9b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1749 microversion: 2.20 time: 0.396117 Aug 06 21:19:14.867125 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2582/4985] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:14 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1749 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:15.375400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:15.389968 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-785b6406-d347-4a3b-a542-13fd28d22dcb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1314 microversion: 2.1 time: 0.881738 Aug 06 21:19:15.391561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2404/4986] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:14 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1314 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:15.627945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3482f645-aa7b-4c6e-a213-6f3b899c8062 req-2c0b8930-be24-4211-9dc3-d80a1137fb72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb20bab-9b22-4671-b84c-7bc4eaf210e3", "name": "network-vif-unplugged", "status": "completed", "tag": "f485cd9a-93ad-408a-96d5-4b3ca1a20ca3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:15.655119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3482f645-aa7b-4c6e-a213-6f3b899c8062 req-2c0b8930-be24-4211-9dc3-d80a1137fb72 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:15.656189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3482f645-aa7b-4c6e-a213-6f3b899c8062 req-2c0b8930-be24-4211-9dc3-d80a1137fb72 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:15.661983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3482f645-aa7b-4c6e-a213-6f3b899c8062 req-2c0b8930-be24-4211-9dc3-d80a1137fb72 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:15.697506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.compute.server_external_events [req-3482f645-aa7b-4c6e-a213-6f3b899c8062 req-2c0b8930-be24-4211-9dc3-d80a1137fb72 service nova] Unable to find a host for instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3. Dropping event network-vif-unplugged {{(pid=142461) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 21:19:15.699589 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3482f645-aa7b-4c6e-a213-6f3b899c8062 req-2c0b8930-be24-4211-9dc3-d80a1137fb72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.076136 Aug 06 21:19:15.700650 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2583/4987] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 78 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 21:19:15.884265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:15.884889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:15.894281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:15.897919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:15.899351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:15.900734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:15.901569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:15.903442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:16.400727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:16.413591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:16.413824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:16.414233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:16.418089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:16.419353 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b556047a-0e8d-4afd-8c11-6735c42885a6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1749 microversion: 2.20 time: 0.539682 Aug 06 21:19:16.422938 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2405/4988] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:15 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1749 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:16.424976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:16.425487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:16.425997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:16.432312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:16.433032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:16.437616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:16.970156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:16.980119 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-189b7876-90f2-406c-99c3-ed74110f58e0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1501 microversion: 2.1 time: 0.571824 Aug 06 21:19:16.996398 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2584/4989] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:16 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1501 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:19:17.002377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:17.003180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:17.011023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:17.013864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:17.014494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:17.017730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:17.018380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:17.019040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:17.366989 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.network.security_group_api [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Removing security group 9dec8cc1-8765-4ef8-9b27-44d39065ad69 from port 27954808-d1f9-4dd8-8b6d-0ed9c1aa7afa Aug 06 21:19:17.447472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:17.449035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:17.464474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:17.465868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:17.474527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:17.476795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:17.478603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:17.479250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:17.916032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:17.925626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:17.933648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:17.935359 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd05d01f-d51d-4311-b48c-c7f2b809d988 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1751 microversion: 2.20 time: 0.494869 Aug 06 21:19:17.951692 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2585/4990] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:17 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1751 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:18.266722 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b4ad26c5-aa5f-4a13-9b6d-95a0f4c6390e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9/action" status: 202 len: 0 microversion: 2.1 time: 1.268233 Aug 06 21:19:18.271458 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2406/4991] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:19:16 2022] POST /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9/action => generated 0 bytes in 1274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:19:18.276515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:18.277961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:18.289912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:18.290842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:18.291066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:18.293290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:18.295202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:18.298037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:18.373663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7881ba15-85e0-48a3-b9c7-452395841793 req-0b40d6a6-9f81-40ed-8d83-38daa28f33dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4120d582-da95-45f9-bbcb-7711563329d9", "tag": "27954808-d1f9-4dd8-8b6d-0ed9c1aa7afa"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:18.384604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:18.400263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7881ba15-85e0-48a3-b9c7-452395841793 req-0b40d6a6-9f81-40ed-8d83-38daa28f33dc service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:18.400771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7881ba15-85e0-48a3-b9c7-452395841793 req-0b40d6a6-9f81-40ed-8d83-38daa28f33dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:18.403760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7881ba15-85e0-48a3-b9c7-452395841793 req-0b40d6a6-9f81-40ed-8d83-38daa28f33dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:18.432997 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7881ba15-85e0-48a3-b9c7-452395841793 req-0b40d6a6-9f81-40ed-8d83-38daa28f33dc service nova] Creating event network-changed:27954808-d1f9-4dd8-8b6d-0ed9c1aa7afa for instance 4120d582-da95-45f9-bbcb-7711563329d9 on nch1-master-1 Aug 06 21:19:18.446292 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7881ba15-85e0-48a3-b9c7-452395841793 req-0b40d6a6-9f81-40ed-8d83-38daa28f33dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077802 Aug 06 21:19:18.448562 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2407/4992] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:19:18.627977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:18.651714 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1dfc3eab-df45-4933-9f0f-b382e329c4e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1459 microversion: 2.1 time: 0.377758 Aug 06 21:19:18.652539 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2586/4993] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:18 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1459 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:19:18.687103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:18.688076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:18.704981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:18.705800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:18.709240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:18.710244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:18.711589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:18.712216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:18.961665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:18.962290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:18.974055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:18.974574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:18.975076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:18.980482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:18.985963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:18.990998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:19.608197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:19.621534 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f5869f55-ae5c-4bb5-9f82-0c24bb039449 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.945222 Aug 06 21:19:19.622733 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2408/4994] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:18 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:19.648933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:19.650049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:19.664766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:19.668409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:19.669117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:19.671386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:19.672332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:19.674780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:20.051947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:20.084715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:20.090655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:20.093159 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-21fd08c8-1329-41af-9503-4851cd0c1e7e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 1.137963 Aug 06 21:19:20.104279 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2587/4995] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:18 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:20.144153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:20.169889 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2a394f18-eebb-4d3f-ad84-76a4e9316e65 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.525061 Aug 06 21:19:20.192165 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2409/4996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:19 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:19:20.198920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:20.199809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:20.213200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:20.216857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:20.219506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:20.220441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:20.223293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:20.224249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:21.122300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:21.122966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:21.133837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:21.136493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:21.136985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:21.137858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:21.138309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:21.143120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:21.661200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:21.676759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:21.681842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:21.688076 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bfb3d60d-01a7-4cb2-8a5c-610319082032 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.570660 Aug 06 21:19:21.699045 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2410/4997] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:21 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:19:21.843027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:21.856192 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f38afbee-edf9-40a1-a502-ba4a8f7df7cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 1.664629 Aug 06 21:19:21.857774 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2588/4998] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:20 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:19:21.882362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:21.883028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:21.890992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:21.892022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:21.892487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:21.893216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:21.893680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:21.894109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:22.048910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-88b53de8-7918-4de6-b9b0-d27afb3b8e75 req-2d76ee88-fd11-4dc4-91a9-f57fd4badf6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb20bab-9b22-4671-b84c-7bc4eaf210e3", "tag": "f485cd9a-93ad-408a-96d5-4b3ca1a20ca3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:22.082828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-88b53de8-7918-4de6-b9b0-d27afb3b8e75 req-2d76ee88-fd11-4dc4-91a9-f57fd4badf6b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:22.084590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-88b53de8-7918-4de6-b9b0-d27afb3b8e75 req-2d76ee88-fd11-4dc4-91a9-f57fd4badf6b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:22.085065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-88b53de8-7918-4de6-b9b0-d27afb3b8e75 req-2d76ee88-fd11-4dc4-91a9-f57fd4badf6b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:22.111525 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-88b53de8-7918-4de6-b9b0-d27afb3b8e75 req-2d76ee88-fd11-4dc4-91a9-f57fd4badf6b service nova] Creating event network-changed:f485cd9a-93ad-408a-96d5-4b3ca1a20ca3 for instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 on nch2-master-1 Aug 06 21:19:22.123434 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-88b53de8-7918-4de6-b9b0-d27afb3b8e75 req-2d76ee88-fd11-4dc4-91a9-f57fd4badf6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085293 Aug 06 21:19:22.125388 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2589/4999] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:19:22.282850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:22.306033 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2ff179fa-2f1c-4cdc-a490-d07dced4fe63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.428537 Aug 06 21:19:22.338122 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2411/5000] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:21 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:22.499896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-373967528", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c08e52fc-aab5-48dd-94e2-7ca909bf5d7b"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:22.614818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] validate_networks() for [('c08e52fc-aab5-48dd-94e2-7ca909bf5d7b', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:19:22.725174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:22.726394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:22.738219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:22.742884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:22.744035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:22.745063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:22.747552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:22.749299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:23.444544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:23.491184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:23.494054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:23.495332 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b7fe3fc-b5ce-4948-a0bb-35169f299fd5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.775461 Aug 06 21:19:23.520188 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2412/5001] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:22 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:24.285559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:19:24.286411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:19:24.286411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:19:24.287218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:19:24.287720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:19:24.299256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:24.301464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:24.302140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:24.303561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:24.304346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:24.305438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:24.347299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:19:24.356530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Getting quotas for user 9b8463a42f2642aaba586380391de6fd and project 9feea686598e4a0d90d716e00e3e290a. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:19:24.390729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:19:24.392395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:19:24.497094 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f614d5ab-9876-4395-b391-d24033315ae4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.001313 Aug 06 21:19:24.497770 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2590/5002] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:19:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:19:24.509416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3306a76c-1e70-4e7f-b47b-2a126f310154 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:24.510762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3306a76c-1e70-4e7f-b47b-2a126f310154 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:24.546430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:24.547355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:24.557537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:24.562936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:24.567339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:24.568906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:24.570141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:24.572891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:25.001969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3306a76c-1e70-4e7f-b47b-2a126f310154 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:25.013070 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3306a76c-1e70-4e7f-b47b-2a126f310154 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1214 microversion: 2.1 time: 0.507410 Aug 06 21:19:25.017494 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2413/5003] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:24 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1214 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:26.043824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:26.046456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:26.081860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:26.089819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:26.095722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:26.099216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:26.100159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:26.103682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:26.104333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:26.113668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:26.126800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:26.131299 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6ff28019-d617-4bd2-b8a9-8fc4cd93c858 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 1.590303 Aug 06 21:19:26.144058 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2591/5004] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:24 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:19:27.128595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:27.156885 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46ba296a-aa2a-4c5b-8a0b-086df9dcceb8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1266 microversion: 2.1 time: 1.123252 Aug 06 21:19:27.161480 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2414/5005] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:26 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1266 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:27.179922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:27.181112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:27.198802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:27.199505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:27.200111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:27.200988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:27.201598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:27.202190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:28.009221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:28.021886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:28.036718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:28.047834 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-10388355-2e8a-4308-a686-bd94db16f9b5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.867154 Aug 06 21:19:28.066871 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2592/5006] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:27 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:28.183423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:28.184931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:28.229143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:28.233385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:28.234804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:28.238878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:28.239645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:28.241258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:28.349474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:28.366060 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-331c5530-fb58-4af3-9a52-e0eca8b8cd63 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1272 microversion: 2.1 time: 0.187596 Aug 06 21:19:28.367300 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2415/5007] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:28 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:29.073479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:29.074127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:29.088641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:29.089136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:29.089842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:29.090849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:29.091537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:29.092254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:29.391436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:29.392331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:29.403937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:29.407367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:29.410821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:29.412117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:29.412799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:29.413400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:29.597225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:29.604238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:29.612003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ec9c8fc-14f5-4936-b4ab-a172e82096cd tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1272 microversion: 2.1 time: 0.225142 Aug 06 21:19:29.627627 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2416/5008] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:29 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:19:29.692668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:29.695329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:29.710072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:29.714564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:29.718069 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5307698a-485f-46b9-a619-0b685d7139f4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.648589 Aug 06 21:19:29.731087 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2593/5009] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:29 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:30.644654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:30.645391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:30.689021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:30.692092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:30.692861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:30.693712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:30.712563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:30.713396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:30.746715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:30.748958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:30.791129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:30.795306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:30.796151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:30.798767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:30.800498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:30.801726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:31.648708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:31.703993 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bb35e612-5e8c-42bc-ace5-17625f0cf1c2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1314 microversion: 2.1 time: 1.066704 Aug 06 21:19:31.707448 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2417/5010] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:30 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1314 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:32.178011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:32.202046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:32.205249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:32.208159 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0aabacec-4221-4904-a61a-87ebe30aee9c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 1.466290 Aug 06 21:19:32.209847 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2594/5011] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:30 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:32.727644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:32.728357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:32.745165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:32.750215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:32.752781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:32.754125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:32.754649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:32.759455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:33.233116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:33.233743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:33.246588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:33.246988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:33.247493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:33.249428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:33.254905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:33.255638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:33.256253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:33.277028 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b2cc010-23fa-42fb-a0b4-7208d32d322b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1314 microversion: 2.1 time: 0.538871 Aug 06 21:19:33.279434 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2418/5012] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:32 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:33.998910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:34.023845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:34.033371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:34.045827 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-97661dbf-ac1c-4649-9625-9d1ddb9db206 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.817278 Aug 06 21:19:34.046468 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2595/5013] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:33 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:19:34.226128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-4ca3d1a1-ecac-4e39-8fc4-2f087c497937 req-fb798ecd-30d8-4891-a95f-2ce75005b9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c02955-845b-4476-ac9c-e6f7e4e6730c", "tag": "13f81297-5740-4b09-b1dc-2910500568ac"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:34.258350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4ca3d1a1-ecac-4e39-8fc4-2f087c497937 req-fb798ecd-30d8-4891-a95f-2ce75005b9f7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:34.259568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4ca3d1a1-ecac-4e39-8fc4-2f087c497937 req-fb798ecd-30d8-4891-a95f-2ce75005b9f7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:34.260273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4ca3d1a1-ecac-4e39-8fc4-2f087c497937 req-fb798ecd-30d8-4891-a95f-2ce75005b9f7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:34.303203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:34.304597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:34.306975 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-4ca3d1a1-ecac-4e39-8fc4-2f087c497937 req-fb798ecd-30d8-4891-a95f-2ce75005b9f7 service nova] Creating event network-changed:13f81297-5740-4b09-b1dc-2910500568ac for instance 09c02955-845b-4476-ac9c-e6f7e4e6730c on nch2-master-1 Aug 06 21:19:34.322351 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-4ca3d1a1-ecac-4e39-8fc4-2f087c497937 req-fb798ecd-30d8-4891-a95f-2ce75005b9f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100599 Aug 06 21:19:34.328332 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2419/5014] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:19:34.329201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:34.331083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:34.331792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:34.332386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:34.333196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:34.336379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:34.338223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:34.376129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:35.074176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:35.075618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:35.093837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:35.097301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:35.098669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:35.099297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:35.100210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:35.100824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:35.101416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:35.231094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:35.245124 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0722bcff-2b31-4db5-9bbb-70d9a3246a4f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1314 microversion: 2.1 time: 0.944589 Aug 06 21:19:35.249720 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2596/5015] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:34 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1314 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:35.478752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:35.494494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:35.496920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:35.500011 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2dd0cc53-fbe3-4b8d-ac71-538da653ab6d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.430179 Aug 06 21:19:35.506422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2420/5016] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:35 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:36.270814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:36.272044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:36.281558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:36.282224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:36.282846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:36.283735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:36.284465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:36.286302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:36.535144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:36.536533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:36.567484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:36.568146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:36.568859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:36.569691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:36.570372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:36.571073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:36.834230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:36.844906 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da3cfd34-2225-4485-adcb-fbec77bd9b69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1314 microversion: 2.1 time: 0.578297 Aug 06 21:19:36.846335 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2597/5017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:36 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:36.866372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:36.881986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:36.883540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:36.885225 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eec5f0b8-37a7-4de9-b402-e5009050afc6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.357008 Aug 06 21:19:36.886309 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2421/5018] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:36 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:37.867903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:37.870082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:37.887973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:37.894987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:37.895571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:37.896416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:37.896973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:37.897487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:37.911700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:37.912885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:37.928001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:37.929222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:37.939489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:37.944646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:37.948428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:37.949214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:38.328812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:38.342899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:38.345351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:38.347026 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e2a66dfc-feb4-4075-940c-41bb0bb94707 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.442240 Aug 06 21:19:38.347912 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2422/5019] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:37 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:38.690361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:38.702847 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1af6090a-933e-44ec-9dec-f23f4ab73a74 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1314 microversion: 2.1 time: 0.841019 Aug 06 21:19:38.705269 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2598/5020] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:37 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1314 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:39.376153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:39.376860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:39.399468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:39.400122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:39.400653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:39.402026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:39.405305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:39.405836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:39.745185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:39.746488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:39.763307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:39.767325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:39.769600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:39.770191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:39.772137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:39.775235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:39.776503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:39.988696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:40.003892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:40.005497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:40.006756 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9fcba6d4-be6c-4943-a3b5-4c0ae9e48c43 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.637885 Aug 06 21:19:40.023272 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2423/5021] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:39 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:40.515307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:40.532996 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bdccb4b0-748f-4c6b-b43d-ecac1cd76984 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1314 microversion: 2.1 time: 0.808348 Aug 06 21:19:40.535473 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2599/5022] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:39 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:41.033410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:41.035564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:41.048825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:41.051690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:41.052302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:41.053622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:41.054277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:41.055162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:41.391392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:41.403344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:41.405786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:41.407848 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f718b8f-6f00-4f03-8ee6-0197317934be tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.379374 Aug 06 21:19:41.410428 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2424/5023] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:41 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:19:41.556173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:41.556173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:41.573006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:41.573713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:41.574481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:41.575393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:41.577468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:41.580098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:42.080952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:42.089136 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bbc82398-62f7-4ad3-ba26-868686597812 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1314 microversion: 2.1 time: 0.537838 Aug 06 21:19:42.095726 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2600/5024] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:41 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:42.434373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:42.435186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:42.451071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:42.451581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:42.452213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:42.453032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:42.453409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:42.453851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:42.689076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:42.722608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:42.729119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:42.739573 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-68450685-2c7e-4ca9-8641-eaeb93035658 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.309998 Aug 06 21:19:42.743331 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2425/5025] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:42 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:42.869566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-747f1e8d-f145-4d93-9915-d5e061c90edf req-76ddc43c-b36d-43e8-be8c-5958ac4b5704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c02955-845b-4476-ac9c-e6f7e4e6730c", "name": "network-vif-plugged", "status": "completed", "tag": "13f81297-5740-4b09-b1dc-2910500568ac"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:42.884566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-747f1e8d-f145-4d93-9915-d5e061c90edf req-76ddc43c-b36d-43e8-be8c-5958ac4b5704 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:42.885483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-747f1e8d-f145-4d93-9915-d5e061c90edf req-76ddc43c-b36d-43e8-be8c-5958ac4b5704 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:42.886103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-747f1e8d-f145-4d93-9915-d5e061c90edf req-76ddc43c-b36d-43e8-be8c-5958ac4b5704 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:42.905667 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-747f1e8d-f145-4d93-9915-d5e061c90edf req-76ddc43c-b36d-43e8-be8c-5958ac4b5704 service nova] Creating event network-vif-plugged:13f81297-5740-4b09-b1dc-2910500568ac for instance 09c02955-845b-4476-ac9c-e6f7e4e6730c on nch2-master-1 Aug 06 21:19:42.915137 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-747f1e8d-f145-4d93-9915-d5e061c90edf req-76ddc43c-b36d-43e8-be8c-5958ac4b5704 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264605 Aug 06 21:19:42.917643 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2601/5026] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:19:43.119805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:43.120872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:43.127903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:43.133334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:43.134048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:43.135786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:43.139009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:43.139642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:43.529676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:43.563842 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-47b0b366-4445-493f-a9e0-9516d85627b3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1314 microversion: 2.1 time: 0.448658 Aug 06 21:19:43.580199 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2426/5027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:43 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:43.768053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:43.768913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:43.775659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:43.776167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:43.776722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:43.777885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:43.778487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:43.779088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:44.263218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:44.275289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:44.278014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:44.293340 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-15a17642-2127-46dc-82e8-166ceef26dc5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.530806 Aug 06 21:19:44.296716 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2602/5028] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:43 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:44.585616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:44.586448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:44.607517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:44.609017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:44.612176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:44.613467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:44.614786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:44.617687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:45.234981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-029b8b67-af58-4c6e-a932-7f6a48662025 req-a00e4a62-16fd-4450-95ed-2206edf8540e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb20bab-9b22-4671-b84c-7bc4eaf210e3", "name": "network-vif-plugged", "status": "completed", "tag": "f485cd9a-93ad-408a-96d5-4b3ca1a20ca3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:45.264600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:45.267505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-029b8b67-af58-4c6e-a932-7f6a48662025 req-a00e4a62-16fd-4450-95ed-2206edf8540e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:45.268910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-029b8b67-af58-4c6e-a932-7f6a48662025 req-a00e4a62-16fd-4450-95ed-2206edf8540e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:45.269569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-029b8b67-af58-4c6e-a932-7f6a48662025 req-a00e4a62-16fd-4450-95ed-2206edf8540e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:45.282466 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-029b8b67-af58-4c6e-a932-7f6a48662025 req-a00e4a62-16fd-4450-95ed-2206edf8540e service nova] Creating event network-vif-plugged:f485cd9a-93ad-408a-96d5-4b3ca1a20ca3 for instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 on nch2-master-1 Aug 06 21:19:45.285557 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-52265c2c-625c-4b5a-bb51-93f05ade82fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1314 microversion: 2.1 time: 0.702241 Aug 06 21:19:45.288989 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-029b8b67-af58-4c6e-a932-7f6a48662025 req-a00e4a62-16fd-4450-95ed-2206edf8540e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060326 Aug 06 21:19:45.290325 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2603/5029] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:19:45.304505 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2427/5030] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:44 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:45.323185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:45.324017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:45.332671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:45.340153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:45.341171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:45.342142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:45.343975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:45.345469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:46.293767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:46.311836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:46.313403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:46.323419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:46.324962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:46.326185 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-625a435f-ebde-442a-af22-56d71ac7d628 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 1.007855 Aug 06 21:19:46.333495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:46.334114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:46.334692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:46.336502 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2604/5031] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:45 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:46.338303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:46.338907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:46.339366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:47.281604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:47.298342 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b605035a-ec00-4e66-baf2-e213d637c81f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1501 microversion: 2.1 time: 0.990573 Aug 06 21:19:47.300093 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2428/5032] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:46 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1501 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:47.321093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e7bd166-79af-4f86-b41a-1a6ed979c668 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:47.321637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e7bd166-79af-4f86-b41a-1a6ed979c668 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:47.344855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e7bd166-79af-4f86-b41a-1a6ed979c668 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:47.346938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e7bd166-79af-4f86-b41a-1a6ed979c668 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:47.349861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e7bd166-79af-4f86-b41a-1a6ed979c668 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:47.350682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e7bd166-79af-4f86-b41a-1a6ed979c668 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:47.351162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e7bd166-79af-4f86-b41a-1a6ed979c668 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:47.363850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:47.364479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:47.369455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e7bd166-79af-4f86-b41a-1a6ed979c668 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:47.383715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:47.388462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:47.389606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:47.394469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:47.397244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:47.397735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:47.602950 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e7bd166-79af-4f86-b41a-1a6ed979c668 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c/action" status: 202 len: 0 microversion: 2.1 time: 0.283274 Aug 06 21:19:47.608220 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2605/5033] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:19:47 2022] POST /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:19:47.639055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:47.641716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:47.655359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:47.664065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:47.665451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:47.674996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:47.675850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:47.680907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:47.957619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:47.976489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:47.979793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:47.982959 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-afa7cb83-1031-464c-a85c-1740b8fecfe1 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1807 microversion: 2.20 time: 0.624187 Aug 06 21:19:47.987610 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2429/5034] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:47 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1807 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:48.056091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:48.069178 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1d0e14e9-26f0-474a-8399-72b296b41c7b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1506 microversion: 2.1 time: 0.457274 Aug 06 21:19:48.070099 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2606/5035] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:47 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:49.012115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:49.013285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:49.021267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=48 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:49.050101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:49.055570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:49.060347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:49.061366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:49.062483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:49.064801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:49.093463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:49.095769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:49.117737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:49.118529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:49.119265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:49.121259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:49.121905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:49.123141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:49.281805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:49.295617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:49.298198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:49.299970 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-926c8990-425f-4097-a3e2-419dbf7bc537 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1794 microversion: 2.20 time: 0.294397 Aug 06 21:19:49.300877 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2430/5036] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:19:49 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1794 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:19:49.421949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:49.434118 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e62f0fda-4460-4051-87e7-fcfdd51140c6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1486 microversion: 2.1 time: 0.344505 Aug 06 21:19:49.435429 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2607/5037] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:49 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1486 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:49.462369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:49.463472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:49.471273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:49.475801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:49.478380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:49.479365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:49.481845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:49.482471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:49.547531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lazy-loading 'flavor' on Instance uuid 09c02955-845b-4476-ac9c-e6f7e4e6730c {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:19:49.930881 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8318319b-7248-461a-9b31-0492da916fd4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c/action" status: 202 len: 0 microversion: 2.1 time: 0.473730 Aug 06 21:19:49.937601 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2431/5038] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:19:49 2022] POST /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:19:49.952812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:49.953845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:49.988186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:49.989331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:49.989787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:49.994233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:49.995932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:49.996688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:50.418723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:50.431564 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-44a3f27c-9276-4850-b73b-faf0582daf32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1492 microversion: 2.1 time: 0.489439 Aug 06 21:19:50.441957 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2608/5039] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:49 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1492 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:51.463106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:51.464501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:51.484575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:51.487246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:51.492096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:51.493163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:51.494136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:51.494479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:51.511512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:51.825356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:51.835336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-023e6ddf-0ef2-40d0-926b-648a72209257 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1513 microversion: 2.1 time: 0.378711 Aug 06 21:19:51.839705 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2432/5040] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:51 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1513 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:52.858185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:52.859561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:52.876098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:52.878905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:52.881065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:52.882873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:52.885197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:52.886122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:53.324474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:53.333140 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8cac7294-0a97-4c63-b451-f874419ede10 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.480031 Aug 06 21:19:53.338564 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2609/5041] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:52 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:54.363683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:54.364850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:54.380500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:54.381318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:54.382099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:54.383385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:54.385130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:54.387785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:55.290306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:55.306332 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1ab6f299-5deb-47bd-9c6a-a011afb3e0b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.948349 Aug 06 21:19:55.311070 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2433/5042] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:54 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:56.333632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:56.334980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:56.355298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:56.358888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:56.360797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:56.363992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:56.366142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:56.371644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:57.062850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:57.069573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:19:57.072763 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2dbb5908-2efa-4206-b388-0e1a81e93548 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.743263 Aug 06 21:19:57.074178 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2610/5043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:56 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:19:57.773314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-33448760-5cd3-468b-8069-2b28a04d85e6 req-00a55711-4d45-4d31-bfb1-cd2fb5611d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c02955-845b-4476-ac9c-e6f7e4e6730c", "name": "network-vif-plugged", "status": "completed", "tag": "13f81297-5740-4b09-b1dc-2910500568ac"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:19:57.825379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-33448760-5cd3-468b-8069-2b28a04d85e6 req-00a55711-4d45-4d31-bfb1-cd2fb5611d42 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:57.825990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-33448760-5cd3-468b-8069-2b28a04d85e6 req-00a55711-4d45-4d31-bfb1-cd2fb5611d42 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:57.832124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-33448760-5cd3-468b-8069-2b28a04d85e6 req-00a55711-4d45-4d31-bfb1-cd2fb5611d42 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:57.864136 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-33448760-5cd3-468b-8069-2b28a04d85e6 req-00a55711-4d45-4d31-bfb1-cd2fb5611d42 service nova] Creating event network-vif-plugged:13f81297-5740-4b09-b1dc-2910500568ac for instance 09c02955-845b-4476-ac9c-e6f7e4e6730c on nch2-master-1 Aug 06 21:19:57.871153 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-33448760-5cd3-468b-8069-2b28a04d85e6 req-00a55711-4d45-4d31-bfb1-cd2fb5611d42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114933 Aug 06 21:19:57.873001 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2434/5044] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:19:58.094812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:19:58.097614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:19:58.113315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:58.114188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:58.118302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:58.119401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:19:58.120166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:19:58.120810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:19:59.221827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:19:59.236398 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2980387-fbbd-4c04-881b-950f847519f4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 1.145265 Aug 06 21:19:59.255233 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2611/5045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:19:58 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:00.262142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:00.263754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:00.282106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:00.285316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:00.286847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:00.290026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:00.290846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:00.291861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:00.832851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:00.848398 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4267119b-2476-44b5-87ff-9d3cefa6631f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.591032 Aug 06 21:20:00.849618 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2435/5046] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:00 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:01.870161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:01.870818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:01.898693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:01.901901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:01.905458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:01.909500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:01.910461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:01.913835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:02.514327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:02.534673 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3b6674c-de79-4dcc-8448-8a78da78029b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.665083 Aug 06 21:20:02.544228 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2612/5047] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:01 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:03.576355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:03.577460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:03.625525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:03.627520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:03.628388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:03.634859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:03.637096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:03.641221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:04.691803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:04.737777 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fff89b67-f4d5-4f58-be72-f5ba6f65692e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 1.175822 Aug 06 21:20:04.743845 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2436/5048] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:03 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:05.769477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:05.770819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:05.792170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:05.798766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:05.799492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:05.804858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:05.808095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:05.808556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:06.364358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:06.374228 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c74802e4-c6cc-4175-aebf-ed0c3749d02a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.610462 Aug 06 21:20:06.386021 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2613/5049] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:05 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:07.412267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:07.412907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:07.425931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:07.426637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:07.428500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:07.434769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:07.436359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:07.440713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:09.310049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:09.331600 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9f787888-3226-4430-9285-4e76d3476384 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 1.922416 Aug 06 21:20:09.333078 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2437/5050] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:07 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:10.354394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:10.356127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:10.360707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=30 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:10.399067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:10.400095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:10.400889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:10.401813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:10.402465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:10.403161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:11.086230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:11.100731 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fc7f3f58-6441-48d8-903e-850ac0da4d69 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.750305 Aug 06 21:20:11.101525 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2614/5051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:10 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:12.122803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:12.123439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:12.135472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:12.135973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:12.141943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:12.145603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:12.146858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:12.147584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:12.530359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:12.542882 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce5129f2-f504-4a43-abd1-8c0f8e05dc85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.424150 Aug 06 21:20:12.544043 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2438/5052] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:12 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:20:13.566612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:13.568797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:13.596706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:13.597533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:13.599782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:13.606622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:13.607506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:13.609258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:14.149346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:14.160750 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5faad9b8-3383-4dc9-9d5f-4b1da15edd32 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.599661 Aug 06 21:20:14.162341 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2615/5053] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:13 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:15.187242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:15.189491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:15.206129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:15.206953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:15.207123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:15.207831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:15.208293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:15.208727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:15.874387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:15.887359 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac765947-8824-490c-a688-6dbc9af4d9d7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.705214 Aug 06 21:20:15.887960 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2439/5054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:15 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:16.908991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:16.909897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:16.927732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:16.928236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:16.928678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:16.929398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:16.929881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:16.942516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:18.577611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:18.592257 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37f0a779-dddf-4117-aa65-54bae2670c61 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 1.687263 Aug 06 21:20:18.593360 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2616/5055] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:16 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:19.616105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:19.616989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:19.633597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=20 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:19.685712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:19.686381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:19.686944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:19.688137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:19.688800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:19.689251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:20.524351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:20.539146 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-651bbfac-7ba7-4e88-80a5-764956054c75 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.927068 Aug 06 21:20:20.540122 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2440/5056] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:19 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:21.566532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:21.568288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:21.581178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:21.582495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:21.583175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:21.587115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:21.587939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:21.591551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:21.955146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:21.967219 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b608bac8-c26c-4886-af52-2d8d3f8c4f38 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1508 microversion: 2.1 time: 0.405472 Aug 06 21:20:21.968243 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2617/5057] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:21 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:22.607863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d99823eb-2bbe-4eb5-90da-80f261387968 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:22.608423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d99823eb-2bbe-4eb5-90da-80f261387968 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:22.626701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99823eb-2bbe-4eb5-90da-80f261387968 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:22.628208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99823eb-2bbe-4eb5-90da-80f261387968 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:22.629376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99823eb-2bbe-4eb5-90da-80f261387968 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:22.632539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99823eb-2bbe-4eb5-90da-80f261387968 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:22.634653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99823eb-2bbe-4eb5-90da-80f261387968 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:22.637304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d99823eb-2bbe-4eb5-90da-80f261387968 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:22.720729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=50 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:22.744636 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d99823eb-2bbe-4eb5-90da-80f261387968 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments/2ff735e5-1c13-4f4b-a375-3a73824d0945" status: 200 len: 194 microversion: 2.20 time: 0.142852 Aug 06 21:20:22.746505 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2441/5058] 10.222.0.33 () {60 vars in 1454 bytes} [Sat Aug 6 21:20:22 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments/2ff735e5-1c13-4f4b-a375-3a73824d0945 => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:20:22.863062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:22.863563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:22.874744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:22.875812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:22.876253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:22.876960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:22.879736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:22.880579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:22.988851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:22.989593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:23.001684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:23.002306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:23.002801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:23.005006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:23.006429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:23.007999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:23.034888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lazy-loading 'services' on Instance uuid 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:20:23.199335 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7504fa41-b575-4b2b-ab13-410604294fe5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments/2ff735e5-1c13-4f4b-a375-3a73824d0945" status: 202 len: 0 microversion: 2.20 time: 0.340041 Aug 06 21:20:23.200029 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2618/5059] 10.222.0.33 () {60 vars in 1457 bytes} [Sat Aug 6 21:20:22 2022] DELETE /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments/2ff735e5-1c13-4f4b-a375-3a73824d0945 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:20:23.217889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2926c3f2-b542-4f94-8d95-170a441d20ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:23.228862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2926c3f2-b542-4f94-8d95-170a441d20ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:23.256242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2926c3f2-b542-4f94-8d95-170a441d20ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:23.258070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2926c3f2-b542-4f94-8d95-170a441d20ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:23.260335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2926c3f2-b542-4f94-8d95-170a441d20ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:23.261259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2926c3f2-b542-4f94-8d95-170a441d20ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:23.264052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2926c3f2-b542-4f94-8d95-170a441d20ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:23.264930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2926c3f2-b542-4f94-8d95-170a441d20ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:23.370094 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2926c3f2-b542-4f94-8d95-170a441d20ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163418 Aug 06 21:20:23.371288 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2619/5060] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 21:20:23 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:20:23.427881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:23.443174 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1be7be83-699f-43ae-9c3d-d2317762a9e2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1505 microversion: 2.1 time: 0.458904 Aug 06 21:20:23.447229 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2442/5061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:22 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:20:24.383936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42adecef-4588-4e15-a346-e243f48652ee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:24.387384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42adecef-4588-4e15-a346-e243f48652ee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:24.396990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42adecef-4588-4e15-a346-e243f48652ee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:24.397656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42adecef-4588-4e15-a346-e243f48652ee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:24.398378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42adecef-4588-4e15-a346-e243f48652ee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:24.399258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42adecef-4588-4e15-a346-e243f48652ee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:24.399991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42adecef-4588-4e15-a346-e243f48652ee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:24.400570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42adecef-4588-4e15-a346-e243f48652ee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:24.467504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:24.469723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:24.472973 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42adecef-4588-4e15-a346-e243f48652ee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092616 Aug 06 21:20:24.476971 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2620/5062] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 21:20:24 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 21:20:24.479191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:24.479849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:24.480441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:24.481308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:24.482336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:24.482952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:24.855515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:24.875739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d609f1f7-8d7d-43a4-94ff-f0ac8ae28d7c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1505 microversion: 2.1 time: 0.413923 Aug 06 21:20:24.876372 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2443/5063] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:24 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:20:25.490877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ef10cfb-6f16-4c81-9abb-fc018dabc7fd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:25.494839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ef10cfb-6f16-4c81-9abb-fc018dabc7fd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:25.514348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef10cfb-6f16-4c81-9abb-fc018dabc7fd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:25.519509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef10cfb-6f16-4c81-9abb-fc018dabc7fd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:25.520168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef10cfb-6f16-4c81-9abb-fc018dabc7fd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:25.521055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef10cfb-6f16-4c81-9abb-fc018dabc7fd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:25.528323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef10cfb-6f16-4c81-9abb-fc018dabc7fd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:25.529316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ef10cfb-6f16-4c81-9abb-fc018dabc7fd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:25.582122 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ef10cfb-6f16-4c81-9abb-fc018dabc7fd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097697 Aug 06 21:20:25.585462 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2621/5064] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 21:20:25 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:20:25.898154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:25.899079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:25.914030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:25.915027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:25.915735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:25.916887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:25.917723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:25.919924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:26.261418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c1d7827b-b7da-45ea-9359-e3a43ff86276 req-5c9929c9-3ab3-4dda-aa3e-dd748093531c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c02955-845b-4476-ac9c-e6f7e4e6730c", "name": "network-vif-unplugged", "status": "completed", "tag": "13f81297-5740-4b09-b1dc-2910500568ac"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:26.276393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1d7827b-b7da-45ea-9359-e3a43ff86276 req-5c9929c9-3ab3-4dda-aa3e-dd748093531c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:26.277426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1d7827b-b7da-45ea-9359-e3a43ff86276 req-5c9929c9-3ab3-4dda-aa3e-dd748093531c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:26.278015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1d7827b-b7da-45ea-9359-e3a43ff86276 req-5c9929c9-3ab3-4dda-aa3e-dd748093531c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:26.291690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.compute.server_external_events [req-c1d7827b-b7da-45ea-9359-e3a43ff86276 req-5c9929c9-3ab3-4dda-aa3e-dd748093531c service nova] Unable to find a host for instance 09c02955-845b-4476-ac9c-e6f7e4e6730c. Dropping event network-vif-unplugged {{(pid=142461) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 21:20:26.292884 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c1d7827b-b7da-45ea-9359-e3a43ff86276 req-5c9929c9-3ab3-4dda-aa3e-dd748093531c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039436 Aug 06 21:20:26.293993 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2622/5065] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 21:20:26.317736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:26.327680 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f72def78-a12e-4f4e-a8fc-fc1e0ef13b85 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 200 len: 1448 microversion: 2.1 time: 0.433868 Aug 06 21:20:26.329592 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2444/5066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:25 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 1448 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:26.352140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:26.353253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:26.363732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:26.364632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:26.365253 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:26.366384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:26.367835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:26.368495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:26.595757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d33c8cac-a729-405e-965e-214af4acc3ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:26.598455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d33c8cac-a729-405e-965e-214af4acc3ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:26.605711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33c8cac-a729-405e-965e-214af4acc3ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:26.606582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33c8cac-a729-405e-965e-214af4acc3ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:26.607243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33c8cac-a729-405e-965e-214af4acc3ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:26.608260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33c8cac-a729-405e-965e-214af4acc3ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:26.608993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33c8cac-a729-405e-965e-214af4acc3ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:26.609697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d33c8cac-a729-405e-965e-214af4acc3ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:26.645772 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d33c8cac-a729-405e-965e-214af4acc3ad tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054826 Aug 06 21:20:26.647175 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2445/5067] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 21:20:26 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:20:26.746852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:26.747546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:26.762755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:26.763394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:26.763838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:26.766975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:26.768831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:26.769310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:26.833521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:20:26.839613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:26.861128 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4fc7bc03-f7ff-49a2-9dae-eb68d0155ec5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.512916 Aug 06 21:20:26.861998 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2623/5068] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:26 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:26.901627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:26.902918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:26.916409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:26.918046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:26.918506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:26.919257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:26.919717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:26.920147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:27.009466 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-22b699b0-0487-4c90-acd5-0fc7f04c4c52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 204 len: 0 microversion: 2.20 time: 0.264626 Aug 06 21:20:27.010913 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2446/5069] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:20:26 2022] DELETE /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 21:20:27.030625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:27.038232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:27.054570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:27.055577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:27.056294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:27.057593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:27.058458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:27.059554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:27.253380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:27.263902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:27.267395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:27.269013 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9533b164-fc8b-4ac4-a41e-ff0b61fa61e2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.249382 Aug 06 21:20:27.281181 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2447/5070] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:27 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:20:27.494522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:27.518611 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-90c857c6-554a-443f-a22d-0b0a32f1b7de tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.622101 Aug 06 21:20:27.525125 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2624/5071] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:26 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:20:27.557700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:27.558510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:27.570369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:27.574345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:27.575099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:27.587911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:27.588412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:27.588870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:27.840769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:27.852994 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b30a6a5-4476-4ce0-8b40-33df781b4cba tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.310299 Aug 06 21:20:27.854429 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2448/5072] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:27 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:27.875323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:27.876587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:27.884918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:27.885693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:27.886317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:27.887776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:27.888523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:27.889574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:28.297089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:28.297921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:28.310498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:28.311243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:28.313767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:28.315780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:28.317358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:28.317998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:28.496293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:28.514725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:28.526996 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d801b7fe-3060-46b2-aa28-4b8c1e3467b2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.655724 Aug 06 21:20:28.534180 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2625/5073] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:27 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:28.566099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-52cf5114-768c-447b-8496-8e352699a0f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:28.573716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-52cf5114-768c-447b-8496-8e352699a0f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:28.574225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-52cf5114-768c-447b-8496-8e352699a0f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:28.574699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-52cf5114-768c-447b-8496-8e352699a0f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:28.603730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-52cf5114-768c-447b-8496-8e352699a0f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Going to try to stop instance {{(pid=142461) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 21:20:28.697272 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-52cf5114-768c-447b-8496-8e352699a0f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.141951 Aug 06 21:20:28.711664 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2626/5074] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:20:28 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:20:28.730101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:28.731727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:28.750129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:28.757096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:28.757594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:28.758306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:28.758801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:28.759237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:28.904005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:28.919209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:28.921701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:28.923324 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2460a372-ecf7-4c4c-872e-f45dfb1698dc tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.631194 Aug 06 21:20:28.930928 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2449/5075] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:28 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:20:29.186165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:29.195976 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce79c3cb-91c9-4e58-b63d-ce2507d79be0 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.480880 Aug 06 21:20:29.199282 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2627/5076] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:28 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:29.948191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:29.948191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:29.962592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:29.963102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:29.963557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:29.964672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:29.965293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:29.965882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:30.221766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:30.222384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:30.241717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:30.242434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:30.243127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:30.244074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:30.244721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:30.245371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:30.426171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:30.440800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:30.442343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:30.449570 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0db55c0c-0abe-4b08-9276-b4c04eb33cae tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1722 microversion: 2.20 time: 0.500827 Aug 06 21:20:30.450249 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2450/5077] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:29 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:20:30.842860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:30.858747 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3961e2a2-aced-443f-a016-b362fd427d98 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.637202 Aug 06 21:20:30.862226 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2628/5078] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:30 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:20:31.474278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:31.475027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:31.486787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:31.487294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:31.491381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:31.492381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:31.496374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:31.498059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:31.634815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:31.650145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:31.654069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:31.656246 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dbc0502b-e3db-4d01-9c29-39b9d727e4fb tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1655 microversion: 2.20 time: 0.186321 Aug 06 21:20:31.656919 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2451/5079] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:31 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1655 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:20:31.891157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:31.892782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:31.904300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:31.905221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:31.908045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:31.909020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:31.912802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:31.913507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:32.428389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:32.447957 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0cdd38c4-7109-4d62-8d19-c78ee1873dd3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.564020 Aug 06 21:20:32.453741 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2629/5080] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:31 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:32.630025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a1d48551-5653-429e-9a37-4e9fae418f68 req-7b140186-ea0a-46b0-9dbf-dac74d69b802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb20bab-9b22-4671-b84c-7bc4eaf210e3", "name": "network-vif-deleted", "tag": "f485cd9a-93ad-408a-96d5-4b3ca1a20ca3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:32.642322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a1d48551-5653-429e-9a37-4e9fae418f68 req-7b140186-ea0a-46b0-9dbf-dac74d69b802 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:32.642859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a1d48551-5653-429e-9a37-4e9fae418f68 req-7b140186-ea0a-46b0-9dbf-dac74d69b802 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:32.643319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a1d48551-5653-429e-9a37-4e9fae418f68 req-7b140186-ea0a-46b0-9dbf-dac74d69b802 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:32.658534 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a1d48551-5653-429e-9a37-4e9fae418f68 req-7b140186-ea0a-46b0-9dbf-dac74d69b802 service nova] Creating event network-vif-deleted:f485cd9a-93ad-408a-96d5-4b3ca1a20ca3 for instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 on nch2-master-1 Aug 06 21:20:32.664771 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a1d48551-5653-429e-9a37-4e9fae418f68 req-7b140186-ea0a-46b0-9dbf-dac74d69b802 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.405048 Aug 06 21:20:32.665961 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2452/5081] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:20:32.684566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:32.685396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:32.693045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:32.693603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:32.694056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:32.695370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:32.696768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:32.697831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:32.760837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:32.761793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:32.762480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:32.763145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lazy-loading 'fault' on Instance uuid 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:20:32.838811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:32.855435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:32.871297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:32.883261 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f96f47ff-3441-4744-9ca8-75b993723b5d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 200 len: 1370 microversion: 2.20 time: 0.196437 Aug 06 21:20:32.885004 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2630/5082] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:32 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:20:33.478691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:33.479799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:33.504516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:33.509662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:33.511048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:33.513474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:33.516675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:33.521042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:33.909738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:33.911153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:33.920705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:33.922067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:33.922983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:33.924673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:33.925810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:33.926466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:33.943888 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] HTTP exception thrown: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Request method failure captured: Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 HTTP/1.1 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tpZlTnQifiurCKbhHduuaCcqA_zyeQjYTyy5dii-I7Kr7P6k8qmX-0cm0iDGkUoxvGFe_h5sUjCN-CbKS4We_SsJdW30V8taEXIppNT_xnQbveZ4hgma7cRNjvt6t32guJ0yYTZ5gJ0SHWAdz0JCMZwe80wxISfAqiR2yLcLNEBRHM Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfb3b91ed1294ea187812b7312601b27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 65e64ff8f2b14f70b1b05327f691701e Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4eb20bab-9b22-4671-b84c-7bc4eaf210e3'} Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:20:33.947571 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:20:33.951383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:20:33.951383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:20:33.951383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:20:33.951383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:20:33.951383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:20:33.951383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:20:33.951383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:20:33.951383 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:20:33.955914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Returning 404 to user: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:20:33.957943 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a1598683-a451-4a5f-bc9f-e806d7de14d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 404 len: 111 microversion: 2.20 time: 0.052079 Aug 06 21:20:33.959221 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2631/5083] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:33 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:20:33.969223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9cbb4d2c-0ca7-46d5-933a-24c0ce06cda7 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '.version_select at 0x7f729dc06d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:34.029121 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9cbb4d2c-0ca7-46d5-933a-24c0ce06cda7 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894272917" status: 204 len: 0 microversion: 2.20 time: 0.065040 Aug 06 21:20:34.029717 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2632/5084] 10.222.0.33 () {60 vars in 1262 bytes} [Sat Aug 6 21:20:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894272917 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:20:34.285599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:34.297604 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9c1695ad-7858-4b37-9227-289c6f1a0db8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.823638 Aug 06 21:20:34.304344 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2453/5085] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:33 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:35.330135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:35.330813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:35.342528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:35.343130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:35.343805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:35.350867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:35.351431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:35.351897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:35.785010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:35.795908 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4afd8b28-0eae-4046-be40-e9bcabbfea44 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.477085 Aug 06 21:20:35.810454 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2633/5086] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:35 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:35.888817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-686fd2ef-e8a6-4aca-837d-3a23b366998b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'create', calling method: .version_select at 0x7f729d31c310>, body: {"keypair": {"name": "tempest-keypair-916960982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8akEtqu1V+L7dk+gMNFoyT+fenG+lbnZ3JJYL3gBL3iCo/axVh0q6KIJvWy9Ea8I9TXfxmyZMfkllYTZB6SnIqn5bRGw3KdbusW1UYHfWmak9kZzTFFYNP9cKHgTDOXw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:35.906223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-686fd2ef-e8a6-4aca-837d-3a23b366998b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Getting quotas for project cfb3b91ed1294ea187812b7312601b27. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:20:35.912612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-686fd2ef-e8a6-4aca-837d-3a23b366998b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Getting quotas for user 65e64ff8f2b14f70b1b05327f691701e and project cfb3b91ed1294ea187812b7312601b27. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:20:35.937317 ncdv-master-1 devstack@n-api.service[142462]: ERROR oslo.messaging._drivers.impl_rabbit [None req-686fd2ef-e8a6-4aca-837d-3a23b366998b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [41d7b629-8cf5-44f7-8d88-b794a946da68] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 21:20:36.818984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:36.819623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:36.835608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:36.836410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:36.837006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:36.838175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:36.839513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:36.840204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:36.946260 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [None req-686fd2ef-e8a6-4aca-837d-3a23b366998b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [41d7b629-8cf5-44f7-8d88-b794a946da68] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 50504. Aug 06 21:20:36.980536 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-686fd2ef-e8a6-4aca-837d-3a23b366998b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.095613 Aug 06 21:20:36.989622 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2454/5087] 10.222.0.33 () {62 vars in 1200 bytes} [Sat Aug 6 21:20:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1105 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 21:20:37.324584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:37.334311 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd1a8a4f-cd40-42db-860f-962991ea32b7 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.519686 Aug 06 21:20:37.335152 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2634/5088] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:36 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:38.357345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:38.359142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:38.366707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:38.367458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:38.368060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:38.368933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:38.369542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:38.370121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:38.621297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:38.639424 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6ae221f5-430a-4676-8b27-4bace134c340 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1680 microversion: 2.1 time: 0.285432 Aug 06 21:20:38.641929 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2455/5089] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:38 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1680 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:39.674395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:39.675794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:39.699548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:39.700033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:39.713371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:39.716030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:39.719731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:39.720469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:40.243728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:40.259113 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca9edf92-1a34-4cce-8327-08656f3d05d4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1657 microversion: 2.1 time: 0.593725 Aug 06 21:20:40.271830 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2635/5090] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:39 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1657 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:40.285708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-31fe38c7-0f67-43c1-affa-de6cccc536b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:40.303750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31fe38c7-0f67-43c1-affa-de6cccc536b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:40.304264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31fe38c7-0f67-43c1-affa-de6cccc536b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:40.304716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31fe38c7-0f67-43c1-affa-de6cccc536b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:40.372155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-31fe38c7-0f67-43c1-affa-de6cccc536b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Going to try to start instance {{(pid=142462) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 21:20:40.439576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:40.456373 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-31fe38c7-0f67-43c1-affa-de6cccc536b4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.175567 Aug 06 21:20:40.458111 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2456/5091] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:20:40 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:20:40.466952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:40.468733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:40.477323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:40.492288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:40.493590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:40.494377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:40.500490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:40.501318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:40.501914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:40.992246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:41.005067 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a9ebf18-2146-409e-86ce-e1dee62a611c tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1666 microversion: 2.1 time: 0.542628 Aug 06 21:20:41.018589 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2636/5092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:40 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1666 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:42.047957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:42.048903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:42.060207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:42.069083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:42.070450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:42.073946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:42.074733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:42.076626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:42.135134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1537222073", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57a9db63-1558-403c-8e4e-84bf972aa3e6"}], "security_groups": [{"name": "tempest-securitygroup--1807251940"}], "key_name": "tempest-keypair-916960982", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:42.328735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] validate_networks() for [('57a9db63-1558-403c-8e4e-84bf972aa3e6', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:20:42.554119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:42.567311 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-789c8dbc-36f6-4b9c-abe4-5490496f88bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1666 microversion: 2.1 time: 0.540117 Aug 06 21:20:42.571209 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2457/5093] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:42 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1666 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:43.063181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:20:43.063789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:20:43.064458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:20:43.064930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:20:43.065459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:20:43.086957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:43.087740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:43.088446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:43.090792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:43.091392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:43.092602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:43.121341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Getting quotas for project cfb3b91ed1294ea187812b7312601b27. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:20:43.129613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Getting quotas for user 65e64ff8f2b14f70b1b05327f691701e and project cfb3b91ed1294ea187812b7312601b27. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:20:43.149258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:20:43.153034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:20:43.216946 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ed27b000-963e-471d-9825-8e927648f5cd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.087742 Aug 06 21:20:43.220301 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2637/5094] 10.222.0.33 () {62 vars in 1188 bytes} [Sat Aug 6 21:20:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 21:20:43.232096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f72a4be-7e82-4bfa-a661-6bde7d990b98 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:43.233895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7f72a4be-7e82-4bfa-a661-6bde7d990b98 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:43.591306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:43.592048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:43.620143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:43.620772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:43.629664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:43.630816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:43.631391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:43.631894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:43.667117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7f72a4be-7e82-4bfa-a661-6bde7d990b98 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:43.694734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7f72a4be-7e82-4bfa-a661-6bde7d990b98 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:43.700417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7f72a4be-7e82-4bfa-a661-6bde7d990b98 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:43.705686 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f72a4be-7e82-4bfa-a661-6bde7d990b98 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1281 microversion: 2.20 time: 0.475334 Aug 06 21:20:43.711208 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2458/5095] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:43 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1281 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:20:44.243238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:44.257482 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-86d2ea70-0e98-4e29-8ee3-f6238426e3c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.671808 Aug 06 21:20:44.261975 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2638/5096] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:43 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:20:44.284059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:44.285606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:44.321636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:44.322893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:44.329936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:44.331579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:44.346661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:44.347455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:44.738720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04fcd58f-b04b-4bf1-b2bb-81f51f22db80 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:44.739741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-04fcd58f-b04b-4bf1-b2bb-81f51f22db80 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:44.861100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-04fcd58f-b04b-4bf1-b2bb-81f51f22db80 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:44.874485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-04fcd58f-b04b-4bf1-b2bb-81f51f22db80 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:44.876402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-04fcd58f-b04b-4bf1-b2bb-81f51f22db80 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:44.881466 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-04fcd58f-b04b-4bf1-b2bb-81f51f22db80 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1281 microversion: 2.20 time: 0.153318 Aug 06 21:20:44.884095 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2639/5097] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:44 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:20:45.079620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:45.110376 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9ca5d4e1-fd7c-4926-af72-3a54b7bed121 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.829649 Aug 06 21:20:45.113271 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2459/5098] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:44 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:45.135755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:45.140430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:45.164684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:45.171090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:45.171940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:45.172891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:45.173588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:45.174179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:45.542877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:45.584182 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-87d70adf-4434-4764-b00a-afbc95c145f2 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.436779 Aug 06 21:20:45.584878 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2640/5099] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:45 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:45.605721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:45.606348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:45.618936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:45.619639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:45.620232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:45.621801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:45.622449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:45.623071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:45.912783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:45.913538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:45.923355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:45.924289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:45.929018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:45.930418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:45.931110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:45.931825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:46.101480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:46.103533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:46.109930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:46.111770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:46.113042 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-87b059c3-65c6-4762-8008-70856714d750 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1351 microversion: 2.20 time: 0.209078 Aug 06 21:20:46.113613 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2641/5100] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:45 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1351 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:20:46.131956 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-53e88a49-a29e-461f-bfb1-582ec29b8206 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.530143 Aug 06 21:20:46.133273 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2460/5101] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:45 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:46.154799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:46.156061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:46.165988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:46.167315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:46.167910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:46.169060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:46.169673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:46.171124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:46.470514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:46.513531 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c16c63c-647f-462c-9d54-d1726148003d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.341614 Aug 06 21:20:46.515234 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2642/5102] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:46 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:46.536206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:46.537547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:46.552844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:46.553380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:46.553804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:46.554527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:46.555006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:46.555442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:46.599580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lazy-loading 'flavor' on Instance uuid e71d3632-d411-41b2-a821-54ef313a3279 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:20:46.728094 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d9db5308-4636-4ae1-b4b4-89ff339fd15b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.196568 Aug 06 21:20:46.729521 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2461/5103] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:20:46 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:20:46.757230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:46.759285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:46.778079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:46.779537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:46.783540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:46.786218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:46.788161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:46.790779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:47.013589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:47.055068 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-50b3e031-b265-4763-974b-212f8697dc1a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1678 microversion: 2.1 time: 0.305615 Aug 06 21:20:47.055606 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2643/5104] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:46 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1678 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:20:47.139495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:47.140702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:47.148749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:47.149763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:47.150363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:47.151325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:47.152295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:47.152898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:47.287343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:47.305078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:47.309512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:47.316826 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-38bf8075-c293-49b6-adc9-69f419ba0368 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1339 microversion: 2.20 time: 0.181917 Aug 06 21:20:47.318472 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2462/5105] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:47 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:20:48.077920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:48.079496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:48.097722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:48.098241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:48.102611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:48.103725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:48.104228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:48.104670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:48.169116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:48.341514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:48.342299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:48.364141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:48.365279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:48.366084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:48.367609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:48.368538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:48.369199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:48.509682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:48.522652 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-962073ff-7a63-435f-a873-4c93f73c3cb5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1661 microversion: 2.1 time: 0.450058 Aug 06 21:20:48.524289 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2644/5106] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:48 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1661 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:48.549486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-878d2e78-3835-421f-8deb-d573f40b58c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:48.550040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-878d2e78-3835-421f-8deb-d573f40b58c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:48.561381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-878d2e78-3835-421f-8deb-d573f40b58c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:48.565806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-878d2e78-3835-421f-8deb-d573f40b58c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:48.567164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-878d2e78-3835-421f-8deb-d573f40b58c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:48.567934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-878d2e78-3835-421f-8deb-d573f40b58c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:48.568414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-878d2e78-3835-421f-8deb-d573f40b58c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:48.568854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-878d2e78-3835-421f-8deb-d573f40b58c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:48.697249 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-878d2e78-3835-421f-8deb-d573f40b58c4 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action" status: 202 len: 0 microversion: 2.1 time: 0.150507 Aug 06 21:20:48.712082 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2645/5107] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:20:48 2022] POST /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:20:48.727210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:48.744120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:48.744737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:48.746338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:48.750892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:48.755492 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-42520d86-ba39-461a-80db-3a3103d4c04d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1407 microversion: 2.20 time: 0.418320 Aug 06 21:20:48.774482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:48.780551 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2463/5108] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:48 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:20:48.782395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:48.783290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:48.784087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:48.784862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:48.785445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:49.702848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:49.716654 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-63ad8910-c57e-44be-a427-093d49a38cbb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1667 microversion: 2.1 time: 1.000002 Aug 06 21:20:49.718440 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2646/5109] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:48 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1667 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:49.782886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:49.783809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:49.799595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:49.801187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:49.802584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:49.808048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:49.808552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:49.809211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:49.993180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-20d95204-46f5-401e-9225-ce1cf11ea3d1 req-9c074db4-ad16-4530-b4d9-670b98f17b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdbf80b7-fcb5-4e9a-8ac6-9206d006c170", "tag": "b9aeea6b-a91f-4546-b520-c27af81fa5df"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:50.040282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:50.051593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-20d95204-46f5-401e-9225-ce1cf11ea3d1 req-9c074db4-ad16-4530-b4d9-670b98f17b30 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:50.054027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-20d95204-46f5-401e-9225-ce1cf11ea3d1 req-9c074db4-ad16-4530-b4d9-670b98f17b30 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:50.054830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-20d95204-46f5-401e-9225-ce1cf11ea3d1 req-9c074db4-ad16-4530-b4d9-670b98f17b30 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:50.121158 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-20d95204-46f5-401e-9225-ce1cf11ea3d1 req-9c074db4-ad16-4530-b4d9-670b98f17b30 service nova] Creating event network-changed:b9aeea6b-a91f-4546-b520-c27af81fa5df for instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 on nch1-master-1 Aug 06 21:20:50.137572 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-20d95204-46f5-401e-9225-ce1cf11ea3d1 req-9c074db4-ad16-4530-b4d9-670b98f17b30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.563792 Aug 06 21:20:50.141155 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2464/5110] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:20:50.342264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:50.351323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:50.363401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:50.365627 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-900c0cc5-213a-4394-bb44-9f79aefbe677 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1407 microversion: 2.20 time: 0.588940 Aug 06 21:20:50.366234 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2647/5111] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:49 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1407 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:20:50.745945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:50.748789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:50.769373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:50.769884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:50.770329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:50.777241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:50.777884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:50.778824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:51.384223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:51.395191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:51.396762 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2413cf24-eb5a-40ce-83ed-0b730a4164c3 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1667 microversion: 2.1 time: 0.658831 Aug 06 21:20:51.397097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:51.407283 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2465/5112] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:50 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1667 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:51.415612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:51.416098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:51.416632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:51.418535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:51.419393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:51.420824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:51.730059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:51.747120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:51.750985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:51.753901 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78c6c782-8f78-4cc6-84f2-98952ffb69d4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1407 microversion: 2.20 time: 0.368477 Aug 06 21:20:51.757353 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2648/5113] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:51 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:20:52.424778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:52.426361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:52.442238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:52.442827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:52.443616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:52.445538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:52.446769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:52.447357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:52.612791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:52.622763 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-221b5bbc-e2ec-4fba-b162-5a306af52d3d tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.203245 Aug 06 21:20:52.625623 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2466/5114] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:52 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:52.647886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:52.649292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:52.659837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:52.661102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:52.661959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:52.683197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:52.684649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:52.685305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:52.780448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:52.781390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:52.794719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:52.796686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:52.797405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:52.800077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:52.809303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:52.810732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:52.900026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:52.909617 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bb663796-b688-4c1b-a65f-b9f5475f37bc tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1670 microversion: 2.1 time: 0.266353 Aug 06 21:20:52.910446 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2649/5115] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:52 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1670 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:52.936232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:52.938375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:52.953121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:52.953783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:52.954326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:52.957628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:52.958245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:52.959716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:53.025309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:20:53.035226 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.compute.api [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Working on deleting snapshot e474afe4-a648-4b7e-9cb1-19cd5e64d646 from shelved instance... Aug 06 21:20:53.076018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:53.087418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:53.089446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:53.091434 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b10c2f1b-00dd-4f8e-9b92-68349acd1d85 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1407 microversion: 2.20 time: 0.316481 Aug 06 21:20:53.106522 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2467/5116] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:52 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:20:53.108047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:54.116258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:54.117703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:54.131287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:54.133964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:54.134598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:54.135149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:54.136003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:54.136745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:54.137173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:54.349066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Doing local delete in cell 7b45003e-98b0-47bc-b1e0-e16756e87671(cell1) {{(pid=142461) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 06 21:20:54.350021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:54.350610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:54.350999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:54.351540 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.compute.api [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 06 21:20:54.360251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] deallocate_for_instance() {{(pid=142461) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 06 21:20:54.433994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:54.448503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:54.450413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:54.456499 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0fd51f6-8590-4d77-ab00-6856eac1b50b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1407 microversion: 2.20 time: 0.345271 Aug 06 21:20:54.456499 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2468/5117] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:54 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:20:54.866252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=8 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:55.480500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:55.481319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:55.491640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:55.505626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:55.509451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:55.521798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:55.523665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:55.524989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:56.081068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:56.090280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:56.109954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:56.111262 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-59292371-98a8-48ae-b2cf-ae5f83c01ff5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1407 microversion: 2.20 time: 0.636121 Aug 06 21:20:56.111882 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2469/5118] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:55 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:20:56.135932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8d8f7ddf-1514-4b84-a7e9-edc85a0c4c4e req-bb4e0602-07c9-4860-b387-9828bb2fe0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdbf80b7-fcb5-4e9a-8ac6-9206d006c170", "name": "network-vif-plugged", "status": "completed", "tag": "b9aeea6b-a91f-4546-b520-c27af81fa5df"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:56.178748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8d8f7ddf-1514-4b84-a7e9-edc85a0c4c4e req-bb4e0602-07c9-4860-b387-9828bb2fe0eb service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:56.179246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8d8f7ddf-1514-4b84-a7e9-edc85a0c4c4e req-bb4e0602-07c9-4860-b387-9828bb2fe0eb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:56.179696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8d8f7ddf-1514-4b84-a7e9-edc85a0c4c4e req-bb4e0602-07c9-4860-b387-9828bb2fe0eb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:56.212806 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8d8f7ddf-1514-4b84-a7e9-edc85a0c4c4e req-bb4e0602-07c9-4860-b387-9828bb2fe0eb service nova] Creating event network-vif-plugged:b9aeea6b-a91f-4546-b520-c27af81fa5df for instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 on nch1-master-1 Aug 06 21:20:56.224141 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8d8f7ddf-1514-4b84-a7e9-edc85a0c4c4e req-bb4e0602-07c9-4860-b387-9828bb2fe0eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097996 Aug 06 21:20:56.249212 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2470/5119] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:20:56.259493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d48cb901-a5af-463c-9252-a4376205f9f7 req-ecf0e42e-05a8-4235-8b53-731830c13ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c02955-845b-4476-ac9c-e6f7e4e6730c", "name": "network-vif-deleted", "tag": "13f81297-5740-4b09-b1dc-2910500568ac"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:56.283077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Updating instance_info_cache with network_info: [] {{(pid=142461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 06 21:20:56.292168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d48cb901-a5af-463c-9252-a4376205f9f7 req-ecf0e42e-05a8-4235-8b53-731830c13ed3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:56.292667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d48cb901-a5af-463c-9252-a4376205f9f7 req-ecf0e42e-05a8-4235-8b53-731830c13ed3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:56.293109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d48cb901-a5af-463c-9252-a4376205f9f7 req-ecf0e42e-05a8-4235-8b53-731830c13ed3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:56.323953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.compute.server_external_events [req-d48cb901-a5af-463c-9252-a4376205f9f7 req-ecf0e42e-05a8-4235-8b53-731830c13ed3 service nova] Unable to find a host for instance 09c02955-845b-4476-ac9c-e6f7e4e6730c. Dropping event network-vif-deleted {{(pid=142462) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 21:20:56.324875 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d48cb901-a5af-463c-9252-a4376205f9f7 req-ecf0e42e-05a8-4235-8b53-731830c13ed3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.074439 Aug 06 21:20:56.330599 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2471/5120] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 81 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 21:20:56.828835 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-94b2e269-1818-4a97-93e4-82c1430f485e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 204 len: 0 microversion: 2.1 time: 3.898270 Aug 06 21:20:56.830348 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2650/5121] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:20:52 2022] DELETE /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 0 bytes in 3900 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:20:56.842289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:56.844052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 09c02955-845b-4476-ac9c-e6f7e4e6730c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:56.855637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:56.856708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:56.857621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:56.858800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:56.859491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:56.860350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:56.884844 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] HTTP exception thrown: Instance 09c02955-845b-4476-ac9c-e6f7e4e6730c could not be found. Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Request method failure captured: Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c HTTP/1.1 Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlLrMLphZv01kMCsl_ADxfj1exGN5qj7bksI2CQDXCC5bOT2YoyjPmmNkwAa7sDhgUHz68BSQbQWlFxvxJJUo1Ik54iJqgpkEDeEBkgTYy-xfo6s4EM67H_dKHoDF0seGYVpiDQik6vZu6OMZxgJi_lMnRB4rJ88rWoOy1jEWQv98o Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9feea686598e4a0d90d716e00e3e290a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerActionsTestJSON-985408345 Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 9b8463a42f2642aaba586380391de6fd Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 09c02955-845b-4476-ac9c-e6f7e4e6730c could not be found. Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '09c02955-845b-4476-ac9c-e6f7e4e6730c'} Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c02955-845b-4476-ac9c-e6f7e4e6730c could not be found. Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c02955-845b-4476-ac9c-e6f7e4e6730c could not be found. Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:20:56.887310 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:20:56.891508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:20:56.891508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:20:56.891508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:20:56.891508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:20:56.891508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:20:56.891508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c02955-845b-4476-ac9c-e6f7e4e6730c could not be found. Aug 06 21:20:56.891508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:20:56.894070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Returning 404 to user: Instance 09c02955-845b-4476-ac9c-e6f7e4e6730c could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:20:56.895551 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-076195fa-ba74-452d-8a96-49fcea556b6f tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c" status: 404 len: 111 microversion: 2.1 time: 0.060344 Aug 06 21:20:56.896717 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2472/5122] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:56 2022] GET /compute/v2.1/servers/09c02955-845b-4476-ac9c-e6f7e4e6730c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:20:56.906468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:56.908117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:56.917023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:56.918160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:56.918889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:56.920170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:56.922309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:56.923013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:56.971555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:20:57.148492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:57.149150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:57.168842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:57.171528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:57.172938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:57.174116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:57.174854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:57.175520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:57.180313 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dabd8892-21ce-4089-8de5-51a62693aee1 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 204 len: 0 microversion: 2.1 time: 0.279177 Aug 06 21:20:57.181628 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2651/5123] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:20:56 2022] DELETE /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:20:57.195460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:57.205271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:57.223408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:57.225226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:57.225897 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:57.227521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:57.227521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:57.228645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:57.237852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:20:57.382288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:57.393664 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-04e22e3b-934a-4973-b589-22ee67b938fb tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1465 microversion: 2.1 time: 0.206786 Aug 06 21:20:57.394808 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2652/5124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:57 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1465 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:57.480674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:57.517659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:57.522651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:57.525536 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bb244f4d-eb29-4fbf-b593-31ed1b7ac692 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1407 microversion: 2.20 time: 0.392697 Aug 06 21:20:57.527045 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2473/5125] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:57 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:20:58.416676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:58.418167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:58.427431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:58.428259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:58.429035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:58.429886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:58.430496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:58.430965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:58.549781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:58.551058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:58.558973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:58.559862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:58.560591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:58.561479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:58.562278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:58.562852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:58.596056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:58.608392 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b1e0c7e-7601-42e2-bbac-dbfc3b3e6750 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1465 microversion: 2.1 time: 0.195530 Aug 06 21:20:58.609911 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2653/5126] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:58 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1465 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:58.850515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:58.865129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:58.867374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:58.868883 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0d629305-6866-4022-b2a8-024d4ac07c56 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1407 microversion: 2.20 time: 0.322750 Aug 06 21:20:58.869695 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2474/5127] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:58 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:20:59.630646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:59.631831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:59.639852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:59.640816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:59.641406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:59.642447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:59.643527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:59.644349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:59.764619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e7bf2a0c-978b-498c-8073-92b3d9b96978 req-7900bb2a-833d-43f4-930d-726d0a5b34b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4120d582-da95-45f9-bbcb-7711563329d9", "name": "network-vif-deleted", "tag": "27954808-d1f9-4dd8-8b6d-0ed9c1aa7afa"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:20:59.805969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e7bf2a0c-978b-498c-8073-92b3d9b96978 req-7900bb2a-833d-43f4-930d-726d0a5b34b0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:59.806809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e7bf2a0c-978b-498c-8073-92b3d9b96978 req-7900bb2a-833d-43f4-930d-726d0a5b34b0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:59.807994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e7bf2a0c-978b-498c-8073-92b3d9b96978 req-7900bb2a-833d-43f4-930d-726d0a5b34b0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:59.832538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:20:59.843278 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c86301e4-0dbb-4a1a-b5cf-806f10383b81 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 200 len: 1465 microversion: 2.1 time: 0.217006 Aug 06 21:20:59.845329 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e7bf2a0c-978b-498c-8073-92b3d9b96978 req-7900bb2a-833d-43f4-930d-726d0a5b34b0 service nova] Creating event network-vif-deleted:27954808-d1f9-4dd8-8b6d-0ed9c1aa7afa for instance 4120d582-da95-45f9-bbcb-7711563329d9 on nch1-master-1 Aug 06 21:20:59.847193 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2654/5128] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:20:59 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 1465 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:20:59.868233 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e7bf2a0c-978b-498c-8073-92b3d9b96978 req-7900bb2a-833d-43f4-930d-726d0a5b34b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109984 Aug 06 21:20:59.869344 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2475/5129] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:20:59.892363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:20:59.893597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:20:59.901444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:59.902279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:59.903026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:20:59.904556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:20:59.905138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:20:59.905860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:00.119207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:00.129198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:00.131086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:00.132414 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32979900-d75b-48dd-8ae9-d680650b7448 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1599 microversion: 2.20 time: 0.244354 Aug 06 21:21:00.134059 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2655/5130] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:20:59 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1599 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:00.160521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71bfcf0a-d937-4d1d-8926-7dcf3c9a8a01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:00.161121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-71bfcf0a-d937-4d1d-8926-7dcf3c9a8a01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:00.168043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71bfcf0a-d937-4d1d-8926-7dcf3c9a8a01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:00.168751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71bfcf0a-d937-4d1d-8926-7dcf3c9a8a01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:00.169365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71bfcf0a-d937-4d1d-8926-7dcf3c9a8a01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:00.171419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71bfcf0a-d937-4d1d-8926-7dcf3c9a8a01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:00.172042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71bfcf0a-d937-4d1d-8926-7dcf3c9a8a01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:00.172627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71bfcf0a-d937-4d1d-8926-7dcf3c9a8a01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:00.178219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:00.324814 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71bfcf0a-d937-4d1d-8926-7dcf3c9a8a01 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.168932 Aug 06 21:21:00.325433 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2476/5131] 10.222.0.33 () {60 vars in 1316 bytes} [Sat Aug 6 21:21:00 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:21:00.868435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:00.869134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4120d582-da95-45f9-bbcb-7711563329d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:00.876251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:00.876735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:00.877180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:00.877889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:00.878570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:00.879196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:00.896136 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] HTTP exception thrown: Instance 4120d582-da95-45f9-bbcb-7711563329d9 could not be found. Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Request method failure captured: Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 HTTP/1.1 Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlLrMLphZv01kMCsl_ADxfj1exGN5qj7bksI2CQDXCC5bOT2YoyjPmmNkwAa7sDhgUHz68BSQbQWlFxvxJJUo1Ik54iJqgpkEDeEBkgTYy-xfo6s4EM67H_dKHoDF0seGYVpiDQik6vZu6OMZxgJi_lMnRB4rJ88rWoOy1jEWQv98o Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9feea686598e4a0d90d716e00e3e290a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 9b8463a42f2642aaba586380391de6fd Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4120d582-da95-45f9-bbcb-7711563329d9 could not be found. Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4120d582-da95-45f9-bbcb-7711563329d9'} Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4120d582-da95-45f9-bbcb-7711563329d9 could not be found. Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4120d582-da95-45f9-bbcb-7711563329d9 could not be found. Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:00.898007 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:00.902769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:00.902769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:00.902769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:00.902769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:21:00.902769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:21:00.902769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4120d582-da95-45f9-bbcb-7711563329d9 could not be found. Aug 06 21:21:00.902769 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:00.902769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Returning 404 to user: Instance 4120d582-da95-45f9-bbcb-7711563329d9 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:00.902769 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6c028034-e876-4353-b2f4-4f68d4d8a02e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9" status: 404 len: 111 microversion: 2.1 time: 0.034914 Aug 06 21:21:00.903400 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2656/5132] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:00 2022] GET /compute/v2.1/servers/4120d582-da95-45f9-bbcb-7711563329d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:21:00.909746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:00.910255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:00.917239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:00.917753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:00.918355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:00.919339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:00.920352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:00.920991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:00.965617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:21:01.112955 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d8f5a14d-da5d-4ec0-8a9f-4a701739ee80 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 204 len: 0 microversion: 2.1 time: 0.208334 Aug 06 21:21:01.114128 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2477/5133] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:21:00 2022] DELETE /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:21:01.122315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:01.123713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:01.131195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:01.132012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:01.132606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:01.133477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:01.134152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:01.134759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:01.323245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:01.332674 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-72b96797-92ca-4689-abd1-e326e5975081 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1508 microversion: 2.1 time: 0.214206 Aug 06 21:21:01.333486 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2657/5134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:01 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:02.061326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-adda0687-fe7c-417c-8daa-9a3704995f44 req-87288dd9-087b-4cab-94b3-817f3a4ccc5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdbf80b7-fcb5-4e9a-8ac6-9206d006c170", "tag": "b9aeea6b-a91f-4546-b520-c27af81fa5df"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:02.084058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-adda0687-fe7c-417c-8daa-9a3704995f44 req-87288dd9-087b-4cab-94b3-817f3a4ccc5c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:02.085544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-adda0687-fe7c-417c-8daa-9a3704995f44 req-87288dd9-087b-4cab-94b3-817f3a4ccc5c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:02.087529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-adda0687-fe7c-417c-8daa-9a3704995f44 req-87288dd9-087b-4cab-94b3-817f3a4ccc5c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:02.101232 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-adda0687-fe7c-417c-8daa-9a3704995f44 req-87288dd9-087b-4cab-94b3-817f3a4ccc5c service nova] Creating event network-changed:b9aeea6b-a91f-4546-b520-c27af81fa5df for instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 on nch1-master-1 Aug 06 21:21:02.106271 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-adda0687-fe7c-417c-8daa-9a3704995f44 req-87288dd9-087b-4cab-94b3-817f3a4ccc5c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065758 Aug 06 21:21:02.107546 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2478/5135] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:21:02.354650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:02.356190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:02.371615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:02.372117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:02.376895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:02.382337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:02.387435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:02.393287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:02.698190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:02.711834 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc0cea02-3d53-45d9-8e12-963e91fd6b83 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1508 microversion: 2.1 time: 0.361371 Aug 06 21:21:02.713256 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2658/5136] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:02 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1508 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:03.147737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ff07d835-04b0-4f88-9d81-4ea628346b5b req-14554fcf-c9af-4e33-a780-fe0796e81b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6", "name": "network-vif-deleted", "tag": "a753c87f-b490-45e1-b4a2-cbb9f73d1607"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:03.171460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ff07d835-04b0-4f88-9d81-4ea628346b5b req-14554fcf-c9af-4e33-a780-fe0796e81b7f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:03.172267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ff07d835-04b0-4f88-9d81-4ea628346b5b req-14554fcf-c9af-4e33-a780-fe0796e81b7f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:03.172983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ff07d835-04b0-4f88-9d81-4ea628346b5b req-14554fcf-c9af-4e33-a780-fe0796e81b7f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:03.193797 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ff07d835-04b0-4f88-9d81-4ea628346b5b req-14554fcf-c9af-4e33-a780-fe0796e81b7f service nova] Creating event network-vif-deleted:a753c87f-b490-45e1-b4a2-cbb9f73d1607 for instance 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 on nch2-master-1 Aug 06 21:21:03.218225 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ff07d835-04b0-4f88-9d81-4ea628346b5b req-14554fcf-c9af-4e33-a780-fe0796e81b7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057407 Aug 06 21:21:03.223327 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2479/5137] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:21:03.738904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:03.740821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:03.761283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:03.763806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:03.767434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:03.768206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:03.768882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:03.769920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:03.865004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:03.866093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:03.867995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:03.868844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lazy-loading 'fault' on Instance uuid 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:21:03.946654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:03.955932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9e8d5037-9ad9-4c28-9e3c-bb5330bce732 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 200 len: 1304 microversion: 2.1 time: 0.226044 Aug 06 21:21:03.971868 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2659/5138] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:03 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 1304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:04.985366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:04.986935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:05.001265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:05.002107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:05.002831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:05.003762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:05.004281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:05.005687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:05.034770 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] HTTP exception thrown: Instance 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 could not be found. Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Request method failure captured: Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 HTTP/1.1 Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlLrMLphZv01kMCsl_ADxfj1exGN5qj7bksI2CQDXCC5bOT2YoyjPmmNkwAa7sDhgUHz68BSQbQWlFxvxJJUo1Ik54iJqgpkEDeEBkgTYy-xfo6s4EM67H_dKHoDF0seGYVpiDQik6vZu6OMZxgJi_lMnRB4rJ88rWoOy1jEWQv98o Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9feea686598e4a0d90d716e00e3e290a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 9b8463a42f2642aaba586380391de6fd Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 could not be found. Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6'} Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 could not be found. Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 could not be found. Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:05.036496 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:05.040948 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:05.040948 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:05.040948 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:05.040948 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:21:05.040948 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:21:05.040948 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 could not be found. Aug 06 21:21:05.040948 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:05.040948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Returning 404 to user: Instance 4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:05.041481 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d05e9141-5f1b-4ce7-a347-568aee1eb65e tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6" status: 404 len: 111 microversion: 2.1 time: 0.066186 Aug 06 21:21:05.041963 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2480/5139] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:04 2022] GET /compute/v2.1/servers/4121f51c-d1ce-4a4f-8a0e-971ad4a9bac6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:05.051827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:05.051827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:05.063236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:05.063751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:05.064298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:05.065049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:05.065703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:05.069497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:05.131415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:21:05.364767 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f232f63a-25d5-488e-8350-bc893e256738 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 204 len: 0 microversion: 2.1 time: 0.317622 Aug 06 21:21:05.367047 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2660/5140] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:21:05 2022] DELETE /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:21:05.376608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:05.377509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:05.390643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:05.391376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:05.392021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:05.392952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:05.393599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:05.395606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:05.744794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:05.759443 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-799a0c38-d470-4112-85a1-20581211a6c9 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1495 microversion: 2.1 time: 0.388260 Aug 06 21:21:05.760352 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2481/5141] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:05 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1495 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:21:06.782862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:06.783806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:06.784315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ea75003f-29a6-47f6-bd58-769f1ddb70bb req-464f066c-873e-4722-a426-4e7602493aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade0065c-362a-4494-9132-39a8c1acbb47", "name": "network-vif-deleted", "tag": "a59da8c6-0e1b-4bc8-a3d3-940d4cb2cce8"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:06.801656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:06.803722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:06.808217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:06.809858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:06.812144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:06.812505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:06.815100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ea75003f-29a6-47f6-bd58-769f1ddb70bb req-464f066c-873e-4722-a426-4e7602493aed service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:06.817017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ea75003f-29a6-47f6-bd58-769f1ddb70bb req-464f066c-873e-4722-a426-4e7602493aed service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:06.817927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ea75003f-29a6-47f6-bd58-769f1ddb70bb req-464f066c-873e-4722-a426-4e7602493aed service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:06.851068 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ea75003f-29a6-47f6-bd58-769f1ddb70bb req-464f066c-873e-4722-a426-4e7602493aed service nova] Creating event network-vif-deleted:a59da8c6-0e1b-4bc8-a3d3-940d4cb2cce8 for instance ade0065c-362a-4494-9132-39a8c1acbb47 on nch2-master-1 Aug 06 21:21:06.859361 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ea75003f-29a6-47f6-bd58-769f1ddb70bb req-464f066c-873e-4722-a426-4e7602493aed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081855 Aug 06 21:21:06.860474 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2661/5142] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:21:07.094392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:07.103750 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23584db1-0ce3-439a-8325-2aaedc986cf5 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 200 len: 1287 microversion: 2.1 time: 0.326681 Aug 06 21:21:07.107772 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2482/5143] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:06 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 1287 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:08.125967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:08.126699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: ade0065c-362a-4494-9132-39a8c1acbb47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:08.134824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:08.135492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:08.135936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:08.136649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:08.137107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:08.137534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:08.152375 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] HTTP exception thrown: Instance ade0065c-362a-4494-9132-39a8c1acbb47 could not be found. Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Request method failure captured: Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 HTTP/1.1 Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tlLrMLphZv01kMCsl_ADxfj1exGN5qj7bksI2CQDXCC5bOT2YoyjPmmNkwAa7sDhgUHz68BSQbQWlFxvxJJUo1Ik54iJqgpkEDeEBkgTYy-xfo6s4EM67H_dKHoDF0seGYVpiDQik6vZu6OMZxgJi_lMnRB4rJ88rWoOy1jEWQv98o Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9feea686598e4a0d90d716e00e3e290a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 9b8463a42f2642aaba586380391de6fd Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ade0065c-362a-4494-9132-39a8c1acbb47 could not be found. Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ade0065c-362a-4494-9132-39a8c1acbb47'} Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade0065c-362a-4494-9132-39a8c1acbb47 could not be found. Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade0065c-362a-4494-9132-39a8c1acbb47 could not be found. Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:08.154605 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:08.158801 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:08.158801 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:08.158801 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:08.158801 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:21:08.158801 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:21:08.158801 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade0065c-362a-4494-9132-39a8c1acbb47 could not be found. Aug 06 21:21:08.158801 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:08.160434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Returning 404 to user: Instance ade0065c-362a-4494-9132-39a8c1acbb47 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:08.161250 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7ece365b-6676-4794-b9fe-75d44887e28b tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47" status: 404 len: 111 microversion: 2.1 time: 0.039787 Aug 06 21:21:08.165501 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2662/5144] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:08 2022] GET /compute/v2.1/servers/ade0065c-362a-4494-9132-39a8c1acbb47 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:08.173366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:08.174887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:08.182703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:08.182999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:08.183494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:08.184267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:08.185229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:08.185843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:08.230952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:21:08.386122 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-708f0c2d-7c32-4dc7-8ade-9be67aa381d8 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 204 len: 0 microversion: 2.1 time: 0.219130 Aug 06 21:21:08.391692 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2483/5145] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:21:08 2022] DELETE /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:21:08.409152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:08.409801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:08.424211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:08.428141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:08.429804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:08.431117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:08.433109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:08.434024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:08.628431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:08.636584 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9877ead-23e2-43c2-aa46-cd34e2fd436a tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1676 microversion: 2.1 time: 0.243155 Aug 06 21:21:08.637164 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2663/5146] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:08 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:09.672921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:09.679145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:09.700554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:09.701664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:09.702313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:09.703254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:09.704413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:09.705014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:09.939287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:09.951844 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb71f6dc-ce8f-4a32-9fc6-28e975121a05 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1676 microversion: 2.1 time: 0.296362 Aug 06 21:21:09.953371 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2484/5147] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:09 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:10.975270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:10.976417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:10.985502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:10.993475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:10.993972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:10.994417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:11.012280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:11.015356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:11.016639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:11.390108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-b0de7496-1def-4a83-af9c-686da996a6e3 req-1088054f-0433-4010-8ca6-6051ed8e9b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d3632-d411-41b2-a821-54ef313a3279", "name": "network-vif-deleted", "tag": "c13de6ff-8ee6-46cd-b833-7c454b2ab71e"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:11.403543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b0de7496-1def-4a83-af9c-686da996a6e3 req-1088054f-0433-4010-8ca6-6051ed8e9b39 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:11.404541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b0de7496-1def-4a83-af9c-686da996a6e3 req-1088054f-0433-4010-8ca6-6051ed8e9b39 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:11.405534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b0de7496-1def-4a83-af9c-686da996a6e3 req-1088054f-0433-4010-8ca6-6051ed8e9b39 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:11.420354 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-b0de7496-1def-4a83-af9c-686da996a6e3 req-1088054f-0433-4010-8ca6-6051ed8e9b39 service nova] Creating event network-vif-deleted:c13de6ff-8ee6-46cd-b833-7c454b2ab71e for instance e71d3632-d411-41b2-a821-54ef313a3279 on nch1-master-1 Aug 06 21:21:11.426769 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-b0de7496-1def-4a83-af9c-686da996a6e3 req-1088054f-0433-4010-8ca6-6051ed8e9b39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042518 Aug 06 21:21:11.427674 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2485/5148] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:21:11.564598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8463a42f2642aaba586380391de6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9feea686598e4a0d90d716e00e3e290a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:11.577714 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a9c675de-6aa6-459c-b854-f4a827216674 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 200 len: 1608 microversion: 2.1 time: 0.605818 Aug 06 21:21:11.580380 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2664/5149] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:10 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 1608 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:12.604164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:12.604883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] [instance: e71d3632-d411-41b2-a821-54ef313a3279] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:12.624746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:12.625258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:12.625704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:12.626448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:12.626944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:12.627385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:12.649505 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] HTTP exception thrown: Instance e71d3632-d411-41b2-a821-54ef313a3279 could not be found. Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Request method failure captured: Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 HTTP/1.1 Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tlLrMLphZv01kMCsl_ADxfj1exGN5qj7bksI2CQDXCC5bOT2YoyjPmmNkwAa7sDhgUHz68BSQbQWlFxvxJJUo1Ik54iJqgpkEDeEBkgTYy-xfo6s4EM67H_dKHoDF0seGYVpiDQik6vZu6OMZxgJi_lMnRB4rJ88rWoOy1jEWQv98o Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9feea686598e4a0d90d716e00e3e290a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9feea686598e4a0d90d716e00e3e290a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 9feea686598e4a0d90d716e00e3e290a Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerActionsTestJSON-985408345 Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 9b8463a42f2642aaba586380391de6fd Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerActionsTestJSON-985408345-project Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance e71d3632-d411-41b2-a821-54ef313a3279 could not be found. Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'e71d3632-d411-41b2-a821-54ef313a3279'} Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71d3632-d411-41b2-a821-54ef313a3279 could not be found. Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71d3632-d411-41b2-a821-54ef313a3279 could not be found. Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:12.651284 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:12.656446 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:12.656446 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:12.656446 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:12.656446 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:21:12.656446 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:21:12.656446 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71d3632-d411-41b2-a821-54ef313a3279 could not be found. Aug 06 21:21:12.656446 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:12.659253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Returning 404 to user: Instance e71d3632-d411-41b2-a821-54ef313a3279 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:12.663969 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2a6463ff-ea26-499b-99e7-bbe9a3f101bf tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279" status: 404 len: 111 microversion: 2.1 time: 0.065913 Aug 06 21:21:12.671020 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2486/5150] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:12 2022] GET /compute/v2.1/servers/e71d3632-d411-41b2-a821-54ef313a3279 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:12.677682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1708f0c7-b2bc-42e3-938d-217e2b4e4ea6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] Calling method '.version_select at 0x7f729c77ad30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:12.727159 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1708f0c7-b2bc-42e3-938d-217e2b4e4ea6 tempest-ServerActionsTestJSON-985408345 tempest-ServerActionsTestJSON-985408345-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-683625295" status: 202 len: 0 microversion: 2.1 time: 0.052312 Aug 06 21:21:12.729953 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2665/5151] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:21:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-683625295 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:21:13.373853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-836650460", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:13.437569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] validate_networks() for None {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:21:13.850061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:21:13.852367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:21:13.852890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:21:13.854690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:21:13.854986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:21:13.877204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:13.877854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:13.882068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:13.883562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:13.886080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:13.886614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:13.935979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Getting quotas for project af8471e400e24dd7a29c5bbb042ac0b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:21:13.942117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Getting quotas for user 8d1a2c57cf5840f7a1dcede60357580e and project af8471e400e24dd7a29c5bbb042ac0b9. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:21:13.992526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:21:13.999065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:21:14.092724 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0ee4084-1290-4083-905e-ce58895a8405 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721203 Aug 06 21:21:14.093864 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2487/5152] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:21:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:21:14.106310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-efe80568-d06f-45a8-a5c9-c50c9963ec79 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:14.108000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-efe80568-d06f-45a8-a5c9-c50c9963ec79 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:14.253987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-efe80568-d06f-45a8-a5c9-c50c9963ec79 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:14.266423 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-efe80568-d06f-45a8-a5c9-c50c9963ec79 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1214 microversion: 2.1 time: 0.164256 Aug 06 21:21:14.271285 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2666/5153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:14 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:15.291235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:15.291862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:15.335365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:15.337659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:15.341578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:15.344344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:15.347605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:15.348675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:15.471960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:15.480990 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c75c9d3b-0250-4906-99c4-9f4193b3a936 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1266 microversion: 2.1 time: 0.194916 Aug 06 21:21:15.482784 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2488/5154] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:15 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:16.506045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:16.506745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:16.516695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:16.520580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:16.521214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:16.523866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:16.524428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:16.524887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:16.637602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:16.645934 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-096afc59-d501-45d1-8457-06f93826e39d tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1272 microversion: 2.1 time: 0.143720 Aug 06 21:21:16.647602 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2667/5155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:16 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:17.669138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:17.671032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:17.689163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:17.691110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:17.692813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:17.693596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:17.694221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:17.694927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:18.015306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:18.024247 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a423cdd-f0f8-492a-9ad1-c5136bef4f2a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1314 microversion: 2.1 time: 0.359713 Aug 06 21:21:18.025113 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2489/5156] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:17 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:19.049468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:19.051049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:19.065264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:19.066259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:19.068146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:19.069971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:19.071405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:19.072753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:19.145966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-498f3479-9169-4c72-ab45-53264b4592d7 req-1109bc29-eaf1-4f02-b563-597cc9727e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "effe73d2-8fcc-442f-8813-6e2dee0cda27", "tag": "cc9a9e13-6633-4b33-8bc8-4d8a879b9ee5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:19.175790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-498f3479-9169-4c72-ab45-53264b4592d7 req-1109bc29-eaf1-4f02-b563-597cc9727e77 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:19.179481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-498f3479-9169-4c72-ab45-53264b4592d7 req-1109bc29-eaf1-4f02-b563-597cc9727e77 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:19.180294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-498f3479-9169-4c72-ab45-53264b4592d7 req-1109bc29-eaf1-4f02-b563-597cc9727e77 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:19.214300 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-498f3479-9169-4c72-ab45-53264b4592d7 req-1109bc29-eaf1-4f02-b563-597cc9727e77 service nova] Creating event network-changed:cc9a9e13-6633-4b33-8bc8-4d8a879b9ee5 for instance effe73d2-8fcc-442f-8813-6e2dee0cda27 on nch2-master-1 Aug 06 21:21:19.225111 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-498f3479-9169-4c72-ab45-53264b4592d7 req-1109bc29-eaf1-4f02-b563-597cc9727e77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084107 Aug 06 21:21:19.226131 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2490/5157] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:21:19.595621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:19.607410 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d833e42f-2a6c-467f-9ecb-0c990a3b76fb tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1314 microversion: 2.1 time: 0.563076 Aug 06 21:21:19.619022 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2668/5158] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:19 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:20.629808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:20.630568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:20.638303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:20.639040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:20.639489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:20.640199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:20.641492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:20.642067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:20.858605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:20.868933 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a270fae5-46b7-41f9-b552-4768b14395ce tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1314 microversion: 2.1 time: 0.244013 Aug 06 21:21:20.870201 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2491/5159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:20 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:21.892939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:21.894239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:21.901585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:21.902374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:21.903796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:21.904978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:21.906041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:21.906757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:22.145195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:22.153283 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b8472b95-a2f8-4193-8985-25da575be826 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1314 microversion: 2.1 time: 0.264069 Aug 06 21:21:22.168201 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2669/5160] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:21 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:21:23.179343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:23.179982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:23.182998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:23.190357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:23.190925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:23.191370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:23.192098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:23.192561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:23.193498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:23.501193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:23.510777 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0debc916-5494-4e2c-81ab-050c71898a73 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1314 microversion: 2.1 time: 0.337437 Aug 06 21:21:23.516824 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2492/5161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:23 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:24.538003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:24.538883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:24.543031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:24.559817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:24.560640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:24.562154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:24.564381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:24.567252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:24.567905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:25.006817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:25.014460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:25.025965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-283b9404-000a-4401-8842-cc3645f4f498 req-5f4ad06c-56d5-4dcf-a5b6-00a784e9c19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "effe73d2-8fcc-442f-8813-6e2dee0cda27", "name": "network-vif-plugged", "status": "completed", "tag": "cc9a9e13-6633-4b33-8bc8-4d8a879b9ee5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:25.034288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:25.038874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:25.041162 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ff713a33-d3e8-4b9b-a6d6-cfcfccd05194 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1314 microversion: 2.1 time: 0.507459 Aug 06 21:21:25.051100 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2670/5162] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:24 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:25.053172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-283b9404-000a-4401-8842-cc3645f4f498 req-5f4ad06c-56d5-4dcf-a5b6-00a784e9c19e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:25.056979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-283b9404-000a-4401-8842-cc3645f4f498 req-5f4ad06c-56d5-4dcf-a5b6-00a784e9c19e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:25.057967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-283b9404-000a-4401-8842-cc3645f4f498 req-5f4ad06c-56d5-4dcf-a5b6-00a784e9c19e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:25.109468 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-283b9404-000a-4401-8842-cc3645f4f498 req-5f4ad06c-56d5-4dcf-a5b6-00a784e9c19e service nova] Creating event network-vif-plugged:cc9a9e13-6633-4b33-8bc8-4d8a879b9ee5 for instance effe73d2-8fcc-442f-8813-6e2dee0cda27 on nch2-master-1 Aug 06 21:21:25.129132 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-283b9404-000a-4401-8842-cc3645f4f498 req-5f4ad06c-56d5-4dcf-a5b6-00a784e9c19e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106879 Aug 06 21:21:25.130270 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2493/5163] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:21:26.066934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:26.067565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:26.082651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:26.085165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:26.085609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:26.086410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:26.089239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:26.089686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:26.747882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:26.763706 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da9c6d31-f17a-4ec8-89f8-1bfae1c00d3a tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1314 microversion: 2.1 time: 0.701816 Aug 06 21:21:26.781177 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2671/5164] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:26 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:27.792387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:27.793173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:27.807758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:27.808736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:27.809303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:27.810174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:27.812486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:27.813144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:28.100264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:28.119970 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf81b43d-efd8-49ab-a65c-ea266afc6515 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1463 microversion: 2.1 time: 0.334293 Aug 06 21:21:28.122997 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2494/5165] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:27 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1463 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:28.172625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:28.173300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:28.189886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:28.190418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:28.192225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:28.195308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:28.195809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:28.196259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:28.275870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:21:28.409147 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e96a7040-9bfd-4032-99c5-115b646124cd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "DELETE /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 204 len: 0 microversion: 2.1 time: 0.240844 Aug 06 21:21:28.412734 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2672/5166] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:21:28 2022] DELETE /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:21:28.421753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:28.422870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:28.436649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:28.437327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:28.438202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:28.440662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:28.441284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:28.442212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:28.448917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:29.048666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:29.069413 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-73e5629b-a787-4f45-821f-3754595562fd tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1469 microversion: 2.1 time: 0.652015 Aug 06 21:21:29.071886 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2495/5167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:28 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1469 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:30.098821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:30.100124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:30.116940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:30.119216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:30.120496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:30.131754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:30.132452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:30.133439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:30.657116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-bb7cbbc7-4fb0-40a7-b679-6aa12a51f417 req-7f633573-e097-4f92-aae9-43e7701b9161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "effe73d2-8fcc-442f-8813-6e2dee0cda27", "name": "network-vif-deleted", "tag": "cc9a9e13-6633-4b33-8bc8-4d8a879b9ee5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:30.657818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1a2c57cf5840f7a1dcede60357580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8471e400e24dd7a29c5bbb042ac0b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:30.688032 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b35838f4-5e5f-4487-bd64-b63c66663cdf tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 200 len: 1469 microversion: 2.1 time: 0.592038 Aug 06 21:21:30.694756 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2673/5168] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:30 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 1469 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:30.710412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bb7cbbc7-4fb0-40a7-b679-6aa12a51f417 req-7f633573-e097-4f92-aae9-43e7701b9161 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:30.713757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bb7cbbc7-4fb0-40a7-b679-6aa12a51f417 req-7f633573-e097-4f92-aae9-43e7701b9161 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:30.714416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bb7cbbc7-4fb0-40a7-b679-6aa12a51f417 req-7f633573-e097-4f92-aae9-43e7701b9161 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:30.737501 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-bb7cbbc7-4fb0-40a7-b679-6aa12a51f417 req-7f633573-e097-4f92-aae9-43e7701b9161 service nova] Creating event network-vif-deleted:cc9a9e13-6633-4b33-8bc8-4d8a879b9ee5 for instance effe73d2-8fcc-442f-8813-6e2dee0cda27 on nch2-master-1 Aug 06 21:21:30.771135 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-bb7cbbc7-4fb0-40a7-b679-6aa12a51f417 req-7f633573-e097-4f92-aae9-43e7701b9161 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118398 Aug 06 21:21:30.775545 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2496/5169] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:21:31.404073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-858399261", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:31.479126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] validate_networks() for [('070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:21:31.710177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:31.711552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] [instance: effe73d2-8fcc-442f-8813-6e2dee0cda27] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:31.721930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:31.722233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:31.727722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:31.728509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:31.729002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:31.732402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:31.786101 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] HTTP exception thrown: Instance effe73d2-8fcc-442f-8813-6e2dee0cda27 could not be found. Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Request method failure captured: Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 HTTP/1.1 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7ttHeo-GwAG_tf-5xtQQbei236qB0CqVOGE0fLpOlCF1dXKwwnAYLMHWFnZw14aAnheM4ymc9CKU2iv3tGsFTjv4opMajTQUmwTR1ZRB3uVVlItyk3EzHjUf6YgV-srt1Qxo7sBhonhLLPlfw9Dk4rGgUni0hjUes6ZduDO6Kvhvfl8 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: af8471e400e24dd7a29c5bbb042ac0b9 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesNegativeTest-1659341584 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/af8471e400e24dd7a29c5bbb042ac0b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_af8471e400e24dd7a29c5bbb042ac0b9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/af8471e400e24dd7a29c5bbb042ac0b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/af8471e400e24dd7a29c5bbb042ac0b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesNegativeTest-1659341584 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: af8471e400e24dd7a29c5bbb042ac0b9 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesNegativeTest-1659341584 Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesNegativeTest-1659341584-project Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 8d1a2c57cf5840f7a1dcede60357580e Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesNegativeTest-1659341584-project Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance effe73d2-8fcc-442f-8813-6e2dee0cda27 could not be found. Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'effe73d2-8fcc-442f-8813-6e2dee0cda27'} Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effe73d2-8fcc-442f-8813-6e2dee0cda27 could not be found. Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effe73d2-8fcc-442f-8813-6e2dee0cda27 could not be found. Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:31.788029 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:31.792208 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:31.792208 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:31.792208 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:31.792208 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:21:31.792208 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:21:31.792208 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effe73d2-8fcc-442f-8813-6e2dee0cda27 could not be found. Aug 06 21:21:31.792208 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:31.794419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] Returning 404 to user: Instance effe73d2-8fcc-442f-8813-6e2dee0cda27 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:31.795554 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-17d59011-b75b-49b9-acd7-3e43cd332956 tempest-VolumesNegativeTest-1659341584 tempest-VolumesNegativeTest-1659341584-project] 10.222.0.33 "GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27" status: 404 len: 111 microversion: 2.1 time: 0.089903 Aug 06 21:21:31.796329 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2497/5170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:31 2022] GET /compute/v2.1/servers/effe73d2-8fcc-442f-8813-6e2dee0cda27 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:21:32.284036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:21:32.284469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:21:32.284948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:21:32.285359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:21:32.285984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:21:32.302990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:32.304025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:32.304526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:32.306842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:32.308314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:32.309456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:32.330051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Getting quotas for project 430d71c92050477cae2117986e31e3db. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:21:32.335977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Getting quotas for user e63fbea26373463f8e97bd38a0bc6688 and project 430d71c92050477cae2117986e31e3db. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:21:32.350435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:21:32.352783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:21:32.403762 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b60f2b28-edac-47d5-8765-6fffdbeb7a7e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.527960 Aug 06 21:21:32.410122 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2674/5171] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:21:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:21:32.415057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b68d2ac-c323-4728-a5a7-34e5dbcb7b03 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:32.415685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b68d2ac-c323-4728-a5a7-34e5dbcb7b03 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:32.559767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b68d2ac-c323-4728-a5a7-34e5dbcb7b03 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:32.574997 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b68d2ac-c323-4728-a5a7-34e5dbcb7b03 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1223 microversion: 2.1 time: 0.163616 Aug 06 21:21:32.575586 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2498/5172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:32 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:21:33.595234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:33.596020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:33.612290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:33.613727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:33.615609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:33.617319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:33.618289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:33.618988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:33.761958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:33.774942 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a00440a8-a52c-4304-9d56-de755f319bf8 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1219 microversion: 2.1 time: 0.183748 Aug 06 21:21:33.783156 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2675/5173] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:33 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:34.802681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:34.804169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:34.833175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:34.834029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:34.834672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:34.835691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:34.836416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:34.837122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:35.035010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:35.050766 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5658307b-4871-4f8f-8b21-ac085ec64e64 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1281 microversion: 2.1 time: 0.253081 Aug 06 21:21:35.066040 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2499/5174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:34 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:36.096742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:36.098697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:36.117342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:36.117590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:36.119113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:36.124834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:36.125329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:36.125772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:36.146135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-25ca81e2-06eb-48b6-bed0-72a67ff37012 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:36.147434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-25ca81e2-06eb-48b6-bed0-72a67ff37012 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:36.165394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25ca81e2-06eb-48b6-bed0-72a67ff37012 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:36.167261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25ca81e2-06eb-48b6-bed0-72a67ff37012 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:36.169604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25ca81e2-06eb-48b6-bed0-72a67ff37012 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:36.176675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25ca81e2-06eb-48b6-bed0-72a67ff37012 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:36.177308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25ca81e2-06eb-48b6-bed0-72a67ff37012 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:36.177878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25ca81e2-06eb-48b6-bed0-72a67ff37012 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:36.236365 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-25ca81e2-06eb-48b6-bed0-72a67ff37012 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/ips" status: 200 len: 152 microversion: 2.20 time: 0.095173 Aug 06 21:21:36.237680 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2500/5175] 10.222.0.33 () {60 vars in 1289 bytes} [Sat Aug 6 21:21:36 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/ips => generated 152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:21:36.714304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:36.728443 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-191293c9-ed3b-411d-b6ff-ac6713d95b7d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1323 microversion: 2.1 time: 0.640620 Aug 06 21:21:36.732701 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2676/5176] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:36 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1323 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:36.884023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c8e513e9-52b4-4643-b1b9-edaa37e25d63 req-8742aeb4-0a91-4344-b5a6-d544ae973a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d46882b-56dc-4565-91e7-224cd61ee3b8", "tag": "c6b2b7f0-fe5f-44ba-b678-d9640a7c84be"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:36.913266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c8e513e9-52b4-4643-b1b9-edaa37e25d63 req-8742aeb4-0a91-4344-b5a6-d544ae973a44 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:36.914900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c8e513e9-52b4-4643-b1b9-edaa37e25d63 req-8742aeb4-0a91-4344-b5a6-d544ae973a44 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:36.915868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c8e513e9-52b4-4643-b1b9-edaa37e25d63 req-8742aeb4-0a91-4344-b5a6-d544ae973a44 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:36.933685 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c8e513e9-52b4-4643-b1b9-edaa37e25d63 req-8742aeb4-0a91-4344-b5a6-d544ae973a44 service nova] Creating event network-changed:c6b2b7f0-fe5f-44ba-b678-d9640a7c84be for instance 6d46882b-56dc-4565-91e7-224cd61ee3b8 on nch2-master-1 Aug 06 21:21:36.939342 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c8e513e9-52b4-4643-b1b9-edaa37e25d63 req-8742aeb4-0a91-4344-b5a6-d544ae973a44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060571 Aug 06 21:21:36.940368 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2501/5177] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:21:37.754638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:37.756830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:37.764954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:37.767498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:37.768039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:37.768948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:37.769505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:37.770164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:37.996713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:38.009635 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e78fef99-8a3e-47bc-81f4-690eae2ba687 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1323 microversion: 2.1 time: 0.260788 Aug 06 21:21:38.010238 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2677/5178] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:37 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1323 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:38.308750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:38.309667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:38.324943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:38.325447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:38.335020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:38.335819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:38.336314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:38.336762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:38.413020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lazy-loading 'flavor' on Instance uuid cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:21:38.865020 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a4167283-b17b-4445-a45f-d91d103046d9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/action" status: 202 len: 0 microversion: 2.20 time: 0.561395 Aug 06 21:21:38.866019 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2502/5179] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 21:21:38 2022] POST /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:21:38.876479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:38.877108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:38.886934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:38.887856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:38.888489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:38.889446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:38.897904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:38.898555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:39.034051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:39.035815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:39.050806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:39.051409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:39.053521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:39.056891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:39.059490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:39.060221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:39.202333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:39.211451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:39.213963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:39.215476 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22d41b17-3740-4126-9af7-c844bb67b5e5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.343685 Aug 06 21:21:39.231682 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2678/5180] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:38 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:39.264858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:39.276312 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4e5a2390-b5b4-4187-8b43-8c058447d96e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1323 microversion: 2.1 time: 0.248648 Aug 06 21:21:39.277117 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2503/5181] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:39 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:21:40.245093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:40.247294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:40.265590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:40.266093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:40.266538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:40.267286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:40.267763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:40.268191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:40.298598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:40.299359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:40.312082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:40.312819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:40.315867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:40.316868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:40.318858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:40.319844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:40.498708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:40.518750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:40.520321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:40.521911 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f3971de6-777c-4222-ad0c-1b2fae670a87 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.284753 Aug 06 21:21:40.523430 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2679/5182] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:40 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:40.622633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:40.633474 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9e72c3fd-7106-4060-8542-60b1dd0f556d tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1323 microversion: 2.1 time: 0.338871 Aug 06 21:21:40.634292 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2504/5183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:40 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:21:41.550470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:41.551874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:41.561129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:41.563121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:41.563801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:41.564297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:41.565521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:41.566319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:41.567766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:41.659246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:41.660775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:41.672001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:41.673137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:41.674111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:41.674624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:41.675096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:41.675532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:41.764538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:41.774451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:41.777896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:41.779906 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5cd3324-21fe-4e84-b1c9-dbb67c685e99 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.235689 Aug 06 21:21:41.780652 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2680/5184] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:41 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:41.879938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:41.892085 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-31550f8e-0111-4ddc-88f9-0dbf67bcb7e0 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1323 microversion: 2.1 time: 0.239217 Aug 06 21:21:41.893257 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2505/5185] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:41 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1323 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:21:42.622536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7e728eee-3e33-4066-92c4-f352082863b8 req-e7f2f387-f6ea-48bc-8bc5-a069d307d3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d46882b-56dc-4565-91e7-224cd61ee3b8", "name": "network-vif-plugged", "status": "completed", "tag": "c6b2b7f0-fe5f-44ba-b678-d9640a7c84be"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:42.631088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:42.631671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:42.652583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7e728eee-3e33-4066-92c4-f352082863b8 req-e7f2f387-f6ea-48bc-8bc5-a069d307d3da service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:42.653078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7e728eee-3e33-4066-92c4-f352082863b8 req-e7f2f387-f6ea-48bc-8bc5-a069d307d3da service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:42.653511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7e728eee-3e33-4066-92c4-f352082863b8 req-e7f2f387-f6ea-48bc-8bc5-a069d307d3da service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:42.707045 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7e728eee-3e33-4066-92c4-f352082863b8 req-e7f2f387-f6ea-48bc-8bc5-a069d307d3da service nova] Creating event network-vif-plugged:c6b2b7f0-fe5f-44ba-b678-d9640a7c84be for instance 6d46882b-56dc-4565-91e7-224cd61ee3b8 on nch2-master-1 Aug 06 21:21:42.719585 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7e728eee-3e33-4066-92c4-f352082863b8 req-e7f2f387-f6ea-48bc-8bc5-a069d307d3da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103694 Aug 06 21:21:42.720645 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2681/5186] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:21:42.804554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:42.805194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:42.807492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:42.824345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:42.827334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:42.831331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:42.832334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:42.833009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:42.833710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:42.916011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:42.916758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:42.929359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:42.930057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:42.930303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:42.931081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:42.931548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:42.931980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:43.166007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:43.210767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:43.218630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:43.223160 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-622a66f1-5583-479a-8419-a41ff6b5b365 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.421801 Aug 06 21:21:43.226169 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2506/5187] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:42 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:43.247249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:43.256858 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1a644fd6-48b8-4c1d-a747-6dc28e282471 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1323 microversion: 2.1 time: 0.347083 Aug 06 21:21:43.257466 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2682/5188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:42 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:21:44.262493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:44.263296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:44.278244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:44.279713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:44.280394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:44.281738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:44.282402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:44.282713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:44.283664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:44.283866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:44.294120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:44.294639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:44.295078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:44.295792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:44.296247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:44.296666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:44.504569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:44.509494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:44.517796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:44.519546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:44.520135 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e9d63a7-c2ef-4af9-a3f3-26ba26a3a081 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1518 microversion: 2.1 time: 0.242084 Aug 06 21:21:44.520735 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2683/5189] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:44 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1518 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:21:44.521610 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6e334cad-0e9c-49e1-b2d1-75fc8fd9a23d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.273666 Aug 06 21:21:44.522182 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2507/5190] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:44 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:44.720509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8108555-3007-4754-ad92-cee7e891e916 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1898195677", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8108555-3007-4754-ad92-cee7e891e916 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Request method failure captured: Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 243 Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7ttaJw5AuduMhfGSVKAVhxtcuZeMSDMtq88MTlJTCazze410rulB8lfc-n8gl_TUTMMTuG8xdZ4VXAi8RmHOqFJbGDVv501bomKMuQsr39eXd8EfcGfElaN35_bBYwf0mOfqXXPBu9oQFFotFHnQJlGiA73aBz-jKCFBkXPo0bfb3Ks Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/430d71c92050477cae2117986e31e3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_430d71c92050477cae2117986e31e3db", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e63fbea26373463f8e97bd38a0bc6688 Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1898195677", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1898195677', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d'}]}}} Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:44.726975 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.732261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8108555-3007-4754-ad92-cee7e891e916 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:44.735614 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d8108555-3007-4754-ad92-cee7e891e916 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.018983 Aug 06 21:21:44.736282 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2684/5191] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:21:44 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:21:44.750348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00dd476a-f6ea-40e9-9a9c-780b59a760f4 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:44.751551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-00dd476a-f6ea-40e9-9a9c-780b59a760f4 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 7d43b598-2229-4115-9d27-1f542d7d2471] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:44.757802 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-00dd476a-f6ea-40e9-9a9c-780b59a760f4 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] HTTP exception thrown: Instance 7d43b598-2229-4115-9d27-1f542d7d2471 could not be found. Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00dd476a-f6ea-40e9-9a9c-780b59a760f4 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Request method failure captured: Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/7d43b598-2229-4115-9d27-1f542d7d2471/metadata HTTP/1.1 Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7ttaJw5AuduMhfGSVKAVhxtcuZeMSDMtq88MTlJTCazze410rulB8lfc-n8gl_TUTMMTuG8xdZ4VXAi8RmHOqFJbGDVv501bomKMuQsr39eXd8EfcGfElaN35_bBYwf0mOfqXXPBu9oQFFotFHnQJlGiA73aBz-jKCFBkXPo0bfb3Ks Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/430d71c92050477cae2117986e31e3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_430d71c92050477cae2117986e31e3db", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e63fbea26373463f8e97bd38a0bc6688 Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 7d43b598-2229-4115-9d27-1f542d7d2471 could not be found. Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'server_id': '7d43b598-2229-4115-9d27-1f542d7d2471'} Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d43b598-2229-4115-9d27-1f542d7d2471 could not be found. Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d43b598-2229-4115-9d27-1f542d7d2471 could not be found. Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:44.768551 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:44.772474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:21:44.772474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:21:44.772474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d43b598-2229-4115-9d27-1f542d7d2471 could not be found. Aug 06 21:21:44.772474 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.772474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00dd476a-f6ea-40e9-9a9c-780b59a760f4 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Returning 404 to user: Instance 7d43b598-2229-4115-9d27-1f542d7d2471 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:44.772474 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-00dd476a-f6ea-40e9-9a9c-780b59a760f4 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/7d43b598-2229-4115-9d27-1f542d7d2471/metadata" status: 404 len: 111 microversion: 2.1 time: 0.025550 Aug 06 21:21:44.772474 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2508/5192] 10.222.0.33 () {58 vars in 1263 bytes} [Sat Aug 6 21:21:44 2022] GET /compute/v2.1/servers/7d43b598-2229-4115-9d27-1f542d7d2471/metadata => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:44.936148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b159f375-dd6b-4f34-8310-0173ac3dd17f tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1573733676", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b159f375-dd6b-4f34-8310-0173ac3dd17f tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Request method failure captured: Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 499 Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7ttaJw5AuduMhfGSVKAVhxtcuZeMSDMtq88MTlJTCazze410rulB8lfc-n8gl_TUTMMTuG8xdZ4VXAi8RmHOqFJbGDVv501bomKMuQsr39eXd8EfcGfElaN35_bBYwf0mOfqXXPBu9oQFFotFHnQJlGiA73aBz-jKCFBkXPo0bfb3Ks Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/430d71c92050477cae2117986e31e3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_430d71c92050477cae2117986e31e3db", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e63fbea26373463f8e97bd38a0bc6688 Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1573733676", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1573733676', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d'}]}}} Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 06 21:21:44.941318 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b159f375-dd6b-4f34-8310-0173ac3dd17f tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b159f375-dd6b-4f34-8310-0173ac3dd17f tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.010679 Aug 06 21:21:44.944324 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2685/5193] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:21:44 2022] POST /compute/v2.1/servers => generated 687 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:21:45.181700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b223757e-c993-45ba-b80e-6205561a528c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1774590032", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b223757e-c993-45ba-b80e-6205561a528c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Request method failure captured: Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 500 Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7ttaJw5AuduMhfGSVKAVhxtcuZeMSDMtq88MTlJTCazze410rulB8lfc-n8gl_TUTMMTuG8xdZ4VXAi8RmHOqFJbGDVv501bomKMuQsr39eXd8EfcGfElaN35_bBYwf0mOfqXXPBu9oQFFotFHnQJlGiA73aBz-jKCFBkXPo0bfb3Ks Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/430d71c92050477cae2117986e31e3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_430d71c92050477cae2117986e31e3db", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e63fbea26373463f8e97bd38a0bc6688 Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1774590032", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1774590032', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d'}]}}} Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 06 21:21:45.188334 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.191149 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.194931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b223757e-c993-45ba-b80e-6205561a528c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:45.196296 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b223757e-c993-45ba-b80e-6205561a528c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.019020 Aug 06 21:21:45.197161 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2509/5194] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:21:45 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 21:21:45.339432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48cbd63c-fdf0-4bf3-b130-520084978f0a tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1881415521", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48cbd63c-fdf0-4bf3-b130-520084978f0a tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Request method failure captured: Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 754 Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7ttaJw5AuduMhfGSVKAVhxtcuZeMSDMtq88MTlJTCazze410rulB8lfc-n8gl_TUTMMTuG8xdZ4VXAi8RmHOqFJbGDVv501bomKMuQsr39eXd8EfcGfElaN35_bBYwf0mOfqXXPBu9oQFFotFHnQJlGiA73aBz-jKCFBkXPo0bfb3Ks Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/430d71c92050477cae2117986e31e3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_430d71c92050477cae2117986e31e3db", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e63fbea26373463f8e97bd38a0bc6688 Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1881415521", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1881415521', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d'}]}}} Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:21:45.349160 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:21:45.351692 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:21:45.356222 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.356222 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.358346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48cbd63c-fdf0-4bf3-b130-520084978f0a tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:45.359556 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-48cbd63c-fdf0-4bf3-b130-520084978f0a tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.030756 Aug 06 21:21:45.360694 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2686/5195] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:21:45 2022] POST /compute/v2.1/servers => generated 1197 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 06 21:21:45.480808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2048c2ce-33d1-4199-9166-a7c1ba4ebbc6 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1216714179", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2048c2ce-33d1-4199-9166-a7c1ba4ebbc6 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Request method failure captured: Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 1266 Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7ttaJw5AuduMhfGSVKAVhxtcuZeMSDMtq88MTlJTCazze410rulB8lfc-n8gl_TUTMMTuG8xdZ4VXAi8RmHOqFJbGDVv501bomKMuQsr39eXd8EfcGfElaN35_bBYwf0mOfqXXPBu9oQFFotFHnQJlGiA73aBz-jKCFBkXPo0bfb3Ks Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/430d71c92050477cae2117986e31e3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_430d71c92050477cae2117986e31e3db", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e63fbea26373463f8e97bd38a0bc6688 Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1216714179", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d"}]}} Aug 06 21:21:45.485227 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1216714179', 'imageRef': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '070e5f46-8b6c-4cea-a9ed-a6dd1e7a075d'}]}}} Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.487673 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:21:45.488955 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:21:45.491062 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 06 21:21:45.491062 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.491062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2048c2ce-33d1-4199-9166-a7c1ba4ebbc6 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:45.491062 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2048c2ce-33d1-4199-9166-a7c1ba4ebbc6 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011617 Aug 06 21:21:45.494032 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2510/5196] 10.222.0.33 () {60 vars in 1148 bytes} [Sat Aug 6 21:21:45 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 06 21:21:45.500579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a31b177c-c260-4909-b827-10867013d60b tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:45.501469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a31b177c-c260-4909-b827-10867013d60b tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: a9fdf7a4-4a99-487f-a31c-c13bb5d0d385] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:45.508064 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a31b177c-c260-4909-b827-10867013d60b tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] HTTP exception thrown: Instance a9fdf7a4-4a99-487f-a31c-c13bb5d0d385 could not be found. Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a31b177c-c260-4909-b827-10867013d60b tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Request method failure captured: Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/a9fdf7a4-4a99-487f-a31c-c13bb5d0d385/metadata/test2 HTTP/1.1 Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7ttaJw5AuduMhfGSVKAVhxtcuZeMSDMtq88MTlJTCazze410rulB8lfc-n8gl_TUTMMTuG8xdZ4VXAi8RmHOqFJbGDVv501bomKMuQsr39eXd8EfcGfElaN35_bBYwf0mOfqXXPBu9oQFFotFHnQJlGiA73aBz-jKCFBkXPo0bfb3Ks Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/430d71c92050477cae2117986e31e3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_430d71c92050477cae2117986e31e3db", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e63fbea26373463f8e97bd38a0bc6688 Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance a9fdf7a4-4a99-487f-a31c-c13bb5d0d385 could not be found. Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'server_id': 'a9fdf7a4-4a99-487f-a31c-c13bb5d0d385', 'id': 'test2'} Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9fdf7a4-4a99-487f-a31c-c13bb5d0d385 could not be found. Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9fdf7a4-4a99-487f-a31c-c13bb5d0d385 could not be found. Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:45.509880 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:45.523189 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:21:45.523189 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:21:45.523189 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9fdf7a4-4a99-487f-a31c-c13bb5d0d385 could not be found. Aug 06 21:21:45.523189 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:45.523189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a31b177c-c260-4909-b827-10867013d60b tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Returning 404 to user: Instance a9fdf7a4-4a99-487f-a31c-c13bb5d0d385 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:45.523189 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a31b177c-c260-4909-b827-10867013d60b tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/a9fdf7a4-4a99-487f-a31c-c13bb5d0d385/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015902 Aug 06 21:21:45.523189 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2687/5197] 10.222.0.33 () {58 vars in 1281 bytes} [Sat Aug 6 21:21:45 2022] GET /compute/v2.1/servers/a9fdf7a4-4a99-487f-a31c-c13bb5d0d385/metadata/test2 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:45.529765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:45.530289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:45.537998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:45.545383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:45.546008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:45.549321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:45.549797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:45.550600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:45.551067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:45.551511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:45.554240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:45.555784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:45.556327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:45.557156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:45.558424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:45.559147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:45.599095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:21:45.765293 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b3fa83dc-041b-433e-a11a-a4d556b26a3c tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 204 len: 0 microversion: 2.1 time: 0.239789 Aug 06 21:21:45.765967 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2511/5198] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:21:45 2022] DELETE /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:21:45.770343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:45.779772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:45.782586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:45.788399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:45.791601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:45.795205 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-50729ecf-d6d3-40a6-bddc-c1ad972f05c2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.254044 Aug 06 21:21:45.796684 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2688/5199] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:45 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:21:45.798871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:45.799809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:45.800846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:45.801864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:45.802563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:45.803184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:45.994020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:46.005558 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-20f6a7e5-e819-4566-baff-1a3f9dce13b7 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1524 microversion: 2.1 time: 0.233908 Aug 06 21:21:46.006857 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2512/5200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:45 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1524 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:46.821585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:46.822204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:46.831937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:46.832965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:46.833770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:46.834524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:46.835496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:46.836037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:46.992750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:47.002002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:47.003815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:47.005017 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-34a63e82-4ff2-414e-bc19-8c3e1b15108c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.187407 Aug 06 21:21:47.005598 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2689/5201] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:46 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:21:47.028123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:47.029576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:47.037202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:47.037686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:47.038129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:47.038857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:47.039317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:47.039749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:47.224587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:47.241015 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f8d05074-e058-4a6f-bfca-eb24ebdf7c51 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1524 microversion: 2.1 time: 0.217884 Aug 06 21:21:47.242320 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2513/5202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:47 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1524 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:47.780252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-1eae0c10-99dc-4e25-bed1-d908deb747ae req-8889c809-934e-49cb-885d-6948f2c8ad23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d46882b-56dc-4565-91e7-224cd61ee3b8", "name": "network-vif-deleted", "tag": "c6b2b7f0-fe5f-44ba-b678-d9640a7c84be"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:47.805830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1eae0c10-99dc-4e25-bed1-d908deb747ae req-8889c809-934e-49cb-885d-6948f2c8ad23 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:47.806599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1eae0c10-99dc-4e25-bed1-d908deb747ae req-8889c809-934e-49cb-885d-6948f2c8ad23 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:47.807578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1eae0c10-99dc-4e25-bed1-d908deb747ae req-8889c809-934e-49cb-885d-6948f2c8ad23 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:47.836294 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-1eae0c10-99dc-4e25-bed1-d908deb747ae req-8889c809-934e-49cb-885d-6948f2c8ad23 service nova] Creating event network-vif-deleted:c6b2b7f0-fe5f-44ba-b678-d9640a7c84be for instance 6d46882b-56dc-4565-91e7-224cd61ee3b8 on nch2-master-1 Aug 06 21:21:47.850418 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-1eae0c10-99dc-4e25-bed1-d908deb747ae req-8889c809-934e-49cb-885d-6948f2c8ad23 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075953 Aug 06 21:21:47.857898 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2690/5203] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:21:48.030850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:48.031643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:48.041488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:48.047621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:48.050276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:48.052075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:48.054343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:48.056210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:48.107468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:48.262836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:48.263901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:48.275580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:48.277747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:48.280255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:48.283418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:48.284081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:48.285665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:48.335368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:48.352155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:48.357619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:48.359404 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7682db89-22bd-45c3-b024-815c71eb93b3 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.334488 Aug 06 21:21:48.361538 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2514/5204] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:48 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:48.380682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:48.381198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:48.381700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:48.382152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lazy-loading 'fault' on Instance uuid 6d46882b-56dc-4565-91e7-224cd61ee3b8 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:21:48.388959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:48.486212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63fbea26373463f8e97bd38a0bc6688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '430d71c92050477cae2117986e31e3db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:48.501496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-84652bf9-d600-4d9a-bb37-f51ad94ad4e9 tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 200 len: 1313 microversion: 2.1 time: 0.243570 Aug 06 21:21:48.502911 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2691/5205] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:48 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:21:49.391529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:49.392310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:49.406101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:49.406966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:49.408681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:49.409583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:49.410193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:49.410695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:49.530085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:49.530809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] [instance: 6d46882b-56dc-4565-91e7-224cd61ee3b8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:49.544715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:49.545225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:49.545677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:49.546395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:49.548803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:49.550907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:49.605484 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] HTTP exception thrown: Instance 6d46882b-56dc-4565-91e7-224cd61ee3b8 could not be found. Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Request method failure captured: Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 HTTP/1.1 Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7ttaJw5AuduMhfGSVKAVhxtcuZeMSDMtq88MTlJTCazze410rulB8lfc-n8gl_TUTMMTuG8xdZ4VXAi8RmHOqFJbGDVv501bomKMuQsr39eXd8EfcGfElaN35_bBYwf0mOfqXXPBu9oQFFotFHnQJlGiA73aBz-jKCFBkXPo0bfb3Ks Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/430d71c92050477cae2117986e31e3db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_430d71c92050477cae2117986e31e3db", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/430d71c92050477cae2117986e31e3db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 430d71c92050477cae2117986e31e3db Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1354274120 Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: e63fbea26373463f8e97bd38a0bc6688 Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1354274120-project Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 6d46882b-56dc-4565-91e7-224cd61ee3b8 could not be found. Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '6d46882b-56dc-4565-91e7-224cd61ee3b8'} Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d46882b-56dc-4565-91e7-224cd61ee3b8 could not be found. Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d46882b-56dc-4565-91e7-224cd61ee3b8 could not be found. Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:49.609374 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:21:49.613709 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:49.613709 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:21:49.613709 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:21:49.613709 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:21:49.613709 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:21:49.613709 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:21:49.613709 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d46882b-56dc-4565-91e7-224cd61ee3b8 could not be found. Aug 06 21:21:49.613709 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:21:49.618993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] Returning 404 to user: Instance 6d46882b-56dc-4565-91e7-224cd61ee3b8 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:21:49.620157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9672d8e7-c722-426c-aa15-bc226949c34e tempest-ServerMetadataNegativeTestJSON-1354274120 tempest-ServerMetadataNegativeTestJSON-1354274120-project] 10.222.0.33 "GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8" status: 404 len: 111 microversion: 2.1 time: 0.099168 Aug 06 21:21:49.634237 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2692/5206] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:21:49 2022] GET /compute/v2.1/servers/6d46882b-56dc-4565-91e7-224cd61ee3b8 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:21:49.738474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:49.754467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:49.758026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:49.759572 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6973a44-d828-402e-a17f-74c8bf23fe6a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1745 microversion: 2.20 time: 0.376641 Aug 06 21:21:49.760905 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2515/5207] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:49 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1745 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:50.786853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:50.787670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:50.796837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:50.797664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:50.798650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:50.799776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:50.800519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:50.801208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:51.088597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:51.097270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:51.098936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:51.100146 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bfc40260-faaa-4618-b0a2-6c23cd69a78f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1745 microversion: 2.20 time: 0.317572 Aug 06 21:21:51.100843 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2693/5208] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:50 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1745 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:52.126174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:52.128161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:52.144668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:52.145386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:52.146150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:52.147313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:52.149668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:52.150469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:52.612755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:52.652327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:52.662165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:52.663376 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a4669d1-a273-4d4c-ab44-05c45420d297 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.541178 Aug 06 21:21:52.666076 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2516/5209] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:52 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:53.698224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:53.699579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:53.725200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:53.726220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:53.734118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:53.735391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:53.743311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:53.745739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:54.084420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-566cad82-22dd-4495-83ff-46b29ebcc27b req-c9873799-5103-4adb-a2b7-6402aaaeb640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdbf80b7-fcb5-4e9a-8ac6-9206d006c170", "name": "network-vif-plugged", "status": "completed", "tag": "b9aeea6b-a91f-4546-b520-c27af81fa5df"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:54.101752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:21:54.124716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-566cad82-22dd-4495-83ff-46b29ebcc27b req-c9873799-5103-4adb-a2b7-6402aaaeb640 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:54.125207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-566cad82-22dd-4495-83ff-46b29ebcc27b req-c9873799-5103-4adb-a2b7-6402aaaeb640 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:54.125651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-566cad82-22dd-4495-83ff-46b29ebcc27b req-c9873799-5103-4adb-a2b7-6402aaaeb640 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:54.212897 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-566cad82-22dd-4495-83ff-46b29ebcc27b req-c9873799-5103-4adb-a2b7-6402aaaeb640 service nova] Creating event network-vif-plugged:b9aeea6b-a91f-4546-b520-c27af81fa5df for instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 on nch1-master-1 Aug 06 21:21:54.260842 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-566cad82-22dd-4495-83ff-46b29ebcc27b req-c9873799-5103-4adb-a2b7-6402aaaeb640 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179216 Aug 06 21:21:54.272482 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2517/5210] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:21:54.660524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:54.697337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:54.699496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:54.701758 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d09f3cef-4fd7-4095-8a48-fd105172bafd tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 1.012111 Aug 06 21:21:54.719752 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2694/5211] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:53 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:55.732572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:55.734194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:55.762166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:55.765399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:55.767199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:55.771923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:55.772749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:55.776082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:56.237006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:56.255207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:56.258304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:56.263833 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ca8420a2-b56e-4443-bfe5-22a9522b58c0 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.540787 Aug 06 21:21:56.269052 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2518/5212] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:55 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:57.299510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:57.300289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:57.317603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:57.320813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:57.321688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:57.324322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:57.325845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:57.341356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:57.734720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:57.762990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:57.774045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:57.782598 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-77f028ff-fe1c-4e3f-896f-d3dcdd75bf36 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.487876 Aug 06 21:21:57.800311 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2695/5213] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:57 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:58.816226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:21:58.816882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:21:58.827096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:58.827846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:58.829670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:58.832957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:21:58.834821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:21:58.836295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:21:59.221954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:59.267480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:59.271979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:21:59.274687 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ba6519b5-0f8b-493a-b51a-9d817bb77a69 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.463041 Aug 06 21:21:59.275902 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2519/5214] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:21:58 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:21:59.660966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1260451993", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "825aebcd-af51-4a68-8da8-df4bb4d1d337"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:21:59.788199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] validate_networks() for [('825aebcd-af51-4a68-8da8-df4bb4d1d337', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:22:00.307629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:00.308297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:00.317751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:00.320454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:00.321261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:00.323011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:00.323874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:00.324690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:00.529471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:22:00.530187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:22:00.530931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:22:00.532118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:22:00.532745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:22:00.548217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:00.549055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:00.549931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:00.551067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:00.551824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:00.552469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:00.584208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:00.595988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:00.597997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:00.599975 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3a6387f7-40cf-4c12-97b5-48e453083785 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.297648 Aug 06 21:22:00.600578 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2520/5215] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:00 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:00.624791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Getting quotas for project ed693b6b6ec24af8ac2e64bcd24132f5. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:22:00.633829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Getting quotas for user 84b077253cd94d51ae9dc848e62aa937 and project ed693b6b6ec24af8ac2e64bcd24132f5. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:22:00.670503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:22:00.674200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:22:00.799652 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-21ddbec6-cb06-441b-9c13-f56586501ef6 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705732 Aug 06 21:22:00.807601 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2696/5216] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:21:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:22:00.814259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f3ca535-3afb-4559-a39b-e8feffcfef52 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:00.815298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f3ca535-3afb-4559-a39b-e8feffcfef52 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:00.915997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2f3ca535-3afb-4559-a39b-e8feffcfef52 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:00.926367 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f3ca535-3afb-4559-a39b-e8feffcfef52 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1215 microversion: 2.1 time: 0.117842 Aug 06 21:22:00.927011 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2521/5217] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:00 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:01.626566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:01.627670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:01.645163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:01.652734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:01.653205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:01.667495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:01.668572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:01.671839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:01.949888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:01.951658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:01.983133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:01.998072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:01.999432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:02.006492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:02.007370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:02.007947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:02.017842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:02.043912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:02.050642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:02.055620 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e4fefc53-e417-4561-8f4c-dfe5732c2e58 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.431247 Aug 06 21:22:02.093602 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2697/5218] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:01 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:22:02.280607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:02.294467 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7caf60bc-8c20-4f26-b2ce-0d6d67afdca7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1211 microversion: 2.1 time: 0.346963 Aug 06 21:22:02.295091 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2522/5219] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:01 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1211 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:03.104960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:03.106470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:03.129699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:03.130989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:03.132884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:03.133806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:03.137045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:03.137767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:03.317358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:03.318674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:03.340631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:03.343441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:03.345161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:03.346581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:03.348559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:03.349170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:03.507358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:03.531999 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b09a5323-0600-4e8c-8777-e28bb3380e9e tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1273 microversion: 2.1 time: 0.219375 Aug 06 21:22:03.535218 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2523/5220] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:03 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:03.543559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:03.556106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:03.560192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:03.564189 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37ee830b-8950-4ad6-8099-124160427b31 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.464425 Aug 06 21:22:03.566326 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2698/5221] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:03 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:04.570451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:04.571824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:04.587887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:04.588755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:04.589437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:04.590919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:04.591424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:04.592093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:04.597346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:04.598615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:04.641512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:04.642046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:04.647154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:04.647929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:04.648412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:04.654229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:05.345783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:05.357732 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-170833fe-9676-4b6c-9e52-617f23334240 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1315 microversion: 2.1 time: 0.802875 Aug 06 21:22:05.359288 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2524/5222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:04 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:06.302274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:06.323805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:06.325849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:06.329012 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3b381b73-9fb8-4816-a45d-5a7fbc9b76e6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 1.740826 Aug 06 21:22:06.330517 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2699/5223] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:04 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:06.378110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:06.378770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:06.412677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:06.418991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:06.419700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:06.427431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:06.428504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:06.433408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:06.760604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:06.774327 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d1b904b0-8d4d-4399-8d2e-d4b15240c7e8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1315 microversion: 2.1 time: 0.399983 Aug 06 21:22:06.775874 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2525/5224] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:06 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:06.805059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-9929cbb3-b96c-44ef-ac45-43ea7f1b7985 req-aae50729-8455-45cd-9163-adb17e6f7112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c50eda-5f55-46c2-ac87-cad945dde02e", "tag": "eaa19ad5-a62a-4ba9-977a-109e9e268968"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:06.835921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9929cbb3-b96c-44ef-ac45-43ea7f1b7985 req-aae50729-8455-45cd-9163-adb17e6f7112 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:06.837727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9929cbb3-b96c-44ef-ac45-43ea7f1b7985 req-aae50729-8455-45cd-9163-adb17e6f7112 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:06.838668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9929cbb3-b96c-44ef-ac45-43ea7f1b7985 req-aae50729-8455-45cd-9163-adb17e6f7112 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:06.867768 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-9929cbb3-b96c-44ef-ac45-43ea7f1b7985 req-aae50729-8455-45cd-9163-adb17e6f7112 service nova] Creating event network-changed:eaa19ad5-a62a-4ba9-977a-109e9e268968 for instance c6c50eda-5f55-46c2-ac87-cad945dde02e on nch2-master-1 Aug 06 21:22:06.886786 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-9929cbb3-b96c-44ef-ac45-43ea7f1b7985 req-aae50729-8455-45cd-9163-adb17e6f7112 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085574 Aug 06 21:22:06.887967 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2700/5225] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:22:07.354793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:07.355719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:07.363623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:07.364460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:07.365154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:07.366100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:07.367246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:07.368515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:07.724397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:07.739832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:07.749003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:07.752915 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3f45c075-3c8a-40b9-be53-699bfa547c83 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.401187 Aug 06 21:22:07.754210 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2526/5226] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:07 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:07.830730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:07.830730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:07.830730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:07.830730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:07.830730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:07.830730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:07.830730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:07.830730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:08.305137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:08.318902 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66d93f99-bde7-4870-b2bd-0f9976262e40 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1315 microversion: 2.1 time: 0.522631 Aug 06 21:22:08.320104 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2701/5227] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:07 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:08.780132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:08.781714 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:08.803993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:08.806316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:08.810254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:08.816792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:08.818697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:08.820975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:09.235010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:09.246340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:09.252753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:09.260291 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-182bd01b-f414-4032-8a16-959b0ab30110 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.485877 Aug 06 21:22:09.261589 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2527/5228] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:08 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:09.340610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:09.341870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:09.362891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:09.371355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:09.373378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:09.374342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:09.384162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:09.385040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:10.041272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:10.057064 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e9f322b-4283-4199-8dc1-f088984ee686 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1315 microversion: 2.1 time: 0.720197 Aug 06 21:22:10.076033 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2702/5229] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:09 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:10.289975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:10.291680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:10.300461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:10.301394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:10.302050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:10.303669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:10.304311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:10.304914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:10.497138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:10.508626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:10.511226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:10.512654 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9aadb746-8753-4b0c-a4cc-171145a133c4 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.230079 Aug 06 21:22:10.514411 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2528/5230] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:10 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:11.088704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:11.090165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:11.097263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:11.098702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:11.103835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:11.106332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:11.107527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:11.111661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:11.112515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:11.113182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:11.540516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:11.541395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:11.551546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:11.572117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:11.573042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:11.574617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:11.576695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:11.577933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:11.579709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:11.782531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:11.796114 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1315 microversion: 2.1 time: 0.710004 Aug 06 21:22:11.807426 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2703/5231] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:11 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:11.885970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:11.913318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:11.923920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:11.926511 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-362e5948-aa9b-4b09-adbd-581300820e3f tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.392448 Aug 06 21:22:11.934943 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2529/5232] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:11 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:12.713896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:12.715519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-17febaa0-1ffc-4d6b-ab72-b9d902284a3d tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002059 Aug 06 21:22:12.722059 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2704/5233] 10.222.0.33 () {56 vars in 886 bytes} [Sat Aug 6 21:22:12 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 06 21:22:12.817905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:12.819242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:12.849859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:12.851133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:12.851960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:12.855355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:12.856659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:12.858428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:12.964062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:12.964933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:12.981840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:12.983970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:12.985603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:12.986346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:12.987971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:12.993240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:12.994631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:13.281361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:13.298479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:13.301024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:13.302454 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5cc99cb-47d7-447d-b14d-75cdc0577e23 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.352197 Aug 06 21:22:13.303222 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2705/5234] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:12 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:13.327213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b0bdf05a-af51-46f2-876f-5df097d9e107 req-7f7caaff-c132-47b6-bc2f-561fb32d812e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c50eda-5f55-46c2-ac87-cad945dde02e", "name": "network-vif-plugged", "status": "completed", "tag": "eaa19ad5-a62a-4ba9-977a-109e9e268968"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:13.342011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b0bdf05a-af51-46f2-876f-5df097d9e107 req-7f7caaff-c132-47b6-bc2f-561fb32d812e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:13.342998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b0bdf05a-af51-46f2-876f-5df097d9e107 req-7f7caaff-c132-47b6-bc2f-561fb32d812e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:13.343904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b0bdf05a-af51-46f2-876f-5df097d9e107 req-7f7caaff-c132-47b6-bc2f-561fb32d812e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:13.363562 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b0bdf05a-af51-46f2-876f-5df097d9e107 req-7f7caaff-c132-47b6-bc2f-561fb32d812e service nova] Creating event network-vif-plugged:eaa19ad5-a62a-4ba9-977a-109e9e268968 for instance c6c50eda-5f55-46c2-ac87-cad945dde02e on nch2-master-1 Aug 06 21:22:13.370450 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b0bdf05a-af51-46f2-876f-5df097d9e107 req-7f7caaff-c132-47b6-bc2f-561fb32d812e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052836 Aug 06 21:22:13.371697 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2706/5235] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:22:13.685897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:13.729751 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a3c65b33-28fb-4903-8c7f-70f1124ef31c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1315 microversion: 2.1 time: 0.916061 Aug 06 21:22:13.730363 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2530/5236] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:12 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:14.740759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:14.742366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:14.752415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:14.753198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:14.780040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:14.780555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:14.782592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:14.785388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:14.785887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:14.786960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:14.789909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:14.795866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:14.798055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:14.799499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:14.800457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:14.802826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:15.137384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:15.146824 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df3854f9-6d42-4bd2-b81e-c955247ecdf3 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1315 microversion: 2.1 time: 0.399573 Aug 06 21:22:15.170943 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2531/5237] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:14 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:22:15.322654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:15.338622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:15.340155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:15.341521 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4c462caf-54dc-48f1-92ac-c93567062acf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 1.016275 Aug 06 21:22:15.363100 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2707/5238] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:14 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:16.170180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:16.170972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:16.189164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:16.189673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:16.190128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:16.190938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:16.191410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:16.191848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:16.373468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:16.374785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:16.397268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:16.398242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:16.399152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:16.400376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:16.406352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:16.409938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:16.737366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:16.756850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:16.760470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:16.772568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:16.779614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:16.782077 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-047045ad-12c5-4e67-8f4f-a7afe3406497 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1740 microversion: 2.20 time: 0.416521 Aug 06 21:22:16.788076 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2708/5239] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:16 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:16.790631 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a156a5d-2f06-4cd1-a023-2db11dea64bb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1502 microversion: 2.1 time: 0.622085 Aug 06 21:22:16.792208 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2532/5240] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:16 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1502 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:16.820034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:16.821024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:16.834458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:16.835100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:16.835607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:16.839767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:16.841107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:16.843320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:17.187932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:17.196397 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f8f4cd7-c402-4d9f-a692-16b57ad03941 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1502 microversion: 2.1 time: 0.381569 Aug 06 21:22:17.200042 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2709/5241] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:16 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1502 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:17.220937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:17.221518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:17.233716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:17.234258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:17.234810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:17.235859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:17.236459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:17.236980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:17.301061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lazy-loading 'flavor' on Instance uuid c6c50eda-5f55-46c2-ac87-cad945dde02e {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:22:17.436299 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46d1135e-8812-4588-ad86-cbd0fc32505f tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "POST /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e/action" status: 202 len: 0 microversion: 2.1 time: 0.217904 Aug 06 21:22:17.437058 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2533/5242] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:22:17 2022] POST /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:22:17.445432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:17.446933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:17.459972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:17.460697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:17.461146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:17.462061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:17.462534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:17.467552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:17.814145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:17.814885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:17.833147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:17.833782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:17.834244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:17.835115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:17.835674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:17.836112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:18.223848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:18.247480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:18.249197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:18.250472 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9fbb064b-f989-42b6-b826-69e3c2275571 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1722 microversion: 2.20 time: 0.441256 Aug 06 21:22:18.251084 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2534/5243] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:17 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1722 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:22:18.319180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:18.328155 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-901771b7-1858-4fe0-938a-14a1a857ba8c tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1510 microversion: 2.1 time: 0.886529 Aug 06 21:22:18.332151 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2710/5244] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:17 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1510 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:22:19.273685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:19.275783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:19.286026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:19.286848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:19.287462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:19.288577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:19.289226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:19.290593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:19.357713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:19.359013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:19.378314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:19.381074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:19.381975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:19.385117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:19.385810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:19.386417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:19.440781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:19.521526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:19.537118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:19.545601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:19.546836 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9945fa6c-6e2e-4b2b-8801-55c6856e5f14 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1722 microversion: 2.20 time: 0.277435 Aug 06 21:22:19.550573 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2535/5245] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:19 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:19.671699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:19.681882 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f09d0713-5215-424d-a6d0-7526295cf57a tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1493 microversion: 2.1 time: 0.332215 Aug 06 21:22:19.686419 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2711/5246] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:19 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1493 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:19.708401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-69da1813-a039-4d6c-86ea-7dcfe9ed3575 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:19.714234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-69da1813-a039-4d6c-86ea-7dcfe9ed3575 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:19.727133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69da1813-a039-4d6c-86ea-7dcfe9ed3575 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:19.732517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69da1813-a039-4d6c-86ea-7dcfe9ed3575 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:19.733040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69da1813-a039-4d6c-86ea-7dcfe9ed3575 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:19.733904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69da1813-a039-4d6c-86ea-7dcfe9ed3575 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:19.734485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69da1813-a039-4d6c-86ea-7dcfe9ed3575 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:19.736610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69da1813-a039-4d6c-86ea-7dcfe9ed3575 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:19.932570 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-69da1813-a039-4d6c-86ea-7dcfe9ed3575 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "POST /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e/action" status: 202 len: 0 microversion: 2.1 time: 0.228599 Aug 06 21:22:19.933713 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2536/5247] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:22:19 2022] POST /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:22:19.962373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:19.964627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:20.002059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:20.005490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:20.006585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:20.007825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:20.008218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:20.010825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:20.502003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:20.511968 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d2f8e660-d98f-45e0-8c48-43919037d202 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1499 microversion: 2.1 time: 0.572219 Aug 06 21:22:20.513249 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2712/5248] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:19 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1499 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:20.572773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:20.573491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:20.580795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:20.581287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:20.581961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:20.582701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:20.583163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:20.583593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:20.877292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:20.896310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:20.903358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:20.917656 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aacf9cd5-fe71-4798-875b-266ac192a95b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1725 microversion: 2.20 time: 0.349809 Aug 06 21:22:20.938931 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2537/5249] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:20 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1725 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:20.958129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2dfeeb2b-c10a-49bd-bf78-ac0199c02c64 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5adaf89-1512-4f7e-9904-46f75cd0794e"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:20.963641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2dfeeb2b-c10a-49bd-bf78-ac0199c02c64 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:20.978164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dfeeb2b-c10a-49bd-bf78-ac0199c02c64 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:20.978164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dfeeb2b-c10a-49bd-bf78-ac0199c02c64 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:20.984139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dfeeb2b-c10a-49bd-bf78-ac0199c02c64 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:20.985647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dfeeb2b-c10a-49bd-bf78-ac0199c02c64 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:20.986506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dfeeb2b-c10a-49bd-bf78-ac0199c02c64 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:20.988251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2dfeeb2b-c10a-49bd-bf78-ac0199c02c64 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:21.543478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:21.544477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:21.562771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:21.563280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:21.563736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:21.564466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:21.565036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:21.571802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:21.614154 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2dfeeb2b-c10a-49bd-bf78-ac0199c02c64 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.661453 Aug 06 21:22:21.614919 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2713/5250] 10.222.0.33 () {62 vars in 1364 bytes} [Sat Aug 6 21:22:20 2022] POST /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/os-volume_attachments => generated 188 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:22:21.725883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7b552d7e-856e-4626-92e7-a100103cb99d req-f2113268-3537-44ad-a869-f0248b61b9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdbf80b7-fcb5-4e9a-8ac6-9206d006c170", "name": "network-vif-unplugged", "status": "completed", "tag": "b9aeea6b-a91f-4546-b520-c27af81fa5df"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:21.749675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7b552d7e-856e-4626-92e7-a100103cb99d req-f2113268-3537-44ad-a869-f0248b61b9e1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:21.750194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7b552d7e-856e-4626-92e7-a100103cb99d req-f2113268-3537-44ad-a869-f0248b61b9e1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:21.753684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7b552d7e-856e-4626-92e7-a100103cb99d req-f2113268-3537-44ad-a869-f0248b61b9e1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:21.808120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.compute.server_external_events [req-7b552d7e-856e-4626-92e7-a100103cb99d req-f2113268-3537-44ad-a869-f0248b61b9e1 service nova] Unable to find a host for instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170. Dropping event network-vif-unplugged {{(pid=142461) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 21:22:21.811164 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7b552d7e-856e-4626-92e7-a100103cb99d req-f2113268-3537-44ad-a869-f0248b61b9e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.090131 Aug 06 21:22:21.814279 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2714/5251] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 21:22:21.897653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-779722f2-103a-4de1-8b44-505b5e1182e9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:21.898166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-779722f2-103a-4de1-8b44-505b5e1182e9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:21.912356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779722f2-103a-4de1-8b44-505b5e1182e9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:21.913090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779722f2-103a-4de1-8b44-505b5e1182e9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:21.913722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779722f2-103a-4de1-8b44-505b5e1182e9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:21.918476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779722f2-103a-4de1-8b44-505b5e1182e9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:21.919278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779722f2-103a-4de1-8b44-505b5e1182e9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:21.919884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-779722f2-103a-4de1-8b44-505b5e1182e9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:22.290632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:22.305078 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-779722f2-103a-4de1-8b44-505b5e1182e9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/os-volume_attachments/f5adaf89-1512-4f7e-9904-46f75cd0794e" status: 202 len: 0 microversion: 2.20 time: 0.422026 Aug 06 21:22:22.306564 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2715/5252] 10.222.0.33 () {60 vars in 1457 bytes} [Sat Aug 6 21:22:21 2022] DELETE /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/os-volume_attachments/f5adaf89-1512-4f7e-9904-46f75cd0794e => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:22:22.310338 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9aef0727-513a-4ae2-86b1-1a2165ba97a9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1499 microversion: 2.1 time: 0.779135 Aug 06 21:22:22.316230 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2538/5253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:21 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1499 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:22.401386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:22.402235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:22.409285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:22.410044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:22.410580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:22.411390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:22.411908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:22.412411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:22.460257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=142461) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 21:22:22.590413 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3f2cd650-0c7e-441e-8e0b-f80ce1a57b0c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "POST /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/action" status: 202 len: 0 microversion: 2.20 time: 0.193094 Aug 06 21:22:22.592575 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2716/5254] 10.222.0.33 () {62 vars in 1319 bytes} [Sat Aug 6 21:22:22 2022] POST /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:22:22.600267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:22.601361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:22.620831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:22.621542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:22.623396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:22.624353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:22.624837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:22.625321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:22.833993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:22.843827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:22.853273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:22.855573 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d55dbf2f-9140-4ac4-bec7-24c230301c30 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1673 microversion: 2.20 time: 0.259859 Aug 06 21:22:22.868668 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2539/5255] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:22 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1673 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:23.340025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:23.340653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:23.347610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:23.348692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:23.349388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:23.350385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:23.351112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:23.351759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:23.723916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:23.734466 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-09d73952-222f-4282-a6e6-b4e179bcbbce tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1502 microversion: 2.1 time: 0.399060 Aug 06 21:22:23.736482 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2717/5256] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:23 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:23.767116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:23.769119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:23.781324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:23.781914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:23.782483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:23.783377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:23.784199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:23.784706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:23.822986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lazy-loading 'flavor' on Instance uuid c6c50eda-5f55-46c2-ac87-cad945dde02e {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:22:23.878849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:23.879463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:23.891748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:23.892292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:23.892752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:23.893493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:23.893962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:23.894395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:23.972200 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1bb05198-502e-494a-8832-e3a1159b1956 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "POST /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e/action" status: 202 len: 0 microversion: 2.1 time: 0.209379 Aug 06 21:22:23.973422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2540/5257] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:22:23 2022] POST /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:22:23.994759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:23.997600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:24.047177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:24.049959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:24.053187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:24.054355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:24.056966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:24.058053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:24.239881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:24.253578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:24.259526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:24.263194 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3472165f-a0af-4779-bf54-55721a8f6f73 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1673 microversion: 2.20 time: 0.388222 Aug 06 21:22:24.264981 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2718/5258] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:23 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1673 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:24.661810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:24.674741 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71ffab01-8d9b-4f64-a8ae-72e3f0eb3cea tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1510 microversion: 2.1 time: 0.694091 Aug 06 21:22:24.678181 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2541/5259] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:23 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1510 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:25.294018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:25.295338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:25.310884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:25.311698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:25.312398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:25.323768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:25.324587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:25.325266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:25.701483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:25.703462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:25.707643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=52 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:25.721250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:25.722125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:25.722840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:25.726071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:25.726829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:25.728301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:26.004474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:26.013756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:26.022170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:26.023627 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e37215c-6cf6-4da1-ab42-db616018f4d5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.734036 Aug 06 21:22:26.025301 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2719/5260] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:25 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:26.203889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-447097079", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:26.281684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:22:26.640602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:26.661552 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b1ee4ce0-63ba-4edb-b378-c488bd6bc3cf tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1493 microversion: 2.1 time: 0.964387 Aug 06 21:22:26.662536 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2542/5261] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:25 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1493 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:22:26.698347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d48e8670-011d-4097-ac39-5836e6781bb7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:26.700864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d48e8670-011d-4097-ac39-5836e6781bb7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:26.724359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d48e8670-011d-4097-ac39-5836e6781bb7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:26.724947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d48e8670-011d-4097-ac39-5836e6781bb7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:26.725313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d48e8670-011d-4097-ac39-5836e6781bb7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:26.731489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d48e8670-011d-4097-ac39-5836e6781bb7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:26.732081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d48e8670-011d-4097-ac39-5836e6781bb7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:26.737389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d48e8670-011d-4097-ac39-5836e6781bb7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:26.921667 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d48e8670-011d-4097-ac39-5836e6781bb7 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "POST /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e/action" status: 202 len: 0 microversion: 2.1 time: 0.237363 Aug 06 21:22:26.926668 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2543/5262] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:22:26 2022] POST /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:22:26.935113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:26.939866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:26.951418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:26.952195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:26.952863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:26.953780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:26.954407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:26.955183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:26.965486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:22:26.966056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:22:26.966834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:22:26.967456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:22:26.968260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:22:26.996807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:26.997318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:26.997796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:26.998588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:26.999097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:26.999537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:27.006452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:27.096514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Getting quotas for project a31b7575aa0944cca8da8f093eeeb0bf. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:22:27.110708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Getting quotas for user e286c03134e646ce962ea7b88eab4b38 and project a31b7575aa0944cca8da8f093eeeb0bf. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:22:27.156961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:22:27.159761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:22:27.286269 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8bb2ec45-66f6-40d9-a358-0fb6f758d79a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085838 Aug 06 21:22:27.287852 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2720/5263] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:22:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:22:27.295439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:27.296292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:27.305983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:27.307837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:27.309276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:27.311533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:27.312259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:27.312949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:27.521264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:27.533264 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b4f0598-6ec4-4093-b409-5362e13f4547 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1499 microversion: 2.1 time: 0.602415 Aug 06 21:22:27.534309 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2544/5264] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:26 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1499 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:27.546123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d477635d-ccc6-445b-9e2b-7dd8a75e61d3 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:27.547584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d477635d-ccc6-445b-9e2b-7dd8a75e61d3 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:27.727807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d477635d-ccc6-445b-9e2b-7dd8a75e61d3 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:27.741338 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d477635d-ccc6-445b-9e2b-7dd8a75e61d3 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1213 microversion: 2.1 time: 0.205204 Aug 06 21:22:27.745866 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2545/5265] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:27 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1213 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:28.087098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:28.101415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:28.107008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:28.111333 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a3601ba9-e94a-43c9-9a85-4f014577cac9 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.821805 Aug 06 21:22:28.115999 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2721/5266] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:27 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:28.560824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:28.563136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:28.589322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:28.596316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:28.599068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:28.601213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:28.603353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:28.607876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:28.771325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:28.772896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:28.796732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:28.803445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:28.804759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:28.808965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:28.812828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:28.813834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:29.078895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:29.087133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:29.088404 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e163587c-2ac4-4717-869b-eab70c48fde8 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1209 microversion: 2.1 time: 0.324611 Aug 06 21:22:29.109461 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2722/5267] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:28 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1209 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:29.150619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:29.154711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:29.181384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:29.184618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:29.189466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:29.198936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:29.201357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:29.203927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:29.204420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:29.225619 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8c91edf-df95-4030-bd88-ba6abc051693 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1499 microversion: 2.1 time: 0.671571 Aug 06 21:22:29.229078 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2546/5268] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:28 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1499 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:30.116233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:30.117434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:30.152026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:30.154420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:30.155280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:30.159041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:30.159976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:30.163486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:30.216293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:30.231005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:30.232633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:30.236816 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e5dd28a-d0f5-4875-af2d-393372ef040b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 1.097144 Aug 06 21:22:30.255765 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2723/5269] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:29 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:30.261867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:30.262864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:30.271370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:30.276020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:30.276720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:30.277692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:30.283541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:30.284365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:30.527032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:30.539631 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c49452c4-e8a0-4a08-9118-17db8bf1b8b9 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1499 microversion: 2.1 time: 0.282521 Aug 06 21:22:30.543458 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2724/5270] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:30 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1499 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:31.185642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:31.197761 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-43cfa70e-5fe5-4250-82c7-0efc1a67a4eb tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1271 microversion: 2.1 time: 1.087829 Aug 06 21:22:31.218854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2547/5271] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:30 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1271 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:22:31.262623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:31.263349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:31.274698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:31.275202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:31.282808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:31.287981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:31.288503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:31.293641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:31.568377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:31.569473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:31.598105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:31.599039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:31.603262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:31.604413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:31.604899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:31.605363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:31.717813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:31.738207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:31.746885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:31.749705 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-04df32fe-180a-4766-bcf5-3af800a19436 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.491738 Aug 06 21:22:31.750864 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2725/5272] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:31 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:32.229358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:32.230183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:32.246365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:32.246903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:32.247356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:32.250850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:32.251390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:32.251842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:32.294189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:32.325542 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7265012-10f6-4416-84d8-6d631ebc6354 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1502 microversion: 2.1 time: 0.765443 Aug 06 21:22:32.338636 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2548/5273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:31 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1502 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:22:32.379355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:32.379355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:32.421311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:32.421823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:32.424097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:32.430856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:32.431362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:32.442294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:32.470787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:32.484609 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ed055afd-1f27-49d0-b6bb-f25b12d2489e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1271 microversion: 2.1 time: 0.260910 Aug 06 21:22:32.485879 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2726/5274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:32 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:22:32.534644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:22:32.734162 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bbf637ab-6fef-493a-986f-7078be8047a8 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 204 len: 0 microversion: 2.1 time: 0.377616 Aug 06 21:22:32.735956 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2549/5275] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:22:32 2022] DELETE /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:22:32.745002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:32.746288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:32.760524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:32.767092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:32.767572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:32.778154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:32.782437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:32.783884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:32.784500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:32.787345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:32.818896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:32.819399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:32.819851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:32.825685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:32.828143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:32.828842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:33.161585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:33.174959 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-83336923-4974-43cb-b05f-67f517ce5bdb tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1508 microversion: 2.1 time: 0.434766 Aug 06 21:22:33.176469 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2727/5276] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:32 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1508 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:33.515347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:33.521620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:33.530655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:33.531701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:33.532361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:33.533631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:33.534305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:33.534970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:33.551874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:33.564421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:33.576874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:33.578348 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ec0b38a7-2c35-41d0-808b-a060c6bc3685 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.808699 Aug 06 21:22:33.598930 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2550/5277] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:32 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:33.710862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:33.725492 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5e700669-1a8d-4683-b63f-2e3acb2aaec6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1271 microversion: 2.1 time: 0.216270 Aug 06 21:22:33.735632 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2728/5278] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:33 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:34.200932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:34.201917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:34.228669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:34.230343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:34.232539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:34.234599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:34.236898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:34.238131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:34.605500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:34.606358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:34.635121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:34.636559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:34.637304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:34.638666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:34.656630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:34.659202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:34.782460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:34.808330 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7604aab7-bbc7-4a3e-bc8d-2990e030f6dc tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1508 microversion: 2.1 time: 0.613655 Aug 06 21:22:34.813596 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2551/5279] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:34 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1508 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:34.836811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:34.838065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:34.866192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:34.868394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:34.869954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:34.872912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:34.875261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:34.878722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:36.142562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:36.155673 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4dce6fe0-5f98-43be-af58-48416164e134 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 1.338181 Aug 06 21:22:36.159518 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2552/5280] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:34 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:36.170609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:36.172160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:36.188755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:36.190846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:36.194822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:36.196862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:36.199031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:36.200897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:36.572828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:36.599010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:36.600414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:36.602316 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3bba29bf-d15e-42f8-a68e-a98038605a09 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 2.001126 Aug 06 21:22:36.602959 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2729/5281] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:34 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:37.077038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-62292fad-aa55-400e-9703-9fa7fc5cc5ef req-934c2175-7cce-4d75-ac90-81798bb6a04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c50eda-5f55-46c2-ac87-cad945dde02e", "name": "network-vif-deleted", "tag": "eaa19ad5-a62a-4ba9-977a-109e9e268968"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:37.098015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:37.106461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-62292fad-aa55-400e-9703-9fa7fc5cc5ef req-934c2175-7cce-4d75-ac90-81798bb6a04a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:37.110747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-62292fad-aa55-400e-9703-9fa7fc5cc5ef req-934c2175-7cce-4d75-ac90-81798bb6a04a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:37.111490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-62292fad-aa55-400e-9703-9fa7fc5cc5ef req-934c2175-7cce-4d75-ac90-81798bb6a04a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:37.129483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b077253cd94d51ae9dc848e62aa937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed693b6b6ec24af8ac2e64bcd24132f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:37.144924 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2949d229-32cf-4d6c-aa47-6fefeeabd0aa tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 200 len: 1466 microversion: 2.1 time: 0.983893 Aug 06 21:22:37.153182 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2553/5282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:36 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 1466 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:37.172570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:37.187474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:37.189790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:37.195418 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-62292fad-aa55-400e-9703-9fa7fc5cc5ef req-934c2175-7cce-4d75-ac90-81798bb6a04a service nova] Creating event network-vif-deleted:eaa19ad5-a62a-4ba9-977a-109e9e268968 for instance c6c50eda-5f55-46c2-ac87-cad945dde02e on nch2-master-1 Aug 06 21:22:37.211460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:37.212070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:37.216337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:37.217592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:37.218083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:37.221832 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-62292fad-aa55-400e-9703-9fa7fc5cc5ef req-934c2175-7cce-4d75-ac90-81798bb6a04a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150002 Aug 06 21:22:37.222468 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2730/5283] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:22:37.224361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:37.601823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:37.611628 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f441f19-e3d4-4169-8ad3-3e22633a7c76 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 0.428348 Aug 06 21:22:37.623892 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2554/5284] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:37 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:22:37.631546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:37.634307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:37.649228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:37.652330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:37.652772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:37.653774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:37.654384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:37.655101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:38.001913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:38.023661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:38.025460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:38.043483 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-253698bf-71bd-47e2-8897-6ee8b8ef98b6 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.400819 Aug 06 21:22:38.046114 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2731/5285] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:37 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:38.178517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:38.179191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] [instance: c6c50eda-5f55-46c2-ac87-cad945dde02e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:38.183052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:38.186775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:38.187349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:38.187811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:38.188604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:38.189114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:38.189556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:38.251129 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] HTTP exception thrown: Instance c6c50eda-5f55-46c2-ac87-cad945dde02e could not be found. Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Request method failure captured: Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e HTTP/1.1 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7ttyEP3qkiloyvNJCTotqU3Tv0q7Fgwi3Opm1ntX4UEFhtL23e8RkKiTmleU-pK5YHlyKwgz1YyGN0qBoCXjqWpWPPryVU_EeDjBYfbMglorybKEcP323dm5uGajFSY-9vsyrnQz8Jj0uXbOYRwLGjqO4U9T90SoFOwXeIvCSGSuAeo Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: ed693b6b6ec24af8ac2e64bcd24132f5 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestServerAdvancedOps-1908748249 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed693b6b6ec24af8ac2e64bcd24132f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed693b6b6ec24af8ac2e64bcd24132f5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed693b6b6ec24af8ac2e64bcd24132f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed693b6b6ec24af8ac2e64bcd24132f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestServerAdvancedOps-1908748249 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: ed693b6b6ec24af8ac2e64bcd24132f5 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestServerAdvancedOps-1908748249 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestServerAdvancedOps-1908748249-project Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 84b077253cd94d51ae9dc848e62aa937 Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestServerAdvancedOps-1908748249-project Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance c6c50eda-5f55-46c2-ac87-cad945dde02e could not be found. Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'c6c50eda-5f55-46c2-ac87-cad945dde02e'} Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c50eda-5f55-46c2-ac87-cad945dde02e could not be found. Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c50eda-5f55-46c2-ac87-cad945dde02e could not be found. Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:22:38.262319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:22:38.267210 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:22:38.267210 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:22:38.267210 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:22:38.267210 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:22:38.267210 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:22:38.267210 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c50eda-5f55-46c2-ac87-cad945dde02e could not be found. Aug 06 21:22:38.267210 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:22:38.268676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] Returning 404 to user: Instance c6c50eda-5f55-46c2-ac87-cad945dde02e could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:22:38.269744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03726a62-a08e-4600-856b-6d7cbb054d39 tempest-TestServerAdvancedOps-1908748249 tempest-TestServerAdvancedOps-1908748249-project] 10.222.0.33 "GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e" status: 404 len: 111 microversion: 2.1 time: 0.096162 Aug 06 21:22:38.277178 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2555/5286] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:38 2022] GET /compute/v2.1/servers/c6c50eda-5f55-46c2-ac87-cad945dde02e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:22:38.640530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:38.642407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:38.651553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:38.676414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:38.686628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:38.687781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:38.693564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:38.695028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:39.069514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:39.071439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:39.093358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:39.094424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:39.096297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:39.098372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:39.100638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:39.101680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:39.387979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:39.411488 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e88f223-4703-483f-bed1-84baa09c5865 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 0.775724 Aug 06 21:22:39.416281 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2732/5287] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:38 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:39.864353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:39.887728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:39.935591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:39.943047 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb78a59d-26eb-435c-a0f1-acbeff5c5133 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.877369 Aug 06 21:22:39.955139 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2556/5288] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:39 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:40.436690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:40.437312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:40.447214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:40.452868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:40.455458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:40.456414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:40.459324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:40.459991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:40.511338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-4b4ae044-183b-4224-ab71-bfd186d2700b req-4f3d4785-dbfc-40a6-adfc-f7098f7ed205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ab3abc7-4298-4db9-b2bf-c8ced75938a7", "tag": "4c682ef2-a28f-41c3-aa53-c66c1eed348b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:40.533010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4b4ae044-183b-4224-ab71-bfd186d2700b req-4f3d4785-dbfc-40a6-adfc-f7098f7ed205 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:40.534563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4b4ae044-183b-4224-ab71-bfd186d2700b req-4f3d4785-dbfc-40a6-adfc-f7098f7ed205 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:40.537173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4b4ae044-183b-4224-ab71-bfd186d2700b req-4f3d4785-dbfc-40a6-adfc-f7098f7ed205 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:40.591851 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-4b4ae044-183b-4224-ab71-bfd186d2700b req-4f3d4785-dbfc-40a6-adfc-f7098f7ed205 service nova] Creating event network-changed:4c682ef2-a28f-41c3-aa53-c66c1eed348b for instance 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 on nch1-master-1 Aug 06 21:22:40.606422 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-4b4ae044-183b-4224-ab71-bfd186d2700b req-4f3d4785-dbfc-40a6-adfc-f7098f7ed205 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102072 Aug 06 21:22:40.611446 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2557/5289] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:22:40.972335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:40.973985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:40.989692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:40.990205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:40.990690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:41.004351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:41.005178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:41.006296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:41.114736 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:41.125722 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-85b26a09-b964-446e-9805-8308f10569c6 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 0.692260 Aug 06 21:22:41.128064 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2733/5290] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:40 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:41.737856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bcd2ad8e-6e3d-4d3e-9cfc-a0f365e323d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Action: 'create', calling method: .version_select at 0x7f72a35ba3a0>, body: {"keypair": {"name": "tempest-keypair-722991006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJeyNEMiabOGMs7jVX+MdN5/VRCLKY94YHW4O/DS4hwFaCUAJYnw32wLgZY6YuDKsOBz693FPaTb4HrcUCNPh2vK5wW7zaDawiI2KfkMY5Gnz3rJNQ50ktH1qsYP28zNA=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:41.779038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-bcd2ad8e-6e3d-4d3e-9cfc-a0f365e323d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Getting quotas for project 1ff5cf7fb11b4fc8aab84c3610683094. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:22:41.795813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-bcd2ad8e-6e3d-4d3e-9cfc-a0f365e323d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Getting quotas for user 28aa42b542db43a1bf3d1d21d687b95b and project 1ff5cf7fb11b4fc8aab84c3610683094. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:22:41.856495 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bcd2ad8e-6e3d-4d3e-9cfc-a0f365e323d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.392906 Aug 06 21:22:41.857237 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2734/5291] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:22:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:22:41.947312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:41.958351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:41.962144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:41.964409 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23df245c-874e-42c6-9927-1db06fa43aee tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.998132 Aug 06 21:22:41.976830 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2558/5292] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:40 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:42.152738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:42.153460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:42.164903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:42.165732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:42.167061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:42.170306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:42.171309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:42.175142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:42.989386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:42.990020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:43.005458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:43.005966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:43.006421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:43.019377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:43.020127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:43.021275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:43.106030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:43.121239 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b86a486-cc34-4055-a5e7-8d1205784750 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 0.972792 Aug 06 21:22:43.123835 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2735/5293] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:42 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:43.398650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:43.416813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:43.420444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:43.426089 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b97c55e-5578-4899-95cd-43f9e8425d90 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.440440 Aug 06 21:22:43.427715 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2559/5294] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:42 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:44.148613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:44.149411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:44.153191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:44.167624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:44.171820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:44.172555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:44.173923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:44.174647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:44.178431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:44.455113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:44.455741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:44.475202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:44.476251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:44.476740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:44.477485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:44.477959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:44.478404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:44.796100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:44.807823 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-25e2bc01-67e8-4eb9-b8ed-0606c6a62a09 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 0.663641 Aug 06 21:22:44.821778 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2736/5295] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:44 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:45.642935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:45.656912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:45.685216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:45.687160 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cde2a834-fb34-4e1e-a416-93178d4fd31e tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 1.237537 Aug 06 21:22:45.688445 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2560/5296] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:44 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:45.844395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:45.845087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:45.876277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:45.879965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:45.880539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:45.881320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:45.881811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:45.882283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:46.543457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:46.559651 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1b0d6193-ee65-4a7b-a04a-6d8f7bab8401 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 0.721815 Aug 06 21:22:46.563735 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2737/5297] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:45 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:46.716435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:46.717779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:46.729459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:46.730349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:46.731154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:46.735791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:46.737410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:46.738537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:46.838071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:47.036239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-822626130", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1202548-f8ad-47c3-bd4c-bc9e2f917e5b"}], "security_groups": [{"name": "tempest-securitygroup--1319263149"}], "key_name": "tempest-keypair-722991006", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:47.080099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:47.090673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:47.109717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:47.119911 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-643aa371-8509-49fe-8db7-98161c035e52 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.410880 Aug 06 21:22:47.120717 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2561/5298] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:46 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:47.436277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] validate_networks() for [('b1202548-f8ad-47c3-bd4c-bc9e2f917e5b', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:22:47.594415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:47.594415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:47.618776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:47.620455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:47.622058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:47.630983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:47.632232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:47.633105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:47.837117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:47.847654 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb0d7067-41cc-4359-b105-019311f1e186 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 0.263801 Aug 06 21:22:47.848612 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2562/5299] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:47 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:48.147133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:48.147678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:48.158213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:48.158968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:48.160016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:48.161665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:48.164196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:48.164684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:48.379767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:48.394926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:48.396626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:48.400133 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0ca83800-960a-4cfe-b964-d2d624d35f5a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.257249 Aug 06 21:22:48.401422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2563/5300] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:48 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:22:48.867324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:22:48.868471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:22:48.868963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:22:48.869506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:48.869942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:22:48.870122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:48.870242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:22:48.878915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:48.879641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:48.880597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:48.881198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:48.882534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:48.882837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:48.882959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:48.883890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:48.884021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:48.884544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:48.885035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:48.885205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:48.907138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Getting quotas for project 1ff5cf7fb11b4fc8aab84c3610683094. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:22:48.913415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Getting quotas for user 28aa42b542db43a1bf3d1d21d687b95b and project 1ff5cf7fb11b4fc8aab84c3610683094. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:22:48.929604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:22:48.933763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:22:49.021203 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4afbbb2e-4b4a-43d3-a136-0749b00260d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.996863 Aug 06 21:22:49.023020 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2738/5301] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:22:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:22:49.037855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-782a7303-5494-47f0-a574-1ae9a1a1bad6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:49.039083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-782a7303-5494-47f0-a574-1ae9a1a1bad6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:49.071703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:49.080627 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-edf9e2b1-f455-4071-91c0-7ba226102ff0 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 0.214872 Aug 06 21:22:49.086494 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2564/5302] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:48 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:49.241569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-782a7303-5494-47f0-a574-1ae9a1a1bad6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:49.258485 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-782a7303-5494-47f0-a574-1ae9a1a1bad6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1236 microversion: 2.1 time: 0.228435 Aug 06 21:22:49.259536 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2739/5303] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:49 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1236 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:49.425034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:49.426125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:49.433940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:49.434795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:49.435615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:49.436501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:49.437124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:49.437718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:49.717446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:49.728200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:49.730832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:49.732339 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-400eaee9-f059-4af2-8ad7-936dfedd14a2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.311592 Aug 06 21:22:49.733659 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2565/5304] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:49 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:22:50.018406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-de247b3d-9e8e-46f0-9837-57dd1cb619b3 req-2ec9095e-5e45-468e-b20c-606c099ed1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab3abc7-4298-4db9-b2bf-c8ced75938a7", "name": "network-vif-plugged", "status": "completed", "tag": "4c682ef2-a28f-41c3-aa53-c66c1eed348b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:50.038704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-de247b3d-9e8e-46f0-9837-57dd1cb619b3 req-2ec9095e-5e45-468e-b20c-606c099ed1c8 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:50.039895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-de247b3d-9e8e-46f0-9837-57dd1cb619b3 req-2ec9095e-5e45-468e-b20c-606c099ed1c8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:50.040755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-de247b3d-9e8e-46f0-9837-57dd1cb619b3 req-2ec9095e-5e45-468e-b20c-606c099ed1c8 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:50.085805 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-de247b3d-9e8e-46f0-9837-57dd1cb619b3 req-2ec9095e-5e45-468e-b20c-606c099ed1c8 service nova] Creating event network-vif-plugged:4c682ef2-a28f-41c3-aa53-c66c1eed348b for instance 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 on nch1-master-1 Aug 06 21:22:50.096900 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-de247b3d-9e8e-46f0-9837-57dd1cb619b3 req-2ec9095e-5e45-468e-b20c-606c099ed1c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087195 Aug 06 21:22:50.099844 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2740/5305] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:22:50.114405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:50.116413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:50.134987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:50.136359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:50.138496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:50.139498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:50.143078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:50.144710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:50.281227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:50.281945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:50.292515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:50.295391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:50.297883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:50.298848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:50.303812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:50.304851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:50.425121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:50.434599 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a801ffb-7080-44da-896c-ac779a40c0b2 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1288 microversion: 2.1 time: 0.157809 Aug 06 21:22:50.450495 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2741/5306] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:50 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1288 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:22:50.534575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:50.544409 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b7fd090-0738-4368-ba00-7dc793c9e96f tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1313 microversion: 2.1 time: 0.436874 Aug 06 21:22:50.545378 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2566/5307] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:50 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:50.760067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:50.760878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:50.781026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:50.784618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:50.790583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:50.791438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:50.791938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:50.798204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:51.460646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:51.461606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:51.481922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:51.483722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:51.485817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:51.487504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:51.488288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:51.488918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:51.563744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:51.573066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:51.580711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:51.581920 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d88639e5-7639-468a-8140-53f8a00b85e8 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.829542 Aug 06 21:22:51.582492 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2742/5308] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:50 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:22:51.597862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:51.598793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:51.617288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:51.619912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:51.620410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:51.620842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:51.623368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:51.625621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:51.626269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:51.628483 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-40996a17-891d-42d1-89c9-b0d788912c50 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1294 microversion: 2.1 time: 0.175357 Aug 06 21:22:51.632315 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2567/5309] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:51 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1294 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:51.682667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=100 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:52.029337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:52.039378 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b902d193-f288-4653-a52c-a68876874c65 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1463 microversion: 2.1 time: 0.454132 Aug 06 21:22:52.045438 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2743/5310] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:51 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1463 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:52.066178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-201d4298-f271-47e0-803f-f4f16d816196 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc7cec8b-4a90-4bae-8665-65bc2b7afa72", "device": "/dev/sdb"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:52.071110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-201d4298-f271-47e0-803f-f4f16d816196 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:52.085809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-201d4298-f271-47e0-803f-f4f16d816196 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:52.087216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-201d4298-f271-47e0-803f-f4f16d816196 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:52.087718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-201d4298-f271-47e0-803f-f4f16d816196 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:52.088416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-201d4298-f271-47e0-803f-f4f16d816196 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:52.088897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-201d4298-f271-47e0-803f-f4f16d816196 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:52.102496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-201d4298-f271-47e0-803f-f4f16d816196 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:52.186076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-49fa31c2-3d56-4c2a-85f2-2590dc6f7726 req-c36f7f75-74f5-4f92-901c-ecd89f5c9546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdbf80b7-fcb5-4e9a-8ac6-9206d006c170", "name": "network-vif-plugged", "status": "completed", "tag": "b9aeea6b-a91f-4546-b520-c27af81fa5df"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:52.203423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49fa31c2-3d56-4c2a-85f2-2590dc6f7726 req-c36f7f75-74f5-4f92-901c-ecd89f5c9546 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:52.203920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49fa31c2-3d56-4c2a-85f2-2590dc6f7726 req-c36f7f75-74f5-4f92-901c-ecd89f5c9546 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:52.204375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-49fa31c2-3d56-4c2a-85f2-2590dc6f7726 req-c36f7f75-74f5-4f92-901c-ecd89f5c9546 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:52.232488 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-49fa31c2-3d56-4c2a-85f2-2590dc6f7726 req-c36f7f75-74f5-4f92-901c-ecd89f5c9546 service nova] Creating event network-vif-plugged:b9aeea6b-a91f-4546-b520-c27af81fa5df for instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 on nch1-master-1 Aug 06 21:22:52.247523 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-49fa31c2-3d56-4c2a-85f2-2590dc6f7726 req-c36f7f75-74f5-4f92-901c-ecd89f5c9546 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064953 Aug 06 21:22:52.259397 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2744/5311] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:22:52.608368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:52.609090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:52.626112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:52.637217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:52.638074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:52.639694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:52.640616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:52.689899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:52.704712 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-201d4298-f271-47e0-803f-f4f16d816196 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "POST /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.640971 Aug 06 21:22:52.711812 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2568/5312] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:22:52 2022] POST /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:22:52.774244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:52.776441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:52.800126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:52.800733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:52.801309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:52.802360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:52.803006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:52.804131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:52.949982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:52.960275 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e43cb5fc-d389-4d97-901a-f7c7636eff39 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1294 microversion: 2.1 time: 0.244704 Aug 06 21:22:52.974025 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2569/5313] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:52 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1294 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:53.316659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:53.331343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:53.332922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:53.334116 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-163be211-1917-49d9-a33a-7c69c30cc71b tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.730361 Aug 06 21:22:53.345451 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2745/5314] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:52 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:22:53.981587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:53.982218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:53.991462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:54.005132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:54.005879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:54.007778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:54.009127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:54.010975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:54.355813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:54.369535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:54.370073 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-90576b51-1c09-4c5b-a5c7-462edde3be55 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1362 microversion: 2.1 time: 0.392126 Aug 06 21:22:54.370199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:54.371034 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2570/5315] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:53 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:54.387829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:54.388321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:54.388763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:54.394786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:54.400466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:54.401654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:54.870046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:54.897045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:54.903377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:54.904632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-20743cc1-ddae-4071-bb67-62588359473a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1731 microversion: 2.20 time: 0.539856 Aug 06 21:22:54.913734 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2746/5316] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:54 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1731 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:22:55.392702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:55.394237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:55.411271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:55.413063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:55.416072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:55.417776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:55.429766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:55.430241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:55.722849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:55.736434 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-73cf1dcf-439c-4006-bd38-9e98f717e53a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1362 microversion: 2.1 time: 0.348688 Aug 06 21:22:55.738988 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2571/5317] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:55 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:55.930237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:55.930885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:55.938578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:55.939292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:55.939885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:55.940778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:55.941437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:55.942081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:56.336064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:56.368782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:56.371600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:56.376965 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-245d68c7-9740-4d35-8e40-b4b23d742ebf tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1718 microversion: 2.20 time: 0.450466 Aug 06 21:22:56.378097 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2747/5318] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:22:55 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1718 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:22:56.767753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:56.768400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:56.771410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:56.796791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:56.797352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:56.797809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:56.798777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:56.799546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:56.800153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:57.060081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:57.068457 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b3bafb67-bd35-4b37-889a-b3546d3130a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1362 microversion: 2.1 time: 0.311302 Aug 06 21:22:57.081804 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2572/5319] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:56 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:57.425670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-08350ceb-f6ec-4d35-9b81-9441304656f7 req-d6f55d94-4a09-4d3d-a0d1-ebfd71c3ac94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328c3fb7-0e53-46c2-9490-4291d857a30a", "tag": "6fcfc51a-46a8-43b9-966f-1e876436ba43"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:22:57.457283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-08350ceb-f6ec-4d35-9b81-9441304656f7 req-d6f55d94-4a09-4d3d-a0d1-ebfd71c3ac94 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:57.464100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-08350ceb-f6ec-4d35-9b81-9441304656f7 req-d6f55d94-4a09-4d3d-a0d1-ebfd71c3ac94 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:57.466741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-08350ceb-f6ec-4d35-9b81-9441304656f7 req-d6f55d94-4a09-4d3d-a0d1-ebfd71c3ac94 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:57.506318 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-08350ceb-f6ec-4d35-9b81-9441304656f7 req-d6f55d94-4a09-4d3d-a0d1-ebfd71c3ac94 service nova] Creating event network-changed:6fcfc51a-46a8-43b9-966f-1e876436ba43 for instance 328c3fb7-0e53-46c2-9490-4291d857a30a on nch2-master-1 Aug 06 21:22:57.519877 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-08350ceb-f6ec-4d35-9b81-9441304656f7 req-d6f55d94-4a09-4d3d-a0d1-ebfd71c3ac94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098934 Aug 06 21:22:57.523704 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2748/5320] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:22:58.090107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:58.090757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:58.098218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:58.099572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:58.100599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:58.101336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:58.101971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:58.102594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:58.328501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:58.339474 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2ebd584b-ce34-4382-ab93-493a376c29b1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1362 microversion: 2.1 time: 0.253061 Aug 06 21:22:58.341088 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2573/5321] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:58 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:22:59.361868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:22:59.363556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:22:59.366987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:59.368329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=12 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:22:59.384700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:59.385191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:59.385634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:59.386341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:22:59.386829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:22:59.387256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:22:59.612115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:22:59.683712 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a27977eb-8c09-4df1-a39e-1cfa465bb6d8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1362 microversion: 2.1 time: 0.316985 Aug 06 21:22:59.687604 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2749/5322] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:22:59 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:00.714837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:00.716420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:00.727903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:00.728706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:00.729340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:00.730442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:00.731444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:00.732189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:01.098078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:01.117240 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-424c4a35-d3ff-46e3-b9ce-06dba35472cb tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1362 microversion: 2.1 time: 0.412948 Aug 06 21:23:01.125812 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2574/5323] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:00 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:02.123437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f20b6281-5f25-42f1-b0ea-3d948c964c47 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-4640311", "availability_zone": "foo_zone"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:02.137892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:02.139257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:02.155276 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.155276 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:23:02.156609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.aggregate [None req-f20b6281-5f25-42f1-b0ea-3d948c964c47 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Generated uuid 2008d5e1-6ff1-438f-912b-dde8f8a759cb for aggregate {{(pid=142461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 06 21:23:02.160517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:02.161052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:02.161501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:02.162448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:02.163005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:02.163448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:02.188626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f20b6281-5f25-42f1-b0ea-3d948c964c47 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 206 microversion: 2.1 time: 0.219344 Aug 06 21:23:02.191067 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2750/5324] 10.222.0.33 () {60 vars in 1164 bytes} [Sat Aug 6 21:23:01 2022] POST /compute/v2.1/os-aggregates => generated 206 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:23:02.208039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8c385930-45bc-4097-b975-dedf9156cb8d tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:02.211945 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.211945 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:23:02.246977 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8c385930-45bc-4097-b975-dedf9156cb8d tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 316 microversion: 2.1 time: 0.042909 Aug 06 21:23:02.248220 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2751/5325] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Aug 6 21:23:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 316 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:02.263567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-46f95eff-6cbc-46a8-8eb9-3b3d67dcc29f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:02.267704 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.267704 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:23:02.268989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46f95eff-6cbc-46a8-8eb9-3b3d67dcc29f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:02.269479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46f95eff-6cbc-46a8-8eb9-3b3d67dcc29f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:02.269916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46f95eff-6cbc-46a8-8eb9-3b3d67dcc29f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:02.270674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46f95eff-6cbc-46a8-8eb9-3b3d67dcc29f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:02.271132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46f95eff-6cbc-46a8-8eb9-3b3d67dcc29f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:02.271620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-46f95eff-6cbc-46a8-8eb9-3b3d67dcc29f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:02.303787 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-46f95eff-6cbc-46a8-8eb9-3b3d67dcc29f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047532 Aug 06 21:23:02.304414 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2752/5326] 10.222.0.33 () {58 vars in 1176 bytes} [Sat Aug 6 21:23:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:02.315967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9f9923e-299f-4d80-8106-feb2e086aa93 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:02.317461 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.317461 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:23:02.325176 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9f9923e-299f-4d80-8106-feb2e086aa93 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 295 microversion: 2.1 time: 0.013195 Aug 06 21:23:02.325755 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2753/5327] 10.222.0.33 () {58 vars in 1143 bytes} [Sat Aug 6 21:23:02 2022] GET /compute/v2.1/os-aggregates => generated 295 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:02.338061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:02.338483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-86cac395-a731-4ccf-a358-10b1fb3cc16f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:02.341310 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.341310 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:23:02.345929 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aec6e032-ec68-424c-98fd-563a8b7c362f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1362 microversion: 2.1 time: 0.212013 Aug 06 21:23:02.347098 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2575/5328] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:02 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:23:02.351706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86cac395-a731-4ccf-a358-10b1fb3cc16f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:02.352214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86cac395-a731-4ccf-a358-10b1fb3cc16f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:02.352663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-86cac395-a731-4ccf-a358-10b1fb3cc16f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:02.616106 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-86cac395-a731-4ccf-a358-10b1fb3cc16f tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 307 microversion: 2.1 time: 0.281977 Aug 06 21:23:02.623037 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2754/5329] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Aug 6 21:23:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:23:02.627574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ecc506f6-8e2e-4bd1-ae79-aef4636c09c0 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:02.628437 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.628437 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:23:02.636649 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ecc506f6-8e2e-4bd1-ae79-aef4636c09c0 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 307 microversion: 2.1 time: 0.012668 Aug 06 21:23:02.637296 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2576/5330] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:23:02 2022] GET /compute/v2.1/os-aggregates/19 => generated 307 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:02.648838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9dea3fe5-845c-4b56-aa19-79a47ec3e9e6 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1596499413", "availability_zone": "foo_zone"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:02.733114 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.733114 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:23:02.801952 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9dea3fe5-845c-4b56-aa19-79a47ec3e9e6 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.157412 Aug 06 21:23:02.803365 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2755/5331] 10.222.0.33 () {60 vars in 1173 bytes} [Sat Aug 6 21:23:02 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:02.815929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c6c3bc17-a0df-46d2-9320-c766402a0c42 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:02.818991 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.818991 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:23:02.852918 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c6c3bc17-a0df-46d2-9320-c766402a0c42 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.042069 Aug 06 21:23:02.861110 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2577/5332] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Aug 6 21:23:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:23:02.868767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5c52627b-bd73-4d0e-86ca-db4ce3344042 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:02.869607 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.869607 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:23:02.878945 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5c52627b-bd73-4d0e-86ca-db4ce3344042 tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.016953 Aug 06 21:23:02.879525 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2756/5333] 10.222.0.33 () {58 vars in 1152 bytes} [Sat Aug 6 21:23:02 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:02.890180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-b14eee6a-4de0-4010-8449-8afe9a2fe386 req-55b99545-2b6b-4418-b3f5-a71a97228bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328c3fb7-0e53-46c2-9490-4291d857a30a", "name": "network-vif-plugged", "status": "completed", "tag": "6fcfc51a-46a8-43b9-966f-1e876436ba43"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:02.910124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec1884b3-315b-42f7-ba1b-2b86d77a889c tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:02.916448 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:02.916448 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:23:02.921321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b14eee6a-4de0-4010-8449-8afe9a2fe386 req-55b99545-2b6b-4418-b3f5-a71a97228bdb service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:02.924026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b14eee6a-4de0-4010-8449-8afe9a2fe386 req-55b99545-2b6b-4418-b3f5-a71a97228bdb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:02.928551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-b14eee6a-4de0-4010-8449-8afe9a2fe386 req-55b99545-2b6b-4418-b3f5-a71a97228bdb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:02.936310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec1884b3-315b-42f7-ba1b-2b86d77a889c tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:02.937043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec1884b3-315b-42f7-ba1b-2b86d77a889c tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:02.943672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec1884b3-315b-42f7-ba1b-2b86d77a889c tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:02.949003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-b14eee6a-4de0-4010-8449-8afe9a2fe386 req-55b99545-2b6b-4418-b3f5-a71a97228bdb service nova] Creating event network-vif-plugged:6fcfc51a-46a8-43b9-966f-1e876436ba43 for instance 328c3fb7-0e53-46c2-9490-4291d857a30a on nch2-master-1 Aug 06 21:23:02.955275 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-b14eee6a-4de0-4010-8449-8afe9a2fe386 req-55b99545-2b6b-4418-b3f5-a71a97228bdb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075057 Aug 06 21:23:02.956491 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2578/5334] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:03.126462 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ec1884b3-315b-42f7-ba1b-2b86d77a889c tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.225647 Aug 06 21:23:03.127548 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2757/5335] 10.222.0.33 () {60 vars in 1194 bytes} [Sat Aug 6 21:23:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:03.142970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fa330622-7376-4ba0-9df6-269f2981b44b tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:03.144097 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:03.144097 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:23:03.185454 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fa330622-7376-4ba0-9df6-269f2981b44b tempest-TestAggregatesBasicOps-1760072580 tempest-TestAggregatesBasicOps-1760072580-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.048661 Aug 06 21:23:03.205881 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2579/5336] 10.222.0.33 () {58 vars in 1155 bytes} [Sat Aug 6 21:23:03 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 06 21:23:03.369266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:03.370418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:03.376822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:03.377622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:03.378144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:03.379016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:03.379548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:03.380184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:03.532673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:03.540810 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e99c67dc-ba40-46fd-b858-b9420360d640 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1362 microversion: 2.1 time: 0.176700 Aug 06 21:23:03.541487 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2758/5337] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:03 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:04.562478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:04.563264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:04.576293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:04.577068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:04.577515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:04.578419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:04.579066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:04.579660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:04.598111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:04.850213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:04.862685 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-afb3556c-b8a8-449b-a861-f5c8e1df5b7c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1548 microversion: 2.1 time: 0.303913 Aug 06 21:23:04.865902 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2580/5338] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:04 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1548 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:04.886091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e15796c5-d375-44c2-9633-d20d0c7f922e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:04.886677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e15796c5-d375-44c2-9633-d20d0c7f922e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:04.890685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:04.894674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15796c5-d375-44c2-9633-d20d0c7f922e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:04.895164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15796c5-d375-44c2-9633-d20d0c7f922e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:04.895603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15796c5-d375-44c2-9633-d20d0c7f922e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:04.896303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15796c5-d375-44c2-9633-d20d0c7f922e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:04.897311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15796c5-d375-44c2-9633-d20d0c7f922e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:04.897740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15796c5-d375-44c2-9633-d20d0c7f922e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:04.981556 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e15796c5-d375-44c2-9633-d20d0c7f922e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098806 Aug 06 21:23:04.982353 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2759/5339] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:23:04 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:05.139820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:05.140789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:05.149803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:05.151067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:05.151756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:05.152689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:05.153661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:05.154322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:05.285965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lazy-loading 'services' on Instance uuid 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:23:05.416608 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72863296-6c35-4347-870f-1cf42642930c tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7/os-volume_attachments/dc7cec8b-4a90-4bae-8665-65bc2b7afa72" status: 202 len: 0 microversion: 2.1 time: 0.280626 Aug 06 21:23:05.424532 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2581/5340] 10.222.0.33 () {58 vars in 1416 bytes} [Sat Aug 6 21:23:05 2022] DELETE /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7/os-volume_attachments/dc7cec8b-4a90-4bae-8665-65bc2b7afa72 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:23:07.015910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-da24cdba-6174-493b-bbe9-72a9ad8d39b8 req-bbe2e5cc-1ec0-48a7-b225-7efd4a9654dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328c3fb7-0e53-46c2-9490-4291d857a30a", "tag": "6fcfc51a-46a8-43b9-966f-1e876436ba43"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:07.026936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-da24cdba-6174-493b-bbe9-72a9ad8d39b8 req-bbe2e5cc-1ec0-48a7-b225-7efd4a9654dc service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:07.027802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-da24cdba-6174-493b-bbe9-72a9ad8d39b8 req-bbe2e5cc-1ec0-48a7-b225-7efd4a9654dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:07.028471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-da24cdba-6174-493b-bbe9-72a9ad8d39b8 req-bbe2e5cc-1ec0-48a7-b225-7efd4a9654dc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:07.055359 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-da24cdba-6174-493b-bbe9-72a9ad8d39b8 req-bbe2e5cc-1ec0-48a7-b225-7efd4a9654dc service nova] Creating event network-changed:6fcfc51a-46a8-43b9-966f-1e876436ba43 for instance 328c3fb7-0e53-46c2-9490-4291d857a30a on nch2-master-1 Aug 06 21:23:07.061111 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-da24cdba-6174-493b-bbe9-72a9ad8d39b8 req-bbe2e5cc-1ec0-48a7-b225-7efd4a9654dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049990 Aug 06 21:23:07.063563 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2760/5341] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:07.321315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:07.321917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:07.328495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:07.328991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:07.329619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:07.330528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:07.331013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:07.331437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:07.371215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:23:07.524316 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7be18b62-d371-4f96-bf25-d45fd2abde0a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 204 len: 0 microversion: 2.1 time: 0.375721 Aug 06 21:23:07.538862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:07.540233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:07.542782 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2582/5342] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:23:07 2022] DELETE /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:23:07.549333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:07.551472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:07.552189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:07.553708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:07.554353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:07.555049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:07.805583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:07.829610 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-065ba789-767e-44b0-bf35-ad970fd5d730 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1733 microversion: 2.1 time: 0.293827 Aug 06 21:23:07.830527 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2761/5343] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:07 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1733 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:08.852878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:08.853609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:08.881699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:08.891697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:08.895447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:08.896782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:08.898363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:08.898840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:09.587153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:09.594903 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a69b6a1a-5ada-4e9e-a037-38c191e3cb62 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1733 microversion: 2.1 time: 0.746871 Aug 06 21:23:09.595495 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2583/5344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:08 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1733 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:10.499506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5b527334-a40f-4f24-abab-c1b8424dd248 req-9ce6e039-f325-4540-9181-1557b0f7b1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec600a9-acec-4524-8be8-3e63c1c126b3", "name": "network-vif-deleted", "tag": "4876cba1-7426-4ff2-a027-7850291ec025"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:10.520146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5b527334-a40f-4f24-abab-c1b8424dd248 req-9ce6e039-f325-4540-9181-1557b0f7b1e1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:10.531234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5b527334-a40f-4f24-abab-c1b8424dd248 req-9ce6e039-f325-4540-9181-1557b0f7b1e1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:10.533467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5b527334-a40f-4f24-abab-c1b8424dd248 req-9ce6e039-f325-4540-9181-1557b0f7b1e1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:10.558885 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5b527334-a40f-4f24-abab-c1b8424dd248 req-9ce6e039-f325-4540-9181-1557b0f7b1e1 service nova] Creating event network-vif-deleted:4876cba1-7426-4ff2-a027-7850291ec025 for instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 on nch2-master-1 Aug 06 21:23:10.565438 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5b527334-a40f-4f24-abab-c1b8424dd248 req-9ce6e039-f325-4540-9181-1557b0f7b1e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069585 Aug 06 21:23:10.566807 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2762/5345] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:10.619410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:10.620988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:10.642425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:10.642878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:10.644217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:10.647478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:10.649313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:10.651038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:10.746208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:10.746786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:10.747263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:10.749230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lazy-loading 'fault' on Instance uuid 4ec600a9-acec-4524-8be8-3e63c1c126b3 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:23:10.832764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd539be9e3b426d9eb5bdba4697f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f57cc6855ef4b98ad703de9bdc1e094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:10.845758 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9f3f0ca9-cb1e-4077-a7ae-b7846909861f tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 200 len: 1389 microversion: 2.1 time: 0.230179 Aug 06 21:23:10.850468 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2584/5346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:10 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 1389 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:11.876431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:11.877156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:11.884019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:11.884890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:11.885596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:11.886560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:11.887239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:11.887898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:11.907831 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] HTTP exception thrown: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Request method failure captured: Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 HTTP/1.1 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tp656vX4HE16YXxqrSgZlp8bWVb-rLvftTmrY3k5qJoX1nwrLvZE1WZMRnGZ3oIyhERnHG_7Wq1zxbp1HElk7-NDNAnMGnw4-unaTPg-Bi3sTXsXgtGKREzSd0L_BJkENGJeWILwTwoPZ4Dh6poz7cX91wgwh4WTUBUyb_WrBH9KOY Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 1f57cc6855ef4b98ad703de9bdc1e094 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TestServerBasicOps-2097618416 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f57cc6855ef4b98ad703de9bdc1e094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f57cc6855ef4b98ad703de9bdc1e094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f57cc6855ef4b98ad703de9bdc1e094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f57cc6855ef4b98ad703de9bdc1e094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TestServerBasicOps-2097618416 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 1f57cc6855ef4b98ad703de9bdc1e094 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TestServerBasicOps-2097618416 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TestServerBasicOps-2097618416-project Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7cd539be9e3b426d9eb5bdba4697f849 Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TestServerBasicOps-2097618416-project Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4ec600a9-acec-4524-8be8-3e63c1c126b3'} Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:11.910094 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:11.914195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:11.914195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:11.914195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:11.914195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:23:11.914195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:23:11.914195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:11.914195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:11.916183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Returning 404 to user: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:23:11.917447 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc9522a1-a2e9-4d21-929b-78526e45435a tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 404 len: 111 microversion: 2.1 time: 0.046129 Aug 06 21:23:11.919367 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2763/5347] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:11 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:23:12.515597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:12.516015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:12.524631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:12.524631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:12.524631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:12.524979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:12.525632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:12.526160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:12.544173 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] HTTP exception thrown: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Request method failure captured: Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 HTTP/1.1 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tp656vX4HE16YXxqrSgZlp8bWVb-rLvftTmrY3k5qJoX1nwrLvZE1WZMRnGZ3oIyhERnHG_7Wq1zxbp1HElk7-NDNAnMGnw4-unaTPg-Bi3sTXsXgtGKREzSd0L_BJkENGJeWILwTwoPZ4Dh6poz7cX91wgwh4WTUBUyb_WrBH9KOY Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1f57cc6855ef4b98ad703de9bdc1e094 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestServerBasicOps-2097618416 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f57cc6855ef4b98ad703de9bdc1e094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f57cc6855ef4b98ad703de9bdc1e094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f57cc6855ef4b98ad703de9bdc1e094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f57cc6855ef4b98ad703de9bdc1e094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestServerBasicOps-2097618416 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1f57cc6855ef4b98ad703de9bdc1e094 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestServerBasicOps-2097618416 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestServerBasicOps-2097618416-project Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7cd539be9e3b426d9eb5bdba4697f849 Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestServerBasicOps-2097618416-project Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4ec600a9-acec-4524-8be8-3e63c1c126b3'} Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:23:12.545978 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.549840 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.551909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Returning 404 to user: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:23:12.553773 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ace9bc57-d612-4a39-9ddb-5cfa1a80e5ef tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 404 len: 111 microversion: 2.1 time: 0.042363 Aug 06 21:23:12.554449 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2585/5348] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:23:12 2022] DELETE /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:23:12.564385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:12.565002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] [instance: 4ec600a9-acec-4524-8be8-3e63c1c126b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:12.574677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:12.583511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:12.584037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:12.584479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:12.585190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:12.585651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:12.586076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:12.600741 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] HTTP exception thrown: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Request method failure captured: Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 HTTP/1.1 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tp656vX4HE16YXxqrSgZlp8bWVb-rLvftTmrY3k5qJoX1nwrLvZE1WZMRnGZ3oIyhERnHG_7Wq1zxbp1HElk7-NDNAnMGnw4-unaTPg-Bi3sTXsXgtGKREzSd0L_BJkENGJeWILwTwoPZ4Dh6poz7cX91wgwh4WTUBUyb_WrBH9KOY Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 1f57cc6855ef4b98ad703de9bdc1e094 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TestServerBasicOps-2097618416 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f57cc6855ef4b98ad703de9bdc1e094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f57cc6855ef4b98ad703de9bdc1e094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f57cc6855ef4b98ad703de9bdc1e094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f57cc6855ef4b98ad703de9bdc1e094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TestServerBasicOps-2097618416 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 1f57cc6855ef4b98ad703de9bdc1e094 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TestServerBasicOps-2097618416 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TestServerBasicOps-2097618416-project Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7cd539be9e3b426d9eb5bdba4697f849 Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TestServerBasicOps-2097618416-project Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4ec600a9-acec-4524-8be8-3e63c1c126b3'} Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:12.602306 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Returning 404 to user: Instance 4ec600a9-acec-4524-8be8-3e63c1c126b3 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37ec976c-709f-4e7a-ab20-a58f03bd35a8 tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3" status: 404 len: 111 microversion: 2.1 time: 0.043737 Aug 06 21:23:12.607406 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2764/5349] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:12 2022] GET /compute/v2.1/servers/4ec600a9-acec-4524-8be8-3e63c1c126b3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:23:12.815762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-37de00c7-b1e4-458d-9b8f-6149268c1fdd tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] Calling method '.version_select at 0x7f729d2b1280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:12.851798 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-37de00c7-b1e4-458d-9b8f-6149268c1fdd tempest-TestServerBasicOps-2097618416 tempest-TestServerBasicOps-2097618416-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1024969963" status: 202 len: 0 microversion: 2.1 time: 0.041064 Aug 06 21:23:12.852715 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2586/5350] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 21:23:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1024969963 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:23:15.851238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6f61af19-a3dd-449e-929d-85173541a243 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Action: 'create', calling method: .version_select at 0x7f729c658310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-769382803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeocwvjcwRBWoV3ZJh8qvX5cORye/huxZTvycEn92ns1UEOjgbQZtjTOzeuLxcMutvExdI+fjBXEi3tIlEpuUG2rbY1l1Me1zN1AIDuSPqRMJL171qmWPJ+IJyr/yh8SA=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:15.866882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6f61af19-a3dd-449e-929d-85173541a243 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Getting quotas for project 7054b60d5cc646ec87fa19bedaa69407. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:23:15.873160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-6f61af19-a3dd-449e-929d-85173541a243 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Getting quotas for user 323cbfd25ac04e829ad1c162fedf68e8 and project 7054b60d5cc646ec87fa19bedaa69407. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:23:15.897843 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6f61af19-a3dd-449e-929d-85173541a243 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.242581 Aug 06 21:23:15.898766 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2765/5351] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:23:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:24.204583 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1449310567-access_point-1150667055", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "cf9183cc-f074-41bb-a2d5-4d38cc9f353d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-769382803", "security_groups": [{"name": "tempest-secgroup_access--1973734599"}, {"name": "tempest-secgroup_general--142055396"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:24.219778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:24.220725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:24.421975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] validate_networks() for [('cf9183cc-f074-41bb-a2d5-4d38cc9f353d', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:23:25.056556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:23:25.057357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:23:25.058206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:23:25.059017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:23:25.059675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:23:25.071299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:25.071962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:25.072505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:25.073348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:25.073936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:25.074639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:25.093761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Getting quotas for project 7054b60d5cc646ec87fa19bedaa69407. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:23:25.100284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Getting quotas for user 323cbfd25ac04e829ad1c162fedf68e8 and project 7054b60d5cc646ec87fa19bedaa69407. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:23:25.118577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:23:25.122919 ncdv-master-1 devstack@n-api.service[142462]: WARNING nova.utils [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1449310567-access_point-1150667055 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1449310567-ac Aug 06 21:23:25.124160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:23:25.187535 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a068f8d4-1275-4e6d-acc3-051db7264ce8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.987310 Aug 06 21:23:25.188749 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2587/5352] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:23:24 2022] POST /compute/v2.1/servers => generated 457 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:23:25.199645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0506047f-f56c-4b50-a13b-aa7e65d62966 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:25.205274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0506047f-f56c-4b50-a13b-aa7e65d62966 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:25.212748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=64 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:25.394586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0506047f-f56c-4b50-a13b-aa7e65d62966 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:25.412928 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0506047f-f56c-4b50-a13b-aa7e65d62966 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1294 microversion: 2.1 time: 0.214951 Aug 06 21:23:25.417882 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2766/5353] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:25 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:26.435148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:26.436353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:26.461464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:26.461977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:26.462426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:26.463201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:26.463663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:26.464179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:26.602859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:26.612841 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d8058f56-150d-418d-bc35-c1586bbb5968 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1354 microversion: 2.1 time: 0.181564 Aug 06 21:23:26.613619 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2588/5354] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:26 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1354 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:27.636211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:27.637490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:27.648627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:27.649371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:27.650038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:27.651056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:27.651787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:27.652278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:27.739433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:27.747942 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bcfd910b-4362-4db2-8db3-9e035622e405 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1352 microversion: 2.1 time: 0.115763 Aug 06 21:23:27.748547 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2767/5355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:27 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:28.472911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-80171b32-9f11-45fa-bc0f-6772fff4d7ef tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:28.476098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-80171b32-9f11-45fa-bc0f-6772fff4d7ef tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:28.489763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80171b32-9f11-45fa-bc0f-6772fff4d7ef tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:28.494857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80171b32-9f11-45fa-bc0f-6772fff4d7ef tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:28.495373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80171b32-9f11-45fa-bc0f-6772fff4d7ef tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:28.496134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80171b32-9f11-45fa-bc0f-6772fff4d7ef tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:28.496828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80171b32-9f11-45fa-bc0f-6772fff4d7ef tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:28.497181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80171b32-9f11-45fa-bc0f-6772fff4d7ef tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:28.574299 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-80171b32-9f11-45fa-bc0f-6772fff4d7ef tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.100637 Aug 06 21:23:28.578009 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2589/5356] 10.222.0.33 () {60 vars in 1343 bytes} [Sat Aug 6 21:23:28 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:28.680546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:28.682185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:28.692980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:28.693739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:28.694935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:28.695833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:28.696982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:28.697584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:28.771517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:28.772410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:28.786530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:28.787293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:28.787900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:28.788995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:28.789955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:23:28.791865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:28.792490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:29.010107 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b266f05-f4c8-4206-b285-47801d044a24 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 204 len: 0 microversion: 2.20 time: 0.334160 Aug 06 21:23:29.011030 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2768/5357] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:23:28 2022] DELETE /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 21:23:29.028648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:29.031164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:29.051850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:29.053619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:29.057079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:29.059446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:29.062540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:29.063904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:29.156247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:29.165553 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8026fba-c986-43ab-b222-41245d52eaf0 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1471 microversion: 2.1 time: 0.397968 Aug 06 21:23:29.168370 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2590/5358] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:28 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:29.173122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a578c8b6-f161-40f1-8596-d06b48673d9d req-d5206b76-7cb7-447f-ab19-d62ed4aba37c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f4c0fb-83c8-43ac-964c-05505c18f964", "tag": "706df1a5-8d1b-4614-89fb-5f6e236f4a8c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:29.184730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a578c8b6-f161-40f1-8596-d06b48673d9d req-d5206b76-7cb7-447f-ab19-d62ed4aba37c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:29.185494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a578c8b6-f161-40f1-8596-d06b48673d9d req-d5206b76-7cb7-447f-ab19-d62ed4aba37c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:29.186214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a578c8b6-f161-40f1-8596-d06b48673d9d req-d5206b76-7cb7-447f-ab19-d62ed4aba37c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:29.197959 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a578c8b6-f161-40f1-8596-d06b48673d9d req-d5206b76-7cb7-447f-ab19-d62ed4aba37c service nova] Creating event network-changed:706df1a5-8d1b-4614-89fb-5f6e236f4a8c for instance b0f4c0fb-83c8-43ac-964c-05505c18f964 on nch1-master-1 Aug 06 21:23:29.203443 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a578c8b6-f161-40f1-8596-d06b48673d9d req-d5206b76-7cb7-447f-ab19-d62ed4aba37c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033690 Aug 06 21:23:29.204054 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2591/5359] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:29.317773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:29.328840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:29.330573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:29.331862 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66ddd1f5-cad9-4156-bdc9-db6d16c16a92 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.315721 Aug 06 21:23:29.332685 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2769/5360] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:23:29 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:23:30.190178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:30.193360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:30.205897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:30.206755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:30.208050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:30.209136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:30.209697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:30.210209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:30.357811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:30.363790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:30.371840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:30.373310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:30.373795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:30.374527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:30.377096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:30.377617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:30.647043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:30.677618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:30.679691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:30.681093 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-64cf9f60-04a0-4014-8e8c-5477708f0ac5 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1724 microversion: 2.20 time: 0.327882 Aug 06 21:23:30.682080 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2770/5361] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:23:30 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 21:23:30.741745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:30.742372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:30.754059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:30.756006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:30.759442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:30.760868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:30.763206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:30.763789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:30.824356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:23:30.993167 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a04e516-e577-4073-9ac0-e658e92e37aa tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 204 len: 0 microversion: 2.1 time: 0.257007 Aug 06 21:23:30.994984 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2771/5362] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:23:30 2022] DELETE /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:23:31.009660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:31.011041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:31.018974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:31.020420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:31.021450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:31.022610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:31.023374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:31.024380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:31.111102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:31.123257 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac352e7f-9700-45c0-94b7-72750f940453 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1471 microversion: 2.1 time: 0.939232 Aug 06 21:23:31.124426 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2592/5363] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:30 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1471 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:31.335955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:31.346123 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8dbdf50-157c-4cf5-ab18-70d410ede52e tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1469 microversion: 2.1 time: 0.343470 Aug 06 21:23:31.347545 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2772/5364] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:31 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1469 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:31.712116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:31.712752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:31.722722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:31.723809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:31.724261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:31.725452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:31.725928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:31.726373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:31.853191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:31.862293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:31.865351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e64ff8f2b14f70b1b05327f691701e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb3b91ed1294ea187812b7312601b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:31.866628 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ff201d48-48ee-4881-bd59-9cd4d99c312d tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 200 len: 1656 microversion: 2.20 time: 0.162323 Aug 06 21:23:31.867229 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2593/5365] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:23:31 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 21:23:32.113109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-66171af1-4ed3-48b3-8b37-23c5ae6e1f9f req-ec86224e-187b-4905-a8c7-ae436619f276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdbf80b7-fcb5-4e9a-8ac6-9206d006c170", "name": "network-vif-deleted", "tag": "b9aeea6b-a91f-4546-b520-c27af81fa5df"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:32.148440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:32.149069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:32.155367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-66171af1-4ed3-48b3-8b37-23c5ae6e1f9f req-ec86224e-187b-4905-a8c7-ae436619f276 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:32.157080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-66171af1-4ed3-48b3-8b37-23c5ae6e1f9f req-ec86224e-187b-4905-a8c7-ae436619f276 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:32.157799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-66171af1-4ed3-48b3-8b37-23c5ae6e1f9f req-ec86224e-187b-4905-a8c7-ae436619f276 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:32.169235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:32.169733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:32.170227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:32.173830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:32.174381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:32.174867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:32.194275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-66171af1-4ed3-48b3-8b37-23c5ae6e1f9f req-ec86224e-187b-4905-a8c7-ae436619f276 service nova] Creating event network-vif-deleted:b9aeea6b-a91f-4546-b520-c27af81fa5df for instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 on nch1-master-1 Aug 06 21:23:32.204448 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-66171af1-4ed3-48b3-8b37-23c5ae6e1f9f req-ec86224e-187b-4905-a8c7-ae436619f276 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096371 Aug 06 21:23:32.206864 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2773/5366] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:32.370517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:32.372451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:32.390525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:32.391980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:32.393283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:32.403421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:32.405005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:32.405539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:32.891994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:32.914834 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cac2d617-2127-4c41-b4e5-523714719ee4 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1471 microversion: 2.1 time: 0.768545 Aug 06 21:23:32.918242 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2594/5367] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:32 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1471 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:32.934682 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:32.935616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:32.953699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:32.955848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:32.956884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:32.958442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:32.959289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:32.960405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:32.981074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:32.997544 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-39ddf96c-d717-4c69-8a20-cf348fd7889a tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1469 microversion: 2.1 time: 0.629668 Aug 06 21:23:33.005928 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] HTTP exception thrown: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Request method failure captured: Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 HTTP/1.1 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tpZlTnQifiurCKbhHduuaCcqA_zyeQjYTyy5dii-I7Kr7P6k8qmX-0cm0iDGkUoxvGFe_h5sUjCN-CbKS4We_SsJdW30V8taEXIppNT_xnQbveZ4hgma7cRNjvt6t32guJ0yYTZ5gJ0SHWAdz0JCMZwe80wxISfAqiR2yLcLNEBRHM Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfb3b91ed1294ea187812b7312601b27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 65e64ff8f2b14f70b1b05327f691701e Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'cdbf80b7-fcb5-4e9a-8ac6-9206d006c170'} Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:33.008290 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:33.014291 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:33.014291 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:33.014291 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:33.014291 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:33.014291 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:23:33.014291 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:23:33.014291 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:33.014291 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:33.014291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Returning 404 to user: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:23:33.015727 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2774/5368] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:32 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1469 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:33.017465 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-66eaf5fd-9806-4f11-a228-5e05af165ca2 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 404 len: 111 microversion: 2.20 time: 0.090170 Aug 06 21:23:33.018644 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2595/5369] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:23:32 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:23:33.027294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-765feee0-ede3-44fe-90f2-fcb67a8ff688 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '.version_select at 0x7f729c755820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:33.071659 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-765feee0-ede3-44fe-90f2-fcb67a8ff688 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916960982" status: 204 len: 0 microversion: 2.20 time: 0.048779 Aug 06 21:23:33.072611 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2775/5370] 10.222.0.33 () {60 vars in 1259 bytes} [Sat Aug 6 21:23:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916960982 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 21:23:33.944326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:33.945668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:33.953239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:33.954109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:33.955650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:33.956910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:33.957829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:33.958840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:34.024159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:34.025394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:34.036321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:34.042453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:34.043210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:34.044176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:34.044857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:34.046272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:34.296209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:34.307510 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b4e7e87e-3b87-4c81-9a2f-871dc6f33578 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1427 microversion: 2.1 time: 0.288929 Aug 06 21:23:34.323140 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2776/5371] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:34 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1427 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:34.440148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:34.464536 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-09f03209-7cd5-4e38-9735-65ff540954af tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1471 microversion: 2.1 time: 0.520221 Aug 06 21:23:34.465206 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2596/5372] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:33 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1471 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:34.503629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-abf698b9-ddea-4f45-8e64-006f5fa832ef req-7e65dfbe-d2db-40da-bb09-4b8bcd747240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ab3abc7-4298-4db9-b2bf-c8ced75938a7", "name": "network-vif-deleted", "tag": "4c682ef2-a28f-41c3-aa53-c66c1eed348b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:34.517780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-abf698b9-ddea-4f45-8e64-006f5fa832ef req-7e65dfbe-d2db-40da-bb09-4b8bcd747240 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:34.518506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-abf698b9-ddea-4f45-8e64-006f5fa832ef req-7e65dfbe-d2db-40da-bb09-4b8bcd747240 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:34.521484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-abf698b9-ddea-4f45-8e64-006f5fa832ef req-7e65dfbe-d2db-40da-bb09-4b8bcd747240 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:35.337719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:35.339100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:35.342763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:35.346415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:35.365898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:35.366515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:35.367112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:35.369543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:35.371881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:35.372579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:35.408926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:35.412903 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-abf698b9-ddea-4f45-8e64-006f5fa832ef req-7e65dfbe-d2db-40da-bb09-4b8bcd747240 service nova] Creating event network-vif-deleted:4c682ef2-a28f-41c3-aa53-c66c1eed348b for instance 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 on nch1-master-1 Aug 06 21:23:35.419554 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-abf698b9-ddea-4f45-8e64-006f5fa832ef req-7e65dfbe-d2db-40da-bb09-4b8bcd747240 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.922246 Aug 06 21:23:35.420703 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2777/5373] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:35.455192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:35.457151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:35.459842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:35.462047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lazy-loading 'fault' on Instance uuid 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:23:35.489741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:35.490841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:35.495666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:35.520499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:35.521693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:35.522375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:35.523768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:35.525745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:35.528060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:35.895074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:35.907381 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ae43bdf-7fd4-4d1f-adce-385d7798e869 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 200 len: 1303 microversion: 2.1 time: 0.573714 Aug 06 21:23:35.913033 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2597/5374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:35 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 1303 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:36.034257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:36.053154 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6985c9ec-f8ed-4ab0-af32-2d1067fee465 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1471 microversion: 2.1 time: 0.569274 Aug 06 21:23:36.054085 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2778/5375] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:35 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1471 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:36.392444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:36.393318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:36.402788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:36.403610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:36.404925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:36.408472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:36.409224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:36.410844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:36.432739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] HTTP exception thrown: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Request method failure captured: Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 HTTP/1.1 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tpZlTnQifiurCKbhHduuaCcqA_zyeQjYTyy5dii-I7Kr7P6k8qmX-0cm0iDGkUoxvGFe_h5sUjCN-CbKS4We_SsJdW30V8taEXIppNT_xnQbveZ4hgma7cRNjvt6t32guJ0yYTZ5gJ0SHWAdz0JCMZwe80wxISfAqiR2yLcLNEBRHM Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfb3b91ed1294ea187812b7312601b27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 65e64ff8f2b14f70b1b05327f691701e Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'cdbf80b7-fcb5-4e9a-8ac6-9206d006c170'} Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:23:36.435512 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.439381 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.441545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Returning 404 to user: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:23:36.442762 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-514bfed8-94fe-4b56-91e8-565ee879792a tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 404 len: 111 microversion: 2.20 time: 0.054963 Aug 06 21:23:36.443335 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2598/5376] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:23:36 2022] DELETE /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:23:36.451582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:36.452787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: cdbf80b7-fcb5-4e9a-8ac6-9206d006c170] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:36.462476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:36.465373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:36.466036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:36.466990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:36.467620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:36.468215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:36.487967 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] HTTP exception thrown: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Request method failure captured: Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 HTTP/1.1 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tpZlTnQifiurCKbhHduuaCcqA_zyeQjYTyy5dii-I7Kr7P6k8qmX-0cm0iDGkUoxvGFe_h5sUjCN-CbKS4We_SsJdW30V8taEXIppNT_xnQbveZ4hgma7cRNjvt6t32guJ0yYTZ5gJ0SHWAdz0JCMZwe80wxISfAqiR2yLcLNEBRHM Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfb3b91ed1294ea187812b7312601b27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 65e64ff8f2b14f70b1b05327f691701e Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'cdbf80b7-fcb5-4e9a-8ac6-9206d006c170'} Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.489759 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:36.495357 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.495357 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:36.495357 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:36.495357 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:36.495357 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:23:36.495357 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:23:36.495357 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. Aug 06 21:23:36.495357 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.495357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Returning 404 to user: Instance cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:23:36.496757 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b320145f-5d45-4634-803f-8ca048bfaa5c tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170" status: 404 len: 111 microversion: 2.20 time: 0.048494 Aug 06 21:23:36.503193 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2779/5377] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:23:36 2022] GET /compute/v2.1/servers/cdbf80b7-fcb5-4e9a-8ac6-9206d006c170 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:23:36.935072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:36.936196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] [instance: 8ab3abc7-4298-4db9-b2bf-c8ced75938a7] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:36.951833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:36.952592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:36.953206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:36.953929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:36.954696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:36.955323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:36.984796 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] HTTP exception thrown: Instance 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 could not be found. Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Request method failure captured: Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 HTTP/1.1 Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tuPRuTecTaycuz6phqBJdtyo9d_-_qZ2kfC3afUZEz3-Iii6jqCmS0avWxC45n9PnLyrd2Cyh8bfWU54k4BZIllxyIxXMvMGKbWOpj8ZAMfJKqPGoJd-352_65vno5Jl0gugUuqmaWliKo3JMRZH0f12ltIeWf5uv-B8-5UOVZG_L0 Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: a31b7575aa0944cca8da8f093eeeb0bf Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesBackupsTest-787187355 Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a31b7575aa0944cca8da8f093eeeb0bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a31b7575aa0944cca8da8f093eeeb0bf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a31b7575aa0944cca8da8f093eeeb0bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a31b7575aa0944cca8da8f093eeeb0bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesBackupsTest-787187355 Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: a31b7575aa0944cca8da8f093eeeb0bf Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesBackupsTest-787187355 Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesBackupsTest-787187355-project Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: e286c03134e646ce962ea7b88eab4b38 Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesBackupsTest-787187355-project Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 could not be found. Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '8ab3abc7-4298-4db9-b2bf-c8ced75938a7'} Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 could not be found. Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 could not be found. Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:36.986763 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.991357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:36.991357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:36.991357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:36.991357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:23:36.991357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:23:36.991357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 could not be found. Aug 06 21:23:36.991357 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:36.994286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] Returning 404 to user: Instance 8ab3abc7-4298-4db9-b2bf-c8ced75938a7 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:23:36.995530 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6a9f839c-34d8-458b-8533-1ed32e6f7519 tempest-VolumesBackupsTest-787187355 tempest-VolumesBackupsTest-787187355-project] 10.222.0.33 "GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7" status: 404 len: 111 microversion: 2.1 time: 0.066145 Aug 06 21:23:36.996757 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2599/5378] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:36 2022] GET /compute/v2.1/servers/8ab3abc7-4298-4db9-b2bf-c8ced75938a7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:23:37.077122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:37.081470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:37.094019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:37.094803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:37.095482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:37.096489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:37.097425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:37.099325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:37.330170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:37.341401 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a860b8a6-4c22-4db2-980a-202a4fad9b80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1471 microversion: 2.1 time: 0.269844 Aug 06 21:23:37.342202 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2780/5379] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:37 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:37.717975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:37.719380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:37.735006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:37.735506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:37.735944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:37.741002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:37.747630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:37.749117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:37.791601 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] HTTP exception thrown: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Request method failure captured: Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 HTTP/1.1 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tpZlTnQifiurCKbhHduuaCcqA_zyeQjYTyy5dii-I7Kr7P6k8qmX-0cm0iDGkUoxvGFe_h5sUjCN-CbKS4We_SsJdW30V8taEXIppNT_xnQbveZ4hgma7cRNjvt6t32guJ0yYTZ5gJ0SHWAdz0JCMZwe80wxISfAqiR2yLcLNEBRHM Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfb3b91ed1294ea187812b7312601b27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 65e64ff8f2b14f70b1b05327f691701e Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4eb20bab-9b22-4671-b84c-7bc4eaf210e3'} Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:23:37.793624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Returning 404 to user: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:23:37.797813 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9ca5fce5-a66b-4cee-be1e-f3f721a4b132 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 404 len: 111 microversion: 2.20 time: 0.086057 Aug 06 21:23:37.798964 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2600/5380] 10.222.0.33 () {60 vars in 1280 bytes} [Sat Aug 6 21:23:37 2022] DELETE /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:23:37.807656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:37.808508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] [instance: 4eb20bab-9b22-4671-b84c-7bc4eaf210e3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:37.827776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:37.832872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:37.833614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:37.834439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:37.834989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:37.835432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:37.890705 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] HTTP exception thrown: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Request method failure captured: Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 HTTP/1.1 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tpZlTnQifiurCKbhHduuaCcqA_zyeQjYTyy5dii-I7Kr7P6k8qmX-0cm0iDGkUoxvGFe_h5sUjCN-CbKS4We_SsJdW30V8taEXIppNT_xnQbveZ4hgma7cRNjvt6t32guJ0yYTZ5gJ0SHWAdz0JCMZwe80wxISfAqiR2yLcLNEBRHM Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfb3b91ed1294ea187812b7312601b27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfb3b91ed1294ea187812b7312601b27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cfb3b91ed1294ea187812b7312601b27 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443103339 Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 65e64ff8f2b14f70b1b05327f691701e Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443103339-project Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '4eb20bab-9b22-4671-b84c-7bc4eaf210e3'} Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.892698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:23:37.899754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.899754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:23:37.899754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:23:37.899754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:23:37.899754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:23:37.899754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:23:37.899754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. Aug 06 21:23:37.899754 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:23:37.901813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] Returning 404 to user: Instance 4eb20bab-9b22-4671-b84c-7bc4eaf210e3 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:23:37.902937 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9910c5f6-5468-4cfd-a897-ee1b8e4b8d22 tempest-AttachVolumeShelveTestJSON-1443103339 tempest-AttachVolumeShelveTestJSON-1443103339-project] 10.222.0.33 "GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3" status: 404 len: 111 microversion: 2.20 time: 0.102933 Aug 06 21:23:37.906981 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2781/5381] 10.222.0.33 () {60 vars in 1277 bytes} [Sat Aug 6 21:23:37 2022] GET /compute/v2.1/servers/4eb20bab-9b22-4671-b84c-7bc4eaf210e3 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:23:38.364344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:38.365320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:38.375664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:38.381938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:38.384429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:38.385646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:38.386326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:38.387004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:38.515877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-6b239d60-49d3-4723-8d4b-6de2b6e426a5 req-5379e2f5-dae1-4782-b4a8-d64a82c53627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f4c0fb-83c8-43ac-964c-05505c18f964", "name": "network-vif-plugged", "status": "completed", "tag": "706df1a5-8d1b-4614-89fb-5f6e236f4a8c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:38.538717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6b239d60-49d3-4723-8d4b-6de2b6e426a5 req-5379e2f5-dae1-4782-b4a8-d64a82c53627 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:38.539519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6b239d60-49d3-4723-8d4b-6de2b6e426a5 req-5379e2f5-dae1-4782-b4a8-d64a82c53627 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:38.541477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6b239d60-49d3-4723-8d4b-6de2b6e426a5 req-5379e2f5-dae1-4782-b4a8-d64a82c53627 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:38.590777 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-6b239d60-49d3-4723-8d4b-6de2b6e426a5 req-5379e2f5-dae1-4782-b4a8-d64a82c53627 service nova] Creating event network-vif-plugged:706df1a5-8d1b-4614-89fb-5f6e236f4a8c for instance b0f4c0fb-83c8-43ac-964c-05505c18f964 on nch1-master-1 Aug 06 21:23:38.609656 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-6b239d60-49d3-4723-8d4b-6de2b6e426a5 req-5379e2f5-dae1-4782-b4a8-d64a82c53627 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094607 Aug 06 21:23:38.612178 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2782/5382] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:23:39.049046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:39.058899 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b3101880-6358-415c-9b55-6f3d7c437477 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1471 microversion: 2.1 time: 0.699158 Aug 06 21:23:39.061145 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2601/5383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:38 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1471 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:40.083198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:40.083934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:40.107795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:40.112256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:40.115186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:40.116304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:40.117030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:40.117643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:40.424929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:40.440362 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-337dcdaf-6256-4afb-9c55-cba4cca04bb3 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1643 microversion: 2.1 time: 0.363437 Aug 06 21:23:40.442796 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2783/5384] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:40 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1643 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:40.464908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:40.465985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:40.481892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:40.486203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:40.486716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:40.487484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:40.488008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:40.488812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:40.903684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:23:40.918770 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2aeaa130-bd30-4820-9608-687e7132344d tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1643 microversion: 2.1 time: 0.457679 Aug 06 21:23:40.934029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4db86095-a528-4205-abb3-b504e01d3485 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:40.934934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4db86095-a528-4205-abb3-b504e01d3485 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:40.938732 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2602/5385] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:40 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1643 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:40.953331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4db86095-a528-4205-abb3-b504e01d3485 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:40.954365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99b7b355-7013-470e-b0a3-caee89ce1995 tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:40.955038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4db86095-a528-4205-abb3-b504e01d3485 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:40.955190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-99b7b355-7013-470e-b0a3-caee89ce1995 tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:40.955935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4db86095-a528-4205-abb3-b504e01d3485 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:40.958026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4db86095-a528-4205-abb3-b504e01d3485 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:40.964371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4db86095-a528-4205-abb3-b504e01d3485 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:40.965091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4db86095-a528-4205-abb3-b504e01d3485 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:40.970852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b7b355-7013-470e-b0a3-caee89ce1995 tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:40.971579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b7b355-7013-470e-b0a3-caee89ce1995 tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:40.973866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b7b355-7013-470e-b0a3-caee89ce1995 tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:40.974904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b7b355-7013-470e-b0a3-caee89ce1995 tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:40.983160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b7b355-7013-470e-b0a3-caee89ce1995 tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:40.983926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-99b7b355-7013-470e-b0a3-caee89ce1995 tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:41.014142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:41.048644 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4db86095-a528-4205-abb3-b504e01d3485 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a/ips" status: 200 len: 145 microversion: 2.1 time: 0.120224 Aug 06 21:23:41.054024 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2784/5386] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:23:40 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a/ips => generated 145 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:23:41.937362 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99b7b355-7013-470e-b0a3-caee89ce1995 tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1794 microversion: 2.1 time: 0.994890 Aug 06 21:23:41.939335 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2603/5387] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:40 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1794 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:43.584368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6013622f-e908-4a7f-bc13-e687b5f6d5cf tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "561eca4f-cd63-41fb-84c1-1a34ec519bca"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:43.588949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6013622f-e908-4a7f-bc13-e687b5f6d5cf tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:43.615154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6013622f-e908-4a7f-bc13-e687b5f6d5cf tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:43.615667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6013622f-e908-4a7f-bc13-e687b5f6d5cf tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:43.623048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6013622f-e908-4a7f-bc13-e687b5f6d5cf tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:43.624615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6013622f-e908-4a7f-bc13-e687b5f6d5cf tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:43.625109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6013622f-e908-4a7f-bc13-e687b5f6d5cf tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:43.625571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6013622f-e908-4a7f-bc13-e687b5f6d5cf tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:44.123737 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6013622f-e908-4a7f-bc13-e687b5f6d5cf tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "POST /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546609 Aug 06 21:23:44.124373 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2785/5388] 10.222.0.33 () {60 vars in 1323 bytes} [Sat Aug 6 21:23:43 2022] POST /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:45.737060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9e359312-7427-4043-9f01-2fda29b3b928 req-15d53a29-3079-495d-8ec6-13b22b2ca580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f4c0fb-83c8-43ac-964c-05505c18f964", "tag": "706df1a5-8d1b-4614-89fb-5f6e236f4a8c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:45.751382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9e359312-7427-4043-9f01-2fda29b3b928 req-15d53a29-3079-495d-8ec6-13b22b2ca580 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:45.752196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9e359312-7427-4043-9f01-2fda29b3b928 req-15d53a29-3079-495d-8ec6-13b22b2ca580 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:45.753994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9e359312-7427-4043-9f01-2fda29b3b928 req-15d53a29-3079-495d-8ec6-13b22b2ca580 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:45.771177 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9e359312-7427-4043-9f01-2fda29b3b928 req-15d53a29-3079-495d-8ec6-13b22b2ca580 service nova] Creating event network-changed:706df1a5-8d1b-4614-89fb-5f6e236f4a8c for instance b0f4c0fb-83c8-43ac-964c-05505c18f964 on nch1-master-1 Aug 06 21:23:45.777729 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9e359312-7427-4043-9f01-2fda29b3b928 req-15d53a29-3079-495d-8ec6-13b22b2ca580 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047078 Aug 06 21:23:45.779183 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2604/5389] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:48.406763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-de0ade72-4a12-4a0a-b86e-aa8b2f50dbc4 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:48.408033 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:23:48.408033 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:23:48.408672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de0ade72-4a12-4a0a-b86e-aa8b2f50dbc4 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:48.409166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de0ade72-4a12-4a0a-b86e-aa8b2f50dbc4 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:48.410240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de0ade72-4a12-4a0a-b86e-aa8b2f50dbc4 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:48.413571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de0ade72-4a12-4a0a-b86e-aa8b2f50dbc4 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:48.414145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de0ade72-4a12-4a0a-b86e-aa8b2f50dbc4 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:48.414625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de0ade72-4a12-4a0a-b86e-aa8b2f50dbc4 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:48.444395 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-de0ade72-4a12-4a0a-b86e-aa8b2f50dbc4 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.226462 Aug 06 21:23:48.445491 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2786/5390] 10.222.0.33 () {58 vars in 1185 bytes} [Sat Aug 6 21:23:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:48.694786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-487072576", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "b53582ab-4757-41c4-ae5c-34ad7b949a79"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:48.848790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] validate_networks() for [('b53582ab-4757-41c4-ae5c-34ad7b949a79', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:23:49.683207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:23:49.684168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:23:49.684670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:23:49.685096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:23:49.685523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:23:49.718755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:49.720944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:49.722098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:49.723078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:49.723735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:49.724355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:49.747909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Getting quotas for project 39b1e62bc44b4253b2df0e7b22bfb332. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:23:49.758110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Getting quotas for user 2a19ae0801884a938a94cdfdc4de1b08 and project 39b1e62bc44b4253b2df0e7b22bfb332. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:23:49.789629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:23:49.793082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:23:49.845408 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fe478ad2-0694-43c3-943d-751f655aa1de tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.156996 Aug 06 21:23:49.846322 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2605/5391] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:23:49.863071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08bc4361-78a6-426d-8aba-1ebe6bece199 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:49.863885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-08bc4361-78a6-426d-8aba-1ebe6bece199 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:49.966581 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08bc4361-78a6-426d-8aba-1ebe6bece199 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1328 microversion: 2.1 time: 0.112198 Aug 06 21:23:49.967153 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2787/5392] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:49 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:50.992293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f38fe316-26d4-4b87-ad09-2cf7b7c9f37c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:50.992944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f38fe316-26d4-4b87-ad09-2cf7b7c9f37c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:51.007716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f38fe316-26d4-4b87-ad09-2cf7b7c9f37c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:51.008235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f38fe316-26d4-4b87-ad09-2cf7b7c9f37c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:51.008883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f38fe316-26d4-4b87-ad09-2cf7b7c9f37c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:51.009611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f38fe316-26d4-4b87-ad09-2cf7b7c9f37c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:51.010138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f38fe316-26d4-4b87-ad09-2cf7b7c9f37c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:51.010600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f38fe316-26d4-4b87-ad09-2cf7b7c9f37c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:51.106728 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f38fe316-26d4-4b87-ad09-2cf7b7c9f37c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1415 microversion: 2.1 time: 0.121412 Aug 06 21:23:51.108051 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2606/5393] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:50 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1415 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:51.368676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b10bad79-aa16-4f91-9cac-6e3738ef852c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Action: 'create', calling method: .version_select at 0x7f729c6678b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-755076796", "metadata": {"Type": "work"}}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:51.716220 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b10bad79-aa16-4f91-9cac-6e3738ef852c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.507039 Aug 06 21:23:51.716873 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2788/5394] 10.222.0.33 () {60 vars in 1156 bytes} [Sat Aug 6 21:23:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 508 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 06 21:23:51.731370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d46acfeb-8ffa-45c7-b54d-b04fe64bcd52 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf8d940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:52.002389 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d46acfeb-8ffa-45c7-b54d-b04fe64bcd52 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.275260 Aug 06 21:23:52.004737 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2607/5395] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:23:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:52.129174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2730cff5-d311-4be4-9e4d-1d301a0a581f tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:52.129816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2730cff5-d311-4be4-9e4d-1d301a0a581f tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:52.136563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730cff5-d311-4be4-9e4d-1d301a0a581f tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:52.137172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730cff5-d311-4be4-9e4d-1d301a0a581f tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:52.137621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730cff5-d311-4be4-9e4d-1d301a0a581f tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:52.138428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730cff5-d311-4be4-9e4d-1d301a0a581f tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:52.138991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730cff5-d311-4be4-9e4d-1d301a0a581f tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:52.139680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2730cff5-d311-4be4-9e4d-1d301a0a581f tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:52.285518 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2730cff5-d311-4be4-9e4d-1d301a0a581f tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1463 microversion: 2.1 time: 0.160637 Aug 06 21:23:52.286127 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2789/5396] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:52 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:52.455792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-bb0c7df5-e7b8-4100-93bb-71a7dc080862 req-c1e88a18-6770-4e3e-9232-625cbded05f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8431c4e-ee2f-4c43-adbc-8be9183d2a4a", "tag": "185ac9e9-a5e9-40dd-ba32-bbb6c5a80bc0"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:52.467561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bb0c7df5-e7b8-4100-93bb-71a7dc080862 req-c1e88a18-6770-4e3e-9232-625cbded05f3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:52.468807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bb0c7df5-e7b8-4100-93bb-71a7dc080862 req-c1e88a18-6770-4e3e-9232-625cbded05f3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:52.470069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bb0c7df5-e7b8-4100-93bb-71a7dc080862 req-c1e88a18-6770-4e3e-9232-625cbded05f3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:52.481740 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-bb0c7df5-e7b8-4100-93bb-71a7dc080862 req-c1e88a18-6770-4e3e-9232-625cbded05f3 service nova] Creating event network-changed:185ac9e9-a5e9-40dd-ba32-bbb6c5a80bc0 for instance f8431c4e-ee2f-4c43-adbc-8be9183d2a4a on nch1-master-1 Aug 06 21:23:52.487001 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-bb0c7df5-e7b8-4100-93bb-71a7dc080862 req-c1e88a18-6770-4e3e-9232-625cbded05f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036740 Aug 06 21:23:52.488171 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2608/5397] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:53.017211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba693575-1dfd-4585-9b3c-2ee1b569d6b4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:53.065604 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba693575-1dfd-4585-9b3c-2ee1b569d6b4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052232 Aug 06 21:23:53.066168 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2790/5398] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:23:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:53.307906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32722c1b-a4eb-46c9-a948-840da34c2550 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:53.308532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-32722c1b-a4eb-46c9-a948-840da34c2550 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:53.314821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32722c1b-a4eb-46c9-a948-840da34c2550 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:53.315884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32722c1b-a4eb-46c9-a948-840da34c2550 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:53.316379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32722c1b-a4eb-46c9-a948-840da34c2550 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:53.318094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32722c1b-a4eb-46c9-a948-840da34c2550 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:53.318094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32722c1b-a4eb-46c9-a948-840da34c2550 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:53.318094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-32722c1b-a4eb-46c9-a948-840da34c2550 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:53.451944 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-32722c1b-a4eb-46c9-a948-840da34c2550 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1463 microversion: 2.1 time: 0.149067 Aug 06 21:23:53.452549 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2609/5399] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:53 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1463 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:54.080378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c3c3c83b-18bc-4fcd-a34d-83476423b7c5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6524c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:54.187079 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c3c3c83b-18bc-4fcd-a34d-83476423b7c5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.111427 Aug 06 21:23:54.193745 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2791/5400] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:23:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:54.473513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-441349e4-e2e2-439d-8e85-1f2797a810c8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:54.474141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-441349e4-e2e2-439d-8e85-1f2797a810c8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:54.477067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:54.483192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441349e4-e2e2-439d-8e85-1f2797a810c8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:54.483719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441349e4-e2e2-439d-8e85-1f2797a810c8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:54.484160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441349e4-e2e2-439d-8e85-1f2797a810c8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:54.484859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441349e4-e2e2-439d-8e85-1f2797a810c8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:54.485316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441349e4-e2e2-439d-8e85-1f2797a810c8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:54.485777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-441349e4-e2e2-439d-8e85-1f2797a810c8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:54.490295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=99 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:54.617711 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-441349e4-e2e2-439d-8e85-1f2797a810c8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1463 microversion: 2.1 time: 0.148665 Aug 06 21:23:54.618299 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2610/5401] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:54 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:55.202881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-112ddc58-cb97-4063-8cb4-12ac9dbbf202 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6524c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:55.252606 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-112ddc58-cb97-4063-8cb4-12ac9dbbf202 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055167 Aug 06 21:23:55.253980 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2792/5402] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:23:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:55.638026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-26797ae1-63e5-4583-a5cc-74b536111c1c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:55.638760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-26797ae1-63e5-4583-a5cc-74b536111c1c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:55.645746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26797ae1-63e5-4583-a5cc-74b536111c1c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:55.646232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26797ae1-63e5-4583-a5cc-74b536111c1c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:55.646715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26797ae1-63e5-4583-a5cc-74b536111c1c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:55.647408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26797ae1-63e5-4583-a5cc-74b536111c1c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:55.647867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26797ae1-63e5-4583-a5cc-74b536111c1c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:55.648295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-26797ae1-63e5-4583-a5cc-74b536111c1c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:56.053168 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-26797ae1-63e5-4583-a5cc-74b536111c1c tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1463 microversion: 2.1 time: 0.418779 Aug 06 21:23:56.053747 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2611/5403] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:55 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1463 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:56.267714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4675c388-0879-4ce0-8d31-1f4975150d22 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c729820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:56.318596 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4675c388-0879-4ce0-8d31-1f4975150d22 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055942 Aug 06 21:23:56.319290 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2793/5404] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:23:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:57.072983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3a20ff79-083b-41d4-b9d8-0ac5f8a997bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:57.073603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3a20ff79-083b-41d4-b9d8-0ac5f8a997bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:57.080467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a20ff79-083b-41d4-b9d8-0ac5f8a997bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:57.081725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a20ff79-083b-41d4-b9d8-0ac5f8a997bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:57.082258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a20ff79-083b-41d4-b9d8-0ac5f8a997bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:57.082996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a20ff79-083b-41d4-b9d8-0ac5f8a997bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:57.083457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a20ff79-083b-41d4-b9d8-0ac5f8a997bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:57.083890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a20ff79-083b-41d4-b9d8-0ac5f8a997bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:57.210288 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3a20ff79-083b-41d4-b9d8-0ac5f8a997bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1463 microversion: 2.1 time: 0.140978 Aug 06 21:23:57.210904 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2612/5405] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:57 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:57.334025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-95527832-bfad-4177-b3b7-e4f5e1357bdc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c766f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:57.381679 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-95527832-bfad-4177-b3b7-e4f5e1357bdc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053113 Aug 06 21:23:57.382274 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2794/5406] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:23:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:58.219597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f633badf-1e35-4544-bdfe-18b2987d012c req-38372a0c-3b70-46c4-8433-81117f7db9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8431c4e-ee2f-4c43-adbc-8be9183d2a4a", "name": "network-vif-plugged", "status": "completed", "tag": "185ac9e9-a5e9-40dd-ba32-bbb6c5a80bc0"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:23:58.230770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f633badf-1e35-4544-bdfe-18b2987d012c req-38372a0c-3b70-46c4-8433-81117f7db9ab service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:58.230960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ffc2bb3-97bb-4042-839a-d46ba694960e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:58.231613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f633badf-1e35-4544-bdfe-18b2987d012c req-38372a0c-3b70-46c4-8433-81117f7db9ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:58.231832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ffc2bb3-97bb-4042-839a-d46ba694960e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:58.232056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f633badf-1e35-4544-bdfe-18b2987d012c req-38372a0c-3b70-46c4-8433-81117f7db9ab service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:58.239978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffc2bb3-97bb-4042-839a-d46ba694960e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:58.241127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffc2bb3-97bb-4042-839a-d46ba694960e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:58.241656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffc2bb3-97bb-4042-839a-d46ba694960e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:58.242483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffc2bb3-97bb-4042-839a-d46ba694960e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:58.243065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffc2bb3-97bb-4042-839a-d46ba694960e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:58.243614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ffc2bb3-97bb-4042-839a-d46ba694960e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:58.244190 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f633badf-1e35-4544-bdfe-18b2987d012c req-38372a0c-3b70-46c4-8433-81117f7db9ab service nova] Creating event network-vif-plugged:185ac9e9-a5e9-40dd-ba32-bbb6c5a80bc0 for instance f8431c4e-ee2f-4c43-adbc-8be9183d2a4a on nch1-master-1 Aug 06 21:23:58.249133 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f633badf-1e35-4544-bdfe-18b2987d012c req-38372a0c-3b70-46c4-8433-81117f7db9ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033269 Aug 06 21:23:58.250168 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2613/5407] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:58.389436 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ffc2bb3-97bb-4042-839a-d46ba694960e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1463 microversion: 2.1 time: 0.163153 Aug 06 21:23:58.390404 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2795/5408] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:58 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:58.397075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2dadf5c8-3969-47f5-a463-d6d00e556fa5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729da1f9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:58.446749 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2dadf5c8-3969-47f5-a463-d6d00e556fa5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054787 Aug 06 21:23:58.447332 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2614/5409] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:23:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:23:59.412301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-967d4415-bac7-4c03-ad6d-7f8a54954e5e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:59.412908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-967d4415-bac7-4c03-ad6d-7f8a54954e5e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:59.416264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:23:59.421090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967d4415-bac7-4c03-ad6d-7f8a54954e5e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:59.421581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967d4415-bac7-4c03-ad6d-7f8a54954e5e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:59.422040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967d4415-bac7-4c03-ad6d-7f8a54954e5e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:59.422740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967d4415-bac7-4c03-ad6d-7f8a54954e5e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:59.423368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967d4415-bac7-4c03-ad6d-7f8a54954e5e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:59.423785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-967d4415-bac7-4c03-ad6d-7f8a54954e5e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:59.461898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9277823e-233c-4d6f-87bb-d5a9497e85d0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a34d80d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:59.512856 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9277823e-233c-4d6f-87bb-d5a9497e85d0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057013 Aug 06 21:23:59.513916 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2615/5410] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:23:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:23:59.569822 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-967d4415-bac7-4c03-ad6d-7f8a54954e5e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1649 microversion: 2.1 time: 0.161163 Aug 06 21:23:59.570392 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2796/5411] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:59 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1649 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:23:59.590645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a81dff99-e826-492b-a37e-f76503326a78 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:59.591384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a81dff99-e826-492b-a37e-f76503326a78 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:59.598535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a81dff99-e826-492b-a37e-f76503326a78 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:59.599056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a81dff99-e826-492b-a37e-f76503326a78 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:59.599499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a81dff99-e826-492b-a37e-f76503326a78 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:59.600203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a81dff99-e826-492b-a37e-f76503326a78 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:59.600664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a81dff99-e826-492b-a37e-f76503326a78 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:59.601094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a81dff99-e826-492b-a37e-f76503326a78 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:59.732083 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a81dff99-e826-492b-a37e-f76503326a78 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1649 microversion: 2.1 time: 0.145092 Aug 06 21:23:59.732663 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2616/5412] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:59 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1649 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:59.751158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16f615fd-28e3-4284-ac15-b5fbbef02824 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:23:59.751775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-16f615fd-28e3-4284-ac15-b5fbbef02824 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:23:59.757786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f615fd-28e3-4284-ac15-b5fbbef02824 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:59.758274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f615fd-28e3-4284-ac15-b5fbbef02824 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:59.758743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f615fd-28e3-4284-ac15-b5fbbef02824 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:59.759440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f615fd-28e3-4284-ac15-b5fbbef02824 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:23:59.759939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f615fd-28e3-4284-ac15-b5fbbef02824 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:23:59.760331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16f615fd-28e3-4284-ac15-b5fbbef02824 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:23:59.887209 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16f615fd-28e3-4284-ac15-b5fbbef02824 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1649 microversion: 2.1 time: 0.139380 Aug 06 21:23:59.887836 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2797/5413] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:23:59 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1649 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:23:59.996656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-94086483", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "b53582ab-4757-41c4-ae5c-34ad7b949a79"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:00.004352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:00.005039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:00.056379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] validate_networks() for [('b53582ab-4757-41c4-ae5c-34ad7b949a79', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:24:00.520198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:24:00.520790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:24:00.521102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:24:00.521517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:24:00.522143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:24:00.527568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc86ec0f-99b8-43ca-9659-76397539e4ee tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78cee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:00.531249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:00.531742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:00.532189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:00.532931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:00.533398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:00.533574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:00.534521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:00.553585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Getting quotas for project 39b1e62bc44b4253b2df0e7b22bfb332. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:24:00.558974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Getting quotas for user 2a19ae0801884a938a94cdfdc4de1b08 and project 39b1e62bc44b4253b2df0e7b22bfb332. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:24:00.573048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:24:00.576141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:24:00.577480 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc86ec0f-99b8-43ca-9659-76397539e4ee tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053608 Aug 06 21:24:00.584838 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2798/5414] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:24:00.625608 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c159b2a1-d917-40e2-82a1-a31e857553db tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632607 Aug 06 21:24:00.626264 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2617/5415] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:24:00.637918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9eaa1fc4-d53c-4684-823b-36e663d39cef tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:00.638980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9eaa1fc4-d53c-4684-823b-36e663d39cef tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:00.716494 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9eaa1fc4-d53c-4684-823b-36e663d39cef tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1327 microversion: 2.1 time: 0.082220 Aug 06 21:24:00.717069 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2799/5416] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:00 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1327 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:01.593017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-216b8bc4-705d-47fa-9f0d-15326cd83270 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf8d3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:01.646799 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-216b8bc4-705d-47fa-9f0d-15326cd83270 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.058572 Aug 06 21:24:01.647998 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2618/5417] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:01.737028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48cb55ae-62fc-4854-845c-f3bf1f161db8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:01.738401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-48cb55ae-62fc-4854-845c-f3bf1f161db8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:01.745358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48cb55ae-62fc-4854-845c-f3bf1f161db8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:01.745853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48cb55ae-62fc-4854-845c-f3bf1f161db8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:01.746290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48cb55ae-62fc-4854-845c-f3bf1f161db8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:01.747021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48cb55ae-62fc-4854-845c-f3bf1f161db8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:01.747481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48cb55ae-62fc-4854-845c-f3bf1f161db8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:01.747911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-48cb55ae-62fc-4854-845c-f3bf1f161db8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:01.820697 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-48cb55ae-62fc-4854-845c-f3bf1f161db8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1420 microversion: 2.1 time: 0.087162 Aug 06 21:24:01.821219 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2800/5418] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:01 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:02.661967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-66c56828-6797-4b33-af88-77ede2ea78fb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729dc6eca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:02.713654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c8fa7140-0a54-4157-894d-8f15d8183067 req-ac7973f9-18ea-47cf-8987-dbe7a4c2da9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f7b5399-6a2d-44d9-a330-52063874f3bc", "tag": "1940e6be-bc12-4d43-8b9e-070f78ade4cc"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:02.714154 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-66c56828-6797-4b33-af88-77ede2ea78fb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057161 Aug 06 21:24:02.714772 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2619/5419] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:02.727830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c8fa7140-0a54-4157-894d-8f15d8183067 req-ac7973f9-18ea-47cf-8987-dbe7a4c2da9e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:02.728305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c8fa7140-0a54-4157-894d-8f15d8183067 req-ac7973f9-18ea-47cf-8987-dbe7a4c2da9e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:02.728770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c8fa7140-0a54-4157-894d-8f15d8183067 req-ac7973f9-18ea-47cf-8987-dbe7a4c2da9e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:02.744394 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c8fa7140-0a54-4157-894d-8f15d8183067 req-ac7973f9-18ea-47cf-8987-dbe7a4c2da9e service nova] Creating event network-changed:1940e6be-bc12-4d43-8b9e-070f78ade4cc for instance 4f7b5399-6a2d-44d9-a330-52063874f3bc on nch2-master-1 Aug 06 21:24:02.750501 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c8fa7140-0a54-4157-894d-8f15d8183067 req-ac7973f9-18ea-47cf-8987-dbe7a4c2da9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040886 Aug 06 21:24:02.751418 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2801/5420] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:02.841485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-88f9596c-f49d-4582-8013-e0420ed44d1b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:02.842101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-88f9596c-f49d-4582-8013-e0420ed44d1b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:02.848509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88f9596c-f49d-4582-8013-e0420ed44d1b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:02.849000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88f9596c-f49d-4582-8013-e0420ed44d1b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:02.849442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88f9596c-f49d-4582-8013-e0420ed44d1b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:02.850136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88f9596c-f49d-4582-8013-e0420ed44d1b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:02.850619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88f9596c-f49d-4582-8013-e0420ed44d1b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:02.851048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-88f9596c-f49d-4582-8013-e0420ed44d1b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:03.051916 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-88f9596c-f49d-4582-8013-e0420ed44d1b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1462 microversion: 2.1 time: 0.214324 Aug 06 21:24:03.052519 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2620/5421] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:02 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1462 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:03.728405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9e3bdf11-0baf-40b3-964a-cb05f9a71cdc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c2550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:03.777234 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9e3bdf11-0baf-40b3-964a-cb05f9a71cdc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052955 Aug 06 21:24:03.777799 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2802/5422] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:04.072356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b422d43c-af37-4dd9-bdfe-80f4fef796e9 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:04.072983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b422d43c-af37-4dd9-bdfe-80f4fef796e9 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:04.079976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b422d43c-af37-4dd9-bdfe-80f4fef796e9 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:04.081011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b422d43c-af37-4dd9-bdfe-80f4fef796e9 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:04.081823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b422d43c-af37-4dd9-bdfe-80f4fef796e9 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:04.082568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b422d43c-af37-4dd9-bdfe-80f4fef796e9 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:04.083046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b422d43c-af37-4dd9-bdfe-80f4fef796e9 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:04.083488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b422d43c-af37-4dd9-bdfe-80f4fef796e9 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:04.293614 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b422d43c-af37-4dd9-bdfe-80f4fef796e9 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1462 microversion: 2.1 time: 0.224888 Aug 06 21:24:04.294209 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2621/5423] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:04 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1462 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:04.792124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8d0cb89-1da7-4081-a0a1-2df9f8d69ca2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:04.839582 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e8d0cb89-1da7-4081-a0a1-2df9f8d69ca2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052384 Aug 06 21:24:04.840150 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2803/5424] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:05.314443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-313255ea-c582-458a-8e84-6b25493b0aae tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:05.315712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-313255ea-c582-458a-8e84-6b25493b0aae tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:05.322663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-313255ea-c582-458a-8e84-6b25493b0aae tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:05.323159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-313255ea-c582-458a-8e84-6b25493b0aae tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:05.323635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-313255ea-c582-458a-8e84-6b25493b0aae tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:05.324334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-313255ea-c582-458a-8e84-6b25493b0aae tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:05.324796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-313255ea-c582-458a-8e84-6b25493b0aae tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:05.325231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-313255ea-c582-458a-8e84-6b25493b0aae tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:05.455797 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-313255ea-c582-458a-8e84-6b25493b0aae tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1462 microversion: 2.1 time: 0.144987 Aug 06 21:24:05.456545 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2622/5425] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:05 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1462 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:05.854239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09624cea-7385-4b4e-814e-e02715b5f3fd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c23a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:05.900276 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-09624cea-7385-4b4e-814e-e02715b5f3fd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050645 Aug 06 21:24:05.900843 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2804/5426] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:06.477119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7b61400b-d95d-48f3-87a2-d4e9a8b00822 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:06.477734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7b61400b-d95d-48f3-87a2-d4e9a8b00822 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:06.484713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b61400b-d95d-48f3-87a2-d4e9a8b00822 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:06.485197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b61400b-d95d-48f3-87a2-d4e9a8b00822 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:06.485640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b61400b-d95d-48f3-87a2-d4e9a8b00822 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:06.487829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b61400b-d95d-48f3-87a2-d4e9a8b00822 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:06.488309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b61400b-d95d-48f3-87a2-d4e9a8b00822 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:06.488751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7b61400b-d95d-48f3-87a2-d4e9a8b00822 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:06.614485 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7b61400b-d95d-48f3-87a2-d4e9a8b00822 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1462 microversion: 2.1 time: 0.141015 Aug 06 21:24:06.615093 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2623/5427] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:06 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1462 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:06.915836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d489776-f4d6-4408-b4b1-249e9a4d058f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c787160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:06.965134 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d489776-f4d6-4408-b4b1-249e9a4d058f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054306 Aug 06 21:24:06.965706 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2805/5428] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:07.144586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-09e75679-4060-4a35-9366-61f59c5ecbab req-0146d5f7-4a8e-4277-98d2-5cce518d4d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7b5399-6a2d-44d9-a330-52063874f3bc", "name": "network-vif-plugged", "status": "completed", "tag": "1940e6be-bc12-4d43-8b9e-070f78ade4cc"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:07.154405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-09e75679-4060-4a35-9366-61f59c5ecbab req-0146d5f7-4a8e-4277-98d2-5cce518d4d67 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:07.155158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-09e75679-4060-4a35-9366-61f59c5ecbab req-0146d5f7-4a8e-4277-98d2-5cce518d4d67 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:07.155934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-09e75679-4060-4a35-9366-61f59c5ecbab req-0146d5f7-4a8e-4277-98d2-5cce518d4d67 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:07.168275 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-09e75679-4060-4a35-9366-61f59c5ecbab req-0146d5f7-4a8e-4277-98d2-5cce518d4d67 service nova] Creating event network-vif-plugged:1940e6be-bc12-4d43-8b9e-070f78ade4cc for instance 4f7b5399-6a2d-44d9-a330-52063874f3bc on nch2-master-1 Aug 06 21:24:07.173150 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-09e75679-4060-4a35-9366-61f59c5ecbab req-0146d5f7-4a8e-4277-98d2-5cce518d4d67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033479 Aug 06 21:24:07.173824 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2624/5429] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:24:07.635142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-15764f2f-52aa-4c97-8066-e41ae55d2f61 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:07.636033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-15764f2f-52aa-4c97-8066-e41ae55d2f61 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:07.638039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=40 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:07.644779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15764f2f-52aa-4c97-8066-e41ae55d2f61 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:07.645275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15764f2f-52aa-4c97-8066-e41ae55d2f61 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:07.645722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15764f2f-52aa-4c97-8066-e41ae55d2f61 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:07.646432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15764f2f-52aa-4c97-8066-e41ae55d2f61 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:07.646930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15764f2f-52aa-4c97-8066-e41ae55d2f61 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:07.647366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-15764f2f-52aa-4c97-8066-e41ae55d2f61 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:07.775125 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-15764f2f-52aa-4c97-8066-e41ae55d2f61 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1462 microversion: 2.1 time: 0.143662 Aug 06 21:24:07.775695 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2806/5430] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:07 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1462 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:07.980879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7bbac5d-050c-46ef-a9b5-6bae8eecb7a0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf8dc10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:08.027235 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7bbac5d-050c-46ef-a9b5-6bae8eecb7a0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051505 Aug 06 21:24:08.027807 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2625/5431] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:08.795611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-423a472a-cc57-4bf8-a679-00e1319484fb tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:08.796219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-423a472a-cc57-4bf8-a679-00e1319484fb tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:08.803700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-423a472a-cc57-4bf8-a679-00e1319484fb tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:08.804180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-423a472a-cc57-4bf8-a679-00e1319484fb tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:08.804616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-423a472a-cc57-4bf8-a679-00e1319484fb tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:08.805315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-423a472a-cc57-4bf8-a679-00e1319484fb tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:08.805754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-423a472a-cc57-4bf8-a679-00e1319484fb tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:08.806176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-423a472a-cc57-4bf8-a679-00e1319484fb tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:08.937737 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-423a472a-cc57-4bf8-a679-00e1319484fb tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1647 microversion: 2.1 time: 0.145848 Aug 06 21:24:08.938473 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2807/5432] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:08 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1647 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:08.957845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7cf03781-c755-47ef-8fb1-9bd984da7d13 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:08.958604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7cf03781-c755-47ef-8fb1-9bd984da7d13 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:08.965345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cf03781-c755-47ef-8fb1-9bd984da7d13 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:08.965826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cf03781-c755-47ef-8fb1-9bd984da7d13 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:08.966266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cf03781-c755-47ef-8fb1-9bd984da7d13 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:08.966991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cf03781-c755-47ef-8fb1-9bd984da7d13 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:08.967450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cf03781-c755-47ef-8fb1-9bd984da7d13 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:08.967879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cf03781-c755-47ef-8fb1-9bd984da7d13 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:09.042083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b311d099-15cf-44e7-8f5e-cef0039f47ef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7d8040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:09.089709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b311d099-15cf-44e7-8f5e-cef0039f47ef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052250 Aug 06 21:24:09.090432 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2808/5433] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:24:09.098084 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7cf03781-c755-47ef-8fb1-9bd984da7d13 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1647 microversion: 2.1 time: 0.143843 Aug 06 21:24:09.098698 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2626/5434] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:08 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1647 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:09.118806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1efef77e-3184-4405-a950-1489f74063e8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:09.119546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1efef77e-3184-4405-a950-1489f74063e8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:09.135089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1efef77e-3184-4405-a950-1489f74063e8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:09.135089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1efef77e-3184-4405-a950-1489f74063e8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:09.135089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1efef77e-3184-4405-a950-1489f74063e8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:09.135089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1efef77e-3184-4405-a950-1489f74063e8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:09.135089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1efef77e-3184-4405-a950-1489f74063e8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:09.135089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1efef77e-3184-4405-a950-1489f74063e8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:09.254934 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1efef77e-3184-4405-a950-1489f74063e8 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1647 microversion: 2.1 time: 0.139917 Aug 06 21:24:09.255796 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2809/5435] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:09 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1647 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:24:09.274842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:09.275357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:09.281499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:09.281993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:09.282442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:09.283709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:09.284177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:09.284613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:09.310658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:24:09.388863 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c2765b5-9011-433d-8ebf-623767e3293b tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 204 len: 0 microversion: 2.1 time: 0.117303 Aug 06 21:24:09.389598 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2627/5436] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:24:09 2022] DELETE /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:24:09.399049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f4356d07-c158-424d-bb58-0d65ffc6cbd7 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:09.399884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f4356d07-c158-424d-bb58-0d65ffc6cbd7 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:09.406433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4356d07-c158-424d-bb58-0d65ffc6cbd7 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:09.406980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4356d07-c158-424d-bb58-0d65ffc6cbd7 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:09.407424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4356d07-c158-424d-bb58-0d65ffc6cbd7 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:09.409389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4356d07-c158-424d-bb58-0d65ffc6cbd7 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:09.409891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4356d07-c158-424d-bb58-0d65ffc6cbd7 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:09.410326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f4356d07-c158-424d-bb58-0d65ffc6cbd7 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:09.536361 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f4356d07-c158-424d-bb58-0d65ffc6cbd7 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1653 microversion: 2.1 time: 0.141198 Aug 06 21:24:09.536926 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2810/5437] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:09 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1653 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:10.104628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7328cb3-e93d-4e44-944e-cd4cc4e31be1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a347ec10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:10.154152 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7328cb3-e93d-4e44-944e-cd4cc4e31be1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053406 Aug 06 21:24:10.154675 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2628/5438] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:10.557411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3102dbff-67de-4b55-b539-4de5ede868bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:10.557948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3102dbff-67de-4b55-b539-4de5ede868bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:10.565085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3102dbff-67de-4b55-b539-4de5ede868bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:10.565582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3102dbff-67de-4b55-b539-4de5ede868bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:10.566030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3102dbff-67de-4b55-b539-4de5ede868bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:10.566770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3102dbff-67de-4b55-b539-4de5ede868bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:10.567240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3102dbff-67de-4b55-b539-4de5ede868bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:10.567677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3102dbff-67de-4b55-b539-4de5ede868bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:10.706170 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3102dbff-67de-4b55-b539-4de5ede868bf tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 200 len: 1653 microversion: 2.1 time: 0.152513 Aug 06 21:24:10.706777 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2811/5439] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:10 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 1653 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:11.081726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7dfc893b-2f89-495f-a64f-e59103d3e528 req-0e9f63a6-c040-4acb-af58-0c4005114de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7b5399-6a2d-44d9-a330-52063874f3bc", "name": "network-vif-deleted", "tag": "1940e6be-bc12-4d43-8b9e-070f78ade4cc"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:11.090255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:11.090891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:11.097792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7dfc893b-2f89-495f-a64f-e59103d3e528 req-0e9f63a6-c040-4acb-af58-0c4005114de1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:11.098587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7dfc893b-2f89-495f-a64f-e59103d3e528 req-0e9f63a6-c040-4acb-af58-0c4005114de1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:11.099215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7dfc893b-2f89-495f-a64f-e59103d3e528 req-0e9f63a6-c040-4acb-af58-0c4005114de1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:11.117034 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7dfc893b-2f89-495f-a64f-e59103d3e528 req-0e9f63a6-c040-4acb-af58-0c4005114de1 service nova] Creating event network-vif-deleted:1940e6be-bc12-4d43-8b9e-070f78ade4cc for instance 4f7b5399-6a2d-44d9-a330-52063874f3bc on nch2-master-1 Aug 06 21:24:11.122389 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7dfc893b-2f89-495f-a64f-e59103d3e528 req-0e9f63a6-c040-4acb-af58-0c4005114de1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045824 Aug 06 21:24:11.123748 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2629/5440] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:24:11.165663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:11.171234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-99fb2384-9979-4a87-90cc-345e9dfcafbf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78ca60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:11.227286 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-99fb2384-9979-4a87-90cc-345e9dfcafbf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.062563 Aug 06 21:24:11.227883 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2812/5441] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:11.728214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:11.728983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: 4f7b5399-6a2d-44d9-a330-52063874f3bc] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:11.735489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:11.735993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:11.736485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:11.737184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:11.737641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:11.738069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:11.751264 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] HTTP exception thrown: Instance 4f7b5399-6a2d-44d9-a330-52063874f3bc could not be found. Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Request method failure captured: Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc HTTP/1.1 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tvk2cbiyadhiIZqeqU7KStNc2574hD9o34xflqeGikyaeGtaVSskzoKcAXW8_w7ApbJoimp8iA73BkLgZGr6CgqPJDvFEeUA19cWMCMhLH2MQTAwlOmyuwjv6Xlwgs2feLiFTPPcL-If_-UAMm3kd6edT6M4hY7UmoyhsJhhkDxy5I Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 39b1e62bc44b4253b2df0e7b22bfb332 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestServerMultinode-376141963 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/39b1e62bc44b4253b2df0e7b22bfb332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_39b1e62bc44b4253b2df0e7b22bfb332", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39b1e62bc44b4253b2df0e7b22bfb332"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39b1e62bc44b4253b2df0e7b22bfb332"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestServerMultinode-376141963 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 39b1e62bc44b4253b2df0e7b22bfb332 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestServerMultinode-376141963 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestServerMultinode-376141963-project-admin Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 2a19ae0801884a938a94cdfdc4de1b08 Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestServerMultinode-376141963-project-admin Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 4f7b5399-6a2d-44d9-a330-52063874f3bc could not be found. Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '4f7b5399-6a2d-44d9-a330-52063874f3bc'} Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f7b5399-6a2d-44d9-a330-52063874f3bc could not be found. Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f7b5399-6a2d-44d9-a330-52063874f3bc could not be found. Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:24:11.753039 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f7b5399-6a2d-44d9-a330-52063874f3bc could not be found. Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Returning 404 to user: Instance 4f7b5399-6a2d-44d9-a330-52063874f3bc could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9417636f-b639-428d-b425-2d7f9223b509 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc" status: 404 len: 111 microversion: 2.1 time: 0.030380 Aug 06 21:24:11.758319 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2630/5442] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:11 2022] GET /compute/v2.1/servers/4f7b5399-6a2d-44d9-a330-52063874f3bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:24:11.764850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:11.765392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:11.772639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:11.773135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:11.773584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:11.774285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:11.774780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:11.775218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:11.800397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:24:11.873273 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-89a824c0-3a10-4fb7-9eb1-d7358cb0d61e tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 204 len: 0 microversion: 2.1 time: 0.112862 Aug 06 21:24:11.873860 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2813/5443] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:24:11 2022] DELETE /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:24:11.881917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1a4242a3-451c-4778-8876-591f00f66e64 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:11.882670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1a4242a3-451c-4778-8876-591f00f66e64 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:11.888743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a4242a3-451c-4778-8876-591f00f66e64 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:11.889231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a4242a3-451c-4778-8876-591f00f66e64 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:11.889673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a4242a3-451c-4778-8876-591f00f66e64 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:11.890370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a4242a3-451c-4778-8876-591f00f66e64 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:11.890853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a4242a3-451c-4778-8876-591f00f66e64 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:11.891284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a4242a3-451c-4778-8876-591f00f66e64 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:12.024980 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1a4242a3-451c-4778-8876-591f00f66e64 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1655 microversion: 2.1 time: 0.146759 Aug 06 21:24:12.025561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2631/5444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:11 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:12.241856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9e9e8e1a-22b8-4040-84a8-31ea50e56c1e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7555e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:12.291171 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9e9e8e1a-22b8-4040-84a8-31ea50e56c1e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053456 Aug 06 21:24:12.291758 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2814/5445] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:13.047199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c425069a-8627-4ab9-bacd-4a7d31f50b72 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:13.048218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c425069a-8627-4ab9-bacd-4a7d31f50b72 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:13.057638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c425069a-8627-4ab9-bacd-4a7d31f50b72 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:13.058143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c425069a-8627-4ab9-bacd-4a7d31f50b72 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:13.059002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c425069a-8627-4ab9-bacd-4a7d31f50b72 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:13.059930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c425069a-8627-4ab9-bacd-4a7d31f50b72 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:13.060404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c425069a-8627-4ab9-bacd-4a7d31f50b72 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:13.060845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c425069a-8627-4ab9-bacd-4a7d31f50b72 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:13.218489 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c425069a-8627-4ab9-bacd-4a7d31f50b72 tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 200 len: 1655 microversion: 2.1 time: 0.175665 Aug 06 21:24:13.219140 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2632/5446] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:13 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 1655 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:13.305907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd79c24c-6767-4d32-9169-63d463411818 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a2b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:13.357069 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd79c24c-6767-4d32-9169-63d463411818 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055872 Aug 06 21:24:13.357650 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2815/5447] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:13.714865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-6ae0b351-69e3-436b-b716-9d00c3062486 req-3fab1e1c-97ed-4aef-bd5f-97f256ef11f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8431c4e-ee2f-4c43-adbc-8be9183d2a4a", "name": "network-vif-deleted", "tag": "185ac9e9-a5e9-40dd-ba32-bbb6c5a80bc0"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:13.728673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6ae0b351-69e3-436b-b716-9d00c3062486 req-3fab1e1c-97ed-4aef-bd5f-97f256ef11f6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:13.728985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6ae0b351-69e3-436b-b716-9d00c3062486 req-3fab1e1c-97ed-4aef-bd5f-97f256ef11f6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:13.729436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6ae0b351-69e3-436b-b716-9d00c3062486 req-3fab1e1c-97ed-4aef-bd5f-97f256ef11f6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:13.744686 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-6ae0b351-69e3-436b-b716-9d00c3062486 req-3fab1e1c-97ed-4aef-bd5f-97f256ef11f6 service nova] Creating event network-vif-deleted:185ac9e9-a5e9-40dd-ba32-bbb6c5a80bc0 for instance f8431c4e-ee2f-4c43-adbc-8be9183d2a4a on nch1-master-1 Aug 06 21:24:13.751068 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-6ae0b351-69e3-436b-b716-9d00c3062486 req-3fab1e1c-97ed-4aef-bd5f-97f256ef11f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039865 Aug 06 21:24:13.752550 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2633/5448] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:14.241546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:14.242336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] [instance: f8431c4e-ee2f-4c43-adbc-8be9183d2a4a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:14.248407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:14.248890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:14.249329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:14.250021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:14.250473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:14.250920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:14.254093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:14.266197 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] HTTP exception thrown: Instance f8431c4e-ee2f-4c43-adbc-8be9183d2a4a could not be found. Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Request method failure captured: Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a HTTP/1.1 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tvk2cbiyadhiIZqeqU7KStNc2574hD9o34xflqeGikyaeGtaVSskzoKcAXW8_w7ApbJoimp8iA73BkLgZGr6CgqPJDvFEeUA19cWMCMhLH2MQTAwlOmyuwjv6Xlwgs2feLiFTPPcL-If_-UAMm3kd6edT6M4hY7UmoyhsJhhkDxy5I Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 39b1e62bc44b4253b2df0e7b22bfb332 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TestServerMultinode-376141963 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/39b1e62bc44b4253b2df0e7b22bfb332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_39b1e62bc44b4253b2df0e7b22bfb332", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39b1e62bc44b4253b2df0e7b22bfb332"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/39b1e62bc44b4253b2df0e7b22bfb332"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TestServerMultinode-376141963 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 39b1e62bc44b4253b2df0e7b22bfb332 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TestServerMultinode-376141963 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TestServerMultinode-376141963-project-admin Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 2a19ae0801884a938a94cdfdc4de1b08 Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TestServerMultinode-376141963-project-admin Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance f8431c4e-ee2f-4c43-adbc-8be9183d2a4a could not be found. Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'f8431c4e-ee2f-4c43-adbc-8be9183d2a4a'} Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8431c4e-ee2f-4c43-adbc-8be9183d2a4a could not be found. Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8431c4e-ee2f-4c43-adbc-8be9183d2a4a could not be found. Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:24:14.268128 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8431c4e-ee2f-4c43-adbc-8be9183d2a4a could not be found. Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] Returning 404 to user: Instance f8431c4e-ee2f-4c43-adbc-8be9183d2a4a could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a1baf784-ac3b-48c3-b5a1-6c818d1ff69a tempest-TestServerMultinode-376141963 tempest-TestServerMultinode-376141963-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a" status: 404 len: 111 microversion: 2.1 time: 0.032715 Aug 06 21:24:14.272900 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2816/5449] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:14 2022] GET /compute/v2.1/servers/f8431c4e-ee2f-4c43-adbc-8be9183d2a4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:24:14.371246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8e288142-96a1-4c7d-b8c0-568712b358ee tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a3634820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:14.421003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8e288142-96a1-4c7d-b8c0-568712b358ee tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053936 Aug 06 21:24:14.421817 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2634/5450] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:15.435553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a273e8e5-0b0d-4f19-9870-714dbe95eefb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7660d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:15.487799 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a273e8e5-0b0d-4f19-9870-714dbe95eefb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056211 Aug 06 21:24:15.488564 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2817/5451] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:16.502748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-24d8b216-4b50-49d1-bbf6-9bfd72d3b21d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a361a280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:16.593439 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-24d8b216-4b50-49d1-bbf6-9bfd72d3b21d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.095824 Aug 06 21:24:16.594270 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2635/5452] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:17.608764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4818636d-0070-4925-8052-74d2cff53085 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c766ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:17.740510 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4818636d-0070-4925-8052-74d2cff53085 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.137456 Aug 06 21:24:17.746967 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2818/5453] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:18.755658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2149c14e-c015-492c-bee3-92ff41ce349e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d23fee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:18.815915 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2149c14e-c015-492c-bee3-92ff41ce349e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.065587 Aug 06 21:24:18.816506 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2636/5454] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:19.832100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dde28fab-2217-4c17-8bfc-42af5b1c4a81 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c755550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:19.911937 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dde28fab-2217-4c17-8bfc-42af5b1c4a81 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.086308 Aug 06 21:24:19.919525 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2819/5455] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:20.933971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-767025dd-682a-4cc0-bb44-02447097cf56 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35a4280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:21.015065 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-767025dd-682a-4cc0-bb44-02447097cf56 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.092154 Aug 06 21:24:21.016007 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2637/5456] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:21.925969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-695982260", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "0b1fc2fe-f247-4ef7-b025-a32b55f5e8bf"}], "key_name": "tempest-TestSecurityGroupsBasicOps-769382803", "security_groups": []}, "os:scheduler_hints": {"different_host": ["b0f4c0fb-83c8-43ac-964c-05505c18f964"]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:22.027957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] validate_networks() for [('0b1fc2fe-f247-4ef7-b025-a32b55f5e8bf', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:24:22.033991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-af7bd4ca-8c17-487f-bb72-a6f5ba6a5b6b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ceb5e50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:22.104845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-af7bd4ca-8c17-487f-bb72-a6f5ba6a5b6b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.075997 Aug 06 21:24:22.105428 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2638/5457] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:22.918456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:24:22.919095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:24:22.919874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:24:22.920589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:24:22.921091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:24:22.938864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:22.941273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:22.942448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:22.956606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:22.957463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:22.958694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:22.981600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Getting quotas for project 7054b60d5cc646ec87fa19bedaa69407. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:24:22.988998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Getting quotas for user 323cbfd25ac04e829ad1c162fedf68e8 and project 7054b60d5cc646ec87fa19bedaa69407. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:24:23.004162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:24:23.006530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:24:23.057465 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ada315d1-84fb-4faa-8c42-a9aa04163a80 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.137528 Aug 06 21:24:23.058460 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2820/5458] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:24:21 2022] POST /compute/v2.1/servers => generated 361 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:24:23.072692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b363a643-3377-4165-b6bc-9f162c492f0e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:23.074019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b363a643-3377-4165-b6bc-9f162c492f0e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:23.120057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ceb0eca5-df9a-4999-9a5f-f7f7f62df245 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c70fdc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:23.176779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b363a643-3377-4165-b6bc-9f162c492f0e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:23.196752 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ceb0eca5-df9a-4999-9a5f-f7f7f62df245 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.081283 Aug 06 21:24:23.197408 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2821/5459] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:24:23.212305 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b363a643-3377-4165-b6bc-9f162c492f0e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1240 microversion: 2.1 time: 0.144577 Aug 06 21:24:23.219333 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2639/5460] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:23 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1240 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:24.212438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a88a3a83-24b3-4939-a412-135668e21818 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7668b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:24.244531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:24.245783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:24.249711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:24.258045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:24.258759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:24.259621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:24.260644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:24.261485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:24.265879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:24.280019 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a88a3a83-24b3-4939-a412-135668e21818 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.072513 Aug 06 21:24:24.281665 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2822/5461] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:24.474600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:24.484308 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c0126ddb-b736-4c07-8ccc-d5f51d01bff8 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1300 microversion: 2.1 time: 0.246433 Aug 06 21:24:24.486109 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2640/5462] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:24 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1300 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:25.295865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-220a42cf-474b-4b43-9d84-9e9b809c6840 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca118b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:25.379267 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-220a42cf-474b-4b43-9d84-9e9b809c6840 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.087570 Aug 06 21:24:25.380423 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2823/5463] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:25.506157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:25.506746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:25.515526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:25.518174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:25.518966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:25.519618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:25.520751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:25.521599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:25.522269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:25.655672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:25.665658 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6e5b4b2b-7b61-4dba-9ea0-7aaa6ea151ac tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1298 microversion: 2.1 time: 0.162898 Aug 06 21:24:25.666290 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2641/5464] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:25 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1298 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:25.908859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3c5a7d9e-530b-4441-98fb-92ee43d1d63c req-f88591b8-a7b2-44e5-a699-895cc4516851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43c32f2-28e5-4cb4-87ac-270750f894b6", "tag": "d0b1e51f-9a84-43cc-ad4a-442d0b10ae75"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:25.931032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3c5a7d9e-530b-4441-98fb-92ee43d1d63c req-f88591b8-a7b2-44e5-a699-895cc4516851 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:25.932562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3c5a7d9e-530b-4441-98fb-92ee43d1d63c req-f88591b8-a7b2-44e5-a699-895cc4516851 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:25.933280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3c5a7d9e-530b-4441-98fb-92ee43d1d63c req-f88591b8-a7b2-44e5-a699-895cc4516851 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:25.948249 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3c5a7d9e-530b-4441-98fb-92ee43d1d63c req-f88591b8-a7b2-44e5-a699-895cc4516851 service nova] Creating event network-changed:d0b1e51f-9a84-43cc-ad4a-442d0b10ae75 for instance d43c32f2-28e5-4cb4-87ac-270750f894b6 on nch2-master-1 Aug 06 21:24:25.953459 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3c5a7d9e-530b-4441-98fb-92ee43d1d63c req-f88591b8-a7b2-44e5-a699-895cc4516851 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049556 Aug 06 21:24:25.955710 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2824/5465] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:26.393506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7ebc332c-4ef3-4496-9561-5b3ba5d91ce1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:26.440166 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7ebc332c-4ef3-4496-9561-5b3ba5d91ce1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050633 Aug 06 21:24:26.440735 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2642/5466] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:26.688820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:26.689561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:26.695862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:26.696349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:26.696786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:26.697481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:26.698020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:26.698451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:26.782883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:26.790765 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-03a1334d-22a8-4a28-9573-a6312c9493ab tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1298 microversion: 2.1 time: 0.107054 Aug 06 21:24:26.791323 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2825/5467] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:26 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:24:27.454235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d00d179e-c915-4e98-8171-8f5af2f0def8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf09430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:27.507462 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d00d179e-c915-4e98-8171-8f5af2f0def8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057898 Aug 06 21:24:27.515632 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2643/5468] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:27.811446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:27.812064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:27.819008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:27.819494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:27.819961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:27.820652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:27.821112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:27.821622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:27.901411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:27.909375 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32aa9449-2ed1-450c-8f74-f46c80783953 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1298 microversion: 2.1 time: 0.101887 Aug 06 21:24:27.909941 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2826/5469] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:27 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:28.526972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6448d823-7183-427c-86bd-5c62fa278bde tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf09550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:28.574835 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6448d823-7183-427c-86bd-5c62fa278bde tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055331 Aug 06 21:24:28.575462 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2644/5470] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:28.930215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:28.930858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:28.937737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:28.938906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:28.939344 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:28.940135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:28.940592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:28.941022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:29.022971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:29.030574 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9eafe199-e53d-4446-ae94-a4dd37c28972 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1298 microversion: 2.1 time: 0.104233 Aug 06 21:24:29.031144 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2827/5471] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:28 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:29.590359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-910958ba-befc-40fb-95ab-4f17a5bab0d5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729dc6eca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:29.637405 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-910958ba-befc-40fb-95ab-4f17a5bab0d5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051966 Aug 06 21:24:29.637992 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2645/5472] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:30.051812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:30.052348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:30.058967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:30.059452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:30.059893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:30.060584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:30.061042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:30.061471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:30.145866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:30.153428 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ad6d5320-ce23-4ac6-acdd-f07b9e1e8638 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1298 microversion: 2.1 time: 0.105969 Aug 06 21:24:30.153996 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2828/5473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:30 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:30.652837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76a1525a-7d64-4d2c-8199-b3e1de4ca96a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a34ca940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:30.701814 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-76a1525a-7d64-4d2c-8199-b3e1de4ca96a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053743 Aug 06 21:24:30.702419 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2646/5474] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:31.174607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:31.175338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:31.182420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:31.182942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:31.183382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:31.184086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:31.184547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:31.184974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:31.269028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:31.277484 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a2cd8f63-6056-4634-8646-2d93345fd806 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1298 microversion: 2.1 time: 0.106761 Aug 06 21:24:31.278129 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2829/5475] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:31 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:31.295551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-76e610a2-3fd2-48c1-9cd2-c45d6ad0ef1e req-678f62b2-3469-4fb6-ad7a-1b6aeba25fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43c32f2-28e5-4cb4-87ac-270750f894b6", "name": "network-vif-plugged", "status": "completed", "tag": "d0b1e51f-9a84-43cc-ad4a-442d0b10ae75"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:31.306126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-76e610a2-3fd2-48c1-9cd2-c45d6ad0ef1e req-678f62b2-3469-4fb6-ad7a-1b6aeba25fa9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:31.306875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-76e610a2-3fd2-48c1-9cd2-c45d6ad0ef1e req-678f62b2-3469-4fb6-ad7a-1b6aeba25fa9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:31.307318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-76e610a2-3fd2-48c1-9cd2-c45d6ad0ef1e req-678f62b2-3469-4fb6-ad7a-1b6aeba25fa9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:31.320624 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-76e610a2-3fd2-48c1-9cd2-c45d6ad0ef1e req-678f62b2-3469-4fb6-ad7a-1b6aeba25fa9 service nova] Creating event network-vif-plugged:d0b1e51f-9a84-43cc-ad4a-442d0b10ae75 for instance d43c32f2-28e5-4cb4-87ac-270750f894b6 on nch2-master-1 Aug 06 21:24:31.325559 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-76e610a2-3fd2-48c1-9cd2-c45d6ad0ef1e req-678f62b2-3469-4fb6-ad7a-1b6aeba25fa9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039053 Aug 06 21:24:31.326316 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2647/5476] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:31.715930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee80b41e-17e3-47ed-8010-e834fcab2f6b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:31.764950 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee80b41e-17e3-47ed-8010-e834fcab2f6b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052835 Aug 06 21:24:31.765529 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2830/5477] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:32.301156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:32.301876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:32.308458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:32.308958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:32.309412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:32.310122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:32.310623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:32.311069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:32.398424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:32.406075 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-669915a4-44f5-4f15-ae3b-82a74d1e7e81 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1298 microversion: 2.1 time: 0.110381 Aug 06 21:24:32.406877 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2648/5478] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:32 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:32.779006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-12192d2a-1a6c-433a-bc8f-121a092d836c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729de1dc10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:32.826471 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-12192d2a-1a6c-433a-bc8f-121a092d836c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052178 Aug 06 21:24:32.827081 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2831/5479] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:33.428879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:33.429510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:33.431577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:33.438896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:33.439103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:33.439543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:33.440241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:33.440697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:33.441127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:33.811614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:33.819501 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-19f99cb2-05b0-433f-91b3-a1957b1549e9 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1471 microversion: 2.1 time: 0.394579 Aug 06 21:24:33.820074 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2649/5480] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:33 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:33.836801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:33.837583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:33.840988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ad325fdd-fe27-4d39-b1b4-be3ef86450c0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36345e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:33.843449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:33.844611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:33.851388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:33.851880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:33.852324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:33.853021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:33.853481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:33.853915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:33.894298 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ad325fdd-fe27-4d39-b1b4-be3ef86450c0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057348 Aug 06 21:24:33.894932 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2650/5481] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:24:33.942690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:33.950366 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47913228-10e9-4e74-b392-b8be5705e53a tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1471 microversion: 2.1 time: 0.114441 Aug 06 21:24:33.950989 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2832/5482] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:33 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1471 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:33.972657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eef642cc-d721-4b3a-ae16-514d6bbaad0f tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:33.973283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eef642cc-d721-4b3a-ae16-514d6bbaad0f tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:33.979451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eef642cc-d721-4b3a-ae16-514d6bbaad0f tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:33.979943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eef642cc-d721-4b3a-ae16-514d6bbaad0f tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:33.980395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eef642cc-d721-4b3a-ae16-514d6bbaad0f tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:33.981105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eef642cc-d721-4b3a-ae16-514d6bbaad0f tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:33.981571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eef642cc-d721-4b3a-ae16-514d6bbaad0f tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:33.982005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eef642cc-d721-4b3a-ae16-514d6bbaad0f tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:34.065629 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eef642cc-d721-4b3a-ae16-514d6bbaad0f tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1622 microversion: 2.1 time: 0.097138 Aug 06 21:24:34.066205 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2651/5483] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:33 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1622 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:34.084959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-60c9a7c6-9b03-413d-98a6-89c0f4f1fc9b tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:34.085579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-60c9a7c6-9b03-413d-98a6-89c0f4f1fc9b tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:34.091732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60c9a7c6-9b03-413d-98a6-89c0f4f1fc9b tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:34.092219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60c9a7c6-9b03-413d-98a6-89c0f4f1fc9b tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:34.092662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60c9a7c6-9b03-413d-98a6-89c0f4f1fc9b tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:34.093359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60c9a7c6-9b03-413d-98a6-89c0f4f1fc9b tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:34.093819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60c9a7c6-9b03-413d-98a6-89c0f4f1fc9b tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:34.094895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-60c9a7c6-9b03-413d-98a6-89c0f4f1fc9b tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:34.232160 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-60c9a7c6-9b03-413d-98a6-89c0f4f1fc9b tempest-TestSecurityGroupsBasicOps-1720364644 tempest-TestSecurityGroupsBasicOps-1720364644-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1913 microversion: 2.1 time: 0.150913 Aug 06 21:24:34.232734 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2833/5484] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:34 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1913 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:34.298008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:34.298507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:34.304568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:34.305050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:34.305484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:34.306175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:34.306662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:34.307097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:34.332236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:24:34.410211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-501f8ac8-685e-4907-a4d6-e19e4a8005db tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 204 len: 0 microversion: 2.1 time: 0.115811 Aug 06 21:24:34.411039 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2652/5485] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:24:34 2022] DELETE /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:24:34.419856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:34.420483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:34.426614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:34.427113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:34.427551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:34.428247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:34.428707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:34.429139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:34.510776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:34.518809 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8845db2-0389-4bc4-a5e7-e17fad0615b7 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1477 microversion: 2.1 time: 0.103030 Aug 06 21:24:34.519379 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2834/5486] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:34 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1477 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:34.909486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3855353c-d8bc-4aa0-954c-3bddc30d7659 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36ac4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:34.957280 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3855353c-d8bc-4aa0-954c-3bddc30d7659 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052784 Aug 06 21:24:34.957869 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2653/5487] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:35.539992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:35.540602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:35.547477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:35.547954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:35.548455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:35.549174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:35.549656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:35.550079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:35.634729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:35.642262 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd60fe08-725c-48c2-97dd-9c2104df750e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 200 len: 1477 microversion: 2.1 time: 0.106483 Aug 06 21:24:35.642860 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2835/5488] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:35 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 1477 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:35.974572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e02b0ad9-1bc1-4cbf-a096-9ff044cf1859 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf8d940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:36.024752 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e02b0ad9-1bc1-4cbf-a096-9ff044cf1859 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054888 Aug 06 21:24:36.025721 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2654/5489] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:36.138156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-60e16e5e-eb9c-4048-923c-f3ba56aab43c req-8f6db3fd-b603-4a5e-b79f-16393f96d528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43c32f2-28e5-4cb4-87ac-270750f894b6", "name": "network-vif-deleted", "tag": "d0b1e51f-9a84-43cc-ad4a-442d0b10ae75"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:36.152548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-60e16e5e-eb9c-4048-923c-f3ba56aab43c req-8f6db3fd-b603-4a5e-b79f-16393f96d528 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:36.153033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-60e16e5e-eb9c-4048-923c-f3ba56aab43c req-8f6db3fd-b603-4a5e-b79f-16393f96d528 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:36.153569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-60e16e5e-eb9c-4048-923c-f3ba56aab43c req-8f6db3fd-b603-4a5e-b79f-16393f96d528 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:36.168556 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-60e16e5e-eb9c-4048-923c-f3ba56aab43c req-8f6db3fd-b603-4a5e-b79f-16393f96d528 service nova] Creating event network-vif-deleted:d0b1e51f-9a84-43cc-ad4a-442d0b10ae75 for instance d43c32f2-28e5-4cb4-87ac-270750f894b6 on nch2-master-1 Aug 06 21:24:36.176908 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-60e16e5e-eb9c-4048-923c-f3ba56aab43c req-8f6db3fd-b603-4a5e-b79f-16393f96d528 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045189 Aug 06 21:24:36.177940 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2836/5490] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:36.663944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:36.664958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: d43c32f2-28e5-4cb4-87ac-270750f894b6] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:36.671132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:36.671648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:36.672100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:36.672820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:36.673317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:36.673758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:36.690305 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] HTTP exception thrown: Instance d43c32f2-28e5-4cb4-87ac-270750f894b6 could not be found. Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Request method failure captured: Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 HTTP/1.1 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tvCmPmO7DboqIv2IZ16uCp3BGTKoEPu0i3a0sZSIoB4w-7yXg5l31uk_Ck3yY03qA7VNWagxEeusCWULxKNqQX8e6NY4shd39x0WKGLBN0OWsDbc9FYrCa__zsP52nRWIYD0_X87SkxQQHbOw6AREXlO-Bzm-NV7_UA58vXSpk_xgY Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 7054b60d5cc646ec87fa19bedaa69407 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1449310567 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7054b60d5cc646ec87fa19bedaa69407"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7054b60d5cc646ec87fa19bedaa69407", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7054b60d5cc646ec87fa19bedaa69407"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7054b60d5cc646ec87fa19bedaa69407"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1449310567 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 7054b60d5cc646ec87fa19bedaa69407 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1449310567 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestSecurityGroupsBasicOps-1449310567-project Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 323cbfd25ac04e829ad1c162fedf68e8 Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1449310567-project Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance d43c32f2-28e5-4cb4-87ac-270750f894b6 could not be found. Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'd43c32f2-28e5-4cb4-87ac-270750f894b6'} Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d43c32f2-28e5-4cb4-87ac-270750f894b6 could not be found. Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d43c32f2-28e5-4cb4-87ac-270750f894b6 could not be found. Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:36.691992 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d43c32f2-28e5-4cb4-87ac-270750f894b6 could not be found. Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Returning 404 to user: Instance d43c32f2-28e5-4cb4-87ac-270750f894b6 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:24:36.696403 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a46ab2a9-8b09-4169-b22d-807ae2f3b2bc tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6" status: 404 len: 111 microversion: 2.1 time: 0.033426 Aug 06 21:24:36.698875 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2655/5491] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:36 2022] GET /compute/v2.1/servers/d43c32f2-28e5-4cb4-87ac-270750f894b6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:24:37.039009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ffe03240-f58c-44d3-82db-9eeee3e7520d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c755c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:37.088324 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ffe03240-f58c-44d3-82db-9eeee3e7520d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053509 Aug 06 21:24:37.088904 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2837/5492] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:38.101784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a0b25ca-76e1-4ece-8d8d-399ec4b77bc8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d869310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:38.152889 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a0b25ca-76e1-4ece-8d8d-399ec4b77bc8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055013 Aug 06 21:24:38.153745 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2656/5493] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:39.168577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-75059ac0-820b-4ff2-9310-1c05853f51ba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a7430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:39.222290 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-75059ac0-820b-4ff2-9310-1c05853f51ba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.058811 Aug 06 21:24:39.224238 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2838/5494] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:40.238664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-210160e3-5c94-4aae-877c-1d3ef1ed1a93 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cfa2940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:40.294253 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-210160e3-5c94-4aae-877c-1d3ef1ed1a93 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.061359 Aug 06 21:24:40.295092 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2657/5495] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:40.768035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-2e27201a-db68-4311-9ac0-326ca0d321a5 req-6b9330d8-1b04-48ee-b3f6-8e85c6f1075c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f4c0fb-83c8-43ac-964c-05505c18f964", "tag": "706df1a5-8d1b-4614-89fb-5f6e236f4a8c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:40.771019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:40.771719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:40.773830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:40.780533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:40.781816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:40.782274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:40.782957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2e27201a-db68-4311-9ac0-326ca0d321a5 req-6b9330d8-1b04-48ee-b3f6-8e85c6f1075c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:40.783375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:40.783517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2e27201a-db68-4311-9ac0-326ca0d321a5 req-6b9330d8-1b04-48ee-b3f6-8e85c6f1075c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:40.783848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:40.783973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2e27201a-db68-4311-9ac0-326ca0d321a5 req-6b9330d8-1b04-48ee-b3f6-8e85c6f1075c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:40.784287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:40.796545 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-2e27201a-db68-4311-9ac0-326ca0d321a5 req-6b9330d8-1b04-48ee-b3f6-8e85c6f1075c service nova] Creating event network-changed:706df1a5-8d1b-4614-89fb-5f6e236f4a8c for instance b0f4c0fb-83c8-43ac-964c-05505c18f964 on nch1-master-1 Aug 06 21:24:40.803166 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-2e27201a-db68-4311-9ac0-326ca0d321a5 req-6b9330d8-1b04-48ee-b3f6-8e85c6f1075c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039170 Aug 06 21:24:40.804205 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2658/5496] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:40.813867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:24:40.904275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb90c19b-fee9-4f09-823e-8660e4a46923 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 204 len: 0 microversion: 2.1 time: 0.146105 Aug 06 21:24:40.905221 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2839/5497] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:24:40 2022] DELETE /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:24:40.915834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:40.916830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:40.923549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:40.924048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:40.924495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:40.925210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:40.925859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:40.926317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:41.100047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:41.108210 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ecea326b-f6ec-4f1a-acb0-50832d491c83 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1768 microversion: 2.1 time: 0.197476 Aug 06 21:24:41.108929 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2659/5498] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:40 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1768 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:41.309509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dba2bb5a-77fe-494e-b67d-21a923caf391 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:41.361009 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dba2bb5a-77fe-494e-b67d-21a923caf391 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055812 Aug 06 21:24:41.362131 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2840/5499] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:42.129269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:42.129938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:42.137325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:42.137807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:42.138310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:42.139031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:42.139488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:42.139915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:42.376847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b41ecc37-9e32-404d-b04c-fc9a5d3e52fc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a7550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:42.425347 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b41ecc37-9e32-404d-b04c-fc9a5d3e52fc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054098 Aug 06 21:24:42.425930 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2841/5500] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:24:42.490836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323cbfd25ac04e829ad1c162fedf68e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054b60d5cc646ec87fa19bedaa69407', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:24:42.498776 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-727d7297-3474-42d3-a306-269e1a8d8c4e tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 200 len: 1768 microversion: 2.1 time: 0.373369 Aug 06 21:24:42.499366 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2660/5501] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:42 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 1768 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:24:42.823161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-52d1f446-f471-4ebb-99b8-6b3f28979dfc req-dbf6d4bb-1448-48ea-bd22-67df94f1abcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f4c0fb-83c8-43ac-964c-05505c18f964", "name": "network-vif-deleted", "tag": "706df1a5-8d1b-4614-89fb-5f6e236f4a8c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:24:42.836840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-52d1f446-f471-4ebb-99b8-6b3f28979dfc req-dbf6d4bb-1448-48ea-bd22-67df94f1abcd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:42.837358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-52d1f446-f471-4ebb-99b8-6b3f28979dfc req-dbf6d4bb-1448-48ea-bd22-67df94f1abcd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:42.837801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-52d1f446-f471-4ebb-99b8-6b3f28979dfc req-dbf6d4bb-1448-48ea-bd22-67df94f1abcd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:42.851800 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-52d1f446-f471-4ebb-99b8-6b3f28979dfc req-dbf6d4bb-1448-48ea-bd22-67df94f1abcd service nova] Creating event network-vif-deleted:706df1a5-8d1b-4614-89fb-5f6e236f4a8c for instance b0f4c0fb-83c8-43ac-964c-05505c18f964 on nch1-master-1 Aug 06 21:24:42.857916 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-52d1f446-f471-4ebb-99b8-6b3f28979dfc req-dbf6d4bb-1448-48ea-bd22-67df94f1abcd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038196 Aug 06 21:24:42.858527 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2842/5502] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:43.438354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a3d53ee0-75b1-4879-a88a-52f29f30d1fb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ceb5430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:43.487020 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a3d53ee0-75b1-4879-a88a-52f29f30d1fb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052488 Aug 06 21:24:43.487613 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2661/5503] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:43.522715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:43.523421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] [instance: b0f4c0fb-83c8-43ac-964c-05505c18f964] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:24:43.530445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:43.531133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:43.531435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:43.532949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:24:43.534107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:24:43.534555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:24:43.551374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] HTTP exception thrown: Instance b0f4c0fb-83c8-43ac-964c-05505c18f964 could not be found. Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Request method failure captured: Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 HTTP/1.1 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tvCmPmO7DboqIv2IZ16uCp3BGTKoEPu0i3a0sZSIoB4w-7yXg5l31uk_Ck3yY03qA7VNWagxEeusCWULxKNqQX8e6NY4shd39x0WKGLBN0OWsDbc9FYrCa__zsP52nRWIYD0_X87SkxQQHbOw6AREXlO-Bzm-NV7_UA58vXSpk_xgY Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 7054b60d5cc646ec87fa19bedaa69407 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1449310567 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7054b60d5cc646ec87fa19bedaa69407"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7054b60d5cc646ec87fa19bedaa69407", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7054b60d5cc646ec87fa19bedaa69407"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7054b60d5cc646ec87fa19bedaa69407"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1449310567 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 7054b60d5cc646ec87fa19bedaa69407 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1449310567 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TestSecurityGroupsBasicOps-1449310567-project Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 323cbfd25ac04e829ad1c162fedf68e8 Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1449310567-project Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance b0f4c0fb-83c8-43ac-964c-05505c18f964 could not be found. Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'b0f4c0fb-83c8-43ac-964c-05505c18f964'} Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f4c0fb-83c8-43ac-964c-05505c18f964 could not be found. Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f4c0fb-83c8-43ac-964c-05505c18f964 could not be found. Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:43.553467 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f4c0fb-83c8-43ac-964c-05505c18f964 could not be found. Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Returning 404 to user: Instance b0f4c0fb-83c8-43ac-964c-05505c18f964 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ef68c64b-8c4c-40e9-b74e-007a9ef57283 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964" status: 404 len: 111 microversion: 2.1 time: 0.036467 Aug 06 21:24:43.558136 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2843/5504] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:24:43 2022] GET /compute/v2.1/servers/b0f4c0fb-83c8-43ac-964c-05505c18f964 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:24:44.502003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aa424567-f742-4e92-91a2-f59a98cb200f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9ae50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:44.552296 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aa424567-f742-4e92-91a2-f59a98cb200f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055185 Aug 06 21:24:44.552881 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2662/5505] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:45.569559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e314bf89-c44a-481e-bf70-ffae7bc3338c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c72e430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:45.683348 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e314bf89-c44a-481e-bf70-ffae7bc3338c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.118629 Aug 06 21:24:45.684597 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2844/5506] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:46.702724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2cb716c7-61b2-483b-b0cd-b903ff2fd43a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d89a940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:46.760322 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2cb716c7-61b2-483b-b0cd-b903ff2fd43a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.066763 Aug 06 21:24:46.761268 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2663/5507] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:24:47.066916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1074ea8d-24ca-461f-986f-437927ea5f47 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] Calling method '.version_select at 0x7f729c6a7550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:47.088718 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1074ea8d-24ca-461f-986f-437927ea5f47 tempest-TestSecurityGroupsBasicOps-1449310567 tempest-TestSecurityGroupsBasicOps-1449310567-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-769382803" status: 202 len: 0 microversion: 2.1 time: 0.025574 Aug 06 21:24:47.089298 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2845/5508] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:24:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-769382803 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:24:47.776052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a536b615-0109-4442-86b7-b10fe88af3fa tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:47.827079 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a536b615-0109-4442-86b7-b10fe88af3fa tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055610 Aug 06 21:24:47.833621 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2664/5509] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:48.841680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aa74bf42-667e-434e-86ba-5846c507bf44 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7290d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:48.894264 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aa74bf42-667e-434e-86ba-5846c507bf44 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057504 Aug 06 21:24:48.895286 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2846/5510] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:24:49.909527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-014cdbe1-dd98-4c9e-979a-7cf3e1d633e2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d8695e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:49.958704 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-014cdbe1-dd98-4c9e-979a-7cf3e1d633e2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054790 Aug 06 21:24:49.959306 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2665/5511] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:50.973409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87670f7a-deba-4427-b7ea-b8275a1ba2bc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:51.020782 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-87670f7a-deba-4427-b7ea-b8275a1ba2bc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052231 Aug 06 21:24:51.021356 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2847/5512] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:52.035619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d1f473a7-73b0-4b68-8a3a-6d04deffe3e9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b34c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:52.083312 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d1f473a7-73b0-4b68-8a3a-6d04deffe3e9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053084 Aug 06 21:24:52.089687 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2666/5513] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:53.099939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8dba59dd-6e3f-4687-8ac7-2d8996267ed3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:53.145583 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8dba59dd-6e3f-4687-8ac7-2d8996267ed3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050961 Aug 06 21:24:53.146183 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2848/5514] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:54.156422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:54.157268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:54.162833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eb93db27-e537-47a5-aa01-d3b2e5862ac8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cfa2c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:54.210747 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eb93db27-e537-47a5-aa01-d3b2e5862ac8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055041 Aug 06 21:24:54.211331 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2667/5515] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:55.221503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:55.227025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6dcf440-558b-4d2d-82fb-7376c517e09a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7290d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:55.277448 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6dcf440-558b-4d2d-82fb-7376c517e09a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056648 Aug 06 21:24:55.278196 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2849/5516] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:56.293182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-502c8238-ebde-4dfe-8d23-cf06eb3edcff tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf415e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:56.339818 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-502c8238-ebde-4dfe-8d23-cf06eb3edcff tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051683 Aug 06 21:24:56.340397 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2668/5517] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:57.351036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:24:57.354873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32e313d7-c5a6-48f2-b40b-c5de63d7d00f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c25e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:57.402851 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32e313d7-c5a6-48f2-b40b-c5de63d7d00f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053470 Aug 06 21:24:57.403427 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2850/5518] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:58.417798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-07d23d6b-6d1c-4ee9-8767-0f9184c4d7aa tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a354e550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:58.464092 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-07d23d6b-6d1c-4ee9-8767-0f9184c4d7aa tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051317 Aug 06 21:24:58.464664 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2669/5519] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:24:59.477915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5c6daad1-56cf-48fd-b9d2-dd9c05196c1f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c694f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:24:59.524238 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5c6daad1-56cf-48fd-b9d2-dd9c05196c1f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051033 Aug 06 21:24:59.524889 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2851/5520] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:24:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:00.538040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c51a6a90-2640-4719-9ed7-6c218a66365b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:00.585519 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c51a6a90-2640-4719-9ed7-6c218a66365b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052102 Aug 06 21:25:00.586102 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2670/5521] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:01.600262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9a4ff474-5d2f-4be3-b963-d00ded7a6416 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c816a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:01.647448 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9a4ff474-5d2f-4be3-b963-d00ded7a6416 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051673 Aug 06 21:25:01.654238 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2852/5522] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:02.663165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-122cc161-8cf3-4653-83cc-4282dcaee7be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d869160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:02.710424 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-122cc161-8cf3-4653-83cc-4282dcaee7be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051948 Aug 06 21:25:02.711727 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2671/5523] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:03.725631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-96bff9a3-9181-447a-8d10-141d80251d08 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c729160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:03.774646 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-96bff9a3-9181-447a-8d10-141d80251d08 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053576 Aug 06 21:25:03.775223 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2853/5524] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:04.789718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-06364413-1b00-46ba-8bcf-b5a858215973 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf44160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:04.840148 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-06364413-1b00-46ba-8bcf-b5a858215973 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055756 Aug 06 21:25:04.840767 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2672/5525] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:05.854650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67a13af4-4975-4190-81d0-fe7457716331 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a89d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:05.901171 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67a13af4-4975-4190-81d0-fe7457716331 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051239 Aug 06 21:25:05.901742 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2854/5526] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:06.916503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-210a7179-b6c5-4b9f-aedf-09ccd3de9fe2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cee73a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:06.964074 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-210a7179-b6c5-4b9f-aedf-09ccd3de9fe2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052412 Aug 06 21:25:06.964651 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2673/5527] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:07.979057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-340e018e-ba35-4336-881f-df52f52d43c2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c694040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:08.025932 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-340e018e-ba35-4336-881f-df52f52d43c2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051642 Aug 06 21:25:08.026506 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2855/5528] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:09.040936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c49bf8ed-cc3c-4ebe-9a0b-b8ab2d671a49 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:09.088845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c49bf8ed-cc3c-4ebe-9a0b-b8ab2d671a49 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052900 Aug 06 21:25:09.089426 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2674/5529] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:10.103904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-22f9d94b-b6f0-4dcc-802b-10751c94aee1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7784c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:10.151937 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-22f9d94b-b6f0-4dcc-802b-10751c94aee1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052628 Aug 06 21:25:10.152521 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2856/5530] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:11.166572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7ed1bdb2-38c2-4999-ba96-c7beab3fb922 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1da60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:11.214052 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7ed1bdb2-38c2-4999-ba96-c7beab3fb922 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052500 Aug 06 21:25:11.214670 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2675/5531] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:12.229450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-901c4159-f004-4ebe-ba13-7dd443e57d5e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c72e670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:12.277977 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-901c4159-f004-4ebe-ba13-7dd443e57d5e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053211 Aug 06 21:25:12.278564 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2857/5532] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:13.293141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15c04b85-b2b9-4fe5-b6ba-824df02236e3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9adc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:13.344581 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15c04b85-b2b9-4fe5-b6ba-824df02236e3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056365 Aug 06 21:25:13.345168 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2676/5533] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:14.360070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87c14888-4715-4c3d-87f3-6257cdcf6b4a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdbf430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:14.407724 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-87c14888-4715-4c3d-87f3-6257cdcf6b4a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053011 Aug 06 21:25:14.408298 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2858/5534] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:15.422268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-297e5fde-2153-4878-ac79-0ef31eec3a2e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cee7430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:15.469939 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-297e5fde-2153-4878-ac79-0ef31eec3a2e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052518 Aug 06 21:25:15.470517 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2677/5535] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:16.484549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5a9fbea-487f-476a-898a-3c47118df419 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c694040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:16.530675 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5a9fbea-487f-476a-898a-3c47118df419 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050841 Aug 06 21:25:16.537720 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2859/5536] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:17.546380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f6ec2426-2b31-4b18-b31d-c097c8f8b5f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c9e2700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:17.593742 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f6ec2426-2b31-4b18-b31d-c097c8f8b5f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052154 Aug 06 21:25:17.595128 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2678/5537] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:18.609259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-924283d1-9ddf-4862-a731-292e57bb127d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343a160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:18.659666 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-924283d1-9ddf-4862-a731-292e57bb127d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055035 Aug 06 21:25:18.660288 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2860/5538] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:19.674669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d184ef20-c650-457b-89b5-b16a36d57649 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:19.722326 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d184ef20-c650-457b-89b5-b16a36d57649 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053054 Aug 06 21:25:19.722968 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2679/5539] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:20.736727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-715b5a5f-ac9c-4425-a249-67c89b4d2c04 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c729820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:20.784482 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-715b5a5f-ac9c-4425-a249-67c89b4d2c04 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052463 Aug 06 21:25:20.785057 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2861/5540] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:21.800567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c968c0ab-cadf-4e5f-8cf8-d18379904866 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a34ca940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:21.847704 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c968c0ab-cadf-4e5f-8cf8-d18379904866 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052902 Aug 06 21:25:21.848273 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2680/5541] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:25:22.862997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e3be6dd2-18f0-45fc-8dbd-68e862e042bb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d609700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:22.908710 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e3be6dd2-18f0-45fc-8dbd-68e862e042bb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051291 Aug 06 21:25:22.909276 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2862/5542] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:23.923073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7ce9dbd-81a9-4d25-85e7-14653384690e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:23.970490 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7ce9dbd-81a9-4d25-85e7-14653384690e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051968 Aug 06 21:25:23.971128 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2681/5543] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:24.985114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66d6cbb3-537a-454b-b2ef-7c316678d193 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c816ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:25.031599 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66d6cbb3-537a-454b-b2ef-7c316678d193 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051114 Aug 06 21:25:25.032176 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2863/5544] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:26.047497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b3a9524d-d945-4158-b19f-2a54a068a68e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35a3160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:26.094495 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b3a9524d-d945-4158-b19f-2a54a068a68e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051910 Aug 06 21:25:26.095203 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2682/5545] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:27.109779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9a051818-713d-43e9-9946-769dbd72bdf5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:27.158333 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9a051818-713d-43e9-9946-769dbd72bdf5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052691 Aug 06 21:25:27.159116 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2864/5546] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:28.174498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d0049f5f-b4cd-481d-aeac-c1c6f5f9c7af tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:28.224017 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d0049f5f-b4cd-481d-aeac-c1c6f5f9c7af tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055411 Aug 06 21:25:28.224605 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2683/5547] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:29.238217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fe31e0fc-6b74-420b-b800-3b8964f68ab6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d609d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:29.285378 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fe31e0fc-6b74-420b-b800-3b8964f68ab6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051907 Aug 06 21:25:29.285978 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2865/5548] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:30.300339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d5c913bf-d485-4760-9388-3e425f658ea0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cfa2820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:30.348009 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d5c913bf-d485-4760-9388-3e425f658ea0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052434 Aug 06 21:25:30.348587 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2684/5549] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:31.362238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-97c7d21e-3a24-434f-ac08-b63fa671b723 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cd92670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:31.409786 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-97c7d21e-3a24-434f-ac08-b63fa671b723 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052412 Aug 06 21:25:31.410350 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2866/5550] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:32.424547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c613987-586c-4c21-856c-88f9aa96f785 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:32.473322 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3c613987-586c-4c21-856c-88f9aa96f785 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053432 Aug 06 21:25:32.473917 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2685/5551] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:33.488227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d684f79-fde9-4c46-a2f3-dac0ea752c3a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c755430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:33.535199 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d684f79-fde9-4c46-a2f3-dac0ea752c3a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051934 Aug 06 21:25:33.535780 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2867/5552] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:34.550312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-18b47434-edfb-4dad-a718-3e609ad3de43 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d8d9550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:34.596805 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-18b47434-edfb-4dad-a718-3e609ad3de43 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050734 Aug 06 21:25:34.597394 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2686/5553] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:25:35.611612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6c3c2a7b-4253-491f-a861-3bb8d16a9678 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cd42c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:35.660821 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6c3c2a7b-4253-491f-a861-3bb8d16a9678 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054016 Aug 06 21:25:35.661398 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2868/5554] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:36.676760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4b9de57f-4236-47ed-b51e-ba5e4a2b2e3a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:36.723603 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4b9de57f-4236-47ed-b51e-ba5e4a2b2e3a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052066 Aug 06 21:25:36.724503 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2687/5555] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:37.739211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-03def6ef-843b-4442-a80e-599e0bcbc51b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7858b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:37.787724 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-03def6ef-843b-4442-a80e-599e0bcbc51b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054313 Aug 06 21:25:37.788559 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2869/5556] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:38.802855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5e30df37-c769-442c-a2cc-839db57ae58d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf44ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:38.850353 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5e30df37-c769-442c-a2cc-839db57ae58d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052413 Aug 06 21:25:38.850977 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2688/5557] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:39.865266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ff1d2647-ff07-4650-aaf0-aa33857cc8da tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35ba670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:39.913374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ff1d2647-ff07-4650-aaf0-aa33857cc8da tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052710 Aug 06 21:25:39.914090 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2870/5558] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:40.928789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d24a92be-5405-47b7-b47d-9aa0ebf484c0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cee7700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:40.974583 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d24a92be-5405-47b7-b47d-9aa0ebf484c0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051124 Aug 06 21:25:40.975151 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2689/5559] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:41.989756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e961a2c9-0857-4c13-a218-5599c6e91cef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:42.035796 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e961a2c9-0857-4c13-a218-5599c6e91cef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051251 Aug 06 21:25:42.036364 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2871/5560] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:43.050170 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f6d5f24-97e0-4953-aac6-2313371017cb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf19ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:43.096930 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f6d5f24-97e0-4953-aac6-2313371017cb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051577 Aug 06 21:25:43.097507 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2690/5561] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:25:44.112221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-06c81a9b-841f-4747-89e4-4491ed39bfda tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343ac10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:44.161098 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-06c81a9b-841f-4747-89e4-4491ed39bfda tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054273 Aug 06 21:25:44.161670 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2872/5562] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:45.176622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ff3ee93-94bf-4fac-b48b-04c0942dca3a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729e1ca940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:45.231720 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1ff3ee93-94bf-4fac-b48b-04c0942dca3a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.060398 Aug 06 21:25:45.232558 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2691/5563] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:46.247118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-afe47f61-005a-4c79-910d-c43376ec0822 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35ba8b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:46.296103 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-afe47f61-005a-4c79-910d-c43376ec0822 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053570 Aug 06 21:25:46.296706 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2873/5564] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:47.310195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c282fc82-f26d-4605-9978-9b3a082b3c54 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0a160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:47.360890 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c282fc82-f26d-4605-9978-9b3a082b3c54 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055474 Aug 06 21:25:47.368141 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2692/5565] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:48.376371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-627dfea3-c2e1-40dc-8e79-8c9c9db05137 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdbf4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:48.426772 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-627dfea3-c2e1-40dc-8e79-8c9c9db05137 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055121 Aug 06 21:25:48.427398 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2874/5566] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:49.441949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c651c30-085c-4248-9ae8-a6fdc3ce1b6d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35a4280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:49.489417 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c651c30-085c-4248-9ae8-a6fdc3ce1b6d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052904 Aug 06 21:25:49.489998 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2693/5567] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:50.504912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dce097d5-37fe-4083-a796-a186e696be8c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:50.553649 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dce097d5-37fe-4083-a796-a186e696be8c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054370 Aug 06 21:25:50.554221 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2875/5568] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:25:51.568348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-abb34452-bd28-4364-bf27-c702e6536ce6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ef86c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:51.616134 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-abb34452-bd28-4364-bf27-c702e6536ce6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052447 Aug 06 21:25:51.622382 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2694/5569] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:52.630354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4798311a-793c-4edd-9867-238af4564cd4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d778550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:52.681411 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4798311a-793c-4edd-9867-238af4564cd4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056116 Aug 06 21:25:52.681991 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2876/5570] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:53.698208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d0e6e25-5c0f-4c2d-850f-cad9b5cdf04d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729e1ca940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:53.748926 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d0e6e25-5c0f-4c2d-850f-cad9b5cdf04d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056418 Aug 06 21:25:53.749507 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2695/5571] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:54.764053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb8937d1-2ee6-4347-984f-a76dff92a50e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35ba3a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:54.811791 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb8937d1-2ee6-4347-984f-a76dff92a50e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052485 Aug 06 21:25:54.812366 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2877/5572] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:55.827192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4d7141db-c636-44ce-98aa-7239c3fa1f68 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf39c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:55.878050 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4d7141db-c636-44ce-98aa-7239c3fa1f68 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055001 Aug 06 21:25:55.878696 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2696/5573] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:56.892555 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6b2fcf86-5d53-4045-8b60-76107cd019f7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:56.940839 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6b2fcf86-5d53-4045-8b60-76107cd019f7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052855 Aug 06 21:25:56.941404 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2878/5574] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:25:57.698046 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:25:57.698486 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:25:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:25:57.956502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-77298f03-4472-401d-8360-bc8f4f396ee9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0aaf0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:58.003675 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-77298f03-4472-401d-8360-bc8f4f396ee9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052545 Aug 06 21:25:58.004271 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2697/5575] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:25:59.017315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b59a0139-ed69-4d50-82c5-5cd7e0c4aac2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:25:59.063786 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b59a0139-ed69-4d50-82c5-5cd7e0c4aac2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051133 Aug 06 21:25:59.064344 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2879/5576] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:25:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:00.079000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f0a0e02-54b5-4863-9410-e8be9cb068b9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:00.125523 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f0a0e02-54b5-4863-9410-e8be9cb068b9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051473 Aug 06 21:26:00.126101 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2698/5577] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:01.140166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da963869-e3b1-4459-84ce-779351400b65 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7b04c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:01.186788 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da963869-e3b1-4459-84ce-779351400b65 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051384 Aug 06 21:26:01.187360 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2880/5578] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:02.202570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9720b24b-8afc-4f78-8ab2-febd622f8c42 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf59310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:02.249952 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9720b24b-8afc-4f78-8ab2-febd622f8c42 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052925 Aug 06 21:26:02.250522 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2699/5579] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:03.265435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-399785b1-4e88-4130-b1f4-48c0ad268680 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35baca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:03.312875 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-399785b1-4e88-4130-b1f4-48c0ad268680 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052259 Aug 06 21:26:03.313465 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2881/5580] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:04.328638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-26ee90f7-03df-4aff-8ad6-c5ee3da6ef85 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf44670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:04.376077 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-26ee90f7-03df-4aff-8ad6-c5ee3da6ef85 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052468 Aug 06 21:26:04.376730 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2700/5581] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:26:05.391260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b2b85748-47d4-4ee2-b69c-8f617b6c814c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c21f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:05.440659 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b2b85748-47d4-4ee2-b69c-8f617b6c814c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054135 Aug 06 21:26:05.441233 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2882/5582] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:06.456063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-26982ed4-880d-4b16-a9c8-74559c3aa3f1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0ab80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:06.503284 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-26982ed4-880d-4b16-a9c8-74559c3aa3f1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051966 Aug 06 21:26:06.503863 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2701/5583] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:07.517035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-61a06178-a7ef-46bd-a2ba-fd9813b49087 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdbf670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:07.564154 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-61a06178-a7ef-46bd-a2ba-fd9813b49087 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050890 Aug 06 21:26:07.564738 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2883/5584] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:08.579277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c167234b-d5a9-483b-a63d-766b04640fb2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf095e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:08.626856 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c167234b-d5a9-483b-a63d-766b04640fb2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053420 Aug 06 21:26:08.627436 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2702/5585] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:09.641440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ed7739e-ec4b-45a5-85f1-9f5d3c4d3534 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c787af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:09.690245 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7ed7739e-ec4b-45a5-85f1-9f5d3c4d3534 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053185 Aug 06 21:26:09.691492 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2884/5586] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:26:10.707481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a98d6c7d-5de2-49fb-9cf5-3feaa629b140 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ef86c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:10.756582 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a98d6c7d-5de2-49fb-9cf5-3feaa629b140 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054348 Aug 06 21:26:10.757165 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2703/5587] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:11.772771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b439092c-97ba-4259-9db4-19ed919bc746 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35ba3a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:11.818695 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b439092c-97ba-4259-9db4-19ed919bc746 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051842 Aug 06 21:26:11.819267 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2885/5588] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:12.833908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e98eee32-37c3-4f1f-be1a-67140c057f32 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d869dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:12.880743 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e98eee32-37c3-4f1f-be1a-67140c057f32 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052062 Aug 06 21:26:12.881318 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2704/5589] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:13.896537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1682afcc-0fd8-445b-b6a3-776f85847d3b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:13.943592 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1682afcc-0fd8-445b-b6a3-776f85847d3b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052877 Aug 06 21:26:13.944244 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2886/5590] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:14.958821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0833ff47-63fb-46d5-80d0-52690355b7d4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf593a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:15.005969 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0833ff47-63fb-46d5-80d0-52690355b7d4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052357 Aug 06 21:26:15.006561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2705/5591] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:16.020667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f76b95e9-e543-4639-bc14-cde559be4c0e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:16.077203 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f76b95e9-e543-4639-bc14-cde559be4c0e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.061146 Aug 06 21:26:16.077818 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2887/5592] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:17.092428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f715b42-febf-416d-8aeb-a33229e06ced tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a3634790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:17.139197 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f715b42-febf-416d-8aeb-a33229e06ced tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051482 Aug 06 21:26:17.139770 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2706/5593] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:18.153601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5341e961-fc92-488c-a18a-3ba5f4adc1ef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:18.200869 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5341e961-fc92-488c-a18a-3ba5f4adc1ef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052011 Aug 06 21:26:18.201786 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2888/5594] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:19.217115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f0cf36c6-43ad-400e-8e39-4eb1535fe58c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf59d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:19.263431 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f0cf36c6-43ad-400e-8e39-4eb1535fe58c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051351 Aug 06 21:26:19.264053 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2707/5595] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:20.279171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-434cd31e-3b24-45b1-a416-ca8c7a561c54 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35ba4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:20.326533 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-434cd31e-3b24-45b1-a416-ca8c7a561c54 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052129 Aug 06 21:26:20.327134 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2889/5596] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:21.340838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-08d37d44-850c-4b7f-a6b2-c4d36476c9a1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cee79d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:21.389362 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-08d37d44-850c-4b7f-a6b2-c4d36476c9a1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053271 Aug 06 21:26:21.390023 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2708/5597] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:26:22.404071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b7f899c-0ae6-450b-82b1-a513c6dea9f9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cd423a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:22.451821 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b7f899c-0ae6-450b-82b1-a513c6dea9f9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052745 Aug 06 21:26:22.452407 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2890/5598] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:23.466977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7624dbec-f4c8-4c8c-a6d6-2dff550f5391 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0a0d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:23.516782 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7624dbec-f4c8-4c8c-a6d6-2dff550f5391 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054430 Aug 06 21:26:23.517397 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2709/5599] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:24.531646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f12ed297-f005-41be-bddb-9a5313f1d52f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7b00d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:24.576897 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f12ed297-f005-41be-bddb-9a5313f1d52f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050058 Aug 06 21:26:24.577555 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2891/5600] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:25.592155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-929e1190-fc32-4a8f-bc8a-e8ae485c1097 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a34eadc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:25.638395 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-929e1190-fc32-4a8f-bc8a-e8ae485c1097 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050865 Aug 06 21:26:25.638998 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2710/5601] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:26.653844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa4048cc-2245-410c-85cd-101ef4b0cd49 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:26.703484 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa4048cc-2245-410c-85cd-101ef4b0cd49 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054347 Aug 06 21:26:26.704068 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2892/5602] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:27.717894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ea053c40-ec68-48c7-9bea-36cfb221fff9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf59820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:27.763752 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ea053c40-ec68-48c7-9bea-36cfb221fff9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050566 Aug 06 21:26:27.764336 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2711/5603] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:28.779653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-81d64d2b-1d40-49ba-9e3c-2dbe15b0ba59 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:28.827311 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-81d64d2b-1d40-49ba-9e3c-2dbe15b0ba59 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052315 Aug 06 21:26:28.827883 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2893/5604] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:29.842783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28586c6a-b736-49c0-861f-812cf6d845df tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:29.889127 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28586c6a-b736-49c0-861f-812cf6d845df tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051190 Aug 06 21:26:29.889700 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2712/5605] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:30.903729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aa6a78de-4f17-4da6-b1e7-09b45eea33db tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6525e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:30.950570 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aa6a78de-4f17-4da6-b1e7-09b45eea33db tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051608 Aug 06 21:26:30.951150 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2894/5606] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:31.965282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-87e870ea-fc44-47ad-ba92-fa0b810caafb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf59670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:32.014076 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-87e870ea-fc44-47ad-ba92-fa0b810caafb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053469 Aug 06 21:26:32.014688 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2713/5607] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:33.029314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-48604c12-df25-4e82-8415-ed2ee8237497 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7559d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:33.074973 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-48604c12-df25-4e82-8415-ed2ee8237497 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050388 Aug 06 21:26:33.075573 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2895/5608] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:34.090342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b2607ff-cc44-49ee-8627-b2f9b3105184 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d8b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:34.138630 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b2607ff-cc44-49ee-8627-b2f9b3105184 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052881 Aug 06 21:26:34.139205 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2714/5609] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:35.153400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e50420c6-5cbb-4dd1-8403-380b53c069bd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c2430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:35.200498 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e50420c6-5cbb-4dd1-8403-380b53c069bd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051776 Aug 06 21:26:35.201059 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2896/5610] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:36.215888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a19a6ef4-844d-43b0-932e-e3471eacbf37 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:36.262360 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a19a6ef4-844d-43b0-932e-e3471eacbf37 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051465 Aug 06 21:26:36.263023 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2715/5611] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:37.278052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f00d237-5b9b-4bef-9ddf-0d78a01f6fe9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c652550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:37.324824 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f00d237-5b9b-4bef-9ddf-0d78a01f6fe9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051424 Aug 06 21:26:37.325388 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2897/5612] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:38.340207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-16030790-b180-4632-b6bd-e7165fda5128 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729dd46d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:38.387201 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-16030790-b180-4632-b6bd-e7165fda5128 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051667 Aug 06 21:26:38.387779 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2716/5613] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:39.402103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2060f905-43cd-43e3-87ee-e90cd73e3f4e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c694310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:39.451253 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2060f905-43cd-43e3-87ee-e90cd73e3f4e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053805 Aug 06 21:26:39.451822 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2898/5614] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:40.466270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-27acbde4-6885-4f59-b77c-3a00cad1a6e8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf59d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:40.517012 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-27acbde4-6885-4f59-b77c-3a00cad1a6e8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055103 Aug 06 21:26:40.517595 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2717/5615] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:41.531724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ddd20b38-322a-467e-b9bd-a677f137385f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c755ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:41.578066 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ddd20b38-322a-467e-b9bd-a677f137385f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051114 Aug 06 21:26:41.578674 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2899/5616] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:42.592740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-505a3025-ce72-4b0a-9a3d-28926e3b0b6c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cc1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:42.638663 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-505a3025-ce72-4b0a-9a3d-28926e3b0b6c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050478 Aug 06 21:26:42.639246 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2718/5617] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:43.653874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7df49a1d-1eac-4f93-a6e4-c613d552e92b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7d8b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:43.701500 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7df49a1d-1eac-4f93-a6e4-c613d552e92b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052414 Aug 06 21:26:43.702069 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2900/5618] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:44.718102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68aa8352-b2ae-4b09-90be-e8bc841d87cc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c9e2310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:44.763293 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-68aa8352-b2ae-4b09-90be-e8bc841d87cc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.049831 Aug 06 21:26:44.763864 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2719/5619] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:45.778719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-842ca429-b3a8-4dc3-90e6-0fd959c0947e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c652160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:45.825436 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-842ca429-b3a8-4dc3-90e6-0fd959c0947e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051434 Aug 06 21:26:45.826010 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2901/5620] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:46.840174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-304bfeab-abed-41e2-bc76-8443e15f2cba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d1c3ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:46.889550 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-304bfeab-abed-41e2-bc76-8443e15f2cba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053989 Aug 06 21:26:46.890133 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2720/5621] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:47.903469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cce54904-bc96-409d-8c3c-8bc69f60f9c0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d778040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:47.950135 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cce54904-bc96-409d-8c3c-8bc69f60f9c0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051428 Aug 06 21:26:47.950722 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2902/5622] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:48.965470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ba564117-44a6-4f1d-b774-ceb03454d841 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cc1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:49.011147 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ba564117-44a6-4f1d-b774-ceb03454d841 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050264 Aug 06 21:26:49.011719 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2721/5623] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:50.026745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d209fbdf-6886-42bb-84a6-72c51153b1ce tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c755dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:50.072460 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d209fbdf-6886-42bb-84a6-72c51153b1ce tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050334 Aug 06 21:26:50.073030 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2903/5624] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:51.089125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55f77a29-741f-4ce5-a62e-969c7796917f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729dd46d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:51.136564 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55f77a29-741f-4ce5-a62e-969c7796917f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052678 Aug 06 21:26:51.137144 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2722/5625] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:52.151539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc2e627e-0d52-4c00-a1d4-ac3cc8a1fe72 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729dc06550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:52.198312 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc2e627e-0d52-4c00-a1d4-ac3cc8a1fe72 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051645 Aug 06 21:26:52.198929 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2904/5626] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:53.213091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-523c83a2-2f81-45ad-a15c-aecb4684a641 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a361a280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:53.258665 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-523c83a2-2f81-45ad-a15c-aecb4684a641 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050196 Aug 06 21:26:53.259237 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2723/5627] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:54.273861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-badaf765-53ff-4848-93b2-4f0d2da63fe3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78caf0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:54.320256 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-badaf765-53ff-4848-93b2-4f0d2da63fe3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051502 Aug 06 21:26:54.320826 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2905/5628] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:55.334626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a98ae3db-471f-478a-9afc-f3246dd13649 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:55.386595 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a98ae3db-471f-478a-9afc-f3246dd13649 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056754 Aug 06 21:26:55.387172 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2724/5629] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:56.401781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c23e8c1-f338-49f1-ab0a-0c7bd94bb187 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:56.449280 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2c23e8c1-f338-49f1-ab0a-0c7bd94bb187 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052621 Aug 06 21:26:56.449857 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2906/5630] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:57.464849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e64718c6-e85d-4964-bf0a-bb2eda1afcf1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf27ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:57.511246 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e64718c6-e85d-4964-bf0a-bb2eda1afcf1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051256 Aug 06 21:26:57.512446 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2725/5631] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:58.528733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd5379f2-0a45-43c4-8f88-bf44f0d932b7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7559d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:58.575006 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd5379f2-0a45-43c4-8f88-bf44f0d932b7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052761 Aug 06 21:26:58.575599 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2907/5632] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:26:59.590039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9558b601-13ce-478e-9286-ec8f75a61d17 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:26:59.636794 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9558b601-13ce-478e-9286-ec8f75a61d17 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051410 Aug 06 21:26:59.637369 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2726/5633] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:26:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:00.651757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92d759b1-aaaa-4882-92da-6725509f7721 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343a1f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:00.699409 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92d759b1-aaaa-4882-92da-6725509f7721 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052363 Aug 06 21:27:00.699981 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2908/5634] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:01.716089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bfc09dd6-b535-445f-9e79-bdf828947fb5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a361a3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:01.762580 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bfc09dd6-b535-445f-9e79-bdf828947fb5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051960 Aug 06 21:27:01.763170 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2727/5635] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:02.778287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6f224139-255b-4471-a823-86c3ad52c897 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78cd30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:02.825867 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6f224139-255b-4471-a823-86c3ad52c897 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052292 Aug 06 21:27:02.826518 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2909/5636] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:03.841429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e8c899e0-dd95-49a4-ab06-519863278579 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36acaf0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:03.887784 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e8c899e0-dd95-49a4-ab06-519863278579 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051255 Aug 06 21:27:03.888359 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2728/5637] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:04.017677 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:27:04.018203 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:27:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:27:04.902741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5adcadf-33ce-4332-9898-d71753b539b4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729db09ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:04.949349 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5adcadf-33ce-4332-9898-d71753b539b4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051949 Aug 06 21:27:04.949914 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2910/5638] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:05.964343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d8b07067-d6a5-4754-a5af-5dad0295569c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ef86c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:06.013848 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d8b07067-d6a5-4754-a5af-5dad0295569c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054256 Aug 06 21:27:06.014474 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2729/5639] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:27:07.029429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab576a45-d278-40da-a303-50a75beaf7be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c755e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:07.075208 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab576a45-d278-40da-a303-50a75beaf7be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050408 Aug 06 21:27:07.075757 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2911/5640] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:07.287584 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:27:07.288107 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:27:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:27:08.091124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33a61143-dd48-4c66-a1b5-1763e31574a8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a3641430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:08.138693 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33a61143-dd48-4c66-a1b5-1763e31574a8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052446 Aug 06 21:27:08.139281 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2730/5641] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:09.153467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-31e6e1de-59a1-413c-9835-5c74ad6326a6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daa4ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:09.200268 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-31e6e1de-59a1-413c-9835-5c74ad6326a6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051509 Aug 06 21:27:09.200834 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2912/5642] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:27:10.214025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-652d3f7d-716f-4ede-b066-ad9fda3a5421 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a361a0d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:10.261667 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-652d3f7d-716f-4ede-b066-ad9fda3a5421 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052238 Aug 06 21:27:10.262255 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2731/5643] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:11.277173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1c1ddec4-3d08-45e7-86f5-a9e0dddfd4c9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:11.323069 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1c1ddec4-3d08-45e7-86f5-a9e0dddfd4c9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050555 Aug 06 21:27:11.323667 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2913/5644] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:12.338212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8ff27fed-81db-4054-8646-eba0cf901838 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d94ee50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:12.384500 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8ff27fed-81db-4054-8646-eba0cf901838 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051221 Aug 06 21:27:12.385123 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2732/5645] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:27:13.399312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80b1cdf4-5558-4c6f-895e-458b560e280d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:13.446043 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80b1cdf4-5558-4c6f-895e-458b560e280d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051507 Aug 06 21:27:13.446695 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2914/5646] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:14.460884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-11389373-a1c8-48cc-8b52-e2c178bd26b5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cce50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:14.507638 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-11389373-a1c8-48cc-8b52-e2c178bd26b5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051425 Aug 06 21:27:14.508207 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2733/5647] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:15.523297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9e82015-a450-4e58-8865-a506b72192dd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c8b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:15.575055 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9e82015-a450-4e58-8865-a506b72192dd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056236 Aug 06 21:27:15.575811 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2915/5648] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:16.592234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c048dc4e-dae2-45bd-b928-ec7b40a7460d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cfa2820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:16.639683 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c048dc4e-dae2-45bd-b928-ec7b40a7460d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052372 Aug 06 21:27:16.640265 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2734/5649] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:16.957418 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:27:16.957925 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:27:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:27:17.654040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e99286d-4f1c-4896-939d-43eccddd386c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdccd30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:17.705230 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e99286d-4f1c-4896-939d-43eccddd386c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055201 Aug 06 21:27:17.705828 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2916/5650] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:18.721148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-35356008-6019-492d-b0d5-0fbf11dc233d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d94e160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:18.766260 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-35356008-6019-492d-b0d5-0fbf11dc233d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050591 Aug 06 21:27:18.766854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2735/5651] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:19.781558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ad197e30-21d1-4991-836f-54b0b2b43f86 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daa4430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:19.827866 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ad197e30-21d1-4991-836f-54b0b2b43f86 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050960 Aug 06 21:27:19.828428 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2917/5652] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:20.842842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9cd3c389-ec7f-4445-a518-34a57786f2a4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0ab80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:20.889332 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9cd3c389-ec7f-4445-a518-34a57786f2a4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051194 Aug 06 21:27:20.889936 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2736/5653] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:21.903324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e873a4ba-6692-4061-b91a-772e16572e6e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c72ec10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:21.950316 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e873a4ba-6692-4061-b91a-772e16572e6e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051654 Aug 06 21:27:21.950922 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2918/5654] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:22.965122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-84a35d61-af5e-41bf-b1ae-55bd30857aa7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf415e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:23.012094 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-84a35d61-af5e-41bf-b1ae-55bd30857aa7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051810 Aug 06 21:27:23.012674 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2737/5655] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:24.027533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2bbf4387-5c73-491d-b1ee-cc5a7670b7f4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:24.074019 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2bbf4387-5c73-491d-b1ee-cc5a7670b7f4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052266 Aug 06 21:27:24.074598 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2919/5656] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:25.088742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8923f3af-31f8-4cca-9f4c-977a302f7401 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf44670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:25.134211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8923f3af-31f8-4cca-9f4c-977a302f7401 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050166 Aug 06 21:27:25.135217 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2738/5657] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:26.149715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71e6c087-ffa2-411a-9b65-b8a84c0a3be3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdbfdc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:26.196267 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71e6c087-ffa2-411a-9b65-b8a84c0a3be3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051345 Aug 06 21:27:26.196830 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2920/5658] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:27.211012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-65b37161-f763-49c7-bc62-0494d7fa3fc3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cc430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:27.256924 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-65b37161-f763-49c7-bc62-0494d7fa3fc3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050656 Aug 06 21:27:27.257504 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2739/5659] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:28.272153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-956d876d-d91a-4913-95c2-e230d73dc7de tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daa4430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:28.317632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-956d876d-d91a-4913-95c2-e230d73dc7de tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050726 Aug 06 21:27:28.318192 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2921/5660] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:29.332932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8f3bc92d-49f3-40aa-9132-56a196f019f3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:29.380114 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8f3bc92d-49f3-40aa-9132-56a196f019f3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052545 Aug 06 21:27:29.380811 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2740/5661] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:29.771753 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:27:29.771964 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:27:30.394976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e001c93b-d7ab-42e2-a3ad-b2d676139139 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:30.441844 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e001c93b-d7ab-42e2-a3ad-b2d676139139 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052459 Aug 06 21:27:30.442427 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2922/5662] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:31.457103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f2410d4-3a2e-4274-b84b-fb2e655cc0d8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf44af0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:31.508755 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f2410d4-3a2e-4274-b84b-fb2e655cc0d8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057970 Aug 06 21:27:31.509336 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2741/5663] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:32.524132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-71bfaba6-167d-4ff6-ad99-e21710d4ceb3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:32.569616 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-71bfaba6-167d-4ff6-ad99-e21710d4ceb3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050104 Aug 06 21:27:32.570171 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2923/5664] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:33.585152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-82170ee7-b113-4b56-8f62-e71b8feece62 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a361a820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:33.631422 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-82170ee7-b113-4b56-8f62-e71b8feece62 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051592 Aug 06 21:27:33.632082 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2742/5665] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:34.646292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66ccdf80-e15c-4ff2-ac41-378f99f39b01 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d778310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:34.695709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66ccdf80-e15c-4ff2-ac41-378f99f39b01 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054318 Aug 06 21:27:34.696275 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2924/5666] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:35.710247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2e8ecfa6-e05e-49ee-8db5-2885e9d150a2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d3594c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:35.759266 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2e8ecfa6-e05e-49ee-8db5-2885e9d150a2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053669 Aug 06 21:27:35.759987 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2743/5667] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:36.774666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1d32d6f2-5656-457e-a3c2-0307d1ba5814 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daa4820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:36.823685 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1d32d6f2-5656-457e-a3c2-0307d1ba5814 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054696 Aug 06 21:27:36.824485 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2925/5668] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:37.838840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ad5d327a-714d-454b-9de2-0cd7855451c6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c960790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:37.890486 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ad5d327a-714d-454b-9de2-0cd7855451c6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056238 Aug 06 21:27:37.897679 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2744/5669] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:38.906121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-002d8e10-359f-4b92-9ebb-6c287ef10ec5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:38.956347 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-002d8e10-359f-4b92-9ebb-6c287ef10ec5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054925 Aug 06 21:27:38.957054 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2926/5670] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:39.971308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c6e053a-daa9-4d25-979a-1123b561d4b5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec3dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:40.019076 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c6e053a-daa9-4d25-979a-1123b561d4b5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053145 Aug 06 21:27:40.019651 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2745/5671] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:41.033773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6be78a9-82a6-41d5-9449-d601954c2594 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:41.094721 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c6be78a9-82a6-41d5-9449-d601954c2594 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.065618 Aug 06 21:27:41.095304 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2927/5672] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:42.109199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-895982f5-8809-4805-9ce2-a4c8f33d81bf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce009d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:42.159142 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-895982f5-8809-4805-9ce2-a4c8f33d81bf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054242 Aug 06 21:27:42.159961 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2746/5673] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:43.174675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-91bec5c1-0c0d-4369-97ab-1ab413b25376 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7d8310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:43.220957 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-91bec5c1-0c0d-4369-97ab-1ab413b25376 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051595 Aug 06 21:27:43.221526 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2928/5674] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:44.236079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6ca7c904-a63d-4771-91b2-b665878ef5ff tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cc4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:44.282395 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6ca7c904-a63d-4771-91b2-b665878ef5ff tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051693 Aug 06 21:27:44.283044 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2747/5675] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:45.297389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a94cee60-2a4b-431b-b3da-24219640315a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729dc06550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:45.344188 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a94cee60-2a4b-431b-b3da-24219640315a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051525 Aug 06 21:27:45.344770 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2929/5676] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:46.358814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c3a47a9b-095e-419d-a11d-d32413577fe6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf44b80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:46.405574 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c3a47a9b-095e-419d-a11d-d32413577fe6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051522 Aug 06 21:27:46.406144 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2748/5677] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:47.421078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d235baad-42a4-43ea-9df6-e3c1e7a6221f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6945e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:47.468313 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d235baad-42a4-43ea-9df6-e3c1e7a6221f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052055 Aug 06 21:27:47.468876 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2930/5678] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:48.482127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ea363166-5cd1-45e6-99d7-c3b22294156e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:48.528951 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ea363166-5cd1-45e6-99d7-c3b22294156e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051473 Aug 06 21:27:48.529526 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2749/5679] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:49.544901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-57e2615b-05e5-4a70-ba4f-3df51072c9df tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:49.591029 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-57e2615b-05e5-4a70-ba4f-3df51072c9df tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050780 Aug 06 21:27:49.591598 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2931/5680] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:50.605339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-41987bbd-a3c4-41e6-8887-f1c4eaf7981f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf095e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:50.652892 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-41987bbd-a3c4-41e6-8887-f1c4eaf7981f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052194 Aug 06 21:27:50.653479 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2750/5681] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:51.667623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a4b871a4-04a0-4f28-8dc5-dbe99cd0e083 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c70f670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:51.713928 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a4b871a4-04a0-4f28-8dc5-dbe99cd0e083 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051211 Aug 06 21:27:51.714565 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2932/5682] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:52.729617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf6472bc-1148-4d92-b8e9-2bcf64d1f0d6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35ccd30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:52.776182 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf6472bc-1148-4d92-b8e9-2bcf64d1f0d6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051259 Aug 06 21:27:52.776764 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2751/5683] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:53.790952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e877d6f2-5d70-4931-bfda-6900056264b2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daa4ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:53.835957 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e877d6f2-5d70-4931-bfda-6900056264b2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.049680 Aug 06 21:27:53.836557 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2933/5684] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:54.850768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f23b4e64-4b83-48f2-b28f-c707fe2f7141 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf8d5e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:54.897205 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f23b4e64-4b83-48f2-b28f-c707fe2f7141 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051428 Aug 06 21:27:54.897791 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2752/5685] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:55.913299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-17e2ef0f-879a-4712-8abc-42417550e199 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a7ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:55.961978 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-17e2ef0f-879a-4712-8abc-42417550e199 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054811 Aug 06 21:27:55.962583 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2934/5686] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:56.977544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-47c308ec-6f51-4402-b4dc-74805fe336d1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec3670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:57.028572 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-47c308ec-6f51-4402-b4dc-74805fe336d1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055615 Aug 06 21:27:57.029166 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2753/5687] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:58.044040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5e3ece2d-c06c-470a-a9c7-2c3587d0d9cc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:58.090398 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5e3ece2d-c06c-470a-a9c7-2c3587d0d9cc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051165 Aug 06 21:27:58.091015 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2935/5688] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:27:59.105600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-653d3bed-748b-498e-94cf-a778357a4afe tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35a3ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:27:59.154688 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-653d3bed-748b-498e-94cf-a778357a4afe tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051515 Aug 06 21:27:59.154688 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2754/5689] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:27:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:00.167216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d324dfaf-8fb1-4f0a-9168-967ab783e7eb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:00.217215 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d324dfaf-8fb1-4f0a-9168-967ab783e7eb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054817 Aug 06 21:28:00.217845 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2936/5690] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:01.231460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8105bbda-23c1-4872-895b-a6b24c736319 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35a3040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:01.281383 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8105bbda-23c1-4872-895b-a6b24c736319 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053749 Aug 06 21:28:01.281960 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2755/5691] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:02.296732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-483397cf-e47d-43f8-ba09-228059524507 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6948b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:02.345873 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-483397cf-e47d-43f8-ba09-228059524507 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054095 Aug 06 21:28:02.346441 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2937/5692] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:03.360433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c5b81fc6-7744-4d2c-9a1e-cc2c0bb24d0c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cee79d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:03.410167 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c5b81fc6-7744-4d2c-9a1e-cc2c0bb24d0c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054402 Aug 06 21:28:03.410840 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2756/5693] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:04.424938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b27d8941-8c2a-4c9a-aee6-f6485c058c8a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdcca60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:04.470806 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b27d8941-8c2a-4c9a-aee6-f6485c058c8a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050474 Aug 06 21:28:04.471379 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2938/5694] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:05.486193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e5275f5c-a880-4536-bb35-771919ab77cb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:05.531380 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e5275f5c-a880-4536-bb35-771919ab77cb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050139 Aug 06 21:28:05.531962 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2757/5695] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:06.546049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f6b0e450-c0b3-474e-a8f8-3a0f0b84c8a0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:06.591015 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f6b0e450-c0b3-474e-a8f8-3a0f0b84c8a0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.049560 Aug 06 21:28:06.591596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2939/5696] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:07.606122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2918e036-727f-4b7b-8e79-c8dae9df8fcd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36ac550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:07.652287 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2918e036-727f-4b7b-8e79-c8dae9df8fcd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050958 Aug 06 21:28:07.652859 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2758/5697] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:08.667841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1fc1cc4f-8ed2-4a6b-8d64-65e15fa73e9c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdae310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:08.717334 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1fc1cc4f-8ed2-4a6b-8d64-65e15fa73e9c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054376 Aug 06 21:28:08.717939 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2940/5698] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:09.733581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b1a74f92-88ba-416d-8045-92cb262eacd5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec3dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:09.780147 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b1a74f92-88ba-416d-8045-92cb262eacd5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051188 Aug 06 21:28:09.780728 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2759/5699] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:10.794587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-310d192c-8960-4987-bc5a-7542ba9d43bc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:10.840835 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-310d192c-8960-4987-bc5a-7542ba9d43bc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050846 Aug 06 21:28:10.841394 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2941/5700] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:11.855489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33ca5f80-dae6-48ad-8850-c9db49ffd060 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:11.902744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33ca5f80-dae6-48ad-8850-c9db49ffd060 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051852 Aug 06 21:28:11.903338 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2760/5701] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:12.918168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1b5075da-a093-43ca-9a61-345ab3af1c73 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a7820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:12.963683 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1b5075da-a093-43ca-9a61-345ab3af1c73 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050205 Aug 06 21:28:12.964246 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2942/5702] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:13.978394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f2aa557-7801-4cdd-9106-de7c88822848 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36ac9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:14.024892 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f2aa557-7801-4cdd-9106-de7c88822848 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051145 Aug 06 21:28:14.025466 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2761/5703] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:15.039677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dcaa360f-aa92-4b8f-9525-1a98020584c4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdae790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:15.086653 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dcaa360f-aa92-4b8f-9525-1a98020584c4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051507 Aug 06 21:28:15.087212 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2943/5704] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:16.101588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fa365137-d33c-4638-a1ed-b56fb60eaba2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:16.147516 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fa365137-d33c-4638-a1ed-b56fb60eaba2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050967 Aug 06 21:28:16.148093 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2762/5705] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:17.163142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9322296-4c7c-4242-a36f-215bd54430d5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c2670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:17.221047 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9322296-4c7c-4242-a36f-215bd54430d5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.063475 Aug 06 21:28:17.221669 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2944/5706] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:18.235980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-504a90a8-d12e-4044-8d30-03a479690660 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce004c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:18.282217 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-504a90a8-d12e-4044-8d30-03a479690660 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050923 Aug 06 21:28:18.282850 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2763/5707] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:19.297402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2db67709-ea5f-46cd-ad89-3ba311d61f6b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c9d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:19.345580 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2db67709-ea5f-46cd-ad89-3ba311d61f6b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053039 Aug 06 21:28:19.346174 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2945/5708] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:20.360271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4772ac19-a2c3-49d4-b5d6-e765590a32eb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d1c3d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:20.406466 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4772ac19-a2c3-49d4-b5d6-e765590a32eb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050826 Aug 06 21:28:20.407131 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2764/5709] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:21.421941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5203bc79-4e04-4c89-9b35-74f592add8b3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c694940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:21.468602 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5203bc79-4e04-4c89-9b35-74f592add8b3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051358 Aug 06 21:28:21.469199 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2946/5710] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:28:22.483954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-45a33084-a044-4eb4-82e0-bb39a1622ea3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36ac9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:22.531830 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-45a33084-a044-4eb4-82e0-bb39a1622ea3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052571 Aug 06 21:28:22.532417 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2765/5711] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:23.547391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-477e848a-a549-48d1-8bde-810a13922114 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d6090d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:23.594986 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-477e848a-a549-48d1-8bde-810a13922114 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052343 Aug 06 21:28:23.595556 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2947/5712] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:24.610286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dc5c974f-4c44-43b6-8d64-ca07913dece7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf27ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:24.656250 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dc5c974f-4c44-43b6-8d64-ca07913dece7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050869 Aug 06 21:28:24.656822 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2766/5713] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:25.671942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-94d66b93-e0bc-4e80-ad86-1fb4d0f7bb3f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a80d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:25.718861 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-94d66b93-e0bc-4e80-ad86-1fb4d0f7bb3f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051531 Aug 06 21:28:25.719433 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2948/5714] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:26.734240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-41f0c6f8-cecd-4f5e-8f74-ab172ab31236 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d1c3a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:26.780425 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-41f0c6f8-cecd-4f5e-8f74-ab172ab31236 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051042 Aug 06 21:28:26.781011 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2767/5715] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:27.795483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8da42bc0-69ca-427f-aa65-b7fe964eaf99 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:27.842373 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8da42bc0-69ca-427f-aa65-b7fe964eaf99 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051675 Aug 06 21:28:27.843001 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2949/5716] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:28.857445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-904bae9d-e284-4170-92ac-ccac6c1ddfc1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c960160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:28.906168 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-904bae9d-e284-4170-92ac-ccac6c1ddfc1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053539 Aug 06 21:28:28.906792 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2768/5717] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:29.920760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-91498563-a01d-4618-bb6a-8e604ffbcb98 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7785e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:29.967201 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-91498563-a01d-4618-bb6a-8e604ffbcb98 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051368 Aug 06 21:28:29.967764 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2950/5718] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:30.981856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-132c98e1-5697-45fc-95ab-ee28f4a2cd47 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:31.028287 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-132c98e1-5697-45fc-95ab-ee28f4a2cd47 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051047 Aug 06 21:28:31.028941 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2769/5719] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:32.043410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-760fff6c-c2c5-4175-9339-6b6cef10ed2c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d6095e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:32.088942 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-760fff6c-c2c5-4175-9339-6b6cef10ed2c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050242 Aug 06 21:28:32.089503 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2951/5720] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:33.103618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5566d275-973a-459d-9a7e-3e9b3fcd2800 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:33.149186 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5566d275-973a-459d-9a7e-3e9b3fcd2800 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050308 Aug 06 21:28:33.149751 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2770/5721] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:34.164034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1fd1725b-1024-4be3-a94b-11f0578dfc47 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729dc064c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:34.216262 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1fd1725b-1024-4be3-a94b-11f0578dfc47 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056742 Aug 06 21:28:34.216907 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2952/5722] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:35.229926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a2805c08-4097-4fd1-8f64-2eaf2ac875f7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf593a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:35.276962 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a2805c08-4097-4fd1-8f64-2eaf2ac875f7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051626 Aug 06 21:28:35.277538 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2771/5723] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:36.292317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-983f44a9-03dd-4ba2-be5d-ad10e25560d4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78cd30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:36.339709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-983f44a9-03dd-4ba2-be5d-ad10e25560d4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052081 Aug 06 21:28:36.340541 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2953/5724] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:37.354653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9c02fc9-8ba2-4994-b7b0-471ce57e1f54 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36acc10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:37.401778 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c9c02fc9-8ba2-4994-b7b0-471ce57e1f54 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052049 Aug 06 21:28:37.402349 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2772/5725] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:38.417769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-64d528c7-d9cb-459c-b8e1-e2a32aeab2ec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daa4550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:38.466318 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-64d528c7-d9cb-459c-b8e1-e2a32aeab2ec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053552 Aug 06 21:28:38.466945 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2954/5726] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:28:39.481408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f68a404d-a9b4-4f46-9b2b-bd4f021e4075 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:39.527927 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f68a404d-a9b4-4f46-9b2b-bd4f021e4075 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051331 Aug 06 21:28:39.528519 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2773/5727] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:40.543938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d1813b98-9c74-4cc5-94f4-882e90e041ea tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d609c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:40.590871 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d1813b98-9c74-4cc5-94f4-882e90e041ea tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051827 Aug 06 21:28:40.591440 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2955/5728] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:41.606568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8351d62c-ce07-4d0f-8743-5cb2655b0289 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729dc6e820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:41.657295 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8351d62c-ce07-4d0f-8743-5cb2655b0289 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055389 Aug 06 21:28:41.657874 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2774/5729] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:42.672402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3242c312-5d0d-4498-a71b-39ff3b588b04 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdbf790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:42.718051 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3242c312-5d0d-4498-a71b-39ff3b588b04 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050387 Aug 06 21:28:42.718644 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2956/5730] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:43.733132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1e2c368f-ef07-43f0-a179-1d918dd47972 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0f790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:43.781256 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1e2c368f-ef07-43f0-a179-1d918dd47972 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052701 Aug 06 21:28:43.781860 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2775/5731] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:44.796742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e5d84e9-3343-4c16-a66c-5802f976f64b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:44.843205 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e5d84e9-3343-4c16-a66c-5802f976f64b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051167 Aug 06 21:28:44.843775 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2957/5732] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:45.858021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-523db479-e6bf-46ee-bbd2-1f8966ae9a3d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36345e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:45.905244 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-523db479-e6bf-46ee-bbd2-1f8966ae9a3d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051901 Aug 06 21:28:45.905851 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2776/5733] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:46.920386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf8a0161-a6cf-4782-bb76-7f6b1560333d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c755e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:46.967291 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf8a0161-a6cf-4782-bb76-7f6b1560333d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051638 Aug 06 21:28:46.967860 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2958/5734] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:47.983158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-123444ea-dc9e-4a5e-8ea8-58149ae6e077 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a347ec10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:48.029679 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-123444ea-dc9e-4a5e-8ea8-58149ae6e077 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051473 Aug 06 21:28:48.030262 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2777/5735] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:49.044931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb337b34-d014-4d57-9355-e3e303238df8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdae0d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:49.089967 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb337b34-d014-4d57-9355-e3e303238df8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.049733 Aug 06 21:28:49.090529 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2959/5736] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:50.105200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1e8fa537-cc1a-47cf-a65e-6f357af339fd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d869310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:50.152344 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1e8fa537-cc1a-47cf-a65e-6f357af339fd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051784 Aug 06 21:28:50.152908 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2778/5737] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:51.337086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30712701-3efd-4473-91e4-3b7c3eab28dc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c72e670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:51.383709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-30712701-3efd-4473-91e4-3b7c3eab28dc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.221009 Aug 06 21:28:51.384283 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2960/5738] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:52.398328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4031dde0-2620-4c73-b322-c567945bfbac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf59790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:52.499894 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4031dde0-2620-4c73-b322-c567945bfbac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.106322 Aug 06 21:28:52.501234 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2779/5739] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:28:53.515490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-744bdff7-a4c9-446d-afc2-3a51572082db tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:53.561242 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-744bdff7-a4c9-446d-afc2-3a51572082db tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050463 Aug 06 21:28:53.561865 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2961/5740] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:54.577041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-93a853bd-3acd-45d2-8b75-642044df688e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ef86e50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:54.624340 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-93a853bd-3acd-45d2-8b75-642044df688e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051997 Aug 06 21:28:54.624951 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2780/5741] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:55.639252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6c7570b-60b5-4bb4-8043-5c1bbc0af624 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35ba1f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:55.742339 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d6c7570b-60b5-4bb4-8043-5c1bbc0af624 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.107803 Aug 06 21:28:55.742956 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2962/5742] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:56.757184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-61b70c55-4361-4708-9c06-2d4962714443 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a347e9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:56.802981 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-61b70c55-4361-4708-9c06-2d4962714443 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050354 Aug 06 21:28:56.803554 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2781/5743] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:57.818969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-edd5ae56-10b4-454f-adbf-a9b45043ce38 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdae280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:57.864519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-edd5ae56-10b4-454f-adbf-a9b45043ce38 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051154 Aug 06 21:28:57.865092 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2963/5744] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:58.879439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6d6e1f6f-b783-4a36-9d2a-baa5adbc93be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0a940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:58.930517 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6d6e1f6f-b783-4a36-9d2a-baa5adbc93be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056756 Aug 06 21:28:58.931231 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2782/5745] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:28:59.946311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e0bab943-d962-4c7a-85aa-f1e42365f53f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdaf3a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:28:59.995093 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e0bab943-d962-4c7a-85aa-f1e42365f53f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053818 Aug 06 21:28:59.995671 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2964/5746] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:28:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:29:01.009685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8e647cc-0a0c-4106-8e9c-993a3e8c85fc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf590d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:01.055927 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8e647cc-0a0c-4106-8e9c-993a3e8c85fc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050912 Aug 06 21:29:01.056505 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2783/5747] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:02.071317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3409b388-d0e5-4220-b7ad-ef0c194a88b9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:02.117575 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3409b388-d0e5-4220-b7ad-ef0c194a88b9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051148 Aug 06 21:29:02.118138 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2965/5748] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:03.132871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c598a726-3e93-4f67-9ddd-117104bcbd0a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf449d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:03.183840 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c598a726-3e93-4f67-9ddd-117104bcbd0a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055304 Aug 06 21:29:03.184356 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2784/5749] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:04.198994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da0760dd-dfb0-4881-acab-66689fd4dc98 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343ac10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:04.246439 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da0760dd-dfb0-4881-acab-66689fd4dc98 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052012 Aug 06 21:29:04.247056 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2966/5750] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:05.261395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-25384617-6a4f-425e-a5ba-6e85396eeb85 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d1c31f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:05.307787 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-25384617-6a4f-425e-a5ba-6e85396eeb85 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051330 Aug 06 21:29:05.308455 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2785/5751] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:06.323134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e3b69f1-ef01-4ec2-b24e-3c544ea8e8fb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729db09e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:06.369555 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e3b69f1-ef01-4ec2-b24e-3c544ea8e8fb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051201 Aug 06 21:29:06.370119 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2967/5752] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:07.384933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3747da98-c0b3-495d-bf4e-f681e2a51a6a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce004c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:07.432960 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3747da98-c0b3-495d-bf4e-f681e2a51a6a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052658 Aug 06 21:29:07.433541 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2786/5753] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:08.447674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-74582a49-e21f-4b61-8468-99e231208eb1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daa4a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:08.496727 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-74582a49-e21f-4b61-8468-99e231208eb1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053697 Aug 06 21:29:08.497328 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2968/5754] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:29:09.512087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dc8ea817-6bd2-4bd3-86c6-456a21742c43 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a354e3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:09.559626 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dc8ea817-6bd2-4bd3-86c6-456a21742c43 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052482 Aug 06 21:29:09.560231 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2787/5755] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:10.574445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e1936232-1c57-498f-8930-80ee4a3b2de5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:10.619952 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e1936232-1c57-498f-8930-80ee4a3b2de5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050220 Aug 06 21:29:10.620546 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2969/5756] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:11.634745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f625b87-b2cc-4cef-a22b-483168bb4165 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf198b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:11.682901 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f625b87-b2cc-4cef-a22b-483168bb4165 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052868 Aug 06 21:29:11.683489 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2788/5757] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:12.697629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-216d8405-9d1c-43a7-a416-07e78f405f67 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7859d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:12.744341 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-216d8405-9d1c-43a7-a416-07e78f405f67 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051458 Aug 06 21:29:12.744900 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2970/5758] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:13.758155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-693f20dc-201d-47fe-a9ea-c9afce1ac39d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0f790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:13.805365 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-693f20dc-201d-47fe-a9ea-c9afce1ac39d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051872 Aug 06 21:29:13.805950 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2789/5759] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:14.819629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-031441a2-49fe-4986-bdd8-9f32f9f2b5d9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729db09d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:14.865108 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-031441a2-49fe-4986-bdd8-9f32f9f2b5d9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050675 Aug 06 21:29:14.865746 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2971/5760] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:15.879874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a9909732-21bb-4302-a931-0a201b1afa2a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c9600d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:15.926605 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a9909732-21bb-4302-a931-0a201b1afa2a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051309 Aug 06 21:29:15.927186 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2790/5761] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:16.942054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9abfccf9-12e9-418d-8704-57a716783b28 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c8b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:16.991550 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9abfccf9-12e9-418d-8704-57a716783b28 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054801 Aug 06 21:29:16.992153 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2972/5762] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:17.706558 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:29:17.707106 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:29:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:29:18.006894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-125c3de3-af4b-4a87-8367-4a3b427ccc12 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf19a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:18.057398 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-125c3de3-af4b-4a87-8367-4a3b427ccc12 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055481 Aug 06 21:29:18.058222 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2791/5763] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:19.072023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69d9680a-ce2b-4a65-9f80-7fe8b62ae9ac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:19.118001 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-69d9680a-ce2b-4a65-9f80-7fe8b62ae9ac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050575 Aug 06 21:29:19.118721 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2973/5764] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:20.135481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a36ebdde-051d-4ba6-bfff-6beea49ba553 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a354e550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:20.182887 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a36ebdde-051d-4ba6-bfff-6beea49ba553 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054819 Aug 06 21:29:20.183465 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2792/5765] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:21.196811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dfb8117d-ae3f-45f7-a2d6-f280bf341639 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d778d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:21.244646 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dfb8117d-ae3f-45f7-a2d6-f280bf341639 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052502 Aug 06 21:29:21.245210 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2974/5766] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:22.259529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0eb5035a-83ef-404e-ab35-d217a10a50b6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf190d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:22.307171 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0eb5035a-83ef-404e-ab35-d217a10a50b6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052140 Aug 06 21:29:22.307756 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2793/5767] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:23.321952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-51d79287-6cce-4bb5-8be0-74229d44b263 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729db09940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:23.368281 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-51d79287-6cce-4bb5-8be0-74229d44b263 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051204 Aug 06 21:29:23.368963 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2975/5768] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:24.381926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1d905316-c2bb-4776-b27a-2891783262df tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d359a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:24.429836 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1d905316-c2bb-4776-b27a-2891783262df tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052462 Aug 06 21:29:24.430438 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2794/5769] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:25.445029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fb25def-f983-4dac-aead-1d591caf3597 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:25.491611 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3fb25def-f983-4dac-aead-1d591caf3597 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051194 Aug 06 21:29:25.492209 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2976/5770] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:29:26.505995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e4ad7161-7305-4489-9719-0fc3880b3046 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec3dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:26.552790 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e4ad7161-7305-4489-9719-0fc3880b3046 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051485 Aug 06 21:29:26.553369 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2795/5771] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:27.567310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-03f4c70e-c43e-4039-9a77-4a2ac9f97d3c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:27.615148 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-03f4c70e-c43e-4039-9a77-4a2ac9f97d3c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053111 Aug 06 21:29:27.615771 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2977/5772] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:29:28.629983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c40450d7-baeb-466d-a043-b34e83e4e2a8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf448b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:28.677723 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c40450d7-baeb-466d-a043-b34e83e4e2a8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052660 Aug 06 21:29:28.678307 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2796/5773] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:29.692115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-93374a7c-b14d-4be3-8812-1b813e38565f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7b00d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:29.738280 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-93374a7c-b14d-4be3-8812-1b813e38565f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051261 Aug 06 21:29:29.738891 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2978/5774] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:30.753854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-16d93609-5e7e-48e4-b0d7-f191c47d7cf4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf19280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:30.800098 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-16d93609-5e7e-48e4-b0d7-f191c47d7cf4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051955 Aug 06 21:29:30.800680 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2797/5775] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:31.814568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-966e77a7-1d4a-4a09-bec7-a2b73b8d970c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729db09940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:31.862341 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-966e77a7-1d4a-4a09-bec7-a2b73b8d970c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053046 Aug 06 21:29:31.863006 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2979/5776] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:32.877769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e244efaf-b874-4329-abc2-9b30bde31c80 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0a160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:32.925375 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e244efaf-b874-4329-abc2-9b30bde31c80 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052882 Aug 06 21:29:32.925900 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2798/5777] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:33.939595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49764c0a-6027-458e-b81b-2f6307caa0d4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c2160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:33.986883 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-49764c0a-6027-458e-b81b-2f6307caa0d4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052260 Aug 06 21:29:33.987600 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2980/5778] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:35.001626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f24be93-84fe-4f65-b679-45758439a07f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec3280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:35.048368 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f24be93-84fe-4f65-b679-45758439a07f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051146 Aug 06 21:29:35.048949 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2799/5779] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:36.062286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-adfd962d-6932-48fb-9040-30875a6397ec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea3a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:36.111178 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-adfd962d-6932-48fb-9040-30875a6397ec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053442 Aug 06 21:29:36.111744 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2981/5780] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:37.125731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-64d048f6-1b02-46c8-872b-f94edc5bb2d5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cfa20d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:37.174527 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-64d048f6-1b02-46c8-872b-f94edc5bb2d5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053546 Aug 06 21:29:37.175131 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2800/5781] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:38.190237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-98191aef-9c8d-46d1-b050-2b3d53c4d86e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c70f670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:38.237440 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-98191aef-9c8d-46d1-b050-2b3d53c4d86e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052605 Aug 06 21:29:38.238247 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2982/5782] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:39.252576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df6bdc3b-dfe2-4c7d-851b-d2efc8f52fb3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf198b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:39.299011 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df6bdc3b-dfe2-4c7d-851b-d2efc8f52fb3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051389 Aug 06 21:29:39.299590 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2801/5783] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:40.314281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5d3f0df8-9b6a-490d-a584-2702b3587c3f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cea30d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:40.363630 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5d3f0df8-9b6a-490d-a584-2702b3587c3f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054677 Aug 06 21:29:40.364426 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2983/5784] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:41.378809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-05a7f21b-c215-4f19-858b-569817bb4efa tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d869160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:41.426067 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-05a7f21b-c215-4f19-858b-569817bb4efa tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052716 Aug 06 21:29:41.426684 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2802/5785] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:42.440771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f38b106f-5c8a-41ae-a0e4-d8fc37c35b08 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6521f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:42.487291 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f38b106f-5c8a-41ae-a0e4-d8fc37c35b08 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051294 Aug 06 21:29:42.487861 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2984/5786] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:43.501760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3917236-f394-40c5-9f0a-85359a66a905 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec3f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:43.548741 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f3917236-f394-40c5-9f0a-85359a66a905 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051369 Aug 06 21:29:43.549313 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2803/5787] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:44.400626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:44.401231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:44.407713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:44.408220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:44.408663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:44.409359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:44.409818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:44.410251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:44.437432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:29:44.517714 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8467da72-c079-4ad1-ba14-9fd7ba292d61 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "DELETE /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 204 len: 0 microversion: 2.1 time: 0.121567 Aug 06 21:29:44.518376 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2985/5788] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:29:44 2022] DELETE /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:29:44.527607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:44.528234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:44.535532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:44.536035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:44.536517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:44.537240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:44.537712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:44.538168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:44.563181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9290a598-9ad8-4ac3-bb07-8284faa4cf22 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce87ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:44.611855 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9290a598-9ad8-4ac3-bb07-8284faa4cf22 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053013 Aug 06 21:29:44.612435 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2986/5789] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:29:44.674185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:44.681881 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d2bff10f-344e-4e2f-a26f-ed324cb1354c tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1672 microversion: 2.1 time: 0.159164 Aug 06 21:29:44.682461 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2804/5790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:44 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:29:45.627351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-94caa1f2-a25c-4f77-9b24-0c8ee16b9780 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7874c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:45.683848 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-94caa1f2-a25c-4f77-9b24-0c8ee16b9780 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.061894 Aug 06 21:29:45.684419 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2987/5791] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:45.704809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:45.705536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:45.711927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:45.712411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:45.713045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:45.713758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:45.714217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:45.714684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:45.808034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:45.821721 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c503919e-c41f-4957-8798-dc4b335bd980 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 200 len: 1604 microversion: 2.1 time: 0.122298 Aug 06 21:29:45.822318 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2805/5792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:45 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 1604 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:29:45.886733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7e93c5b4-da3e-4c6b-9895-207efb450ae1 req-dcc1e2f4-a712-4852-9f53-ab792cd3fb15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328c3fb7-0e53-46c2-9490-4291d857a30a", "name": "network-vif-deleted", "tag": "6fcfc51a-46a8-43b9-966f-1e876436ba43"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:29:45.898628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7e93c5b4-da3e-4c6b-9895-207efb450ae1 req-dcc1e2f4-a712-4852-9f53-ab792cd3fb15 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:45.899390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7e93c5b4-da3e-4c6b-9895-207efb450ae1 req-dcc1e2f4-a712-4852-9f53-ab792cd3fb15 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:45.900010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7e93c5b4-da3e-4c6b-9895-207efb450ae1 req-dcc1e2f4-a712-4852-9f53-ab792cd3fb15 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:45.913559 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7e93c5b4-da3e-4c6b-9895-207efb450ae1 req-dcc1e2f4-a712-4852-9f53-ab792cd3fb15 service nova] Creating event network-vif-deleted:6fcfc51a-46a8-43b9-966f-1e876436ba43 for instance 328c3fb7-0e53-46c2-9490-4291d857a30a on nch2-master-1 Aug 06 21:29:45.918763 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7e93c5b4-da3e-4c6b-9895-207efb450ae1 req-dcc1e2f4-a712-4852-9f53-ab792cd3fb15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112975 Aug 06 21:29:45.919920 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2988/5793] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:46.697314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c40de82c-8ae4-4ff7-b321-5f90da2e62d2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec38b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:46.748637 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c40de82c-8ae4-4ff7-b321-5f90da2e62d2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055189 Aug 06 21:29:46.749771 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2806/5794] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:46.845627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:46.846339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:46.852606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:46.853092 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:46.853529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:46.854230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:46.854721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:46.855151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:46.870237 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] HTTP exception thrown: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Request method failure captured: Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a HTTP/1.1 Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tuhmqMWqS2t1aUCiEvc538jGHsfh0HagZHyVivWOaUrJ6-Sdq64tF9K-hLhLLZYGNmGCUOAKTaBk00lsvCd3ndF5Q2cDF--vAfL4h6jpOM82z-FRdDOVuDVli4CRl8l82Ik__nd6oyt9sDFnbjZka1snmiJQVWwtB_XiKwz2q9A_sA Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ff5cf7fb11b4fc8aab84c3610683094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 28aa42b542db43a1bf3d1d21d687b95b Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '328c3fb7-0e53-46c2-9490-4291d857a30a'} Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:29:46.871933 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:46.877369 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:29:46.877369 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:29:46.877369 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:29:46.877369 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:29:46.877369 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:29:46.877369 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:29:46.877369 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:46.877369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Returning 404 to user: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:29:46.877369 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1834dad1-ad93-42b6-a947-faf099f1e964 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 404 len: 111 microversion: 2.1 time: 0.033514 Aug 06 21:29:46.878322 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2989/5795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:46 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:29:46.883700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d0c75343-0292-4e5b-8e18-58ce1ecd771a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '.version_select at 0x7f72a34caee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:46.916602 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d0c75343-0292-4e5b-8e18-58ce1ecd771a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722991006" status: 202 len: 0 microversion: 2.1 time: 0.036829 Aug 06 21:29:46.920440 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2807/5796] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722991006 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:29:47.631525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34324206-74fa-4bea-8b8b-0fda30abcda7 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Action: 'create', calling method: .version_select at 0x7f729c652940>, body: {"keypair": {"name": "tempest-keypair-1574223423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2oh1s+0lWUCorGQIe7wGN6K91TPl9M+XSB+1Li+XKewhWd1m/z5TeVrTVNjA2AqW94YVwP8uv+tq99/4ypN454jsqSm1FzUAWrHYxt4ABN3dOaVsmpBe0q1kNtqb0TXw=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:29:47.647667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-34324206-74fa-4bea-8b8b-0fda30abcda7 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Getting quotas for project 1ff5cf7fb11b4fc8aab84c3610683094. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:29:47.652911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-34324206-74fa-4bea-8b8b-0fda30abcda7 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Getting quotas for user 28aa42b542db43a1bf3d1d21d687b95b and project 1ff5cf7fb11b4fc8aab84c3610683094. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:29:47.667601 ncdv-master-1 devstack@n-api.service[142461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34324206-74fa-4bea-8b8b-0fda30abcda7 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [c4d64f3f-2c08-4a87-8b71-e45e80e24cdd] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 21:29:47.764346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d63074ea-352d-4131-b415-759eab98a950 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a34ca040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:47.811607 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d63074ea-352d-4131-b415-759eab98a950 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051987 Aug 06 21:29:47.812180 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2808/5797] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:48.678465 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [None req-34324206-74fa-4bea-8b8b-0fda30abcda7 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [c4d64f3f-2c08-4a87-8b71-e45e80e24cdd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 60884. Aug 06 21:29:48.694640 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-34324206-74fa-4bea-8b8b-0fda30abcda7 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.067136 Aug 06 21:29:48.695301 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2990/5798] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:29:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:48.828098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99ab0574-23b4-4167-9091-305057eb1e39 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a0d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:48.901482 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99ab0574-23b4-4167-9091-305057eb1e39 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.078139 Aug 06 21:29:48.902074 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2809/5799] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:49.916950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92661119-2db1-4ef8-a18f-9a8030ee5287 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a7a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:49.969984 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92661119-2db1-4ef8-a18f-9a8030ee5287 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057136 Aug 06 21:29:49.970571 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2991/5800] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:29:50.064864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1532298756", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1202548-f8ad-47c3-bd4c-bc9e2f917e5b"}], "security_groups": [{"name": "tempest-securitygroup--868582570"}], "key_name": "tempest-keypair-1574223423", "user_data": "}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:29:50.180240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] validate_networks() for [('b1202548-f8ad-47c3-bd4c-bc9e2f917e5b', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:29:50.735178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:29:50.735870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:29:50.736649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:29:50.737228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:29:50.737803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:29:50.747908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:50.748402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:50.748856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:50.749766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:50.750239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:50.751423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:50.769494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Getting quotas for project 1ff5cf7fb11b4fc8aab84c3610683094. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:29:50.775012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Getting quotas for user 28aa42b542db43a1bf3d1d21d687b95b and project 1ff5cf7fb11b4fc8aab84c3610683094. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:29:50.789219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:29:50.791572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:29:50.839916 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b4289c24-c395-44d5-a851-7565c0fb2e0e tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.780341 Aug 06 21:29:50.840901 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2810/5801] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:29:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:29:50.852642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2c628c16-f487-440a-ba94-2f21c772e538 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:50.853795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2c628c16-f487-440a-ba94-2f21c772e538 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:50.916187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2c628c16-f487-440a-ba94-2f21c772e538 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:50.925071 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2c628c16-f487-440a-ba94-2f21c772e538 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1238 microversion: 2.1 time: 0.076609 Aug 06 21:29:50.926001 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2992/5802] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:50 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:29:50.984330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-86d244ba-e834-4eac-a93d-cec3f39107a2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:51.035779 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-86d244ba-e834-4eac-a93d-cec3f39107a2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055324 Aug 06 21:29:51.036356 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2811/5803] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:51.945503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:51.946041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:51.953995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:51.954464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:51.954938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:51.955698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:51.956168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:51.956606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:52.025511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:52.034312 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d41483e5-e465-4ebb-bbea-71b5d5d5c7a1 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1290 microversion: 2.1 time: 0.092856 Aug 06 21:29:52.035244 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2993/5804] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:51 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:29:52.056080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ee13e8f7-82d5-4e68-bc7a-ae46d2e515b3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a3641430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:52.111042 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ee13e8f7-82d5-4e68-bc7a-ae46d2e515b3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.060754 Aug 06 21:29:52.117849 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2812/5805] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:29:52.166599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-410624ed-e4b4-4411-b179-a1cc5851332d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729dc06820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:52.212232 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-410624ed-e4b4-4411-b179-a1cc5851332d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-16f5051a-f563-414e-959e-36ac7781652e) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-410624ed-e4b4-4411-b179-a1cc5851332d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Request method failure captured: Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 HTTP/1.1 Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tvnvKinkeMFhIqhcpkmemG6Smxt-GCvog256VMDeewoHy7fCz5h-xUot88pOkvH6NdOGzREbiFej4vFBnpE_5f1q6ANI_qEQDz_4NN2pCaYrir0Tnn6M0gQ3pV25NOvR-m0tgxd3yageQyp0oQa-9BDCuvuvnaIXro-Kh7pDN1FE_I Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: cb48281491e5408b89aef10e236519aa Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-VolumesGetTestJSON-1712555671 Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cb48281491e5408b89aef10e236519aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cb48281491e5408b89aef10e236519aa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb48281491e5408b89aef10e236519aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb48281491e5408b89aef10e236519aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-VolumesGetTestJSON-1712555671 Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: cb48281491e5408b89aef10e236519aa Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-VolumesGetTestJSON-1712555671 Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-VolumesGetTestJSON-1712555671-project Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 36d19078bf6642389799f23a5f74010a Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-VolumesGetTestJSON-1712555671-project Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-16f5051a-f563-414e-959e-36ac7781652e) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '97839957-8539-4c9f-a353-56fd6fd5f357'} Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-16f5051a-f563-414e-959e-36ac7781652e) Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 21:29:52.214231 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-16f5051a-f563-414e-959e-36ac7781652e) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 138, in delete Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-16f5051a-f563-414e-959e-36ac7781652e) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-16f5051a-f563-414e-959e-36ac7781652e) Aug 06 21:29:52.220680 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:29:52.227450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-410624ed-e4b4-4411-b179-a1cc5851332d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Returning 400 to user: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-16f5051a-f563-414e-959e-36ac7781652e) {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:29:52.227450 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-410624ed-e4b4-4411-b179-a1cc5851332d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 400 len: 397 microversion: 2.1 time: 0.055357 Aug 06 21:29:52.227661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac01a4c9-0608-4b21-9a54-c0d2bcf770d2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a34ea5e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:52.227762 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2994/5806] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:29:52 2022] DELETE /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 397 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:29:52.278238 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac01a4c9-0608-4b21-9a54-c0d2bcf770d2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056949 Aug 06 21:29:52.282480 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2813/5807] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:53.059033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:53.059672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:53.066803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:53.067335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:53.067805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:53.068562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:53.069061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:53.069497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:53.137318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:53.145921 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-01496eeb-79e0-4f6c-9021-97da4c95f92b tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1296 microversion: 2.1 time: 0.092417 Aug 06 21:29:53.146712 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2995/5808] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:53 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:29:53.294280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-61725c6b-d7bf-4bb0-9246-a555bd318c73 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d1c31f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:53.343925 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-61725c6b-d7bf-4bb0-9246-a555bd318c73 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054471 Aug 06 21:29:53.350032 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2814/5809] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:29:54.171891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:54.175785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:54.189504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:54.190879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:54.192360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:54.193942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:54.196115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:54.196908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:54.361383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c1c2b5f-ce5c-4684-b100-7ce80b2ce073 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35a3c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:54.462354 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c1c2b5f-ce5c-4684-b100-7ce80b2ce073 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.108738 Aug 06 21:29:54.463602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:54.463825 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2815/5810] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:54.468526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-150c2266-9b7e-4f91-b3e4-2e07174a1c88 req-997c6d0d-ace0-4a2a-a0f5-80d056f71569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fba38c-83a3-4fdb-a795-ed2adaea7077", "tag": "ad8ab9ee-a989-4f3e-acf0-cc6051829027"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:29:54.475620 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08a4e384-cd64-429d-9ee2-979356cfb812 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1363 microversion: 2.1 time: 0.310323 Aug 06 21:29:54.476429 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2996/5811] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:54 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:29:54.482288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-150c2266-9b7e-4f91-b3e4-2e07174a1c88 req-997c6d0d-ace0-4a2a-a0f5-80d056f71569 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:54.482928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-150c2266-9b7e-4f91-b3e4-2e07174a1c88 req-997c6d0d-ace0-4a2a-a0f5-80d056f71569 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:54.483454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-150c2266-9b7e-4f91-b3e4-2e07174a1c88 req-997c6d0d-ace0-4a2a-a0f5-80d056f71569 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:54.498735 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-150c2266-9b7e-4f91-b3e4-2e07174a1c88 req-997c6d0d-ace0-4a2a-a0f5-80d056f71569 service nova] Creating event network-changed:ad8ab9ee-a989-4f3e-acf0-cc6051829027 for instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 on nch2-master-1 Aug 06 21:29:54.507801 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-150c2266-9b7e-4f91-b3e4-2e07174a1c88 req-997c6d0d-ace0-4a2a-a0f5-80d056f71569 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042516 Aug 06 21:29:54.509264 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2816/5812] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:55.476638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4737e6b2-8b3c-41b1-8c0f-72b3804af92d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daa45e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:55.499055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:55.500507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:55.508588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:55.509381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:55.510010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:55.511018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:55.512214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:55.513643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:55.570115 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4737e6b2-8b3c-41b1-8c0f-72b3804af92d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.097250 Aug 06 21:29:55.570754 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2997/5813] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:55.688256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:55.700436 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9cb97eae-1a79-44dc-bd6c-a10f97b5b0c6 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1363 microversion: 2.1 time: 0.206161 Aug 06 21:29:55.717493 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2817/5814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:55 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:29:56.586913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f1541b2-b984-4a09-9a89-aac7ce595e41 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d778040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:56.646947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f1541b2-b984-4a09-9a89-aac7ce595e41 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.065877 Aug 06 21:29:56.647613 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2998/5815] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:56.730999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:56.731625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:56.753414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:56.753939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:56.754466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:56.755352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:56.756075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:56.756664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:57.045027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:57.054015 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fc47aec6-c3bf-443e-9d71-43077444d5f4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1363 microversion: 2.1 time: 0.328651 Aug 06 21:29:57.054794 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2818/5816] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:56 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:29:57.331153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-475a8dc8-4baa-469d-9bd8-5e34c0a78105 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Action: 'create', calling method: .version_select at 0x7f729d778550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1486460765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmkqHlHqe5ph4pQlbl5JHSpY1kub8qdF4FG0nVVT/Hh14UwFgsm+ZnvQl2ozaixmiK7VP2oE6C/VZ84imCJQVpo1m/nu7M/0arTPXw6RXdXD0Ivb3D8F9QYbqpcrVcTww=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:29:57.357448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-475a8dc8-4baa-469d-9bd8-5e34c0a78105 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for project e498ab168dde414db5130cbc6d21e325. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:29:57.364201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-475a8dc8-4baa-469d-9bd8-5e34c0a78105 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for user 896f039a62824d5bb1123d4694208aea and project e498ab168dde414db5130cbc6d21e325. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:29:57.403522 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-475a8dc8-4baa-469d-9bd8-5e34c0a78105 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.077014 Aug 06 21:29:57.404582 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 2999/5817] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:29:57 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:29:57.668283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a033c0fb-17f3-4bbc-a3b0-812a879f60a2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cc9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:57.740857 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a033c0fb-17f3-4bbc-a3b0-812a879f60a2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.082757 Aug 06 21:29:57.742788 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2819/5818] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:58.075134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:58.077409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:58.087104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:58.088160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:58.092470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:58.093502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:58.094765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:58.095427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:58.281721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:58.292583 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1c80adb-3983-4114-bca7-e5cf3b9ff1bd tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1363 microversion: 2.1 time: 0.221239 Aug 06 21:29:58.296459 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3000/5819] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:58 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:29:58.756333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-16e2ac36-1e64-4c32-ab7a-4c7f1e6181bc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a361a820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:58.815138 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-16e2ac36-1e64-4c32-ab7a-4c7f1e6181bc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.062689 Aug 06 21:29:58.815911 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2820/5820] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:59.001514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1456955737", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "137dc31d-150a-4bb8-8243-955888fd9337"}], "key_name": "tempest-TestNetworkBasicOps-1486460765", "security_groups": [{"name": "tempest-secgroup-smoke-1734688362"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:29:59.077589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-684df45d-b061-4173-8435-7829cc38713e req-8798972c-e285-4284-87b8-951ebdb22fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fba38c-83a3-4fdb-a795-ed2adaea7077", "name": "network-vif-plugged", "status": "completed", "tag": "ad8ab9ee-a989-4f3e-acf0-cc6051829027"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:29:59.089312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-684df45d-b061-4173-8435-7829cc38713e req-8798972c-e285-4284-87b8-951ebdb22fb3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:59.089796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-684df45d-b061-4173-8435-7829cc38713e req-8798972c-e285-4284-87b8-951ebdb22fb3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:59.090229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-684df45d-b061-4173-8435-7829cc38713e req-8798972c-e285-4284-87b8-951ebdb22fb3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:59.101882 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-684df45d-b061-4173-8435-7829cc38713e req-8798972c-e285-4284-87b8-951ebdb22fb3 service nova] Creating event network-vif-plugged:ad8ab9ee-a989-4f3e-acf0-cc6051829027 for instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 on nch2-master-1 Aug 06 21:29:59.107185 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-684df45d-b061-4173-8435-7829cc38713e req-8798972c-e285-4284-87b8-951ebdb22fb3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254435 Aug 06 21:29:59.107790 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3001/5821] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:29:59.115884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] validate_networks() for [('137dc31d-150a-4bb8-8243-955888fd9337', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:29:59.339238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:59.340119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:59.352513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:59.353746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:59.354361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:59.355463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:59.356153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:59.356908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:59.510876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:59.519676 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e15f50f7-00ff-4032-b936-40e84d0e1ce5 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1363 microversion: 2.1 time: 0.210046 Aug 06 21:29:59.533376 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3002/5822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:59 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:29:59.632468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:29:59.632984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:29:59.633468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:29:59.633910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:29:59.634475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:29:59.644732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:59.645226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:59.645671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:59.646405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:29:59.646903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:29:59.647334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:29:59.666803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for project e498ab168dde414db5130cbc6d21e325. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:29:59.673110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for user 896f039a62824d5bb1123d4694208aea and project e498ab168dde414db5130cbc6d21e325. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:29:59.688517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:29:59.690881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:29:59.738307 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-76a9e975-2356-4bbb-a481-ddb320a45f00 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741202 Aug 06 21:29:59.739053 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2821/5823] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:29:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:29:59.750621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d69ee8d4-272b-4878-af12-a9201cfc85a3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:59.751256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d69ee8d4-272b-4878-af12-a9201cfc85a3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:29:59.816843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d69ee8d4-272b-4878-af12-a9201cfc85a3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:29:59.825855 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d69ee8d4-272b-4878-af12-a9201cfc85a3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1249 microversion: 2.1 time: 0.079789 Aug 06 21:29:59.833556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-320f4aa2-3944-4d28-8eb2-00dfd3c974d0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35ccdc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:29:59.842033 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3003/5824] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:29:59 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:29:59.896744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-320f4aa2-3944-4d28-8eb2-00dfd3c974d0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.071563 Aug 06 21:29:59.898260 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2822/5825] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:29:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:30:00.542486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:00.543139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:00.551426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:00.552043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:00.552563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:00.553391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:00.554085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:00.554644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:00.694255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:00.701970 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-496016ca-b761-417a-96ca-2e4045093c19 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1548 microversion: 2.1 time: 0.164882 Aug 06 21:30:00.702558 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3004/5826] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:00 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:00.723118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1707bcfc-657e-44d7-8791-639f083544ae tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:00.723622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1707bcfc-657e-44d7-8791-639f083544ae tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:00.730398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1707bcfc-657e-44d7-8791-639f083544ae tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:00.730938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1707bcfc-657e-44d7-8791-639f083544ae tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:00.731410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1707bcfc-657e-44d7-8791-639f083544ae tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:00.732096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1707bcfc-657e-44d7-8791-639f083544ae tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:00.732565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1707bcfc-657e-44d7-8791-639f083544ae tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:00.733002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1707bcfc-657e-44d7-8791-639f083544ae tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:00.812704 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1707bcfc-657e-44d7-8791-639f083544ae tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093978 Aug 06 21:30:00.813393 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2823/5827] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:30:00 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:00.850093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:00.850872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:00.858714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:00.859766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:00.860688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:00.861652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:00.862125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:00.863076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:00.913503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-51845786-5139-45d5-8796-f7c84f05cca5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf19a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:00.980377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:00.991560 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-58a2e205-1b51-478a-9a20-42cea8e0deef tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1309 microversion: 2.1 time: 0.145218 Aug 06 21:30:00.992726 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3005/5828] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:00 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:00.996371 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-51845786-5139-45d5-8796-f7c84f05cca5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.088130 Aug 06 21:30:00.997628 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2824/5829] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:01.943996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-dbbfe8a1-d714-456a-91b9-78be490b0fde req-f93aef91-e638-4e50-976d-4aa8eeffc12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fba38c-83a3-4fdb-a795-ed2adaea7077", "tag": "ad8ab9ee-a989-4f3e-acf0-cc6051829027"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:01.955655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-dbbfe8a1-d714-456a-91b9-78be490b0fde req-f93aef91-e638-4e50-976d-4aa8eeffc12f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:01.956393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-dbbfe8a1-d714-456a-91b9-78be490b0fde req-f93aef91-e638-4e50-976d-4aa8eeffc12f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:01.957084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-dbbfe8a1-d714-456a-91b9-78be490b0fde req-f93aef91-e638-4e50-976d-4aa8eeffc12f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:01.969365 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-dbbfe8a1-d714-456a-91b9-78be490b0fde req-f93aef91-e638-4e50-976d-4aa8eeffc12f service nova] Creating event network-changed:ad8ab9ee-a989-4f3e-acf0-cc6051829027 for instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 on nch2-master-1 Aug 06 21:30:01.975016 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-dbbfe8a1-d714-456a-91b9-78be490b0fde req-f93aef91-e638-4e50-976d-4aa8eeffc12f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103424 Aug 06 21:30:01.975624 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3006/5830] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:30:02.013147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ef4c1a74-38af-4371-85b5-8568a4789ca2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d359ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:02.024321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:02.025652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:02.033477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:02.034065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:02.034629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:02.035921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:02.036731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:02.037504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:02.079732 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ef4c1a74-38af-4371-85b5-8568a4789ca2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.071727 Aug 06 21:30:02.081119 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2825/5831] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:02.196042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:02.205232 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f27f7fdb-99ba-40f9-9676-4cf5784964ac tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1375 microversion: 2.1 time: 0.185047 Aug 06 21:30:02.206585 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3007/5832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:02 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:02.784414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9edfc816-f45f-4814-afbd-fb77f49eda3d req-3c3c4d06-3a05-44e3-b664-17279f37894b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e601a06d-4347-42a0-a149-4ef8d0100ae8", "tag": "87820f58-2311-4a17-a278-5f7cefffe871"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:02.794863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9edfc816-f45f-4814-afbd-fb77f49eda3d req-3c3c4d06-3a05-44e3-b664-17279f37894b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:02.795802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9edfc816-f45f-4814-afbd-fb77f49eda3d req-3c3c4d06-3a05-44e3-b664-17279f37894b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:02.797369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9edfc816-f45f-4814-afbd-fb77f49eda3d req-3c3c4d06-3a05-44e3-b664-17279f37894b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:02.811960 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9edfc816-f45f-4814-afbd-fb77f49eda3d req-3c3c4d06-3a05-44e3-b664-17279f37894b service nova] Creating event network-changed:87820f58-2311-4a17-a278-5f7cefffe871 for instance e601a06d-4347-42a0-a149-4ef8d0100ae8 on nch1-master-1 Aug 06 21:30:02.827490 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9edfc816-f45f-4814-afbd-fb77f49eda3d req-3c3c4d06-3a05-44e3-b664-17279f37894b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047106 Aug 06 21:30:02.831107 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2826/5833] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:03.094517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa732731-d0c5-46e2-9074-c593c6f0b5c2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a7940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:03.151648 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa732731-d0c5-46e2-9074-c593c6f0b5c2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.061944 Aug 06 21:30:03.152880 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3008/5834] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:03.227259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:03.227980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:03.236904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:03.237493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:03.238021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:03.238851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:03.239496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:03.240043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:03.689417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:03.696931 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f00814f6-66bf-4243-9127-664cca61115e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1375 microversion: 2.1 time: 0.474041 Aug 06 21:30:03.697506 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2827/5835] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:03 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1375 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:04.167449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a3c2e50e-ca8f-4252-8467-5c686f002bba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c70f5e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:04.216339 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a3c2e50e-ca8f-4252-8467-5c686f002bba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053600 Aug 06 21:30:04.216928 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3009/5836] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:04.717406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:04.718030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:04.725822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:04.726308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:04.726793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:04.727488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:04.727945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:04.728380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:04.867383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:04.874916 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eba494b6-3757-424a-9676-8251da7995a1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1375 microversion: 2.1 time: 0.161392 Aug 06 21:30:04.875588 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2828/5837] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:04 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:05.231795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-756f5be4-5eaa-4e13-b596-3c01ece49212 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a7ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:05.277247 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-756f5be4-5eaa-4e13-b596-3c01ece49212 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050416 Aug 06 21:30:05.277855 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3010/5838] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:05.896103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:05.896804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:05.903934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:05.904430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:05.904875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:05.905584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:05.906307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:05.906973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:06.040937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:06.049302 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e3026e7e-af61-4cab-a747-f14ba835c765 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1375 microversion: 2.1 time: 0.157784 Aug 06 21:30:06.049882 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2829/5839] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:05 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:06.292262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e769192-8e6b-4c11-8147-fa8937d8d0f9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:06.344084 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e769192-8e6b-4c11-8147-fa8937d8d0f9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056540 Aug 06 21:30:06.344715 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3011/5840] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:07.070139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:07.070791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:07.077847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:07.078340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:07.078812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:07.079577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:07.080069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:07.080505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:07.221426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:07.229023 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8423f965-e658-4478-b4ab-1702c70229e0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1375 microversion: 2.1 time: 0.162887 Aug 06 21:30:07.229595 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2830/5841] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:07 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:07.358048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-13c3f824-47d3-42b8-bd91-d0118f166dbf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c70f670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:07.404094 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-13c3f824-47d3-42b8-bd91-d0118f166dbf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050638 Aug 06 21:30:07.404669 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3012/5842] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:07.746363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-0df2ba0b-ca6c-4170-a14d-a244389c9a62 req-66199339-fbbb-4d3c-aa68-1c42b3da3a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e601a06d-4347-42a0-a149-4ef8d0100ae8", "name": "network-vif-plugged", "status": "completed", "tag": "87820f58-2311-4a17-a278-5f7cefffe871"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:07.756816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0df2ba0b-ca6c-4170-a14d-a244389c9a62 req-66199339-fbbb-4d3c-aa68-1c42b3da3a82 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:07.757301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0df2ba0b-ca6c-4170-a14d-a244389c9a62 req-66199339-fbbb-4d3c-aa68-1c42b3da3a82 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:07.757771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-0df2ba0b-ca6c-4170-a14d-a244389c9a62 req-66199339-fbbb-4d3c-aa68-1c42b3da3a82 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:07.770001 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-0df2ba0b-ca6c-4170-a14d-a244389c9a62 req-66199339-fbbb-4d3c-aa68-1c42b3da3a82 service nova] Creating event network-vif-plugged:87820f58-2311-4a17-a278-5f7cefffe871 for instance e601a06d-4347-42a0-a149-4ef8d0100ae8 on nch1-master-1 Aug 06 21:30:07.775154 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-0df2ba0b-ca6c-4170-a14d-a244389c9a62 req-66199339-fbbb-4d3c-aa68-1c42b3da3a82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032397 Aug 06 21:30:07.775766 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2831/5843] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:08.249393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:08.250008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:08.256676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:08.257163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:08.257601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:08.258295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:08.258786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:08.259222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:08.391179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:08.399678 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d0ff4531-5105-49cf-abea-842cbeed267e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1375 microversion: 2.1 time: 0.154306 Aug 06 21:30:08.400247 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3013/5844] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:08 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:08.420565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-02178a05-be77-4df4-8116-dc96e24da620 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf8d3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:08.470175 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-02178a05-be77-4df4-8116-dc96e24da620 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054535 Aug 06 21:30:08.470575 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2832/5845] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:09.421373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:09.421909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:09.429273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:09.429763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:09.430215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:09.430942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:09.431410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:09.431844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:09.484532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4135b1c9-3f6e-41be-89ac-3cf34729a15e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:09.533210 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4135b1c9-3f6e-41be-89ac-3cf34729a15e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053269 Aug 06 21:30:09.533785 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2833/5846] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:30:09.566329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:09.574116 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6accbac2-1322-4d07-bc6e-47f02f407573 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1547 microversion: 2.1 time: 0.156741 Aug 06 21:30:09.574722 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3014/5847] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:09 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:09.593916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:09.595452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:09.601822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:09.602294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:09.602781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:09.603477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:09.603941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:09.604375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:09.654942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:09.680612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=12 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:09.741531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:09.749171 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3247b545-18a7-4ff6-b287-dcdac6924230 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1547 microversion: 2.1 time: 0.159082 Aug 06 21:30:09.749754 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2834/5848] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:09 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:10.547024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec923d18-1193-4f1f-8b75-4d7cfedb9327 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7780d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:10.553248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=12 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:10.596918 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ec923d18-1193-4f1f-8b75-4d7cfedb9327 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053843 Aug 06 21:30:10.597522 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3015/5849] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:30:11.474673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ef5201ce-1e92-4ec4-b085-f57feb0df635 req-69ea94be-16b0-4bc9-a48b-da21c74fa3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e601a06d-4347-42a0-a149-4ef8d0100ae8", "tag": "87820f58-2311-4a17-a278-5f7cefffe871"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:11.499820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:11.506652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ef5201ce-1e92-4ec4-b085-f57feb0df635 req-69ea94be-16b0-4bc9-a48b-da21c74fa3b0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:11.507135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ef5201ce-1e92-4ec4-b085-f57feb0df635 req-69ea94be-16b0-4bc9-a48b-da21c74fa3b0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:11.507567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ef5201ce-1e92-4ec4-b085-f57feb0df635 req-69ea94be-16b0-4bc9-a48b-da21c74fa3b0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:11.511665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=69 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:11.528699 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ef5201ce-1e92-4ec4-b085-f57feb0df635 req-69ea94be-16b0-4bc9-a48b-da21c74fa3b0 service nova] Creating event network-changed:87820f58-2311-4a17-a278-5f7cefffe871 for instance e601a06d-4347-42a0-a149-4ef8d0100ae8 on nch1-master-1 Aug 06 21:30:11.536399 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ef5201ce-1e92-4ec4-b085-f57feb0df635 req-69ea94be-16b0-4bc9-a48b-da21c74fa3b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065313 Aug 06 21:30:11.537032 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2835/5850] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:11.612430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47c85564-0ae2-409f-bade-8655727016fb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce87700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:11.675604 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47c85564-0ae2-409f-bade-8655727016fb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.068729 Aug 06 21:30:11.676177 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3016/5851] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:12.691871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-503f0011-5cd1-408e-a96b-70b9b97b9ebf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a347e9d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:12.740450 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-503f0011-5cd1-408e-a96b-70b9b97b9ebf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054736 Aug 06 21:30:12.741032 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2836/5852] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:13.754871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c14d72b-0d92-42b0-b2fb-ac6f4b2a43fe tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c20d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:13.801598 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3c14d72b-0d92-42b0-b2fb-ac6f4b2a43fe tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052192 Aug 06 21:30:13.802169 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3017/5853] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:14.816092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-51f4e8f8-0fb5-4450-bb6a-5379de9c0579 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0ad30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:14.864125 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-51f4e8f8-0fb5-4450-bb6a-5379de9c0579 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052931 Aug 06 21:30:14.864771 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2837/5854] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:15.878238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-452d2922-d381-4ed7-8d28-a217742a6e88 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:15.925559 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-452d2922-d381-4ed7-8d28-a217742a6e88 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052040 Aug 06 21:30:15.926073 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3018/5855] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:16.941239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-631e8d5d-9dbb-4fea-afcd-49ff4b42166d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d1c3820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:16.987909 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-631e8d5d-9dbb-4fea-afcd-49ff4b42166d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052150 Aug 06 21:30:16.988499 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2838/5856] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:18.002049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8d49114-a01a-41af-9bd5-b3ab2fed119b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c78c820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:18.049747 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d8d49114-a01a-41af-9bd5-b3ab2fed119b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052373 Aug 06 21:30:18.050328 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3019/5857] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:19.065869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f6ee51d-3ac6-4f1b-92aa-397ecff29dd5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a361a820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:19.120868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f6ee51d-3ac6-4f1b-92aa-397ecff29dd5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.060974 Aug 06 21:30:19.121446 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2839/5858] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:20.133096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:20.133962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:20.138444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-979253a5-54e3-418c-b901-60b8b127874c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343a820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:20.188949 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-979253a5-54e3-418c-b901-60b8b127874c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056368 Aug 06 21:30:20.189560 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3020/5859] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:21.203933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf204339-61df-423b-a5d9-790715720335 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d1c3ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:21.249967 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf204339-61df-423b-a5d9-790715720335 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050988 Aug 06 21:30:21.251653 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2840/5860] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:22.266919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e80a06c8-3f81-4ce0-bf95-ed7500488d90 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7785e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:22.313440 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e80a06c8-3f81-4ce0-bf95-ed7500488d90 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051599 Aug 06 21:30:22.314017 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3021/5861] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:30:23.325083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:23.325846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:23.330596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34b5ca18-7b2b-4990-8498-1dda66459fc4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cc160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:23.377613 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-34b5ca18-7b2b-4990-8498-1dda66459fc4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054114 Aug 06 21:30:23.378187 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2841/5862] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:24.027056 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:30:24.027574 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:30:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:30:24.392197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cbc16ab3-21cb-4b4d-8cf6-718a15126603 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d609700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:24.439178 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cbc16ab3-21cb-4b4d-8cf6-718a15126603 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052666 Aug 06 21:30:24.439744 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3022/5863] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:25.454178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f03efc07-586a-49d4-af8b-b4649b407d94 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:25.499380 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f03efc07-586a-49d4-af8b-b4649b407d94 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050427 Aug 06 21:30:25.499945 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2842/5864] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:26.514058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a7bc6027-f3b7-4179-9daf-9f6ae3fc78c5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:26.561088 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a7bc6027-f3b7-4179-9daf-9f6ae3fc78c5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051781 Aug 06 21:30:26.561656 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3023/5865] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:27.575724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a0167d68-04a7-4576-aa92-2371d31480f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d359700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:27.622473 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a0167d68-04a7-4576-aa92-2371d31480f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051520 Aug 06 21:30:27.623097 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2843/5866] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:28.637121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37b0961c-0bf1-4da8-8c7a-bcc9b7a72371 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a344ce50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:28.684751 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37b0961c-0bf1-4da8-8c7a-bcc9b7a72371 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052271 Aug 06 21:30:28.685401 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3024/5867] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:29.700161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c088bb15-1039-4af6-810c-584b52fab209 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cca60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:29.747144 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c088bb15-1039-4af6-810c-584b52fab209 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051623 Aug 06 21:30:29.747774 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2844/5868] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:30.761945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ac6b94cf-47e4-4fe9-b636-53137cb1a6f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:30.808524 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ac6b94cf-47e4-4fe9-b636-53137cb1a6f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051321 Aug 06 21:30:30.809083 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3025/5869] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:31.823964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-814f5b42-96ac-4239-a697-f3a23b5811fe tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:31.872492 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-814f5b42-96ac-4239-a697-f3a23b5811fe tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053257 Aug 06 21:30:31.873104 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2845/5870] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:30:32.886930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ee2d0d25-f009-407d-8829-3599ec39e746 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce4a820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:32.936049 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ee2d0d25-f009-407d-8829-3599ec39e746 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053866 Aug 06 21:30:32.936639 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3026/5871] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:33.802830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a0113edc-58c9-4c1a-8243-930306f1d3ad tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:33.805117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a0113edc-58c9-4c1a-8243-930306f1d3ad tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:33.811376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0113edc-58c9-4c1a-8243-930306f1d3ad tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:33.811860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0113edc-58c9-4c1a-8243-930306f1d3ad tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:33.812445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0113edc-58c9-4c1a-8243-930306f1d3ad tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:33.813119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0113edc-58c9-4c1a-8243-930306f1d3ad tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:33.813576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0113edc-58c9-4c1a-8243-930306f1d3ad tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:33.814004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0113edc-58c9-4c1a-8243-930306f1d3ad tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:33.863497 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a0113edc-58c9-4c1a-8243-930306f1d3ad tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "POST /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8/action" status: 200 len: 24561 microversion: 2.1 time: 0.065420 Aug 06 21:30:33.864132 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2846/5872] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:30:33 2022] POST /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8/action => generated 24561 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 21:30:33.951405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9058a587-aac5-411b-ae51-fbd1724413cd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d609820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:33.997666 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9058a587-aac5-411b-ae51-fbd1724413cd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051032 Aug 06 21:30:33.998231 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3027/5873] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:35.012439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cec9dd3e-9b66-4b31-982f-e10bd4603674 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:35.060397 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cec9dd3e-9b66-4b31-982f-e10bd4603674 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052087 Aug 06 21:30:35.060970 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2847/5874] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:36.075671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3672fae7-8e70-45fd-8028-c55448149793 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35ba1f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:36.123171 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3672fae7-8e70-45fd-8028-c55448149793 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052147 Aug 06 21:30:36.123735 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3028/5875] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:37.138091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1719eaf0-b094-4e87-b6da-d6e9084337cc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce004c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:37.184874 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1719eaf0-b094-4e87-b6da-d6e9084337cc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051474 Aug 06 21:30:37.185467 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2848/5876] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:38.199453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1613dc30-97e4-42c0-a386-4bab31f27e65 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ced5e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:38.247148 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1613dc30-97e4-42c0-a386-4bab31f27e65 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052416 Aug 06 21:30:38.247841 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3029/5877] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:38.312822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4dc54619-fb76-4144-a3b7-5e1308792a40 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:38.313384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4dc54619-fb76-4144-a3b7-5e1308792a40 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:38.320130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dc54619-fb76-4144-a3b7-5e1308792a40 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:38.320613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dc54619-fb76-4144-a3b7-5e1308792a40 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:38.321049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dc54619-fb76-4144-a3b7-5e1308792a40 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:38.321737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dc54619-fb76-4144-a3b7-5e1308792a40 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:38.322192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dc54619-fb76-4144-a3b7-5e1308792a40 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:38.322647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4dc54619-fb76-4144-a3b7-5e1308792a40 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:38.346715 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4dc54619-fb76-4144-a3b7-5e1308792a40 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077/ips" status: 200 len: 145 microversion: 2.1 time: 0.038715 Aug 06 21:30:38.347285 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2849/5878] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:30:38 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:39.262097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50c9439f-e83a-4a59-976a-8e14e55f469e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce87ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:39.312646 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-50c9439f-e83a-4a59-976a-8e14e55f469e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054798 Aug 06 21:30:39.313240 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3030/5879] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:39.676326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:39.676830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:39.683677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:39.684156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:39.684599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:39.685287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:39.685743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:39.686171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:39.716908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:30:39.795670 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-882744a8-21b6-4f6d-9158-9390fdc717f8 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "DELETE /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 204 len: 0 microversion: 2.1 time: 0.122746 Aug 06 21:30:39.796622 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2850/5880] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:30:39 2022] DELETE /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:30:39.805179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:39.805790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:39.812007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:39.812494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:39.812933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:39.813622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:39.814081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:39.814512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:39.943923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:39.951506 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c9f59b4a-bef9-4038-92ec-d0d97cbe0448 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1673 microversion: 2.1 time: 0.150193 Aug 06 21:30:39.952074 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3031/5881] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:39 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:40.327013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-346b1df3-a46f-483b-acda-02cd12325cca tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8fe820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:40.379150 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-346b1df3-a46f-483b-acda-02cd12325cca tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056356 Aug 06 21:30:40.379724 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2851/5882] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:40.973852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:40.974465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:40.981315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:40.981855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:40.982298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:40.983015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:40.983476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:40.984020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:41.113681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:41.121417 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d7e5a6d6-2dff-4f4c-b27b-1e1994296a94 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1673 microversion: 2.1 time: 0.151420 Aug 06 21:30:41.121986 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3032/5883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:40 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:41.393708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ff72f94-0db0-4f94-a7c9-e18696273e65 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00ee0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:41.442491 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1ff72f94-0db0-4f94-a7c9-e18696273e65 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053786 Aug 06 21:30:41.443251 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2852/5884] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:41.892813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f7da0cb5-4bc9-4159-88be-86f7a13fc37b req-87456bce-3848-4941-beba-06fa4a7c5aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fba38c-83a3-4fdb-a795-ed2adaea7077", "name": "network-vif-deleted", "tag": "ad8ab9ee-a989-4f3e-acf0-cc6051829027"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:41.907018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f7da0cb5-4bc9-4159-88be-86f7a13fc37b req-87456bce-3848-4941-beba-06fa4a7c5aba service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:41.907821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f7da0cb5-4bc9-4159-88be-86f7a13fc37b req-87456bce-3848-4941-beba-06fa4a7c5aba service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:41.908256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f7da0cb5-4bc9-4159-88be-86f7a13fc37b req-87456bce-3848-4941-beba-06fa4a7c5aba service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:41.922243 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f7da0cb5-4bc9-4159-88be-86f7a13fc37b req-87456bce-3848-4941-beba-06fa4a7c5aba service nova] Creating event network-vif-deleted:ad8ab9ee-a989-4f3e-acf0-cc6051829027 for instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 on nch2-master-1 Aug 06 21:30:41.927985 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f7da0cb5-4bc9-4159-88be-86f7a13fc37b req-87456bce-3848-4941-beba-06fa4a7c5aba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039881 Aug 06 21:30:41.928687 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3033/5885] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:42.143588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:42.144367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:42.150625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:42.151121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:42.151573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:42.152294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:42.152934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:42.153381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:42.186142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:42.186710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:42.187261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:42.187739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lazy-loading 'fault' on Instance uuid 39fba38c-83a3-4fdb-a795-ed2adaea7077 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:30:42.239179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28aa42b542db43a1bf3d1d21d687b95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff5cf7fb11b4fc8aab84c3610683094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:42.248227 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a01d9d01-2b68-4daa-8576-876e66748870 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 200 len: 1328 microversion: 2.1 time: 0.109797 Aug 06 21:30:42.248728 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2853/5886] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:42 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:42.457198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-093c18ac-d990-4c38-881d-d7cdcf696c84 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daa4940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:42.516389 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-093c18ac-d990-4c38-881d-d7cdcf696c84 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.063405 Aug 06 21:30:42.516969 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3034/5887] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:43.271968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:43.272592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:43.279585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:43.280941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:43.281388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:43.282329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:43.282821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:43.283261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:43.297649 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] HTTP exception thrown: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Request method failure captured: Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 HTTP/1.1 Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tuhmqMWqS2t1aUCiEvc538jGHsfh0HagZHyVivWOaUrJ6-Sdq64tF9K-hLhLLZYGNmGCUOAKTaBk00lsvCd3ndF5Q2cDF--vAfL4h6jpOM82z-FRdDOVuDVli4CRl8l82Ik__nd6oyt9sDFnbjZka1snmiJQVWwtB_XiKwz2q9A_sA Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ff5cf7fb11b4fc8aab84c3610683094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 28aa42b542db43a1bf3d1d21d687b95b Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '39fba38c-83a3-4fdb-a795-ed2adaea7077'} Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:30:43.299337 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Returning 404 to user: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f26cf25d-3d9d-4a00-95d3-502a64a56dba tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 404 len: 111 microversion: 2.1 time: 0.032790 Aug 06 21:30:43.304635 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2854/5888] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:43 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:30:43.309522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-18897697-75e9-4400-8922-22e2fbcae8c4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '.version_select at 0x7f729ce87c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:43.330433 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-18897697-75e9-4400-8922-22e2fbcae8c4 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574223423" status: 202 len: 0 microversion: 2.1 time: 0.024721 Aug 06 21:30:43.331279 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3035/5889] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574223423 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:30:43.529919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ebffe848-7794-4fb5-86cd-10032a52841c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c960dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:43.578578 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ebffe848-7794-4fb5-86cd-10032a52841c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052787 Aug 06 21:30:43.579281 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2855/5890] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:44.076714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:44.077666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:44.083866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:44.084354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:44.084813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:44.085486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:44.085944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:44.086373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:44.100180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] HTTP exception thrown: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Request method failure captured: Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 HTTP/1.1 Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tuhmqMWqS2t1aUCiEvc538jGHsfh0HagZHyVivWOaUrJ6-Sdq64tF9K-hLhLLZYGNmGCUOAKTaBk00lsvCd3ndF5Q2cDF--vAfL4h6jpOM82z-FRdDOVuDVli4CRl8l82Ik__nd6oyt9sDFnbjZka1snmiJQVWwtB_XiKwz2q9A_sA Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ff5cf7fb11b4fc8aab84c3610683094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 28aa42b542db43a1bf3d1d21d687b95b Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '39fba38c-83a3-4fdb-a795-ed2adaea7077'} Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:30:44.101812 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Returning 404 to user: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5911b185-2008-46ff-bb41-89eee619ec52 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "DELETE /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 404 len: 111 microversion: 2.1 time: 0.031330 Aug 06 21:30:44.106241 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3036/5891] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:30:44 2022] DELETE /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:30:44.111886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:44.112501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 39fba38c-83a3-4fdb-a795-ed2adaea7077] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:44.118522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:44.119037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:44.119480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:44.120278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:44.120745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:44.121178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:44.135384 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] HTTP exception thrown: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Request method failure captured: Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 HTTP/1.1 Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tuhmqMWqS2t1aUCiEvc538jGHsfh0HagZHyVivWOaUrJ6-Sdq64tF9K-hLhLLZYGNmGCUOAKTaBk00lsvCd3ndF5Q2cDF--vAfL4h6jpOM82z-FRdDOVuDVli4CRl8l82Ik__nd6oyt9sDFnbjZka1snmiJQVWwtB_XiKwz2q9A_sA Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ff5cf7fb11b4fc8aab84c3610683094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 28aa42b542db43a1bf3d1d21d687b95b Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '39fba38c-83a3-4fdb-a795-ed2adaea7077'} Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:30:44.136897 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Returning 404 to user: Instance 39fba38c-83a3-4fdb-a795-ed2adaea7077 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6a867a5b-9d51-4bb7-8b44-53df0007947a tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077" status: 404 len: 111 microversion: 2.1 time: 0.030569 Aug 06 21:30:44.143109 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2856/5892] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:44 2022] GET /compute/v2.1/servers/39fba38c-83a3-4fdb-a795-ed2adaea7077 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:30:44.592510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-872ffc60-67f1-4beb-8d08-3007dfd3ccbc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7b0280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:44.638732 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-872ffc60-67f1-4beb-8d08-3007dfd3ccbc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050045 Aug 06 21:30:44.639329 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3037/5893] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:45.655895 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3f9e855a-4870-47da-9db2-4b005dd45cc8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ceb5670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:45.710691 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3f9e855a-4870-47da-9db2-4b005dd45cc8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.060731 Aug 06 21:30:45.711427 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2857/5894] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:45.806283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f326745-128a-45cb-954e-1417e53a8cdc tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Action: 'create', calling method: .version_select at 0x7f729c6a74c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2082881223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQJi7E+75Mu/mND/ptEAAVVBu4f0bmYZukBCwYmliMI7UDapIznLWgubrF6h4caBeGecaKT7Kc9AnSDNoxZcibCifrfwR4IIA+j38JNPaDSIpa/pHMRpq07JPOylutUlw=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:45.822866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9f326745-128a-45cb-954e-1417e53a8cdc tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for project e498ab168dde414db5130cbc6d21e325. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:30:45.828749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9f326745-128a-45cb-954e-1417e53a8cdc tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for user 896f039a62824d5bb1123d4694208aea and project e498ab168dde414db5130cbc6d21e325. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:30:45.856845 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f326745-128a-45cb-954e-1417e53a8cdc tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.055238 Aug 06 21:30:45.857650 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3038/5895] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:30:45 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:46.725018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99cace6f-c330-4037-b542-ea7754df7bd0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d359430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:46.788948 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99cace6f-c330-4037-b542-ea7754df7bd0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.067880 Aug 06 21:30:46.789822 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2858/5896] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:46.900008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1708125789", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "131cf462-28b3-4d0d-933b-f663e9b358bf"}], "key_name": "tempest-TestNetworkBasicOps-2082881223", "security_groups": [{"name": "tempest-secgroup-smoke-410854560"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:47.009396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] validate_networks() for [('131cf462-28b3-4d0d-933b-f663e9b358bf', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:30:47.504793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:30:47.505335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:30:47.505558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:30:47.506012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:30:47.506437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:30:47.526672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:47.527342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:47.527787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:47.528528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:47.528993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:47.529427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:47.548650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for project e498ab168dde414db5130cbc6d21e325. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:30:47.554161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for user 896f039a62824d5bb1123d4694208aea and project e498ab168dde414db5130cbc6d21e325. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:30:47.567682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:30:47.570155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:30:47.618892 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-767cc0df-33d9-45e1-9a00-887493f9d3a2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.722736 Aug 06 21:30:47.620189 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3039/5897] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:30:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:30:47.631968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33c260f2-9bd6-40ba-add1-b0333038b21a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:47.632600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-33c260f2-9bd6-40ba-add1-b0333038b21a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:47.718874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-33c260f2-9bd6-40ba-add1-b0333038b21a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:47.730264 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33c260f2-9bd6-40ba-add1-b0333038b21a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1249 microversion: 2.1 time: 0.102318 Aug 06 21:30:47.732094 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2859/5898] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:47 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1249 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:47.803463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9d70b1c-d58e-47df-a7e8-2437af80b68b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdae8b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:47.870056 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9d70b1c-d58e-47df-a7e8-2437af80b68b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.070594 Aug 06 21:30:47.871314 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3040/5899] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:48.751994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:48.752630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:48.760295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:48.760804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:48.761256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:48.761974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:48.762444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:48.763037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:48.886046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-296475f9-3a88-47dc-b005-3379a1c21f5a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c2310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:48.937600 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-296475f9-3a88-47dc-b005-3379a1c21f5a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056235 Aug 06 21:30:48.938166 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3041/5900] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:30:49.155605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:49.163765 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-61279d46-0efc-4050-b5b4-2a6eb5468dc7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1307 microversion: 2.1 time: 0.415867 Aug 06 21:30:49.164343 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2860/5901] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:48 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1307 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:49.952846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca5b1f45-6d7c-4ddf-98eb-511d0a483f94 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d778280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:50.000873 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca5b1f45-6d7c-4ddf-98eb-511d0a483f94 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053296 Aug 06 21:30:50.001449 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3042/5902] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:50.187371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:50.188101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:50.195200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:50.195767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:50.196277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:50.197052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:50.197520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:50.197949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:50.320378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-11a59610-2ac4-4a4f-8b15-db5d88adfd40 req-cca2a290-da93-4e78-a220-77fb98300ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fcb87b7-0ad8-4152-9817-7a3e75bb2583", "tag": "be4c4c14-cccd-4632-b536-dc462126988c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:50.332402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-11a59610-2ac4-4a4f-8b15-db5d88adfd40 req-cca2a290-da93-4e78-a220-77fb98300ed7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:50.332895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-11a59610-2ac4-4a4f-8b15-db5d88adfd40 req-cca2a290-da93-4e78-a220-77fb98300ed7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:50.333325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-11a59610-2ac4-4a4f-8b15-db5d88adfd40 req-cca2a290-da93-4e78-a220-77fb98300ed7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:50.346362 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-11a59610-2ac4-4a4f-8b15-db5d88adfd40 req-cca2a290-da93-4e78-a220-77fb98300ed7 service nova] Creating event network-changed:be4c4c14-cccd-4632-b536-dc462126988c for instance 8fcb87b7-0ad8-4152-9817-7a3e75bb2583 on nch2-master-1 Aug 06 21:30:50.351407 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-11a59610-2ac4-4a4f-8b15-db5d88adfd40 req-cca2a290-da93-4e78-a220-77fb98300ed7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034996 Aug 06 21:30:50.352172 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3043/5903] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:50.446160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:50.454763 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f4bb942e-ff86-42c9-a054-006803309f1f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1374 microversion: 2.1 time: 0.271822 Aug 06 21:30:50.455352 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2861/5904] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:50 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1374 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:51.015793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08a12ea4-68bf-4e08-b6df-7e49b6a3ffb4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c24c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:51.063196 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08a12ea4-68bf-4e08-b6df-7e49b6a3ffb4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052326 Aug 06 21:30:51.063772 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3044/5905] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:51.475575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:51.476199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:51.483838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:51.484330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:51.484778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:51.485486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:51.485955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:51.486394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:51.658724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:51.667228 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6f3fcb3b-2511-470f-8d43-1bbf2db35407 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1374 microversion: 2.1 time: 0.195394 Aug 06 21:30:51.682076 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2862/5906] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:51 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:52.079147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67ce2ea0-660d-4588-8c28-808e02a3c07f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:52.126756 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67ce2ea0-660d-4588-8c28-808e02a3c07f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053808 Aug 06 21:30:52.127341 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3045/5907] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:52.689743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:52.690375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:52.697496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:52.697980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:52.698420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:52.699141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:52.699598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:52.700027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:52.833406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:52.841753 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1834642e-569e-4055-9e6e-8103d38e7c4b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1374 microversion: 2.1 time: 0.156419 Aug 06 21:30:52.842925 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2863/5908] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:52 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:53.142454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ced5a2b-1104-4024-bf6d-50489bf041e2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdae1f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:53.189125 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ced5a2b-1104-4024-bf6d-50489bf041e2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052520 Aug 06 21:30:53.189819 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3046/5909] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:53.864774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:53.865395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:53.872385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:53.872874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:53.873318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:53.874386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:53.874898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:53.875335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:54.012820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:54.020988 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4373984f-0911-41e8-bb5f-914bdabefcd7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1374 microversion: 2.1 time: 0.160143 Aug 06 21:30:54.021570 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2864/5910] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:53 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:54.204662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e6488976-f57b-40fe-b7c3-7074762c7f0b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ced5820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:54.250575 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e6488976-f57b-40fe-b7c3-7074762c7f0b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051514 Aug 06 21:30:54.251147 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3047/5911] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:55.009908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-2d651a04-d695-4144-ab19-1a3c242d803f req-ba7307f7-a9bf-4447-8ccd-52e905c7934a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fcb87b7-0ad8-4152-9817-7a3e75bb2583", "name": "network-vif-plugged", "status": "completed", "tag": "be4c4c14-cccd-4632-b536-dc462126988c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:30:55.021355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2d651a04-d695-4144-ab19-1a3c242d803f req-ba7307f7-a9bf-4447-8ccd-52e905c7934a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:55.021845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2d651a04-d695-4144-ab19-1a3c242d803f req-ba7307f7-a9bf-4447-8ccd-52e905c7934a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:55.022338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2d651a04-d695-4144-ab19-1a3c242d803f req-ba7307f7-a9bf-4447-8ccd-52e905c7934a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:55.036153 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-2d651a04-d695-4144-ab19-1a3c242d803f req-ba7307f7-a9bf-4447-8ccd-52e905c7934a service nova] Creating event network-vif-plugged:be4c4c14-cccd-4632-b536-dc462126988c for instance 8fcb87b7-0ad8-4152-9817-7a3e75bb2583 on nch2-master-1 Aug 06 21:30:55.039731 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-2d651a04-d695-4144-ab19-1a3c242d803f req-ba7307f7-a9bf-4447-8ccd-52e905c7934a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033448 Aug 06 21:30:55.040667 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2865/5912] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:55.041820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:55.042712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:55.053286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:55.053791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:55.054452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:55.055447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:55.056082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:55.056522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:55.196277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:55.205303 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b5bf20d2-6e58-45e8-bea9-c063aeaab8f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1374 microversion: 2.1 time: 0.167732 Aug 06 21:30:55.206261 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3048/5913] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:55 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:55.264312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d148ffb2-08d6-43f8-a473-052aae2905d3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:55.311834 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d148ffb2-08d6-43f8-a473-052aae2905d3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051269 Aug 06 21:30:55.312489 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2866/5914] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:56.225821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:56.226434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:56.234448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:56.234974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:56.235412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:56.236142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:56.236588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:56.237019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:56.325983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb893a77-2b2c-4ed6-99c9-98897acc74cb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:56.372160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:56.375985 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb893a77-2b2c-4ed6-99c9-98897acc74cb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054642 Aug 06 21:30:56.376833 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2867/5915] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:56.380615 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5fa47bac-ce54-4fbe-b26a-114bb2dc38f0 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1547 microversion: 2.1 time: 0.158700 Aug 06 21:30:56.381275 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3049/5916] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:56 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:56.401074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:56.401818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:30:56.409539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:56.409970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:56.410418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:56.411155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:30:56.411625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:30:56.412060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:30:56.548482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:30:56.556075 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2e881266-31c3-4e07-893f-642a1e4d6698 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1547 microversion: 2.1 time: 0.158738 Aug 06 21:30:56.556650 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2868/5917] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:30:56 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:30:57.389614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eeeb13c4-eff7-4dc2-b3e6-60e1fb272f3d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c2790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:57.437962 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eeeb13c4-eff7-4dc2-b3e6-60e1fb272f3d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052155 Aug 06 21:30:57.438593 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3050/5918] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:58.451724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a27de667-3ffb-4244-aba5-e3ba7ebc9741 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:58.459637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:58.501464 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a27de667-3ffb-4244-aba5-e3ba7ebc9741 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053471 Aug 06 21:30:58.502467 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2869/5919] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:30:59.512604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:59.513805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:30:59.520374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e5d705e3-6da8-491f-9705-48a3ba7e3864 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:30:59.569264 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e5d705e3-6da8-491f-9705-48a3ba7e3864 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057475 Aug 06 21:30:59.569976 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3051/5920] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:30:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:00.586052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6074e081-bd7d-4458-9576-aeeee37f7a3f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91a160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:00.637988 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6074e081-bd7d-4458-9576-aeeee37f7a3f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056583 Aug 06 21:31:00.638498 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2870/5921] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:01.652972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b894bbb9-2ad9-4428-9b1b-5a5f7bae6927 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c23a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:01.704374 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b894bbb9-2ad9-4428-9b1b-5a5f7bae6927 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056315 Aug 06 21:31:01.704949 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3052/5922] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:02.719792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52ba184f-c759-4971-a04d-37b3fc95ab08 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8fe0d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:02.765901 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-52ba184f-c759-4971-a04d-37b3fc95ab08 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051735 Aug 06 21:31:02.766466 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2871/5923] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:31:03.780428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c79fb9a-90f7-4919-a9a5-dc0ecd6b0fd3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:03.832106 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c79fb9a-90f7-4919-a9a5-dc0ecd6b0fd3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056752 Aug 06 21:31:03.832678 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3053/5924] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:04.846415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2db8cca3-67be-4ff9-892a-7494c88c8850 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91a940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:04.895597 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2db8cca3-67be-4ff9-892a-7494c88c8850 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054423 Aug 06 21:31:04.896188 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2872/5925] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:05.911228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4ff4c142-ed1c-40e1-8127-1d2c4bc65c24 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343ac10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:05.958602 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4ff4c142-ed1c-40e1-8127-1d2c4bc65c24 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052303 Aug 06 21:31:05.964710 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3054/5926] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:06.970119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:06.971047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:06.975335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-da431714-bb98-43f2-930e-8ee63c61af00 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8fe670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:07.028886 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-da431714-bb98-43f2-930e-8ee63c61af00 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.060226 Aug 06 21:31:07.029748 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2873/5927] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:08.039817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:08.040615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=32 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:08.047162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-504009ac-28bf-49f3-a6bf-167e622a516b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7d89d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:08.095883 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-504009ac-28bf-49f3-a6bf-167e622a516b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056675 Aug 06 21:31:08.096462 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3055/5928] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:09.111121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-694ebda6-d42c-4b31-8f79-34b10cbf8db9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a361a820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:09.158201 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-694ebda6-d42c-4b31-8f79-34b10cbf8db9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052511 Aug 06 21:31:09.158816 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2874/5929] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:10.172034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da756c7c-b6be-4fe2-8b7c-eb9d9d5a6929 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ced5b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:10.218950 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da756c7c-b6be-4fe2-8b7c-eb9d9d5a6929 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051741 Aug 06 21:31:10.219525 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3056/5930] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:11.234524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7fca5271-d83c-4802-b8a8-1c88327bbb5a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a1f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:11.282621 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7fca5271-d83c-4802-b8a8-1c88327bbb5a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053913 Aug 06 21:31:11.283209 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2875/5931] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:12.298607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b454c9c0-c042-4482-92d2-6a0258e333d2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce4a430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:12.348967 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b454c9c0-c042-4482-92d2-6a0258e333d2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056349 Aug 06 21:31:12.349579 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3057/5932] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:13.363950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6d340bbd-cd64-4d84-ba82-7f518ab68782 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8fea60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:13.411403 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6d340bbd-cd64-4d84-ba82-7f518ab68782 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052188 Aug 06 21:31:13.412013 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2876/5933] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:14.426029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6b08556c-7a1e-4ac7-9f83-43e1c6a278d1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:14.472155 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6b08556c-7a1e-4ac7-9f83-43e1c6a278d1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050845 Aug 06 21:31:14.472727 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3058/5934] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:15.486627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c5598ed0-35e1-407b-863e-1f06be379d93 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d94e160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:15.534001 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c5598ed0-35e1-407b-863e-1f06be379d93 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052553 Aug 06 21:31:15.534625 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2877/5935] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:16.549449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cccc54b-21c1-47df-ab64-edd5bc75fca4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343aa60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:16.595536 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5cccc54b-21c1-47df-ab64-edd5bc75fca4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051381 Aug 06 21:31:16.596102 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3059/5936] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:17.611022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dc36b5d5-4f87-42e4-bf88-7ecc836a743b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf09820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:17.660913 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dc36b5d5-4f87-42e4-bf88-7ecc836a743b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055475 Aug 06 21:31:17.661495 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2878/5937] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:18.676086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c733f2cb-d643-43b9-8ff3-6c90017e22a9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdbfdc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:18.726504 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c733f2cb-d643-43b9-8ff3-6c90017e22a9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055486 Aug 06 21:31:18.727114 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3060/5938] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:19.745150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-986804e8-ee2f-41d2-bf3c-08caa0a9d5b6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8e8b80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:19.798422 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-986804e8-ee2f-41d2-bf3c-08caa0a9d5b6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.061172 Aug 06 21:31:19.799028 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2879/5939] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:20.815322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-96a32793-5435-4eb4-bb39-c771ba209427 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35bac10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:20.863073 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-96a32793-5435-4eb4-bb39-c771ba209427 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053858 Aug 06 21:31:20.863676 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3061/5940] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:21.877864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a3359bfe-60d4-4f45-9d85-904565630ebf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:21.932573 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a3359bfe-60d4-4f45-9d85-904565630ebf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.059215 Aug 06 21:31:21.933167 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2880/5941] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:22.306468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:22.307034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:22.314282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:22.314850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:22.315350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:22.316134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:22.316665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:22.317115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:22.344324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:31:22.426384 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-390de317-1196-49ce-9c4c-bb224f16cf16 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 204 len: 0 microversion: 2.1 time: 0.123307 Aug 06 21:31:22.427809 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3062/5942] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:31:22 2022] DELETE /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:31:22.435772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:22.437054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:22.443863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:22.444443 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:22.444965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:22.445776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:22.446316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:22.446857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:22.581726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:22.589231 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e8b7d6ff-8e7b-4e91-ba10-b76bf2098f8c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1553 microversion: 2.1 time: 0.157425 Aug 06 21:31:22.589822 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2881/5943] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:22 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:22.948222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b5b6475a-ae81-4e2c-9fb1-39ea574b523c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ced5160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:22.998256 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b5b6475a-ae81-4e2c-9fb1-39ea574b523c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054552 Aug 06 21:31:22.999703 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3063/5944] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:23.611812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:23.612458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:23.619538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:23.620028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:23.620472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:23.621175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:23.621637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:23.622072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:23.806381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:23.818657 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b477f416-53d8-4de4-88bb-e43d218eab8e tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 200 len: 1553 microversion: 2.1 time: 0.208951 Aug 06 21:31:23.822590 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2882/5945] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:23 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:24.013164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-226adbf3-377c-45a4-a48e-43e3c1f0fec6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a344cee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:24.060897 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-226adbf3-377c-45a4-a48e-43e3c1f0fec6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052151 Aug 06 21:31:24.062390 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3064/5946] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:24.251904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9c2a9a1e-7333-4b86-b595-64c010f82ea7 req-37c43dfd-6eb4-475d-bf04-db9909beb1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fcb87b7-0ad8-4152-9817-7a3e75bb2583", "name": "network-vif-deleted", "tag": "be4c4c14-cccd-4632-b536-dc462126988c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:31:24.261747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9c2a9a1e-7333-4b86-b595-64c010f82ea7 req-37c43dfd-6eb4-475d-bf04-db9909beb1f2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:24.262305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9c2a9a1e-7333-4b86-b595-64c010f82ea7 req-37c43dfd-6eb4-475d-bf04-db9909beb1f2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:24.262841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9c2a9a1e-7333-4b86-b595-64c010f82ea7 req-37c43dfd-6eb4-475d-bf04-db9909beb1f2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:24.275352 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9c2a9a1e-7333-4b86-b595-64c010f82ea7 req-37c43dfd-6eb4-475d-bf04-db9909beb1f2 service nova] Creating event network-vif-deleted:be4c4c14-cccd-4632-b536-dc462126988c for instance 8fcb87b7-0ad8-4152-9817-7a3e75bb2583 on nch2-master-1 Aug 06 21:31:24.281553 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9c2a9a1e-7333-4b86-b595-64c010f82ea7 req-37c43dfd-6eb4-475d-bf04-db9909beb1f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034677 Aug 06 21:31:24.282160 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2883/5947] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:24.837680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:24.838322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: 8fcb87b7-0ad8-4152-9817-7a3e75bb2583] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:24.844726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:24.845222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:24.845668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:24.846373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:24.846873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:24.847308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:24.861157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] HTTP exception thrown: Instance 8fcb87b7-0ad8-4152-9817-7a3e75bb2583 could not be found. Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Request method failure captured: Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 HTTP/1.1 Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7t1Oe3wtESfG9N76uK9P_htJ-t58EXIlE-9VW8vn2k_M_IOKpo-m63_Y8QlbTOimPe_sJ6p8ROne0PzOVshvmQCrXI4UNbvuF5HF8dFIXAqlLHnTEruoKrkUNAnGLRzzXQPQKxfGY09toO_AZi0UaXQtz_2OTIlub1UPUe0JmWTpK3s Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: e498ab168dde414db5130cbc6d21e325 Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TestNetworkBasicOps-1721865985 Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e498ab168dde414db5130cbc6d21e325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e498ab168dde414db5130cbc6d21e325", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e498ab168dde414db5130cbc6d21e325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e498ab168dde414db5130cbc6d21e325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TestNetworkBasicOps-1721865985 Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: e498ab168dde414db5130cbc6d21e325 Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TestNetworkBasicOps-1721865985 Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TestNetworkBasicOps-1721865985-project Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 896f039a62824d5bb1123d4694208aea Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TestNetworkBasicOps-1721865985-project Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 8fcb87b7-0ad8-4152-9817-7a3e75bb2583 could not be found. Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '8fcb87b7-0ad8-4152-9817-7a3e75bb2583'} Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fcb87b7-0ad8-4152-9817-7a3e75bb2583 could not be found. Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fcb87b7-0ad8-4152-9817-7a3e75bb2583 could not be found. Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:31:24.862843 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fcb87b7-0ad8-4152-9817-7a3e75bb2583 could not be found. Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Returning 404 to user: Instance 8fcb87b7-0ad8-4152-9817-7a3e75bb2583 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80006778-d8a4-4c07-9ec2-ee15dafd94f6 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583" status: 404 len: 111 microversion: 2.1 time: 0.030626 Aug 06 21:31:24.868269 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3065/5948] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:24 2022] GET /compute/v2.1/servers/8fcb87b7-0ad8-4152-9817-7a3e75bb2583 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:31:25.030013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dc380cff-7195-42af-86ff-aa1b7e540a6f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '.version_select at 0x7f72a35b3af0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:25.051165 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dc380cff-7195-42af-86ff-aa1b7e540a6f tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2082881223" status: 202 len: 0 microversion: 2.1 time: 0.026325 Aug 06 21:31:25.052096 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2884/5949] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Aug 6 21:31:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2082881223 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:31:25.075985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bd73b3a-4d9f-4216-9303-7fea5c3adf6a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce87820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:25.125947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8bd73b3a-4d9f-4216-9303-7fea5c3adf6a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054023 Aug 06 21:31:25.126516 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3066/5950] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:26.142304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4a3ccb4f-14e9-455e-8b93-d334bde4e2ee tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0a940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:26.190224 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4a3ccb4f-14e9-455e-8b93-d334bde4e2ee tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054219 Aug 06 21:31:26.190936 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2885/5951] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:27.092131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:27.092709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:27.093192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-3d143e50-ae92-4506-b737-fe6c01c38481 req-a7a76be2-151c-46bd-99e5-6770c0076ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e601a06d-4347-42a0-a149-4ef8d0100ae8", "tag": "87820f58-2311-4a17-a278-5f7cefffe871"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:31:27.099302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:27.099794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:27.100234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:27.101142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:27.101606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:27.102038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:27.102837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3d143e50-ae92-4506-b737-fe6c01c38481 req-a7a76be2-151c-46bd-99e5-6770c0076ed1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:27.103323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3d143e50-ae92-4506-b737-fe6c01c38481 req-a7a76be2-151c-46bd-99e5-6770c0076ed1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:27.103753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3d143e50-ae92-4506-b737-fe6c01c38481 req-a7a76be2-151c-46bd-99e5-6770c0076ed1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:27.116023 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-3d143e50-ae92-4506-b737-fe6c01c38481 req-a7a76be2-151c-46bd-99e5-6770c0076ed1 service nova] Creating event network-changed:87820f58-2311-4a17-a278-5f7cefffe871 for instance e601a06d-4347-42a0-a149-4ef8d0100ae8 on nch1-master-1 Aug 06 21:31:27.121239 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-3d143e50-ae92-4506-b737-fe6c01c38481 req-a7a76be2-151c-46bd-99e5-6770c0076ed1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032004 Aug 06 21:31:27.121841 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2886/5952] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:27.130526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:31:27.206589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-11728419-d9ba-4905-b258-94d9fce48250 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf44550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:27.243566 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e14e2c9b-d8de-45ad-96b7-53480fbefec1 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 204 len: 0 microversion: 2.1 time: 0.156572 Aug 06 21:31:27.247439 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3067/5953] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:31:27 2022] DELETE /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:31:27.254324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:27.255143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:27.263009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:27.263579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:27.264028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:27.265307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:27.265762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:27.266188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:27.280470 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-11728419-d9ba-4905-b258-94d9fce48250 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.079838 Aug 06 21:31:27.281121 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2887/5954] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:27.425311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:27.433164 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-146b08d5-4af6-4b5c-9491-e2c95fd1d64a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1671 microversion: 2.1 time: 0.184052 Aug 06 21:31:27.433751 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3068/5955] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:27 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:31:28.295174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f52591f1-3952-401e-a8c7-e720e8a37819 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91aca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:28.348990 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f52591f1-3952-401e-a8c7-e720e8a37819 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.058571 Aug 06 21:31:28.349567 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2888/5956] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:28.454562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:28.455529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:28.462941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:28.463449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:28.464206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:28.464608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:28.465082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:28.465519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:28.600270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:28.608330 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5a4f0be9-6bde-4fb9-9bf5-d454207757f3 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1671 microversion: 2.1 time: 0.157505 Aug 06 21:31:28.609082 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3069/5957] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:28 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:29.363485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cafc142b-45f7-41e5-bd09-9cfd5fd39121 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:29.369261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b64c017e-54c4-40fa-a926-56ade4419b31 req-24fdee94-8c80-40b9-9c31-87c57aa7edd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e601a06d-4347-42a0-a149-4ef8d0100ae8", "name": "network-vif-deleted", "tag": "87820f58-2311-4a17-a278-5f7cefffe871"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:31:29.384301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b64c017e-54c4-40fa-a926-56ade4419b31 req-24fdee94-8c80-40b9-9c31-87c57aa7edd1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:29.384789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b64c017e-54c4-40fa-a926-56ade4419b31 req-24fdee94-8c80-40b9-9c31-87c57aa7edd1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:29.385222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b64c017e-54c4-40fa-a926-56ade4419b31 req-24fdee94-8c80-40b9-9c31-87c57aa7edd1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:29.399152 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b64c017e-54c4-40fa-a926-56ade4419b31 req-24fdee94-8c80-40b9-9c31-87c57aa7edd1 service nova] Creating event network-vif-deleted:87820f58-2311-4a17-a278-5f7cefffe871 for instance e601a06d-4347-42a0-a149-4ef8d0100ae8 on nch1-master-1 Aug 06 21:31:29.407265 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b64c017e-54c4-40fa-a926-56ade4419b31 req-24fdee94-8c80-40b9-9c31-87c57aa7edd1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041671 Aug 06 21:31:29.407841 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3070/5958] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:31:29.418308 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cafc142b-45f7-41e5-bd09-9cfd5fd39121 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.060147 Aug 06 21:31:29.419029 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2889/5959] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:29.629921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:29.630700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:29.637747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:29.638257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:29.638742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:29.639493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:29.639984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:29.640430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:29.675991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:29.676107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:29.676455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:29.676921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lazy-loading 'fault' on Instance uuid e601a06d-4347-42a0-a149-4ef8d0100ae8 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:31:29.729433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:29.738848 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4234d4bb-d201-40f5-bfe9-b7540457f1c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 200 len: 1339 microversion: 2.1 time: 0.113134 Aug 06 21:31:29.739848 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3071/5960] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:29 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:30.432881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2e2d50da-03b9-4cba-bce1-29e5f46dd6ff tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91e310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:30.481818 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2e2d50da-03b9-4cba-bce1-29e5f46dd6ff tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053645 Aug 06 21:31:30.482429 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2890/5961] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:30.759380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:30.760005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: e601a06d-4347-42a0-a149-4ef8d0100ae8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:30.767883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:30.768375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:30.768822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:30.769524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:30.769989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:30.770425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:30.785232 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] HTTP exception thrown: Instance e601a06d-4347-42a0-a149-4ef8d0100ae8 could not be found. Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Request method failure captured: Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 HTTP/1.1 Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7t1Oe3wtESfG9N76uK9P_htJ-t58EXIlE-9VW8vn2k_M_IOKpo-m63_Y8QlbTOimPe_sJ6p8ROne0PzOVshvmQCrXI4UNbvuF5HF8dFIXAqlLHnTEruoKrkUNAnGLRzzXQPQKxfGY09toO_AZi0UaXQtz_2OTIlub1UPUe0JmWTpK3s Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: e498ab168dde414db5130cbc6d21e325 Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TestNetworkBasicOps-1721865985 Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e498ab168dde414db5130cbc6d21e325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e498ab168dde414db5130cbc6d21e325", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e498ab168dde414db5130cbc6d21e325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e498ab168dde414db5130cbc6d21e325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TestNetworkBasicOps-1721865985 Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: e498ab168dde414db5130cbc6d21e325 Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TestNetworkBasicOps-1721865985 Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TestNetworkBasicOps-1721865985-project Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 896f039a62824d5bb1123d4694208aea Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TestNetworkBasicOps-1721865985-project Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance e601a06d-4347-42a0-a149-4ef8d0100ae8 could not be found. Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'e601a06d-4347-42a0-a149-4ef8d0100ae8'} Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e601a06d-4347-42a0-a149-4ef8d0100ae8 could not be found. Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e601a06d-4347-42a0-a149-4ef8d0100ae8 could not be found. Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:31:30.786908 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e601a06d-4347-42a0-a149-4ef8d0100ae8 could not be found. Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Returning 404 to user: Instance e601a06d-4347-42a0-a149-4ef8d0100ae8 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8609509c-93d4-4f16-8781-89058ac22f73 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8" status: 404 len: 111 microversion: 2.1 time: 0.032885 Aug 06 21:31:30.791886 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3072/5962] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:30 2022] GET /compute/v2.1/servers/e601a06d-4347-42a0-a149-4ef8d0100ae8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:31:30.952267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e5fe38a-9624-4dcc-9554-dc1c6f9a3344 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '.version_select at 0x7f72a36418b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:30.976499 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0e5fe38a-9624-4dcc-9554-dc1c6f9a3344 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1486460765" status: 202 len: 0 microversion: 2.1 time: 0.028687 Aug 06 21:31:30.977320 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2891/5963] 10.222.0.33 () {58 vars in 1257 bytes} [Sat Aug 6 21:31:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1486460765 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:31:31.496174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cff16775-64bc-4520-aa9b-5c62151dfa50 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cdbfdc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:31.546294 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cff16775-64bc-4520-aa9b-5c62151dfa50 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052960 Aug 06 21:31:31.546752 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3073/5964] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:32.560436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-437a4695-cf17-4b39-b69e-2a90ef43cd04 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91a8b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:32.615945 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-437a4695-cf17-4b39-b69e-2a90ef43cd04 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.060116 Aug 06 21:31:32.616529 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2892/5965] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:33.630299 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d4244cef-12f9-470b-a261-0f546b7dcdd8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35bae50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:33.691829 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d4244cef-12f9-470b-a261-0f546b7dcdd8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.066224 Aug 06 21:31:33.692399 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3074/5966] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:34.708389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4558634-531b-40d0-a679-fac803ef6946 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec38b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:34.761966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f4558634-531b-40d0-a679-fac803ef6946 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.059751 Aug 06 21:31:34.762569 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2893/5967] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:35.778043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-21af4845-560b-43db-a156-bc0df92a3fcc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:35.839618 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-21af4845-560b-43db-a156-bc0df92a3fcc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.066761 Aug 06 21:31:35.840415 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3075/5968] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:36.856626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-674b20c2-95c9-4d6d-87c4-c74117df085e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d3593a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:36.956541 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-674b20c2-95c9-4d6d-87c4-c74117df085e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.106602 Aug 06 21:31:36.957333 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2894/5969] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:31:37.971595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d0ec2ff5-f9a9-4992-b163-30d58946ef61 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35bae50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:38.044663 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d0ec2ff5-f9a9-4992-b163-30d58946ef61 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.077768 Aug 06 21:31:38.045599 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3076/5970] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:38.886240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=16 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:38.892926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6764ffff-e5f6-4449-881e-0e6f2e11542b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Action: 'create', calling method: .version_select at 0x7f729c9068b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-498142656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1jJrG/PVYU021T3B4px7/JlAoCAR2YTSexTWESLspXvqWQDUaGEJEgMUEpry6VQxoyIeXpyD8+oo/qsN7XyZjfogQsoT8AzwHl5dfuh+iDmCUHak9icQaODplODvigaQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:31:38.911477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6764ffff-e5f6-4449-881e-0e6f2e11542b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for project e498ab168dde414db5130cbc6d21e325. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:31:38.917200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-6764ffff-e5f6-4449-881e-0e6f2e11542b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for user 896f039a62824d5bb1123d4694208aea and project e498ab168dde414db5130cbc6d21e325. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:31:38.942628 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6764ffff-e5f6-4449-881e-0e6f2e11542b tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.057091 Aug 06 21:31:38.943718 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2895/5971] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:31:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:39.058783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-82035e03-40e4-4b88-bced-8bd1878e73f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:39.188465 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-82035e03-40e4-4b88-bced-8bd1878e73f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.133558 Aug 06 21:31:39.189889 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3077/5972] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:40.024024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-548782150", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "e1e01123-1a1d-425c-9625-93ff5e0ac79e"}], "key_name": "tempest-TestNetworkBasicOps-498142656", "security_groups": [{"name": "tempest-secgroup-smoke-1381999730"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:31:40.141407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] validate_networks() for [('e1e01123-1a1d-425c-9625-93ff5e0ac79e', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:31:40.203476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b2d6a570-08e8-4a05-8672-ca1088730d8a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ced5820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:40.273352 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b2d6a570-08e8-4a05-8672-ca1088730d8a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.074740 Aug 06 21:31:40.274271 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3078/5973] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:40.556039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:31:40.556694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:31:40.557522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:31:40.558065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:31:40.558629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:31:40.578112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:40.578739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:40.579264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:40.580011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:40.580475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:40.580911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:40.599255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for project e498ab168dde414db5130cbc6d21e325. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:31:40.605038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Getting quotas for user 896f039a62824d5bb1123d4694208aea and project e498ab168dde414db5130cbc6d21e325. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:31:40.619546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:31:40.621983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:31:40.676866 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d258724d-9f3b-4245-8d54-f967cdfe73e8 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.658278 Aug 06 21:31:40.677484 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2896/5974] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:31:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:31:40.688320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba0860b1-1029-4e83-8c98-342d40423d07 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:40.688947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba0860b1-1029-4e83-8c98-342d40423d07 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:40.749260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba0860b1-1029-4e83-8c98-342d40423d07 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:40.765395 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba0860b1-1029-4e83-8c98-342d40423d07 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1247 microversion: 2.1 time: 0.080848 Aug 06 21:31:40.779930 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3079/5975] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:40 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:41.288278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b1c0f83-b7b5-4c60-b599-270d5afc2bc2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0a040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:41.347501 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b1c0f83-b7b5-4c60-b599-270d5afc2bc2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.063015 Aug 06 21:31:41.348076 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2897/5976] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:41.787796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:41.788515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:41.790673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:41.798179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:41.798680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:41.799142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:41.799867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:41.800392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:41.800776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:41.873783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:41.882190 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-34cf9573-9a9b-431d-8c96-27ceff3afad7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1305 microversion: 2.1 time: 0.098142 Aug 06 21:31:41.883099 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3080/5977] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:41 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:31:42.361925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f8221599-f283-413d-823c-d378dc1e8a10 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0a3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:42.416104 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f8221599-f283-413d-823c-d378dc1e8a10 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.058017 Aug 06 21:31:42.416786 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2898/5978] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:42.905057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:42.905855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:42.912972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:42.913500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:42.913907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:42.914642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:42.915121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:42.915535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:43.022339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d61d967e-2b40-42cb-b36b-dec7068e8129 req-57aa1100-ea92-4d52-ba1c-92cb22e2e306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b9bd5c-cdde-4a5a-818a-0370821bbbdf", "tag": "dc4caa03-5d08-481e-a4fb-bf35ddcae6ad"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:31:43.038623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d61d967e-2b40-42cb-b36b-dec7068e8129 req-57aa1100-ea92-4d52-ba1c-92cb22e2e306 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:43.039431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d61d967e-2b40-42cb-b36b-dec7068e8129 req-57aa1100-ea92-4d52-ba1c-92cb22e2e306 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:43.040045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d61d967e-2b40-42cb-b36b-dec7068e8129 req-57aa1100-ea92-4d52-ba1c-92cb22e2e306 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:43.053069 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d61d967e-2b40-42cb-b36b-dec7068e8129 req-57aa1100-ea92-4d52-ba1c-92cb22e2e306 service nova] Creating event network-changed:dc4caa03-5d08-481e-a4fb-bf35ddcae6ad for instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf on nch2-master-1 Aug 06 21:31:43.058424 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d61d967e-2b40-42cb-b36b-dec7068e8129 req-57aa1100-ea92-4d52-ba1c-92cb22e2e306 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045433 Aug 06 21:31:43.059075 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2899/5979] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:43.060998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:43.069625 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4bbe63e4-fe6f-434f-87a4-466c724112d7 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1373 microversion: 2.1 time: 0.169879 Aug 06 21:31:43.070210 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3081/5980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:42 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:43.431397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d572a9ea-82bf-4161-ba7b-02a3e4df7c10 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0adc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:43.483071 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d572a9ea-82bf-4161-ba7b-02a3e4df7c10 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056666 Aug 06 21:31:43.483681 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2900/5981] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:44.090582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:44.091203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:44.098451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:44.098975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:44.099416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:44.100112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:44.100575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:44.101007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:44.238561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:44.246208 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5eb6f344-e3c2-472c-8c6b-2bc667511158 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1373 microversion: 2.1 time: 0.159661 Aug 06 21:31:44.246816 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3082/5982] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:44 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:44.498120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-92e2fda0-0ab0-4664-9800-1cea5f407995 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cc4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:44.546767 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-92e2fda0-0ab0-4664-9800-1cea5f407995 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053977 Aug 06 21:31:44.547442 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2901/5983] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:45.267894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:45.268515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:45.275490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:45.275985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:45.276421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:45.277115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:45.277858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:45.278597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:45.412343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:45.423209 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e55c7a8e-63c5-436e-8693-c0ae79d1ae04 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1373 microversion: 2.1 time: 0.159105 Aug 06 21:31:45.423804 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3083/5984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:45 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:45.561457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bdf8e8b0-cdbe-4f49-9c28-48d4d73d89cf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d94e160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:45.609641 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bdf8e8b0-cdbe-4f49-9c28-48d4d73d89cf tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052917 Aug 06 21:31:45.610336 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2902/5985] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:46.445040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:46.445580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:46.453150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:46.453664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:46.454106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:46.454834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:46.455294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:46.455723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:46.593841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:46.601540 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-63fe350e-5980-4dd9-8453-009439f1acb9 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1373 microversion: 2.1 time: 0.160496 Aug 06 21:31:46.602104 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3084/5986] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:46 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:46.625858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-870337e5-3c76-4d3d-9a77-88563ea3e185 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:46.674155 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-870337e5-3c76-4d3d-9a77-88563ea3e185 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054180 Aug 06 21:31:46.674860 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2903/5987] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:47.160602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-1ec791f7-fa18-4c2f-81f7-69446e389760 req-4ef2f0fa-5d4d-43a2-862b-6c8aeb7287e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b9bd5c-cdde-4a5a-818a-0370821bbbdf", "name": "network-vif-plugged", "status": "completed", "tag": "dc4caa03-5d08-481e-a4fb-bf35ddcae6ad"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:31:47.172924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1ec791f7-fa18-4c2f-81f7-69446e389760 req-4ef2f0fa-5d4d-43a2-862b-6c8aeb7287e6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:47.173486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1ec791f7-fa18-4c2f-81f7-69446e389760 req-4ef2f0fa-5d4d-43a2-862b-6c8aeb7287e6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:47.174451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1ec791f7-fa18-4c2f-81f7-69446e389760 req-4ef2f0fa-5d4d-43a2-862b-6c8aeb7287e6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:47.186042 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-1ec791f7-fa18-4c2f-81f7-69446e389760 req-4ef2f0fa-5d4d-43a2-862b-6c8aeb7287e6 service nova] Creating event network-vif-plugged:dc4caa03-5d08-481e-a4fb-bf35ddcae6ad for instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf on nch2-master-1 Aug 06 21:31:47.191477 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-1ec791f7-fa18-4c2f-81f7-69446e389760 req-4ef2f0fa-5d4d-43a2-862b-6c8aeb7287e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034672 Aug 06 21:31:47.192964 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3085/5988] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:47.624359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:47.625104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:47.629151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:47.633358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:47.633847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:47.634287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:47.635231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:47.635700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:47.636138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:47.688840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ce994aa-d206-4261-bea2-daef65138880 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7559d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:47.745710 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ce994aa-d206-4261-bea2-daef65138880 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.061375 Aug 06 21:31:47.746445 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3086/5989] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:31:47.784239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:47.791912 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-29eafe0a-5781-4ce8-a6b7-6682523bb37c tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1373 microversion: 2.1 time: 0.171909 Aug 06 21:31:47.792492 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2904/5990] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:47 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:48.760690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cab964cb-2247-46f6-8669-9ad9ce8a74eb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c2af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:48.808255 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cab964cb-2247-46f6-8669-9ad9ce8a74eb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051915 Aug 06 21:31:48.808668 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3087/5991] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:48.813478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:48.814098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:48.821125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:48.821813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:48.822255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:48.822983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:48.823446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:48.823877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:48.957951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:48.965706 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-586994a7-9ec6-4f9d-888d-5069392e749a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1545 microversion: 2.1 time: 0.156178 Aug 06 21:31:48.967257 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2905/5992] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:48 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1545 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:31:48.988549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:48.989290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:31:48.991401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:48.998033 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:48.998527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:48.998995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:48.999696 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:49.000193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:49.000624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:49.138324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:31:49.146516 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08cf6085-c6da-48c9-b1c3-51a57c52f689 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1545 microversion: 2.1 time: 0.161870 Aug 06 21:31:49.147133 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3088/5993] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:31:48 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1545 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:31:49.821469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-060432a4-a7ec-4fb8-b1e7-7d76f5666527 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91e670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:49.874230 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-060432a4-a7ec-4fb8-b1e7-7d76f5666527 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056771 Aug 06 21:31:49.874846 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2906/5994] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:50.748611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-6635f374-6a2c-46ea-bb6e-f4830b8fe797 req-322951ef-c2f4-43f6-9050-e7cacc8b73b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b9bd5c-cdde-4a5a-818a-0370821bbbdf", "tag": "dc4caa03-5d08-481e-a4fb-bf35ddcae6ad"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:31:50.759929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:50.762069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6635f374-6a2c-46ea-bb6e-f4830b8fe797 req-322951ef-c2f4-43f6-9050-e7cacc8b73b1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:31:50.763010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6635f374-6a2c-46ea-bb6e-f4830b8fe797 req-322951ef-c2f4-43f6-9050-e7cacc8b73b1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:31:50.763669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6635f374-6a2c-46ea-bb6e-f4830b8fe797 req-322951ef-c2f4-43f6-9050-e7cacc8b73b1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:31:50.780917 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-6635f374-6a2c-46ea-bb6e-f4830b8fe797 req-322951ef-c2f4-43f6-9050-e7cacc8b73b1 service nova] Creating event network-changed:dc4caa03-5d08-481e-a4fb-bf35ddcae6ad for instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf on nch2-master-1 Aug 06 21:31:50.787103 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-6635f374-6a2c-46ea-bb6e-f4830b8fe797 req-322951ef-c2f4-43f6-9050-e7cacc8b73b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043150 Aug 06 21:31:50.788382 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3089/5995] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:50.886232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:50.887184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=10 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:50.893466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15961afc-4d3c-4467-8222-1bbff040bea2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c9245e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:50.953885 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15961afc-4d3c-4467-8222-1bbff040bea2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.067778 Aug 06 21:31:50.954829 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2907/5996] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:51.969612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-210cfd52-3446-41f1-a6c7-7f9dc0265649 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca113a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:52.016168 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-210cfd52-3446-41f1-a6c7-7f9dc0265649 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052058 Aug 06 21:31:52.016747 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3090/5997] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:53.030803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c4bad50-b37a-42d5-82a2-7fa8c39ea02d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91f550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:53.077229 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3c4bad50-b37a-42d5-82a2-7fa8c39ea02d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051355 Aug 06 21:31:53.077814 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2908/5998] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:54.090942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0786782e-8900-41e0-acb0-27a728b3d74f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343a160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:54.137757 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0786782e-8900-41e0-acb0-27a728b3d74f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051453 Aug 06 21:31:54.138378 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3091/5999] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:55.151909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-729576b8-a401-4fdd-a3ac-d50e8b0d3fb7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:55.198903 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-729576b8-a401-4fdd-a3ac-d50e8b0d3fb7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051540 Aug 06 21:31:55.199563 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2909/6000] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:56.213202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f7e002b-93fd-4ee3-9d4c-83053bcd4b82 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ced5af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:56.260289 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f7e002b-93fd-4ee3-9d4c-83053bcd4b82 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051719 Aug 06 21:31:56.260868 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3092/6001] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:57.274559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a053c3db-5c9b-41be-97d8-51f4282c3bf7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91eca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:57.321033 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a053c3db-5c9b-41be-97d8-51f4282c3bf7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051040 Aug 06 21:31:57.321604 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2910/6002] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:58.335864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4e4b3332-a9c6-4c84-b878-b64db0e11190 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d58e3a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:58.383279 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4e4b3332-a9c6-4c84-b878-b64db0e11190 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052021 Aug 06 21:31:58.383849 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3093/6003] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:31:59.394652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:59.395415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=16 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:31:59.399574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6c10bf12-ffaa-4497-9d49-cb82805d85d9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8fe310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:31:59.447611 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6c10bf12-ffaa-4497-9d49-cb82805d85d9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054445 Aug 06 21:31:59.448196 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2911/6004] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:31:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:00.462802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fc2f724f-627d-4b90-9289-24f1a1f76d49 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d58eaf0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:00.509421 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fc2f724f-627d-4b90-9289-24f1a1f76d49 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051944 Aug 06 21:32:00.509986 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3094/6005] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:01.524157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-93a664c2-9bca-493b-8ac0-0ca6ca5551db tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:01.571616 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-93a664c2-9bca-493b-8ac0-0ca6ca5551db tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052174 Aug 06 21:32:01.572190 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2912/6006] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:02.582160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:02.582973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=40 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:02.588053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e040161b-b785-4437-82cd-17510110c283 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c2790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:02.634175 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e040161b-b785-4437-82cd-17510110c283 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052862 Aug 06 21:32:02.634777 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3095/6007] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:03.650633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15f98d2c-f7f0-4b4a-b8d6-ec727d1cecdb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36415e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:03.698898 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15f98d2c-f7f0-4b4a-b8d6-ec727d1cecdb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053973 Aug 06 21:32:03.699472 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2913/6008] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:04.713958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab3d61a5-24be-41e9-8d61-c919c522bbae tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d6ce3a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:04.760566 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab3d61a5-24be-41e9-8d61-c919c522bbae tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051258 Aug 06 21:32:04.761150 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3096/6009] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:05.774933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e10a3410-ec7c-48e9-8705-08ea0c49bf08 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91ec10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:05.821750 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e10a3410-ec7c-48e9-8705-08ea0c49bf08 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051598 Aug 06 21:32:05.822328 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2914/6010] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:06.835828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-864d3787-e3e5-4769-9d4a-e7abc6785398 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7559d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:06.882261 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-864d3787-e3e5-4769-9d4a-e7abc6785398 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051294 Aug 06 21:32:06.882878 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3097/6011] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:07.897604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-53706f8f-6f27-4e1a-84e1-b859f5684184 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:07.944754 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-53706f8f-6f27-4e1a-84e1-b859f5684184 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051884 Aug 06 21:32:07.945336 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2915/6012] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:08.959664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-55fc9995-5a96-44e6-919c-e59f785d7e4a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a83a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:09.006391 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-55fc9995-5a96-44e6-919c-e59f785d7e4a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051584 Aug 06 21:32:09.006982 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3098/6013] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:10.021644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5e8c9644-b66b-44bc-9c63-bf82c7e57c99 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91fd30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:10.069334 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5e8c9644-b66b-44bc-9c63-bf82c7e57c99 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052688 Aug 06 21:32:10.069927 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2916/6014] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:11.085163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f0983ef-598f-4411-9dcd-5d3d02b24aa9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c21f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:11.132265 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f0983ef-598f-4411-9dcd-5d3d02b24aa9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051864 Aug 06 21:32:11.132875 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3099/6015] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:12.147878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-09f6e73e-424d-4e69-8962-5b05b634324a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c906820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:12.194693 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-09f6e73e-424d-4e69-8962-5b05b634324a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051665 Aug 06 21:32:12.195278 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2917/6016] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:13.056873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d5a82365-331c-4d21-9242-5713fb73ec2a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:32:13.060321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d5a82365-331c-4d21-9242-5713fb73ec2a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:32:13.066602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a82365-331c-4d21-9242-5713fb73ec2a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:13.067104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a82365-331c-4d21-9242-5713fb73ec2a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:13.067556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a82365-331c-4d21-9242-5713fb73ec2a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:13.068266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a82365-331c-4d21-9242-5713fb73ec2a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:13.068738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a82365-331c-4d21-9242-5713fb73ec2a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:13.069174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d5a82365-331c-4d21-9242-5713fb73ec2a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:13.118847 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d5a82365-331c-4d21-9242-5713fb73ec2a tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "POST /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf/action" status: 200 len: 24572 microversion: 2.1 time: 0.066747 Aug 06 21:32:13.119483 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3100/6017] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:32:13 2022] POST /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:32:13.290033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dcd86226-96a5-4bc9-ad27-63b308c3f5c6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91e790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:13.336950 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dcd86226-96a5-4bc9-ad27-63b308c3f5c6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051616 Aug 06 21:32:13.337528 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2918/6018] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:14.350405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c6c41e21-f383-445c-8d7c-32102a7f6147 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:14.399618 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c6c41e21-f383-445c-8d7c-32102a7f6147 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053211 Aug 06 21:32:14.400663 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3101/6019] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:15.415435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-81bb58c6-ae9e-4996-bfb9-e88eef686eb0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91aaf0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:15.462587 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-81bb58c6-ae9e-4996-bfb9-e88eef686eb0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052066 Aug 06 21:32:15.463189 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2919/6020] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:16.478308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-56b370d7-9e96-436f-b6d0-613366f93813 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343a940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:16.525703 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-56b370d7-9e96-436f-b6d0-613366f93813 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052936 Aug 06 21:32:16.526271 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3102/6021] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:17.540323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf35cb39-87be-4490-9763-e89a7e26d656 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:17.587703 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bf35cb39-87be-4490-9763-e89a7e26d656 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052071 Aug 06 21:32:17.588284 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2920/6022] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:18.602759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c0b7264b-a384-4c9f-9993-f33018d0b795 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d5614c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:18.649642 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c0b7264b-a384-4c9f-9993-f33018d0b795 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051512 Aug 06 21:32:18.650212 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3103/6023] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:19.665028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-da9e3257-f4a1-45ab-baaa-d1aaadccdb7a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec3a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:19.699596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9bd2d6c9-3d27-4d8f-9148-501882276535 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:32:19.701941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9bd2d6c9-3d27-4d8f-9148-501882276535 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:32:19.708247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bd2d6c9-3d27-4d8f-9148-501882276535 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:19.708739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bd2d6c9-3d27-4d8f-9148-501882276535 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:19.709183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bd2d6c9-3d27-4d8f-9148-501882276535 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:19.709891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bd2d6c9-3d27-4d8f-9148-501882276535 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:19.710359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bd2d6c9-3d27-4d8f-9148-501882276535 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:19.710828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9bd2d6c9-3d27-4d8f-9148-501882276535 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:19.715225 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-da9e3257-f4a1-45ab-baaa-d1aaadccdb7a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055474 Aug 06 21:32:19.716163 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2921/6024] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:19.763513 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9bd2d6c9-3d27-4d8f-9148-501882276535 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "POST /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf/action" status: 200 len: 32646 microversion: 2.1 time: 0.068421 Aug 06 21:32:19.764150 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3104/6025] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:32:19 2022] POST /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf/action => generated 32646 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 21:32:20.731775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2a9469d5-7109-484b-a318-dad855348157 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91ec10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:20.787841 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2a9469d5-7109-484b-a318-dad855348157 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.062137 Aug 06 21:32:20.788439 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2922/6026] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:20.875012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:20.876197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:32:20.879267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-85564ec2-8d07-40cc-a7f1-7112242e8506 req-e77b6a71-18bc-4f84-a5da-1b1bd3802552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b9bd5c-cdde-4a5a-818a-0370821bbbdf", "tag": "dc4caa03-5d08-481e-a4fb-bf35ddcae6ad"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:32:20.884573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:20.885062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:20.885499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:20.886399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:20.886888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:20.887348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:20.891057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-85564ec2-8d07-40cc-a7f1-7112242e8506 req-e77b6a71-18bc-4f84-a5da-1b1bd3802552 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:20.891608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-85564ec2-8d07-40cc-a7f1-7112242e8506 req-e77b6a71-18bc-4f84-a5da-1b1bd3802552 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:20.892114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-85564ec2-8d07-40cc-a7f1-7112242e8506 req-e77b6a71-18bc-4f84-a5da-1b1bd3802552 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:20.904612 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-85564ec2-8d07-40cc-a7f1-7112242e8506 req-e77b6a71-18bc-4f84-a5da-1b1bd3802552 service nova] Creating event network-changed:dc4caa03-5d08-481e-a4fb-bf35ddcae6ad for instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf on nch2-master-1 Aug 06 21:32:20.911561 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-85564ec2-8d07-40cc-a7f1-7112242e8506 req-e77b6a71-18bc-4f84-a5da-1b1bd3802552 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035352 Aug 06 21:32:20.913049 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2923/6027] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:20.933739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:32:21.034916 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-857664e9-0ea4-41c4-bcc3-a50f1982b9c2 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 204 len: 0 microversion: 2.1 time: 0.163551 Aug 06 21:32:21.035568 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3105/6028] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:32:20 2022] DELETE /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:32:21.044884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:21.045598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:32:21.052073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:21.052555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:21.052994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:21.053716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:21.054169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:21.054826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:21.216411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:32:21.227349 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21d61712-8e33-4f76-b0ad-0626795a88f4 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1670 microversion: 2.1 time: 0.186948 Aug 06 21:32:21.227944 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2924/6029] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:32:21 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1670 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:32:21.802766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a00ef1bd-9792-48f2-8c9b-e19ff0e1e9cb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d561d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:21.854431 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a00ef1bd-9792-48f2-8c9b-e19ff0e1e9cb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056128 Aug 06 21:32:21.855121 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3106/6030] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:22.252240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:22.252854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:32:22.259696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:22.260178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:22.260615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:22.261301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:22.261755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:22.262773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:22.490380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f039a62824d5bb1123d4694208aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e498ab168dde414db5130cbc6d21e325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:32:22.499272 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b79832bf-3b99-4a4e-8d7e-face7753c583 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 200 len: 1670 microversion: 2.1 time: 0.250920 Aug 06 21:32:22.499865 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2925/6031] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:32:22 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 1670 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:32:22.870859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08005e7f-a87b-4a1d-a16d-072e0a66a5c9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d8d1af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:22.924603 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08005e7f-a87b-4a1d-a16d-072e0a66a5c9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.059472 Aug 06 21:32:22.925326 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3107/6032] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:22.927605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-580a1c26-aa77-400d-9c5c-b423a634b7ec req-63bc1f1e-aa22-4474-8aae-23044df0152e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b9bd5c-cdde-4a5a-818a-0370821bbbdf", "name": "network-vif-deleted", "tag": "dc4caa03-5d08-481e-a4fb-bf35ddcae6ad"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:32:22.937730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-580a1c26-aa77-400d-9c5c-b423a634b7ec req-63bc1f1e-aa22-4474-8aae-23044df0152e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:22.938237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-580a1c26-aa77-400d-9c5c-b423a634b7ec req-63bc1f1e-aa22-4474-8aae-23044df0152e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:22.938921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-580a1c26-aa77-400d-9c5c-b423a634b7ec req-63bc1f1e-aa22-4474-8aae-23044df0152e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:22.951016 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-580a1c26-aa77-400d-9c5c-b423a634b7ec req-63bc1f1e-aa22-4474-8aae-23044df0152e service nova] Creating event network-vif-deleted:dc4caa03-5d08-481e-a4fb-bf35ddcae6ad for instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf on nch2-master-1 Aug 06 21:32:22.956246 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-580a1c26-aa77-400d-9c5c-b423a634b7ec req-63bc1f1e-aa22-4474-8aae-23044df0152e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032302 Aug 06 21:32:22.956871 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2926/6033] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:32:23.522021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:23.522883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] [instance: a8b9bd5c-cdde-4a5a-818a-0370821bbbdf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:32:23.530873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:23.531368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:23.531813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:23.532524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:32:23.532988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:32:23.533420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:32:23.547667 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] HTTP exception thrown: Instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf could not be found. Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Request method failure captured: Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf HTTP/1.1 Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7t1Oe3wtESfG9N76uK9P_htJ-t58EXIlE-9VW8vn2k_M_IOKpo-m63_Y8QlbTOimPe_sJ6p8ROne0PzOVshvmQCrXI4UNbvuF5HF8dFIXAqlLHnTEruoKrkUNAnGLRzzXQPQKxfGY09toO_AZi0UaXQtz_2OTIlub1UPUe0JmWTpK3s Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: e498ab168dde414db5130cbc6d21e325 Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TestNetworkBasicOps-1721865985 Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e498ab168dde414db5130cbc6d21e325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e498ab168dde414db5130cbc6d21e325", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e498ab168dde414db5130cbc6d21e325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e498ab168dde414db5130cbc6d21e325"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TestNetworkBasicOps-1721865985 Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: e498ab168dde414db5130cbc6d21e325 Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TestNetworkBasicOps-1721865985 Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TestNetworkBasicOps-1721865985-project Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 896f039a62824d5bb1123d4694208aea Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TestNetworkBasicOps-1721865985-project Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf could not be found. Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'a8b9bd5c-cdde-4a5a-818a-0370821bbbdf'} Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf could not be found. Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf could not be found. Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:32:23.549322 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf could not be found. Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Returning 404 to user: Instance a8b9bd5c-cdde-4a5a-818a-0370821bbbdf could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-577b16b7-22ec-4beb-a824-8b063c584671 tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf" status: 404 len: 111 microversion: 2.1 time: 0.033444 Aug 06 21:32:23.554266 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3108/6034] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:32:23 2022] GET /compute/v2.1/servers/a8b9bd5c-cdde-4a5a-818a-0370821bbbdf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:32:23.720517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bb11db9b-6e1b-4931-a63b-ed646e2a70ab tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] Calling method '.version_select at 0x7f729c8e8c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:23.740152 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bb11db9b-6e1b-4931-a63b-ed646e2a70ab tempest-TestNetworkBasicOps-1721865985 tempest-TestNetworkBasicOps-1721865985-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-498142656" status: 202 len: 0 microversion: 2.1 time: 0.024789 Aug 06 21:32:23.741104 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2927/6035] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 21:32:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-498142656 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:32:23.939620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb6b83f9-126b-4795-af43-8356c3a68c5c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d941550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:23.989557 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb6b83f9-126b-4795-af43-8356c3a68c5c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053950 Aug 06 21:32:23.990129 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3109/6036] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:25.004339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0de663bf-c8d9-43a8-94b2-f92061aafbc2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c960dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:25.064446 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0de663bf-c8d9-43a8-94b2-f92061aafbc2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.064071 Aug 06 21:32:25.065450 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2928/6037] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:26.079400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-47176562-eee0-4064-8d60-8cec5dac1766 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7c2790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:26.135308 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-47176562-eee0-4064-8d60-8cec5dac1766 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.059340 Aug 06 21:32:26.136170 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3110/6038] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:27.150021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95cba8e8-1235-48ba-b162-037153f90595 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0ad30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:27.199268 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-95cba8e8-1235-48ba-b162-037153f90595 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053719 Aug 06 21:32:27.199859 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2929/6039] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:28.213819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-43ddf6ce-089d-4b3e-a723-4708c5ab3a27 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729da9d430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:28.261453 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-43ddf6ce-089d-4b3e-a723-4708c5ab3a27 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052336 Aug 06 21:32:28.262961 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3111/6040] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:29.275781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-695740fd-04e6-4964-b539-3412c5dd067a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8e8c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:29.329881 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-695740fd-04e6-4964-b539-3412c5dd067a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057357 Aug 06 21:32:29.330628 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2930/6041] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:30.344746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2ac5483d-89ba-40cf-9282-8d49356d19f5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce87280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:30.393262 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2ac5483d-89ba-40cf-9282-8d49356d19f5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053833 Aug 06 21:32:30.393952 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3112/6042] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:31.407916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-28a3ef20-5925-4744-a1ea-d3a2f3f397ec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c9060d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:31.456493 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-28a3ef20-5925-4744-a1ea-d3a2f3f397ec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053026 Aug 06 21:32:31.457143 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2931/6043] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:32.472650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-322cbbb2-b4be-4ac9-872a-5c6d5a5e354f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7a1e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:32.533782 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-322cbbb2-b4be-4ac9-872a-5c6d5a5e354f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.067209 Aug 06 21:32:32.534604 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3113/6044] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:33.545746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=16 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:33.549900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b9a5c2d1-cd50-42dc-a66e-fe8483a49d0b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cce50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:33.601648 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b9a5c2d1-cd50-42dc-a66e-fe8483a49d0b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057663 Aug 06 21:32:33.602375 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2932/6045] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:34.614398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:34.615953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:34.620542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7caff724-231c-4131-9d4c-f7505404cd4a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7785e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:34.704203 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7caff724-231c-4131-9d4c-f7505404cd4a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.091476 Aug 06 21:32:34.704910 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3114/6046] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:35.717808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ece9aeeb-8d65-4692-a198-5b51f5a146ac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cca60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:35.734183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:35.792302 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ece9aeeb-8d65-4692-a198-5b51f5a146ac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.078842 Aug 06 21:32:35.793052 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2933/6047] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:36.807125 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d1cf86df-a62b-4477-afc5-1574458269bb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729da9d4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:36.858901 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d1cf86df-a62b-4477-afc5-1574458269bb tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055734 Aug 06 21:32:36.859493 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3115/6048] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:37.874354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7d317632-8180-41ea-96f3-707b6150cd49 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8fe700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:37.956049 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7d317632-8180-41ea-96f3-707b6150cd49 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.087089 Aug 06 21:32:37.956633 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2934/6049] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:38.970753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb7b0e8e-ff38-42d7-8fbf-ac5eb6b28314 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:39.034599 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb7b0e8e-ff38-42d7-8fbf-ac5eb6b28314 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.069054 Aug 06 21:32:39.035221 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3116/6050] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:40.050198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6bfb5689-4ea9-4929-ae6a-85e7aeae19de tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0aaf0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:40.135351 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6bfb5689-4ea9-4929-ae6a-85e7aeae19de tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.090706 Aug 06 21:32:40.136376 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2935/6051] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:41.150828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd2ed54c-c138-46f0-9426-40d718254498 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c787af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:41.205700 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd2ed54c-c138-46f0-9426-40d718254498 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.060333 Aug 06 21:32:41.206373 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3117/6052] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:42.221063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3b71597-f571-4845-9f10-713ef1e4486a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d94e820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:42.303659 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f3b71597-f571-4845-9f10-713ef1e4486a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.087320 Aug 06 21:32:42.304521 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2936/6053] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:43.317227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f778e89a-2f12-4377-902c-cb407b720025 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:43.377111 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f778e89a-2f12-4377-902c-cb407b720025 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.063688 Aug 06 21:32:43.377834 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3118/6054] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:44.391744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-181eb11e-13e9-44ed-ac92-27d74093cf4e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec3e50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:44.442086 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-181eb11e-13e9-44ed-ac92-27d74093cf4e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055005 Aug 06 21:32:44.442704 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2937/6055] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:44.857986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f74dcba3-c40b-4be3-922d-db402f5b9f0b tempest-TestVolumeBootPattern-687728872 tempest-TestVolumeBootPattern-687728872-project] Action: 'create', calling method: .version_select at 0x7f729cdbf790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-505200470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9RkfBZqEc0FXjDP1s7oQfCrdYHlcMuO89x2syLMTOqI6iShoxN7+Jda/4cTOt0WXz0ba+J8IZezUIvxyZtq72Ad67pGGrZOQpa+LS3YRZxscMz2Cpekt4fbY1DqXbJJg=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:32:44.879634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f74dcba3-c40b-4be3-922d-db402f5b9f0b tempest-TestVolumeBootPattern-687728872 tempest-TestVolumeBootPattern-687728872-project] Getting quotas for project 5cf0a7d2509d446b89fd2892d71202b9. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:32:44.885394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-f74dcba3-c40b-4be3-922d-db402f5b9f0b tempest-TestVolumeBootPattern-687728872 tempest-TestVolumeBootPattern-687728872-project] Getting quotas for user 4f9c25ad36c74bae879ce0f259c76027 and project 5cf0a7d2509d446b89fd2892d71202b9. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:32:44.913179 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f74dcba3-c40b-4be3-922d-db402f5b9f0b tempest-TestVolumeBootPattern-687728872 tempest-TestVolumeBootPattern-687728872-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.060856 Aug 06 21:32:44.913871 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3119/6056] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:32:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:45.459157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab191bba-cb06-435b-b8cd-0ebf57adb992 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91e3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:45.517202 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab191bba-cb06-435b-b8cd-0ebf57adb992 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.064814 Aug 06 21:32:45.517807 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2938/6057] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:46.532426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f5a8bf1-a990-4f0a-bc8f-2310acdb52ea tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:46.579000 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f5a8bf1-a990-4f0a-bc8f-2310acdb52ea tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051897 Aug 06 21:32:46.579565 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3120/6058] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:47.593740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aae9664a-b319-4267-92eb-b0c278347a5b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cec38b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:47.644175 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aae9664a-b319-4267-92eb-b0c278347a5b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055702 Aug 06 21:32:47.644722 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2939/6059] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:32:47.666141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e4b591de-4b24-47fb-a9be-f253483d64f2 tempest-TestVolumeBootPattern-687728872 tempest-TestVolumeBootPattern-687728872-project] Calling method '.version_select at 0x7f72a343a8b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:47.693793 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e4b591de-4b24-47fb-a9be-f253483d64f2 tempest-TestVolumeBootPattern-687728872 tempest-TestVolumeBootPattern-687728872-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-505200470" status: 202 len: 0 microversion: 2.1 time: 0.031569 Aug 06 21:32:47.694291 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3121/6060] 10.222.0.33 () {58 vars in 1260 bytes} [Sat Aug 6 21:32:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-505200470 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:32:48.659312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e9b0718e-7577-4675-a383-d98ea8ed8fa7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91e5e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:48.726403 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e9b0718e-7577-4675-a383-d98ea8ed8fa7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.071151 Aug 06 21:32:48.727244 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2940/6061] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:49.740739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92a12d66-7d63-4dd3-b9d5-2351b5c5b667 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343a940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:49.793011 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92a12d66-7d63-4dd3-b9d5-2351b5c5b667 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057220 Aug 06 21:32:49.794252 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3122/6062] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:50.811163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f4970d1f-d78b-43b9-a905-36b725d98792 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:50.867338 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f4970d1f-d78b-43b9-a905-36b725d98792 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.062869 Aug 06 21:32:50.868203 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2941/6063] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:51.882470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92513dfa-fd14-4810-9bf1-b97dc65ca70e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d63f940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:51.967163 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92513dfa-fd14-4810-9bf1-b97dc65ca70e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.089512 Aug 06 21:32:51.968223 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3123/6064] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:52.982256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1a9e3771-bed0-4258-a25c-aadb7a9fa464 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1040>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:53.040760 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1a9e3771-bed0-4258-a25c-aadb7a9fa464 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.063834 Aug 06 21:32:53.041364 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2942/6065] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:54.055737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bea4590-b29b-481f-8cdf-49e97e9201b5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7d8310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:54.105592 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8bea4590-b29b-481f-8cdf-49e97e9201b5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054511 Aug 06 21:32:54.106234 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3124/6066] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:55.120326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a7dff96e-83e7-44fc-ada9-fb8c3b981807 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35cc430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:55.172851 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a7dff96e-83e7-44fc-ada9-fb8c3b981807 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057551 Aug 06 21:32:55.173639 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2943/6067] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:56.184517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:56.189599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fe52e29b-385d-4f22-a4a6-696b2b35e810 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d76daf0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:56.239349 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fe52e29b-385d-4f22-a4a6-696b2b35e810 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056020 Aug 06 21:32:56.239928 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3125/6068] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:57.253831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ecf559ec-47b8-4294-b942-b31beac952c4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1b80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:57.301203 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ecf559ec-47b8-4294-b942-b31beac952c4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051975 Aug 06 21:32:57.301785 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2944/6069] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:58.313098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:32:58.317460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fab8baa4-6903-454d-9fb0-c19df264a62e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d76d940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:58.363981 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fab8baa4-6903-454d-9fb0-c19df264a62e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052354 Aug 06 21:32:58.364547 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3126/6070] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:32:59.378640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-063e8db8-763e-4fde-afd3-5c7511560802 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a36418b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:32:59.424618 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-063e8db8-763e-4fde-afd3-5c7511560802 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050541 Aug 06 21:32:59.425369 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2945/6071] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:32:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:00.439702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ebc924ef-b1c2-4eec-81e7-ae0634f96862 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343a3a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:00.486969 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ebc924ef-b1c2-4eec-81e7-ae0634f96862 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052095 Aug 06 21:33:00.487533 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3127/6072] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:01.502186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-928780af-a763-4db0-865d-f8bb6bf03e39 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c9af0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:01.549740 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-928780af-a763-4db0-865d-f8bb6bf03e39 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052574 Aug 06 21:33:01.550316 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2946/6073] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:02.564109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b005047f-7690-49e3-8dfa-eced7053e1b3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7d8310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:02.611290 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b005047f-7690-49e3-8dfa-eced7053e1b3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052142 Aug 06 21:33:02.611865 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3128/6074] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:03.625091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e9bbea26-2346-42d8-949b-7a64330deb48 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:03.674255 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e9bbea26-2346-42d8-949b-7a64330deb48 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053849 Aug 06 21:33:03.674889 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2947/6075] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:04.690015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5ac3eb05-64b1-466a-ba03-e487279e925d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729da9d4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:04.739759 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5ac3eb05-64b1-466a-ba03-e487279e925d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055244 Aug 06 21:33:04.740328 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3129/6076] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:05.754677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a3fb35c-f489-497c-a757-bac91baf5b61 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8d4940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:05.805225 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5a3fb35c-f489-497c-a757-bac91baf5b61 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055438 Aug 06 21:33:05.805817 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2948/6077] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:06.820826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-109a9f29-d120-40bf-9801-e190bf477b5e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d63f430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:06.867191 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-109a9f29-d120-40bf-9801-e190bf477b5e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051384 Aug 06 21:33:06.867751 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3130/6078] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:33:07.881945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dfaa9abd-8018-41e1-b676-263201a014d9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:07.928248 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dfaa9abd-8018-41e1-b676-263201a014d9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050898 Aug 06 21:33:07.928821 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2949/6079] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:08.942693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-88e2c14a-7f57-47f9-b9c6-737f0ecbabb2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:08.989164 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-88e2c14a-7f57-47f9-b9c6-737f0ecbabb2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051246 Aug 06 21:33:08.989814 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3131/6080] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:10.004288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ec375da1-66ae-420b-b79b-018208a3765a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:10.051249 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ec375da1-66ae-420b-b79b-018208a3765a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051659 Aug 06 21:33:10.051818 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2950/6081] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:11.064908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2015ad5f-dcb2-4f35-8cba-46d1af2c49ef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a344cee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:11.113670 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2015ad5f-dcb2-4f35-8cba-46d1af2c49ef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053535 Aug 06 21:33:11.114243 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3132/6082] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:12.128440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-808e8b7e-5b9a-4710-9a98-73fcfa50e1be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c9430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:12.175466 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-808e8b7e-5b9a-4710-9a98-73fcfa50e1be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051728 Aug 06 21:33:12.176053 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2951/6083] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:13.190336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-664ff698-1aa2-46ba-a9e3-d3a086af0b36 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d778b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:13.237135 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-664ff698-1aa2-46ba-a9e3-d3a086af0b36 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051860 Aug 06 21:33:13.237816 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3133/6084] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:14.251977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a128f91-c617-4a45-a7b9-c85108cc73fc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91e430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:14.298467 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a128f91-c617-4a45-a7b9-c85108cc73fc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051426 Aug 06 21:33:14.299086 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2952/6085] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:15.313576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68e3f4e4-446d-4425-bb2d-28ce7c9915b2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d63f0d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:15.359088 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-68e3f4e4-446d-4425-bb2d-28ce7c9915b2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050630 Aug 06 21:33:15.359913 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3134/6086] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:16.374461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8f251b4d-4191-413a-806d-04929889cf92 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:16.421072 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8f251b4d-4191-413a-806d-04929889cf92 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051490 Aug 06 21:33:16.421639 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2953/6087] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:17.435871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d9f1642-6ae5-4b99-979c-f462493df2e3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce875e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:17.483564 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d9f1642-6ae5-4b99-979c-f462493df2e3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052591 Aug 06 21:33:17.484140 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3135/6088] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:18.498955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8bdaef95-801f-481b-a34c-540ef6a48b20 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cfa2940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:18.547753 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8bdaef95-801f-481b-a34c-540ef6a48b20 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053126 Aug 06 21:33:18.548556 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2954/6089] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:19.562684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-435410b0-7b9b-4053-8d31-10ef80066564 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7d8700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:19.608415 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-435410b0-7b9b-4053-8d31-10ef80066564 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050588 Aug 06 21:33:19.608983 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3136/6090] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:20.623854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c04fd45-5c81-4c3f-851b-0b716d168677 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c9280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:20.676524 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c04fd45-5c81-4c3f-851b-0b716d168677 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057540 Aug 06 21:33:20.678426 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2955/6091] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:21.692878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c491ce2d-4068-4dd6-bce2-c6474c762aa0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d5a4c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:21.738866 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c491ce2d-4068-4dd6-bce2-c6474c762aa0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051142 Aug 06 21:33:21.739465 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3137/6092] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:22.753496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0a0af6a-3284-44db-8672-2991005d005a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8fe430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:22.799653 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0a0af6a-3284-44db-8672-2991005d005a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051454 Aug 06 21:33:22.800456 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2956/6093] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:23.815147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04403c41-229e-407e-8445-e34063fd249b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce87280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:23.862082 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-04403c41-229e-407e-8445-e34063fd249b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051952 Aug 06 21:33:23.862678 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3138/6094] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:24.876139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e9743426-9f3d-4d6d-bec6-dd35a46628ac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1310>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:24.923038 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e9743426-9f3d-4d6d-bec6-dd35a46628ac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051520 Aug 06 21:33:24.924399 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2957/6095] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:25.937910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ef5066d-2621-4bc3-abb2-035434d6ab8a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d8e90d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:25.984079 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8ef5066d-2621-4bc3-abb2-035434d6ab8a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050934 Aug 06 21:33:25.984655 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3139/6096] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:26.999168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b917dadb-6bd6-4317-a6af-f525f81f0801 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:27.045911 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b917dadb-6bd6-4317-a6af-f525f81f0801 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051661 Aug 06 21:33:27.046226 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2958/6097] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:28.060355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2ba6dae2-aa82-4905-a2a5-94c21b04ff6c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d63fca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:28.106261 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2ba6dae2-aa82-4905-a2a5-94c21b04ff6c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050746 Aug 06 21:33:28.106869 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3140/6098] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:29.121400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-96e0f10f-62fa-4883-86b3-45e553f6980e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c9280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:29.167630 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-96e0f10f-62fa-4883-86b3-45e553f6980e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050928 Aug 06 21:33:29.168606 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2959/6099] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:30.182395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9bcdaef0-75cc-4351-a75d-e973464fcc7a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7a13a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:30.231445 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9bcdaef0-75cc-4351-a75d-e973464fcc7a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053820 Aug 06 21:33:30.232027 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3141/6100] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:31.246114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-30e01999-7b42-4e30-8c05-33df9711a6a3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf8d3a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:31.293374 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-30e01999-7b42-4e30-8c05-33df9711a6a3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051945 Aug 06 21:33:31.294237 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2960/6101] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:32.308834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a8d36ecb-eb87-4878-99e1-320c5a9950e1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:32.356478 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a8d36ecb-eb87-4878-99e1-320c5a9950e1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052428 Aug 06 21:33:32.357089 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3142/6102] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:33.371898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9f841c9d-e71a-47ed-8c69-edeb0dc3ad01 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:33.420487 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9f841c9d-e71a-47ed-8c69-edeb0dc3ad01 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053224 Aug 06 21:33:33.421067 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2961/6103] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:34.435690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fb8f7d7c-f2c0-4c6d-bcbe-fa93f2425436 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d561ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:34.483947 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fb8f7d7c-f2c0-4c6d-bcbe-fa93f2425436 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052902 Aug 06 21:33:34.484523 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3143/6104] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:35.498951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cfc9e5ec-22da-4d49-86e7-9bd0fd6bdef8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91aaf0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:35.549444 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cfc9e5ec-22da-4d49-86e7-9bd0fd6bdef8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055067 Aug 06 21:33:35.550609 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2962/6105] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:36.564318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b5ec6b01-1880-4f37-a48f-8591cf4dcb51 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d785e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:36.611519 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b5ec6b01-1880-4f37-a48f-8591cf4dcb51 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051796 Aug 06 21:33:36.612093 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3144/6106] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:37.625095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-07ed408a-87e5-4fa6-8b99-04cef3239419 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cfa2160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:37.672480 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-07ed408a-87e5-4fa6-8b99-04cef3239419 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052130 Aug 06 21:33:37.673076 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2963/6107] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:38.686834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c0ac97d-660b-4e81-9731-10b5170774f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c755ca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:38.735204 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c0ac97d-660b-4e81-9731-10b5170774f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053260 Aug 06 21:33:38.735778 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3145/6108] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:39.750116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1eb55ae0-5d37-4b61-8f07-24c3a246459e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d8d9790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:39.797101 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1eb55ae0-5d37-4b61-8f07-24c3a246459e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051713 Aug 06 21:33:39.797678 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2964/6109] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:40.812086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b39715bc-de3a-4229-a022-fc1399024c87 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7d8b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:40.865631 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b39715bc-de3a-4229-a022-fc1399024c87 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.057971 Aug 06 21:33:40.866263 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3146/6110] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:41.883769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d1ebd68-146a-419e-86a1-796041c92620 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:41.931053 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d1ebd68-146a-419e-86a1-796041c92620 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053965 Aug 06 21:33:41.931656 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2965/6111] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:42.945619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a54d8be8-ad80-4ba7-a4af-2177156d5344 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daf4ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:42.991927 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a54d8be8-ad80-4ba7-a4af-2177156d5344 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051649 Aug 06 21:33:42.992582 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3147/6112] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:44.007717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c0ffcf0-796b-497e-a912-e4baf4a998f6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d359d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:44.036029 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:33:44.036497 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:33:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:33:44.055896 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c0ffcf0-796b-497e-a912-e4baf4a998f6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053838 Aug 06 21:33:44.056480 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2966/6113] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:45.070769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d4c31120-fa5a-47de-b966-72d7bea05dc5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7a11f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:45.116733 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d4c31120-fa5a-47de-b966-72d7bea05dc5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051320 Aug 06 21:33:45.117297 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3148/6114] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:33:46.131634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e8fcd24a-712f-420e-9dc5-23c9b548fe2d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:46.177571 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e8fcd24a-712f-420e-9dc5-23c9b548fe2d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051032 Aug 06 21:33:46.178139 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2967/6115] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:47.194767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f666e549-eab5-411e-ade8-a13c1f012db9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daf4ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:47.241258 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f666e549-eab5-411e-ade8-a13c1f012db9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053940 Aug 06 21:33:47.241841 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3149/6116] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:48.256448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-44c67943-d9b3-4cb0-9da7-a5f01cf17682 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8d4a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:48.306263 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-44c67943-d9b3-4cb0-9da7-a5f01cf17682 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055269 Aug 06 21:33:48.307093 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2968/6117] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:49.320833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f96d03c-7f8b-411a-8ea8-a8ee06b9f5c9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d561a60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:49.366208 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f96d03c-7f8b-411a-8ea8-a8ee06b9f5c9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050849 Aug 06 21:33:49.366804 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3150/6118] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:50.381997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7262917d-aa27-4864-8a35-1134cc0ac848 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1dc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:50.429864 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7262917d-aa27-4864-8a35-1134cc0ac848 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053402 Aug 06 21:33:50.430443 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2969/6119] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:33:51.724174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ce548280-6189-4d3b-959a-5ca549115271 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7a18b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:51.770501 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ce548280-6189-4d3b-959a-5ca549115271 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.330030 Aug 06 21:33:51.771103 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3151/6120] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:52.785357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e806c46-002a-45a3-9c56-76480a665fde tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8da700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:52.939790 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e806c46-002a-45a3-9c56-76480a665fde tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.159374 Aug 06 21:33:52.940376 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2970/6121] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:53.954959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-19b003df-10a6-4197-a7ad-b6563801cdc9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d9415e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:54.001675 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-19b003df-10a6-4197-a7ad-b6563801cdc9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051467 Aug 06 21:33:54.002252 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3152/6122] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:55.016252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3a7ad1d2-0c73-41d6-802d-95ea05068827 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:55.062437 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3a7ad1d2-0c73-41d6-802d-95ea05068827 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050696 Aug 06 21:33:55.063122 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2971/6123] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:56.076541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66459ebc-d6e4-432b-8d90-bc0e5b2aa3c4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7859d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:56.177336 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66459ebc-d6e4-432b-8d90-bc0e5b2aa3c4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.105330 Aug 06 21:33:56.177910 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3153/6124] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:57.192555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-095e565b-3251-45fa-b3c0-4d03b28fb265 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8dd550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:57.240709 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-095e565b-3251-45fa-b3c0-4d03b28fb265 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052865 Aug 06 21:33:57.242125 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2972/6125] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:58.255971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16f584bc-70c7-4f98-9864-706cff330413 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d561700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:58.302761 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16f584bc-70c7-4f98-9864-706cff330413 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051308 Aug 06 21:33:58.303334 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3154/6126] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:33:59.317266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-87ed74e9-0648-4f86-b6f5-7187e35d2026 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0ab80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:33:59.363346 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-87ed74e9-0648-4f86-b6f5-7187e35d2026 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050997 Aug 06 21:33:59.363921 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2973/6127] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:33:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:00.378339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5da6c4c5-ea79-4621-8467-2bb41d18eea2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d5a4310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:00.427489 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5da6c4c5-ea79-4621-8467-2bb41d18eea2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054046 Aug 06 21:34:00.428083 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3155/6128] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:01.442495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-89eabb7b-ef06-4845-a156-fea2a2dca3ba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c9064c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:01.489454 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-89eabb7b-ef06-4845-a156-fea2a2dca3ba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051517 Aug 06 21:34:01.490024 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2974/6129] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:01 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:02.504279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1578097b-66e4-446b-8d2c-9879d163090f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d941670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:02.551757 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1578097b-66e4-446b-8d2c-9879d163090f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052141 Aug 06 21:34:02.552320 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3156/6130] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:03.566141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4863d61b-80e4-4710-87e3-41a1d3247fac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8d4d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:03.613373 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4863d61b-80e4-4710-87e3-41a1d3247fac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051941 Aug 06 21:34:03.613952 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2975/6131] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:04.627772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1aad0912-2dcc-46d8-9431-9f7b541baf21 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a7310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:04.679842 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1aad0912-2dcc-46d8-9431-9f7b541baf21 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056812 Aug 06 21:34:04.680456 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3157/6132] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:05.696402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c3857020-db38-4db0-9d3e-415782020ca2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a361a820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:05.744538 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c3857020-db38-4db0-9d3e-415782020ca2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053910 Aug 06 21:34:05.745114 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2976/6133] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:06.758073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cd670294-ac3e-4d03-9258-3df6257aafad tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d5613a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:06.805328 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cd670294-ac3e-4d03-9258-3df6257aafad tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051972 Aug 06 21:34:06.806604 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3158/6134] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:07.820354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-be15751e-40a1-43ad-aec7-33a62d25336f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0ae50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:07.866945 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-be15751e-40a1-43ad-aec7-33a62d25336f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051277 Aug 06 21:34:07.867514 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2977/6135] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:08.881514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d7fc2747-3650-45e3-9da5-8a833025e357 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d778820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:08.928645 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d7fc2747-3650-45e3-9da5-8a833025e357 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051883 Aug 06 21:34:08.929258 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3159/6136] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:09.942511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d72f5d28-c82c-4e54-a05f-05c533b1c696 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8e8c10>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:09.990346 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d72f5d28-c82c-4e54-a05f-05c533b1c696 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052680 Aug 06 21:34:09.990973 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2978/6137] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:11.006323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-50bff3f6-3a55-4e33-87e7-7a3f11844839 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d941310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:11.053135 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-50bff3f6-3a55-4e33-87e7-7a3f11844839 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051590 Aug 06 21:34:11.053753 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3160/6138] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:12.068016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72ad998c-cc3e-4452-a17e-a6f22b67063b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8d4820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:12.115157 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72ad998c-cc3e-4452-a17e-a6f22b67063b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051748 Aug 06 21:34:12.115726 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2979/6139] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:13.130234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-37a39bd1-d53d-41c8-8a91-06568ad3720f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:13.177305 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-37a39bd1-d53d-41c8-8a91-06568ad3720f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051756 Aug 06 21:34:13.178004 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3161/6140] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:14.192530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-67f6a019-bf7c-4922-ae20-aac0d94073ab tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a5e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:14.240640 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-67f6a019-bf7c-4922-ae20-aac0d94073ab tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052724 Aug 06 21:34:14.241302 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2980/6141] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:15.255546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c429de59-afcf-4cff-abe7-cc0c3e30714b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d941dc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:15.302410 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c429de59-afcf-4cff-abe7-cc0c3e30714b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051554 Aug 06 21:34:15.303021 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3162/6142] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:16.317542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-074c1940-2bc1-43ff-ab17-2e0058156383 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0a940>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:16.365143 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-074c1940-2bc1-43ff-ab17-2e0058156383 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052253 Aug 06 21:34:16.365716 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2981/6143] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:17.379978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-72462dcb-028e-47af-bf80-63c70b3d89ba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ca11d30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:17.427086 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-72462dcb-028e-47af-bf80-63c70b3d89ba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051795 Aug 06 21:34:17.427665 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3163/6144] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:18.441716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-527b1492-95b2-4a5f-b8eb-7c1a9fb92880 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8fe550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:18.488587 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-527b1492-95b2-4a5f-b8eb-7c1a9fb92880 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051510 Aug 06 21:34:18.489161 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2982/6145] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:18 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:19.503283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d9d4b926-0c06-4ce1-8787-8261d96c2756 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7858b0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:19.549177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d9d4b926-0c06-4ce1-8787-8261d96c2756 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050658 Aug 06 21:34:19.549744 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3164/6146] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:20.564556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c0a9f598-6df7-4cbc-b279-d707b773e0d4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8d4f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:20.610225 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c0a9f598-6df7-4cbc-b279-d707b773e0d4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050530 Aug 06 21:34:20.610835 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2983/6147] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:34:21.625620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3e8ae4f8-0f2e-47a1-955a-9d01acd3e309 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d76da60>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:21.679345 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3e8ae4f8-0f2e-47a1-955a-9d01acd3e309 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.058910 Aug 06 21:34:21.680202 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3165/6148] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:22.694228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fa3c565a-3130-4c93-871a-dac6605ee86b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c9550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:22.742871 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fa3c565a-3130-4c93-871a-dac6605ee86b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053356 Aug 06 21:34:22.743538 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2984/6149] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:23.758315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b40483cc-e51b-426d-a6fa-9cbcb9932776 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d941310>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:23.805474 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b40483cc-e51b-426d-a6fa-9cbcb9932776 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052038 Aug 06 21:34:23.806157 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3166/6150] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:24.822008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d3a332db-c290-4ea1-af4c-5aa794037af1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0a550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:24.871188 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d3a332db-c290-4ea1-af4c-5aa794037af1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053317 Aug 06 21:34:24.871771 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2985/6151] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:25.886062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-565f8ac2-7f60-476e-97bc-a6f52c4860d7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a343a430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:25.933852 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-565f8ac2-7f60-476e-97bc-a6f52c4860d7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052435 Aug 06 21:34:25.934435 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3167/6152] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:26.948013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-547dcfb0-b942-4873-bef8-6cb23f71d6ec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d869160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:26.994210 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-547dcfb0-b942-4873-bef8-6cb23f71d6ec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050890 Aug 06 21:34:26.994861 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2986/6153] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:28.009142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e4dd69f-dc1d-4299-9324-97a7c04ca8e2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d76dd30>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:28.057800 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e4dd69f-dc1d-4299-9324-97a7c04ca8e2 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053272 Aug 06 21:34:28.058963 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3168/6154] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:29.072888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-37462a66-dade-44a3-879f-709b95f10e31 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a3634b80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:29.125038 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-37462a66-dade-44a3-879f-709b95f10e31 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056708 Aug 06 21:34:29.125621 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2987/6155] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:30.140412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-89ac77d6-cb13-4708-afd4-469b42aca9ce tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7c9040>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:30.188247 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-89ac77d6-cb13-4708-afd4-469b42aca9ce tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053305 Aug 06 21:34:30.188850 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3169/6156] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:31.202910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a58973f3-1756-4571-8291-e82f15b192f3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91eca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:31.250461 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a58973f3-1756-4571-8291-e82f15b192f3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052715 Aug 06 21:34:31.251081 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2988/6157] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:32.265589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ddfb5799-a8af-464d-afa3-bfd45f042636 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d9414c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:32.316262 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ddfb5799-a8af-464d-afa3-bfd45f042636 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055826 Aug 06 21:34:32.316950 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3170/6158] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:33.332002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6311ad55-6e6b-44d3-be8d-9e429a4c7af3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0ae50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:33.378730 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6311ad55-6e6b-44d3-be8d-9e429a4c7af3 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051291 Aug 06 21:34:33.379309 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2989/6159] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:34.392922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5aa8fffa-ad0b-4580-9fff-bb7728f7f9f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d820f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:34.441511 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5aa8fffa-ad0b-4580-9fff-bb7728f7f9f0 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053161 Aug 06 21:34:34.442083 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3171/6160] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:35.456590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1b01c673-0ada-48fa-8a75-221ed4f24961 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00e50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:35.503881 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1b01c673-0ada-48fa-8a75-221ed4f24961 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051941 Aug 06 21:34:35.509841 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2990/6161] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:35 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:36.518771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a91016e-d57a-4e1c-9e61-c286ccf4cd77 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c6a7940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:36.568613 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a91016e-d57a-4e1c-9e61-c286ccf4cd77 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054573 Aug 06 21:34:36.569280 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3172/6162] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:37.582440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2eac8cda-bd3f-478e-9aa9-10cbd59a22f9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:37.635145 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2eac8cda-bd3f-478e-9aa9-10cbd59a22f9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056761 Aug 06 21:34:37.635730 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2991/6163] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:38.649850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4ed47149-f402-4ece-8bc0-eba012cacccd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d869550>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:38.699383 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4ed47149-f402-4ece-8bc0-eba012cacccd tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054172 Aug 06 21:34:38.700871 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3173/6164] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:39.713918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9031746c-2d16-44b5-a389-72d95ea4c574 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1b80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:39.761667 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9031746c-2d16-44b5-a389-72d95ea4c574 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052378 Aug 06 21:34:39.763373 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2992/6165] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:40.777050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b24c9ba-420a-405a-a495-c9b1eaf94cb6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d941790>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:40.824325 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b24c9ba-420a-405a-a495-c9b1eaf94cb6 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051780 Aug 06 21:34:40.825197 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3174/6166] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:41.839044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ee47ba3-ac2f-49c5-8bdd-38b56497772d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce00a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:41.885845 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ee47ba3-ac2f-49c5-8bdd-38b56497772d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051556 Aug 06 21:34:41.886418 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2993/6167] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:42.901584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5af8ec00-4b92-4476-8dab-7bc01284d3f8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce4a9d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:42.948430 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5af8ec00-4b92-4476-8dab-7bc01284d3f8 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051744 Aug 06 21:34:42.948990 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3175/6168] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:43.963441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4e793dff-1d47-4788-b62c-ad5bde5368d7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8dd5e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:44.009451 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4e793dff-1d47-4788-b62c-ad5bde5368d7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050709 Aug 06 21:34:44.010017 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2994/6169] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:45.024797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bca403a3-0254-42b8-9fa1-ba2f1102d111 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d63f280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:45.071628 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bca403a3-0254-42b8-9fa1-ba2f1102d111 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051612 Aug 06 21:34:45.072201 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3176/6170] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:34:46.087380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3876f93e-a85c-4265-81be-2ca2a8146a07 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8d4f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:46.133586 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3876f93e-a85c-4265-81be-2ca2a8146a07 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051158 Aug 06 21:34:46.134185 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2995/6171] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:47.147790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b9cec725-b246-4153-9cd6-602c5b6c4a81 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c755e50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:47.194995 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b9cec725-b246-4153-9cd6-602c5b6c4a81 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050852 Aug 06 21:34:47.195558 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3177/6172] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:48.210105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-783ae6ed-7e90-4b2b-a11a-43202d62b31f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c86a4c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:48.258281 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-783ae6ed-7e90-4b2b-a11a-43202d62b31f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052904 Aug 06 21:34:48.258911 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2996/6173] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:49.273618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5d39e311-0e06-490b-9b8f-b05ad71d0976 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce4a940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:49.321569 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5d39e311-0e06-490b-9b8f-b05ad71d0976 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052688 Aug 06 21:34:49.322146 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3178/6174] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:50.336504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d685a242-4001-4fa9-af37-874b1ab5385f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:50.382566 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d685a242-4001-4fa9-af37-874b1ab5385f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050693 Aug 06 21:34:50.383193 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2997/6175] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:51.397717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-be7bbb32-47c3-4b7a-8d75-5fc9c066371c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c7a8940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:51.444891 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-be7bbb32-47c3-4b7a-8d75-5fc9c066371c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051745 Aug 06 21:34:51.445451 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3179/6176] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:52.460111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-738810c6-f3e4-4017-98b4-fef96124e2a7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce001f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:52.506030 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-738810c6-f3e4-4017-98b4-fef96124e2a7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050694 Aug 06 21:34:52.506626 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2998/6177] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:52 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:53.521566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-63ffab25-1309-43a4-a83a-fbef405c4a61 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d63f940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:53.567629 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-63ffab25-1309-43a4-a83a-fbef405c4a61 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050863 Aug 06 21:34:53.568205 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3180/6178] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:54.583920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-efb49895-5276-4d56-ad31-44210f49d29d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf0ab80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:54.631172 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-efb49895-5276-4d56-ad31-44210f49d29d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052561 Aug 06 21:34:54.631736 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 2999/6179] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:54 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:55.646252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cbd4edc5-483a-4f79-b1ba-bac34cb7f557 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d58e700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:55.693024 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cbd4edc5-483a-4f79-b1ba-bac34cb7f557 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051464 Aug 06 21:34:55.693624 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3181/6180] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:55 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:56.708228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0fe7fd65-d36e-470c-a90c-9d115f78a34a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91e430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:56.754993 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0fe7fd65-d36e-470c-a90c-9d115f78a34a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051540 Aug 06 21:34:56.755581 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3000/6181] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:56 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:57.770101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-adbcdde9-fbff-4574-b693-f10cb0929ab4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d820820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:57.817288 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-adbcdde9-fbff-4574-b693-f10cb0929ab4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052416 Aug 06 21:34:57.817856 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3182/6182] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:57 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:58.832924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2e379422-a830-445c-bbc2-b87ce369773e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:58.879255 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2e379422-a830-445c-bbc2-b87ce369773e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051751 Aug 06 21:34:58.879844 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3001/6183] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:58 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:34:59.894020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78837ae9-c31f-4fca-9da9-0abc9665f57c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce87700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:34:59.942677 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78837ae9-c31f-4fca-9da9-0abc9665f57c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054046 Aug 06 21:34:59.943261 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3183/6184] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:34:59 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:00.958479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0ad4193-73b8-4b7a-a3c5-6cc37118c1be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d8699d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:01.005181 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0ad4193-73b8-4b7a-a3c5-6cc37118c1be tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052538 Aug 06 21:35:01.005748 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3002/6185] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:00 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:02.020110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-92c4d0a2-6bf1-4339-8ede-146d0ff9e832 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d58eaf0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:02.066659 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-92c4d0a2-6bf1-4339-8ede-146d0ff9e832 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051619 Aug 06 21:35:02.067225 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3184/6186] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:02 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:03.081515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c61a77cd-5e98-46d2-926d-85d8a0210d30 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c10d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:03.127657 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c61a77cd-5e98-46d2-926d-85d8a0210d30 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050983 Aug 06 21:35:03.128241 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3003/6187] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:03 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:04.142950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-849c76b1-e4c4-428e-bde6-b7e5f787958f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c694c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:04.192504 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-849c76b1-e4c4-428e-bde6-b7e5f787958f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054960 Aug 06 21:35:04.193086 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3185/6188] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:04 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:05.208095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b20ebc1-6eeb-4e46-87f7-b2fe4e8ce80c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8fe160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:05.255200 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b20ebc1-6eeb-4e46-87f7-b2fe4e8ce80c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052605 Aug 06 21:35:05.255779 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3004/6189] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:05 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:06.270021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-82b56e9f-0867-4ffe-b2c7-56844e8dfc31 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d820b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:06.317003 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-82b56e9f-0867-4ffe-b2c7-56844e8dfc31 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051804 Aug 06 21:35:06.317611 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3186/6190] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:06 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:07.331865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bd3fac39-6f3f-4907-9975-7fd97e56e70f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c14c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:07.379118 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bd3fac39-6f3f-4907-9975-7fd97e56e70f tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052027 Aug 06 21:35:07.379694 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3005/6191] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:07 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:08.393911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1f42d05b-a1a2-4693-b67a-b26206946218 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d5a49d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:08.440889 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1f42d05b-a1a2-4693-b67a-b26206946218 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051931 Aug 06 21:35:08.441457 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3187/6192] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:08 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:09.456311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7f8879e1-3176-446d-9923-014d7e2c9d9e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:09.503317 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7f8879e1-3176-446d-9923-014d7e2c9d9e tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052447 Aug 06 21:35:09.503922 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3006/6193] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:09 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:10.517843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3a52d1e3-376c-458e-8055-31e09413ec93 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c694820>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:10.564278 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3a52d1e3-376c-458e-8055-31e09413ec93 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051110 Aug 06 21:35:10.565480 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3188/6194] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:10 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:11.579551 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3acfcd29-4e15-41fe-a64c-581c07482e62 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1a60>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:11.625537 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3acfcd29-4e15-41fe-a64c-581c07482e62 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050776 Aug 06 21:35:11.626110 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3007/6195] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:11 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:12.640429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f1387ab9-a9ec-4712-a448-dda0f2f9528b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d561b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:12.689998 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f1387ab9-a9ec-4712-a448-dda0f2f9528b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054374 Aug 06 21:35:12.690596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3189/6196] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:12 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:13.703805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e0ca99fb-a82a-481e-a588-a9ed97a7ad7b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf9a5e0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:13.750458 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e0ca99fb-a82a-481e-a588-a9ed97a7ad7b tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051491 Aug 06 21:35:13.751166 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3008/6197] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:13 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:14.765023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a594074a-8edf-407a-809e-5bc4d79388ab tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d63f280>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:14.810863 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a594074a-8edf-407a-809e-5bc4d79388ab tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050578 Aug 06 21:35:14.811444 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3190/6198] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:14 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:15.826688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f415970-ae68-450f-8ba1-12d3823c3e83 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c14c0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:15.872533 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f415970-ae68-450f-8ba1-12d3823c3e83 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050548 Aug 06 21:35:15.873105 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3009/6199] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:15 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:16.886778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e416cd9a-2186-42af-9aed-509603ca8c71 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daf41f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:16.934391 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e416cd9a-2186-42af-9aed-509603ca8c71 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052457 Aug 06 21:35:16.934998 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3191/6200] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:16 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:17.949056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b09a0ade-cf88-40e4-9ffd-d4f58256cbfc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8d4d30>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:17.995980 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b09a0ade-cf88-40e4-9ffd-d4f58256cbfc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051632 Aug 06 21:35:17.996550 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3010/6201] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:17 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:19.010515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d6942b2-8c5a-425e-a6e8-872c1df45fec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d58e430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:19.057570 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d6942b2-8c5a-425e-a6e8-872c1df45fec tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051677 Aug 06 21:35:19.058135 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3192/6202] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:19 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:20.072850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-18da9a79-29a9-47fa-8f1e-a1094ded4983 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c1280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:20.120108 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-18da9a79-29a9-47fa-8f1e-a1094ded4983 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052004 Aug 06 21:35:20.121012 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3011/6203] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:20 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:21.134944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4fa9874e-801c-4be4-bd03-3c19152a3850 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d7a1b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:21.181837 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4fa9874e-801c-4be4-bd03-3c19152a3850 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051632 Aug 06 21:35:21.183381 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3193/6204] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:21 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:22.195952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2c54c1da-e666-4d85-8987-7591715f0051 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c91adc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:22.245466 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2c54c1da-e666-4d85-8987-7591715f0051 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054370 Aug 06 21:35:22.246053 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3012/6205] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:22 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:23.260908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d6956a2c-bf41-46fe-949a-6e4c336196ac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d5a4940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:23.307079 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d6956a2c-bf41-46fe-949a-6e4c336196ac tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051512 Aug 06 21:35:23.307657 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3194/6206] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:23 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:23.628922 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:35:23.629182 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:35:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:35:24.321479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b0d883a4-dfd3-43fc-be7b-f5db7be26702 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8d4ca0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:24.368649 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b0d883a4-dfd3-43fc-be7b-f5db7be26702 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052321 Aug 06 21:35:24.369225 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3013/6207] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:24 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:25.383879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ef59271-70c7-46c7-978b-bb1d11b64ea7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daf4700>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:25.430551 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ef59271-70c7-46c7-978b-bb1d11b64ea7 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052554 Aug 06 21:35:25.431147 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3195/6208] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:25 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:26.444902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c1c6e13d-0dcb-428f-855f-dee3299545ea tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d8d9af0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:26.491483 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c1c6e13d-0dcb-428f-855f-dee3299545ea tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051850 Aug 06 21:35:26.492057 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3014/6209] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:26 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:27.506137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-be2e2c5c-4bb7-422c-a7bd-01beedae0cee tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d869670>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:27.552462 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-be2e2c5c-4bb7-422c-a7bd-01beedae0cee tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051164 Aug 06 21:35:27.553031 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3196/6210] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:27 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:28.567623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d589ac5f-4572-43cb-aeff-dbd5bd35ac41 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8c18b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:28.613652 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d589ac5f-4572-43cb-aeff-dbd5bd35ac41 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051394 Aug 06 21:35:28.614234 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3015/6211] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:28 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:29.628373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b79180e4-8fa5-4182-bc2f-8c2f652da502 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729de60f70>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:29.678663 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b79180e4-8fa5-4182-bc2f-8c2f652da502 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055053 Aug 06 21:35:29.679266 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3197/6212] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:29 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:30.693139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-66a17159-1b15-46d2-904a-37da03d30113 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c906280>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:30.741456 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-66a17159-1b15-46d2-904a-37da03d30113 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052917 Aug 06 21:35:30.742047 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3016/6213] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:30 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:31.756452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8e2b6d7d-3074-4d44-bd86-5cc2526ea9e9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ced5ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:31.802886 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8e2b6d7d-3074-4d44-bd86-5cc2526ea9e9 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050559 Aug 06 21:35:31.803462 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3198/6214] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:31 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:32.819631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14e80e63-9145-4293-85a2-89738d78f935 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a35b3790>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:32.871084 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-14e80e63-9145-4293-85a2-89738d78f935 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.056683 Aug 06 21:35:32.871770 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3017/6215] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:32 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:33.886671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8bbca2ca-ed9d-4c47-9858-d3744daa6eef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729daf4160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:33.934040 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8bbca2ca-ed9d-4c47-9858-d3744daa6eef tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052063 Aug 06 21:35:33.934663 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3199/6216] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:33 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:35:34.948787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-90aa692b-fca2-41a4-92d0-7d73a94eef8d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c86a670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:34.996456 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-90aa692b-fca2-41a4-92d0-7d73a94eef8d tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052670 Aug 06 21:35:34.997079 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3018/6217] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:34 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:36.010465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c146317d-3257-4979-8730-72e417507583 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d869c10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:36.057877 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c146317d-3257-4979-8730-72e417507583 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052311 Aug 06 21:35:36.058440 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3200/6218] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:36 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:36.970612 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:35:36.970849 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:35:37.072504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b12d5618-1970-4eab-adb9-5eaa6dcab520 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c906820>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:37.118744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b12d5618-1970-4eab-adb9-5eaa6dcab520 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050960 Aug 06 21:35:37.119318 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3019/6219] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:37 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:38.133545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9440e376-a995-4168-b915-b780f103f063 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d561160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:38.181699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9440e376-a995-4168-b915-b780f103f063 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053027 Aug 06 21:35:38.182296 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3201/6220] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:38 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:39.196085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-33bfa20a-561c-44b3-8622-7b05a7fa1317 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8713a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:39.244503 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-33bfa20a-561c-44b3-8622-7b05a7fa1317 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053174 Aug 06 21:35:39.245095 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3020/6221] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:39 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:40.259870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-456bbfbb-48ed-40f7-a5b2-1384d810dedc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d8d19d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:40.309825 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-456bbfbb-48ed-40f7-a5b2-1384d810dedc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.055236 Aug 06 21:35:40.310396 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3202/6222] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:40 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:41.325533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b066c5b-7303-4ac0-aab5-f0719ce0b9af tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c906160>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:41.371107 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9b066c5b-7303-4ac0-aab5-f0719ce0b9af tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050197 Aug 06 21:35:41.371674 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3021/6223] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:41 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:35:42.385806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d567900f-d670-4ac7-83f3-01ddfaf50aa4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d5a41f0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:42.435621 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d567900f-d670-4ac7-83f3-01ddfaf50aa4 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.054505 Aug 06 21:35:42.436186 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3203/6224] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:42 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:43.450825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d7d5a28d-cb32-4177-b5c4-97ce3cf7489c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729cf1d8b0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:43.496389 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d7d5a28d-cb32-4177-b5c4-97ce3cf7489c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050230 Aug 06 21:35:43.496967 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3022/6225] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:43 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:44.511118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d3b7c4a2-590d-4c24-a0d5-c3b5fc923899 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d561430>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:44.558893 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d3b7c4a2-590d-4c24-a0d5-c3b5fc923899 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053097 Aug 06 21:35:44.559469 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3204/6226] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:44 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:45.573718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f3e5f9c0-b9b5-4b00-b265-45d122e29fba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d3593a0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:45.619302 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f3e5f9c0-b9b5-4b00-b265-45d122e29fba tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050927 Aug 06 21:35:45.619877 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3023/6227] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:45 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:46.634560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-acafa661-6b0f-408d-94b3-69d938d74573 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d63fe50>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:46.681481 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-acafa661-6b0f-408d-94b3-69d938d74573 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.052254 Aug 06 21:35:46.682050 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3205/6228] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:46 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:47.696758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e87dcaf4-c916-48d0-a850-eb5177d150a5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c8e8f70>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:47.742900 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e87dcaf4-c916-48d0-a850-eb5177d150a5 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051311 Aug 06 21:35:47.743463 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3024/6229] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:47 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:48.756431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf1e4cc9-2129-484c-85fa-33e38a09964a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d8d15e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:48.805489 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf1e4cc9-2129-484c-85fa-33e38a09964a tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053765 Aug 06 21:35:48.806059 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3206/6230] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:48 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:35:49.820054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0be9bab0-8c5e-47b1-9cf5-bf12670f203c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729c9060d0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:49.868412 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0be9bab0-8c5e-47b1-9cf5-bf12670f203c tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.053090 Aug 06 21:35:49.868987 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3025/6231] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:49 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:50.883746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f380966d-b9ca-4b0f-956a-13da9eb5a8fc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729ce87ee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:50.929789 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f380966d-b9ca-4b0f-956a-13da9eb5a8fc tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051571 Aug 06 21:35:50.930354 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3207/6232] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:50 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:51.944296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce298211-23ad-4e13-87f6-5d3dea533cb1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f72a3641430>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:51.990734 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce298211-23ad-4e13-87f6-5d3dea533cb1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.051044 Aug 06 21:35:51.992146 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3026/6233] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:51 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:35:53.005989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-883e7d59-bdc9-4627-8071-8b970ffa43c1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] Calling method '.version_select at 0x7f729d63fca0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:35:53.052038 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-883e7d59-bdc9-4627-8071-8b970ffa43c1 tempest-VolumesGetTestJSON-1712555671 tempest-VolumesGetTestJSON-1712555671-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357" status: 200 len: 345 microversion: 2.1 time: 0.050648 Aug 06 21:35:53.052624 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3208/6234] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:35:53 2022] GET /compute/v2.1/os-volumes/97839957-8539-4c9f-a353-56fd6fd5f357 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:36:12.549511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Calling method '.version_select at 0x7f72a3641b80>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:36:12.550344 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:36:12.550344 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:36:12.551471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:36:12.551965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:36:12.552414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:36:12.567325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:36:12.567813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:36:12.568266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:36:12.578970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:36:12.579453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:36:12.579901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:36:12.585591 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-edd61f39-b132-4e21-b730-c455584de6c7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1757189585-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.155331 Aug 06 21:36:12.586153 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3027/6235] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:36:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:36:44.079363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:36:44.079945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:36:44.086610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:36:44.087101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:36:44.087540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:36:44.088235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:36:44.088693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:36:44.089118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:36:44.103207 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] HTTP exception thrown: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Request method failure captured: Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a HTTP/1.1 Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7tuhmqMWqS2t1aUCiEvc538jGHsfh0HagZHyVivWOaUrJ6-Sdq64tF9K-hLhLLZYGNmGCUOAKTaBk00lsvCd3ndF5Q2cDF--vAfL4h6jpOM82z-FRdDOVuDVli4CRl8l82Ik__nd6oyt9sDFnbjZka1snmiJQVWwtB_XiKwz2q9A_sA Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ff5cf7fb11b4fc8aab84c3610683094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 28aa42b542db43a1bf3d1d21d687b95b Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '328c3fb7-0e53-46c2-9490-4291d857a30a'} Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:36:44.104802 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Returning 404 to user: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e717d4e-acc5-481a-8f16-c38b0df09af9 tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "DELETE /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 404 len: 111 microversion: 2.1 time: 0.033080 Aug 06 21:36:44.110882 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3209/6236] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:36:44 2022] DELETE /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:36:44.115640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:36:44.116376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] [instance: 328c3fb7-0e53-46c2-9490-4291d857a30a] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:36:44.118458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:44.119133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:36:44.124950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:36:44.125449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:36:44.125890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:36:44.126615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:36:44.127075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:36:44.127502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:36:44.141979 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] HTTP exception thrown: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Request method failure captured: Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a HTTP/1.1 Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7tuhmqMWqS2t1aUCiEvc538jGHsfh0HagZHyVivWOaUrJ6-Sdq64tF9K-hLhLLZYGNmGCUOAKTaBk00lsvCd3ndF5Q2cDF--vAfL4h6jpOM82z-FRdDOVuDVli4CRl8l82Ik__nd6oyt9sDFnbjZka1snmiJQVWwtB_XiKwz2q9A_sA Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ff5cf7fb11b4fc8aab84c3610683094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ff5cf7fb11b4fc8aab84c3610683094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1ff5cf7fb11b4fc8aab84c3610683094 Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-AttachVolumeTestJSON-441755749 Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 28aa42b542db43a1bf3d1d21d687b95b Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-AttachVolumeTestJSON-441755749-project Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '328c3fb7-0e53-46c2-9490-4291d857a30a'} Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:36:44.143572 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] Returning 404 to user: Instance 328c3fb7-0e53-46c2-9490-4291d857a30a could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0e7e775c-aeb4-4014-9ef7-e10ff5eeb09f tempest-AttachVolumeTestJSON-441755749 tempest-AttachVolumeTestJSON-441755749-project] 10.222.0.33 "GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a" status: 404 len: 111 microversion: 2.1 time: 0.033587 Aug 06 21:36:44.148206 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3028/6237] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:36:44 2022] GET /compute/v2.1/servers/328c3fb7-0e53-46c2-9490-4291d857a30a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:36:50.274921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c0aee516-b8da-492c-9d01-e7ec8bf526fe tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] Action: 'create', calling method: .version_select at 0x7f729d63f0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2031452477"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:36:50.582824 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c0aee516-b8da-492c-9d01-e7ec8bf526fe tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.427243 Aug 06 21:36:50.583453 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3210/6238] 10.222.0.33 () {60 vars in 1155 bytes} [Sat Aug 6 21:36:50 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 429 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 06 21:36:50.597426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-71566a7a-258d-4644-a6a4-c525cd69349f tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] Calling method '.version_select at 0x7f72a35b3670>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:36:50.654486 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-71566a7a-258d-4644-a6a4-c525cd69349f tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/b1caf80b-47c2-4856-b569-9d2d8ce14ec4" status: 200 len: 338 microversion: 2.1 time: 0.061682 Aug 06 21:36:50.655926 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3029/6239] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:36:50 2022] GET /compute/v2.1/os-volumes/b1caf80b-47c2-4856-b569-9d2d8ce14ec4 => generated 338 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:36:51.671104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f5166637-3c3f-4bcf-a555-c0ca0d60f037 tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] Calling method '.version_select at 0x7f729d58e3a0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:36:51.721853 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f5166637-3c3f-4bcf-a555-c0ca0d60f037 tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/b1caf80b-47c2-4856-b569-9d2d8ce14ec4" status: 200 len: 335 microversion: 2.1 time: 0.056517 Aug 06 21:36:51.722436 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3211/6240] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:36:51 2022] GET /compute/v2.1/os-volumes/b1caf80b-47c2-4856-b569-9d2d8ce14ec4 => generated 335 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:36:51.741597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6c2f0d2-e6e3-4caf-a746-8c59c378a98c tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] Calling method '.version_select at 0x7f729c8fee50>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:36:51.864503 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6c2f0d2-e6e3-4caf-a746-8c59c378a98c tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/b1caf80b-47c2-4856-b569-9d2d8ce14ec4" status: 202 len: 0 microversion: 2.1 time: 0.127651 Aug 06 21:36:51.865083 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3030/6241] 10.222.0.33 () {58 vars in 1248 bytes} [Sat Aug 6 21:36:51 2022] DELETE /compute/v2.1/os-volumes/b1caf80b-47c2-4856-b569-9d2d8ce14ec4 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:36:51.873282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5eb92c4a-d7b0-43af-9fe2-ea376e9c6352 tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] Calling method '.version_select at 0x7f729ca11b80>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:36:51.903176 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-5eb92c4a-d7b0-43af-9fe2-ea376e9c6352 tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] HTTP exception thrown: Volume b1caf80b-47c2-4856-b569-9d2d8ce14ec4 could not be found. Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5eb92c4a-d7b0-43af-9fe2-ea376e9c6352 tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] Request method failure captured: Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/os-volumes/b1caf80b-47c2-4856-b569-9d2d8ce14ec4 HTTP/1.1 Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7t7ySeKAKZ1_y_u8tHpc_LLY5O3Jr3HythTcQtSvMH_DTMZnbedJ9BoZx5tPjSOH7oLjXV6hO3MmRuZAKGINX562aK07YMh9u-FEfnp-bAfrW_gF_3Nwk9n8NONmRirqulFEZEJf0T8Z0DX7lI_YdD2XfR40fbgQEwxH4IUWMbvPODM Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: b58239511b5743eaa35d789a7a64ad7e Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-756214212 Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b58239511b5743eaa35d789a7a64ad7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b58239511b5743eaa35d789a7a64ad7e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b58239511b5743eaa35d789a7a64ad7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b58239511b5743eaa35d789a7a64ad7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-VolumesSnapshotsTestJSON-756214212 Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: b58239511b5743eaa35d789a7a64ad7e Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-756214212 Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-VolumesSnapshotsTestJSON-756214212-project Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: b314f44e3040410a9ad48c3fe48679de Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-VolumesSnapshotsTestJSON-756214212-project Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: method: Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: exception: Volume b1caf80b-47c2-4856-b569-9d2d8ce14ec4 could not be found. Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'b1caf80b-47c2-4856-b569-9d2d8ce14ec4'} Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1caf80b-47c2-4856-b569-9d2d8ce14ec4 could not be found. (HTTP 404) (Request-ID: req-64a41050-01c4-406f-8ff6-f5696135605c) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 21:36:51.905464 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1caf80b-47c2-4856-b569-9d2d8ce14ec4 could not be found. Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1caf80b-47c2-4856-b569-9d2d8ce14ec4 could not be found. Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1caf80b-47c2-4856-b569-9d2d8ce14ec4 could not be found. Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5eb92c4a-d7b0-43af-9fe2-ea376e9c6352 tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] Returning 404 to user: Volume b1caf80b-47c2-4856-b569-9d2d8ce14ec4 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5eb92c4a-d7b0-43af-9fe2-ea376e9c6352 tempest-VolumesSnapshotsTestJSON-756214212 tempest-VolumesSnapshotsTestJSON-756214212-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/b1caf80b-47c2-4856-b569-9d2d8ce14ec4" status: 404 len: 109 microversion: 2.1 time: 0.039535 Aug 06 21:36:51.910824 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3212/6242] 10.222.0.33 () {58 vars in 1245 bytes} [Sat Aug 6 21:36:51 2022] GET /compute/v2.1/os-volumes/b1caf80b-47c2-4856-b569-9d2d8ce14ec4 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:37:04.045968 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:37:04.046620 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:37:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:37:07.304321 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:37:07.304978 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:37:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:37:29.795448 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:37:29.796142 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:37:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:37:37.723597 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:37:37.725166 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:37:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:37:48.044745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:48.046713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:48.298936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c8a8ee03-0172-4fde-a2ab-175cf2a63749 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'create', calling method: .version_select at 0x7f729c8fe310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1415531044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUfWR6xfZgrT7AsrvnxvTLxE0TOgpYj7uMZTlJmh+DdxtLJhcSy0z+gZYOf1o5Txi22FxNOUvOgrJ8qalwkGxLKwo9c2hJAc+UDv8HFvjJWFCcwPpd9UXTwEaC/4K6Pxw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:37:48.318315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c8a8ee03-0172-4fde-a2ab-175cf2a63749 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:37:48.323884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-c8a8ee03-0172-4fde-a2ab-175cf2a63749 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for user 7c192e32cff047039b46c50e69dfc9c1 and project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:37:48.357136 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c8a8ee03-0172-4fde-a2ab-175cf2a63749 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.318372 Aug 06 21:37:48.358285 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3031/6243] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:37:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:37:56.564055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:56.565586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:37:56.570359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1494483196", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "f518bd08-16cf-4412-b212-0173eeafd5a9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1415531044", "security_groups": [{"name": "tempest-secgroup-smoke-1253937611"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:37:56.778300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] validate_networks() for [('f518bd08-16cf-4412-b212-0173eeafd5a9', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:37:57.891610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:37:57.892349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:37:57.893181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:37:57.893607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:37:57.894030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:37:57.905371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:37:57.906729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:37:57.907186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:37:57.907939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:37:57.908613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:37:57.909244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:37:57.932182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:37:57.938618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for user 7c192e32cff047039b46c50e69dfc9c1 and project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:37:57.956491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:37:57.959150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:37:58.022456 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-abaed9da-c708-4348-a8d1-7819e85ced67 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.461523 Aug 06 21:37:58.030884 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3213/6244] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:37:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:37:58.035783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a4cc7ae2-9cc2-49a0-b46f-e0c4b5b7558c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:37:58.036554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a4cc7ae2-9cc2-49a0-b46f-e0c4b5b7558c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:37:58.244180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a4cc7ae2-9cc2-49a0-b46f-e0c4b5b7558c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:37:58.254740 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a4cc7ae2-9cc2-49a0-b46f-e0c4b5b7558c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1267 microversion: 2.1 time: 0.223398 Aug 06 21:37:58.255333 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3032/6245] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:37:58 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:37:59.279119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:37:59.281218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:37:59.292705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:37:59.293493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:37:59.294086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:37:59.295040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:37:59.295686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:37:59.296966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:37:59.404645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:37:59.421088 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-573fa1b5-07af-4c55-9b00-46482c5f4b7d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1319 microversion: 2.1 time: 0.145549 Aug 06 21:37:59.423149 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3214/6246] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:37:59 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:00.449267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:00.449903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:00.460330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:00.460851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:00.461305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:00.462037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:00.462506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:00.471423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:00.818640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:00.843204 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-50f9add5-2d20-4ac3-b87e-f2e56f9a550a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1393 microversion: 2.1 time: 0.393794 Aug 06 21:38:00.845916 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3033/6247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:00 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1393 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:01.868301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:01.869483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:01.879655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:01.880682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:01.881616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:01.882644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:01.883532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:01.884406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:02.011250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ed6d680c-3b40-4c53-85b0-fd5f30b862a9 req-19ee204d-d2ef-4acf-a32c-80db46305842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22747190-ecfe-42ab-80b5-d8e518548d20", "tag": "6c8f483c-53be-43a5-9762-e4ec07e33695"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:38:02.025232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ed6d680c-3b40-4c53-85b0-fd5f30b862a9 req-19ee204d-d2ef-4acf-a32c-80db46305842 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:02.026034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ed6d680c-3b40-4c53-85b0-fd5f30b862a9 req-19ee204d-d2ef-4acf-a32c-80db46305842 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:02.026680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ed6d680c-3b40-4c53-85b0-fd5f30b862a9 req-19ee204d-d2ef-4acf-a32c-80db46305842 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:02.040955 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ed6d680c-3b40-4c53-85b0-fd5f30b862a9 req-19ee204d-d2ef-4acf-a32c-80db46305842 service nova] Creating event network-changed:6c8f483c-53be-43a5-9762-e4ec07e33695 for instance 22747190-ecfe-42ab-80b5-d8e518548d20 on nch2-master-1 Aug 06 21:38:02.052667 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ed6d680c-3b40-4c53-85b0-fd5f30b862a9 req-19ee204d-d2ef-4acf-a32c-80db46305842 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137483 Aug 06 21:38:02.053469 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3034/6248] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:38:02.313407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:02.322193 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f488b9fc-365a-42c1-99ff-601a7c4ff7e7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1393 microversion: 2.1 time: 0.457560 Aug 06 21:38:02.323411 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3215/6249] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:01 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1393 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:03.345488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:03.346383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:03.352751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:03.353322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:03.353829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:03.354624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:03.355274 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:03.355882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:03.597629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:03.620780 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-517f73c2-081a-4d28-ab83-5e6d2a65d461 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1393 microversion: 2.1 time: 0.280384 Aug 06 21:38:03.622321 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3035/6250] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:03 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1393 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:04.642002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:04.642853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:04.650192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:04.650743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:04.651194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:04.652463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:04.652931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:04.653807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:04.808406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:04.817803 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7032f852-62ea-4fd6-abfd-ffa84bfcd51f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1393 microversion: 2.1 time: 0.180300 Aug 06 21:38:04.819070 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3216/6251] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:04 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:05.839829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:05.840439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:05.848378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:05.849084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:05.849529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:05.850242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:05.850735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:05.851177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:06.141826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:06.149651 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-49bb8f9b-2c9a-4e96-ac8f-8b5686f2bfd2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1393 microversion: 2.1 time: 0.314087 Aug 06 21:38:06.150342 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3036/6252] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:05 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1393 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:07.172831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:07.173388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:07.180744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:07.181248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:07.181970 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:07.182722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:07.183194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:07.183631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:07.328941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:07.336640 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0b3a6805-37c4-49fd-b7d7-5fc5f0fce2c7 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1393 microversion: 2.1 time: 0.168408 Aug 06 21:38:07.337217 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3217/6253] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:07 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:38:08.357549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:08.359102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:08.363116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:08.366784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:08.367293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:08.367746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:08.368498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:08.368972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:08.369415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:08.603874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:08.613320 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-30c77ebb-da25-4bfd-8dee-7f84909bb19a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1393 microversion: 2.1 time: 0.259636 Aug 06 21:38:08.614056 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3037/6254] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:08 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1393 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:08.779945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:08.781937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:08.859070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-a0b84c74-addd-4daa-a339-d59cb2ec5b9d req-7efa64ae-3131-461d-b46c-bd3330495178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22747190-ecfe-42ab-80b5-d8e518548d20", "name": "network-vif-plugged", "status": "completed", "tag": "6c8f483c-53be-43a5-9762-e4ec07e33695"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:38:08.870503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a0b84c74-addd-4daa-a339-d59cb2ec5b9d req-7efa64ae-3131-461d-b46c-bd3330495178 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:08.871084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a0b84c74-addd-4daa-a339-d59cb2ec5b9d req-7efa64ae-3131-461d-b46c-bd3330495178 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:08.871647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a0b84c74-addd-4daa-a339-d59cb2ec5b9d req-7efa64ae-3131-461d-b46c-bd3330495178 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:08.884697 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a0b84c74-addd-4daa-a339-d59cb2ec5b9d req-7efa64ae-3131-461d-b46c-bd3330495178 service nova] Creating event network-vif-plugged:6c8f483c-53be-43a5-9762-e4ec07e33695 for instance 22747190-ecfe-42ab-80b5-d8e518548d20 on nch2-master-1 Aug 06 21:38:08.891560 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-a0b84c74-addd-4daa-a339-d59cb2ec5b9d req-7efa64ae-3131-461d-b46c-bd3330495178 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119315 Aug 06 21:38:08.892391 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3218/6255] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:38:09.637012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:09.638505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:09.646967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:09.647636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:09.648336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:09.649308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:09.649982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:09.650575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:09.881161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:09.889519 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c585f1b-87bc-404b-8a7f-9b51b6b2279d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1393 microversion: 2.1 time: 0.256704 Aug 06 21:38:09.890909 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3038/6256] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:09 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1393 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:10.912712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:10.914043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:10.921678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:10.922439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:10.923107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:10.924579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:10.925248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:10.926009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:11.163073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:11.177671 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ce05276-878a-4682-9bfc-99222deec929 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1565 microversion: 2.1 time: 0.269298 Aug 06 21:38:11.178613 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3219/6257] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:10 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1565 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:11.205225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:11.206298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:11.221060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:11.222793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:11.223480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:11.224286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:11.225242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:11.225883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:11.457490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:11.466936 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-68d8dd3c-5b84-42cf-a1a8-f45058201b27 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1565 microversion: 2.1 time: 0.269128 Aug 06 21:38:11.469656 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3039/6258] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:11 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1565 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:13.798965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:13.799724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:13.814727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:13.815247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:13.815705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:13.816446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:13.816916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:13.818813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:13.824774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-42191694-527a-450a-afab-d1567c10f089 req-993c37ba-d788-4b2f-8b8a-f201beda2136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22747190-ecfe-42ab-80b5-d8e518548d20", "tag": "6c8f483c-53be-43a5-9762-e4ec07e33695"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:38:13.849922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-42191694-527a-450a-afab-d1567c10f089 req-993c37ba-d788-4b2f-8b8a-f201beda2136 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:13.853187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-42191694-527a-450a-afab-d1567c10f089 req-993c37ba-d788-4b2f-8b8a-f201beda2136 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:13.853739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-42191694-527a-450a-afab-d1567c10f089 req-993c37ba-d788-4b2f-8b8a-f201beda2136 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:13.878073 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-42191694-527a-450a-afab-d1567c10f089 req-993c37ba-d788-4b2f-8b8a-f201beda2136 service nova] Creating event network-changed:6c8f483c-53be-43a5-9762-e4ec07e33695 for instance 22747190-ecfe-42ab-80b5-d8e518548d20 on nch2-master-1 Aug 06 21:38:13.895769 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-42191694-527a-450a-afab-d1567c10f089 req-993c37ba-d788-4b2f-8b8a-f201beda2136 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072380 Aug 06 21:38:13.895769 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3040/6259] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:38:14.075061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:14.087621 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-28703da7-364b-4263-9ca0-68b6f6610b2f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1565 microversion: 2.1 time: 0.293828 Aug 06 21:38:14.107129 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3220/6260] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:13 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1565 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:34.538141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:34.539099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=40 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:34.543530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-31f17802-d053-489f-aa44-6b7ecfa0f119 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:38:34.546108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-31f17802-d053-489f-aa44-6b7ecfa0f119 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:34.554596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f17802-d053-489f-aa44-6b7ecfa0f119 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:34.555187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f17802-d053-489f-aa44-6b7ecfa0f119 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:34.555733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f17802-d053-489f-aa44-6b7ecfa0f119 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:34.556524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f17802-d053-489f-aa44-6b7ecfa0f119 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:34.557192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f17802-d053-489f-aa44-6b7ecfa0f119 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:34.557696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31f17802-d053-489f-aa44-6b7ecfa0f119 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:34.620397 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-31f17802-d053-489f-aa44-6b7ecfa0f119 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action" status: 200 len: 24570 microversion: 2.1 time: 0.083935 Aug 06 21:38:34.621556 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3041/6261] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:38:34 2022] POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action => generated 24570 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:38:43.637758 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:38:43.638325 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:38:45.621907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-307a0f45-3f33-453b-8a6b-cd54ecbc790b tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:45.623225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-307a0f45-3f33-453b-8a6b-cd54ecbc790b tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:45.626083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:45.626930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=40 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:45.633478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-307a0f45-3f33-453b-8a6b-cd54ecbc790b tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:45.634040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-307a0f45-3f33-453b-8a6b-cd54ecbc790b tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:45.634738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-307a0f45-3f33-453b-8a6b-cd54ecbc790b tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:45.635607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-307a0f45-3f33-453b-8a6b-cd54ecbc790b tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:45.636053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-307a0f45-3f33-453b-8a6b-cd54ecbc790b tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:45.636705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-307a0f45-3f33-453b-8a6b-cd54ecbc790b tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:46.090112 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-307a0f45-3f33-453b-8a6b-cd54ecbc790b tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1835 microversion: 2.1 time: 0.471906 Aug 06 21:38:46.111291 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3221/6262] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:45 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1835 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:46.113545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:46.114799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:46.122568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:46.123706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:38:46.125770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:46.126422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:46.127711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:46.128841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:46.129346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:46.130112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:46.320986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:46.338100 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-07a7b084-ee09-46df-8a2e-5c058cb5204a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1684 microversion: 2.1 time: 0.221563 Aug 06 21:38:46.339001 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3042/6263] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:46 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1684 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:46.447742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c46d2684-707b-4288-a975-5dc17344778a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:38:46.450062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c46d2684-707b-4288-a975-5dc17344778a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:46.457409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c46d2684-707b-4288-a975-5dc17344778a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:46.458014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c46d2684-707b-4288-a975-5dc17344778a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:46.458472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c46d2684-707b-4288-a975-5dc17344778a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:46.459247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c46d2684-707b-4288-a975-5dc17344778a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:46.459722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c46d2684-707b-4288-a975-5dc17344778a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:46.460161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c46d2684-707b-4288-a975-5dc17344778a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:46.516496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c46d2684-707b-4288-a975-5dc17344778a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action" status: 200 len: 32642 microversion: 2.1 time: 0.072257 Aug 06 21:38:46.517859 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3222/6264] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:38:46 2022] POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action => generated 32642 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:38:46.708900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:38:46.709415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:46.716067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:46.716565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:46.717007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:46.717909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:46.718579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:46.719110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:46.920725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2daf7e8662ec45b2a5b8d92876546ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee81fb612e64d278277698b4f721414', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:46.922922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] flavor_id is None. Assuming migration. {{(pid=142462) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 06 21:38:46.923509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=142462) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:38:47.322881 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0807e7e5-f8dc-4f7e-9259-eaeac4505006 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action" status: 202 len: 0 microversion: 2.1 time: 0.617896 Aug 06 21:38:47.323824 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3043/6265] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:38:46 2022] POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:38:47.333976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:47.335672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:47.346810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:47.347475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:47.348154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:47.348882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:47.349493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:47.350206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:47.547714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:47.558136 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cdd29043-aab3-4c94-a899-487b5fb6704f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1693 microversion: 2.1 time: 0.229662 Aug 06 21:38:47.559732 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3223/6266] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:47 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1693 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:38:48.582509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:48.584005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:48.592466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:48.593222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:48.594605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:48.595972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:48.596720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:48.597354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:48.815543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:48.823901 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cfda3754-10ec-412b-947d-35e0d4f03964 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1693 microversion: 2.1 time: 0.246603 Aug 06 21:38:48.824782 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3044/6267] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:48 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1693 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:49.848009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:49.849231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:49.858788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:49.860080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:49.860693 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:49.861582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:49.863101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:49.863721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:50.030126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:50.039195 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bacfc9db-fb8a-471e-bec0-62ceb744926c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.195669 Aug 06 21:38:50.040185 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3224/6268] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:49 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:51.062472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:51.064069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:51.070638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:51.071281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:51.071822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:51.072624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:51.073197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:51.073843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:51.310908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:51.319587 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eb4365d5-7ce2-40c5-9ca2-cc9e29a2d2cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.262293 Aug 06 21:38:51.320476 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3045/6269] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:51 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:52.341435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:52.342062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:52.350038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:52.350571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:52.351023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:52.351743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:52.352374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:52.352814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:52.492308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:52.500116 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3aa5a4a3-bf8d-4c91-86c1-85d3034b20be tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.162628 Aug 06 21:38:52.501219 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3225/6270] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:52 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:53.521676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:53.522295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:53.529244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:53.529727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:53.530168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:53.530898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:53.531451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:53.531975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:53.834644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:53.847508 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab51a388-00f0-4cfc-8a83-a5d8d31606dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.329679 Aug 06 21:38:53.848103 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3046/6271] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:53 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:54.870691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:54.871880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:54.879485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:54.880562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:54.881169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:54.882036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:54.882649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:54.883347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:55.130354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:55.139208 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d9cee13f-2950-4b31-933c-d667dc3d779e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.273776 Aug 06 21:38:55.139814 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3226/6272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:54 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:56.161632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:56.162373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:56.174169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:56.179279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:56.180973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:56.181812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:56.183413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:56.184054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:56.361066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:56.371480 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-64ac7438-77ae-465f-9cd3-455cad25fd5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.213955 Aug 06 21:38:56.382574 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3047/6273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:56 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:57.393631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:57.394262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:57.401949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:57.402450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:57.403598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:57.404341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:57.404881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:57.405329 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:57.630377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:57.638565 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9a0d9250-f10e-46e0-b373-364213cf737f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.248955 Aug 06 21:38:57.639152 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3227/6274] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:57 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:58.661279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:58.662872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:58.670130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:58.670962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:58.671610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:58.672671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:58.673459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:58.674103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:58.870107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:38:58.878855 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-52a55b90-6097-4e74-8939-7cffe9d0445a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.222161 Aug 06 21:38:58.880477 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3048/6275] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:58 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:38:59.901900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:38:59.902515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:38:59.913207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:59.914086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:59.915229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:38:59.916334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:38:59.916944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:38:59.917522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:00.103389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:00.112529 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2661faa5-621b-4e92-8dcc-b1bb8fb2b653 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.214997 Aug 06 21:39:00.113309 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3228/6276] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:38:59 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:01.133690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:01.134940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:01.143390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:01.144087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:01.144668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:01.145512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:01.146077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:01.146651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:01.304093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:01.312071 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6404dc85-292b-4b75-ae21-f694fdb34c23 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1698 microversion: 2.1 time: 0.182557 Aug 06 21:39:01.312655 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3049/6277] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:01 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:02.335134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:02.335767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:02.342936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:02.343614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:02.344063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:02.345021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:02.347527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:02.353611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:02.607173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:02.618958 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-04558851-807d-4e1e-8a1a-ed49c0d06c28 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1697 microversion: 2.1 time: 0.287778 Aug 06 21:39:02.620094 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3229/6278] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:02 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1697 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:02.679708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-a2feb163-0526-478e-8e2e-41a2bd7776a7 req-101cdc19-8571-4bf7-b449-68fd05574aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22747190-ecfe-42ab-80b5-d8e518548d20", "name": "network-vif-unplugged", "status": "completed", "tag": "6c8f483c-53be-43a5-9762-e4ec07e33695"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:02.691038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a2feb163-0526-478e-8e2e-41a2bd7776a7 req-101cdc19-8571-4bf7-b449-68fd05574aa6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:02.691524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a2feb163-0526-478e-8e2e-41a2bd7776a7 req-101cdc19-8571-4bf7-b449-68fd05574aa6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:02.691962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-a2feb163-0526-478e-8e2e-41a2bd7776a7 req-101cdc19-8571-4bf7-b449-68fd05574aa6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:02.707502 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-a2feb163-0526-478e-8e2e-41a2bd7776a7 req-101cdc19-8571-4bf7-b449-68fd05574aa6 service nova] Creating event network-vif-unplugged:6c8f483c-53be-43a5-9762-e4ec07e33695 for instance 22747190-ecfe-42ab-80b5-d8e518548d20 on nch1-master-1 Aug 06 21:39:02.713899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-a2feb163-0526-478e-8e2e-41a2bd7776a7 req-101cdc19-8571-4bf7-b449-68fd05574aa6 service nova] Instance 22747190-ecfe-42ab-80b5-d8e518548d20 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:39:02.738775 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-a2feb163-0526-478e-8e2e-41a2bd7776a7 req-101cdc19-8571-4bf7-b449-68fd05574aa6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.170034 Aug 06 21:39:02.739940 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3050/6279] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:03.643127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:03.643127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:03.650865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:03.651492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:03.652031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:03.653606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:03.654336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:03.654993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:03.892721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:03.903100 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-574db29f-7311-4cf2-9579-f8018626726b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1697 microversion: 2.1 time: 0.265285 Aug 06 21:39:03.912436 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3230/6280] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:03 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1697 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:04.789180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-49be6501-4763-45d9-a650-9b0405df5fdf req-10fba7e9-0ecc-4744-a5d4-3460d898e209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22747190-ecfe-42ab-80b5-d8e518548d20", "tag": "6c8f483c-53be-43a5-9762-e4ec07e33695"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:04.800562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-49be6501-4763-45d9-a650-9b0405df5fdf req-10fba7e9-0ecc-4744-a5d4-3460d898e209 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:04.801053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-49be6501-4763-45d9-a650-9b0405df5fdf req-10fba7e9-0ecc-4744-a5d4-3460d898e209 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:04.801489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-49be6501-4763-45d9-a650-9b0405df5fdf req-10fba7e9-0ecc-4744-a5d4-3460d898e209 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:04.816955 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-49be6501-4763-45d9-a650-9b0405df5fdf req-10fba7e9-0ecc-4744-a5d4-3460d898e209 service nova] Creating event network-changed:6c8f483c-53be-43a5-9762-e4ec07e33695 for instance 22747190-ecfe-42ab-80b5-d8e518548d20 on nch1-master-1 Aug 06 21:39:04.825011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-49be6501-4763-45d9-a650-9b0405df5fdf req-10fba7e9-0ecc-4744-a5d4-3460d898e209 service nova] Instance 22747190-ecfe-42ab-80b5-d8e518548d20 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:39:04.841331 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-49be6501-4763-45d9-a650-9b0405df5fdf req-10fba7e9-0ecc-4744-a5d4-3460d898e209 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057026 Aug 06 21:39:04.842237 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3051/6281] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:04.928852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:04.929468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:04.942166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:04.942720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:04.943382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:04.944237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:04.944722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:04.945159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:05.293949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:05.305931 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-17b8c6e9-dfdf-4f8f-8d06-08b5eae4b110 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1695 microversion: 2.1 time: 0.381948 Aug 06 21:39:05.306879 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3231/6282] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:04 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1695 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:06.329894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:06.330744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:06.337693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:06.338396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:06.338871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:06.339580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:06.340050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:06.340483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:06.480788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:06.488978 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-023aa01f-a7d5-42b7-a6bb-50c742196d06 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1692 microversion: 2.1 time: 0.163693 Aug 06 21:39:06.489551 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3052/6283] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:06 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:39:06.510026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76d032ec-4a8c-41a7-bc7e-95c3b89d0182 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:06.510586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76d032ec-4a8c-41a7-bc7e-95c3b89d0182 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:06.518851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d032ec-4a8c-41a7-bc7e-95c3b89d0182 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:06.519346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d032ec-4a8c-41a7-bc7e-95c3b89d0182 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:06.519780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d032ec-4a8c-41a7-bc7e-95c3b89d0182 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:06.520480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d032ec-4a8c-41a7-bc7e-95c3b89d0182 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:06.520937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d032ec-4a8c-41a7-bc7e-95c3b89d0182 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:06.521363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76d032ec-4a8c-41a7-bc7e-95c3b89d0182 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:06.581296 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-76d032ec-4a8c-41a7-bc7e-95c3b89d0182 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action" status: 204 len: 0 microversion: 2.1 time: 0.075320 Aug 06 21:39:06.582224 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3232/6284] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:39:06 2022] POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:39:06.590511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:06.591288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:06.598141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:06.598967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:06.599542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:06.600572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:06.601176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:06.601824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:06.766011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:06.775507 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-73781d5c-900c-465d-86ea-631518b12ec4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1692 microversion: 2.1 time: 0.188998 Aug 06 21:39:06.781238 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3053/6285] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:06 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:07.802209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:07.802817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:07.810788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:07.811614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:07.812193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:07.812931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:07.813964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:07.814408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:07.977467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:07.986197 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d78149a1-d0f0-4079-a72e-a18d554d64c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1692 microversion: 2.1 time: 0.189573 Aug 06 21:39:07.998820 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3233/6286] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:07 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:39:09.009726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:09.010491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:09.016992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:09.017479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:09.017921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:09.018651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:09.019155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:09.019787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:09.161075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:09.168949 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-adaf12a5-ccf3-4093-9f00-f384cb4b1099 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1684 microversion: 2.1 time: 0.163077 Aug 06 21:39:09.169552 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3054/6287] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:09 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:10.278476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2930208d-ba6a-4235-8f8f-a2752f830c06 req-e20fe4d8-9c7f-42da-9a50-12390c1cef91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22747190-ecfe-42ab-80b5-d8e518548d20", "name": "network-vif-plugged", "status": "completed", "tag": "6c8f483c-53be-43a5-9762-e4ec07e33695"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:10.294973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2930208d-ba6a-4235-8f8f-a2752f830c06 req-e20fe4d8-9c7f-42da-9a50-12390c1cef91 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:10.295566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2930208d-ba6a-4235-8f8f-a2752f830c06 req-e20fe4d8-9c7f-42da-9a50-12390c1cef91 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:10.296071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2930208d-ba6a-4235-8f8f-a2752f830c06 req-e20fe4d8-9c7f-42da-9a50-12390c1cef91 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:10.308521 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2930208d-ba6a-4235-8f8f-a2752f830c06 req-e20fe4d8-9c7f-42da-9a50-12390c1cef91 service nova] Creating event network-vif-plugged:6c8f483c-53be-43a5-9762-e4ec07e33695 for instance 22747190-ecfe-42ab-80b5-d8e518548d20 on nch1-master-1 Aug 06 21:39:10.315354 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2930208d-ba6a-4235-8f8f-a2752f830c06 req-e20fe4d8-9c7f-42da-9a50-12390c1cef91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042655 Aug 06 21:39:10.316429 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3234/6288] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:20.381986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=28 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:20.382881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:20.494303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1498552865", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "90b40ac7-330d-4fa4-8245-223cada4bd33"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:20.549741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] validate_networks() for [('90b40ac7-330d-4fa4-8245-223cada4bd33', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:39:20.986390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:39:20.986846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:39:20.987324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:39:20.987757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:39:20.988171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:39:20.997046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:20.997527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:20.997965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:20.998760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:20.999219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:20.999647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:21.017603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Getting quotas for project f7cb11cd2bd34e619347fb2cb0fff071. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:39:21.022698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Getting quotas for user fdca6e4d27c748d1bb59781a7e71da37 and project f7cb11cd2bd34e619347fb2cb0fff071. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:39:21.035057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:39:21.037306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:39:21.081372 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce1a805d-a72e-4327-a916-4202831ad2b8 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704870 Aug 06 21:39:21.082023 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3055/6289] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:39:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:39:21.091048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=28 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:21.091972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:21.097089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-013292bd-ec14-4d1c-a21a-7aed45074531 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:21.097803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-013292bd-ec14-4d1c-a21a-7aed45074531 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:21.161221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-013292bd-ec14-4d1c-a21a-7aed45074531 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:21.168985 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-013292bd-ec14-4d1c-a21a-7aed45074531 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1214 microversion: 2.1 time: 0.079863 Aug 06 21:39:21.182311 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3235/6290] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:21 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:39:22.191336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:22.191861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:22.198672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:22.199186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:22.199609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:22.200321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:22.200783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:22.201216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:22.267735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:22.275577 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ecdbde83-b204-47a0-a783-dcbec4522c3e tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1272 microversion: 2.1 time: 0.090291 Aug 06 21:39:22.276152 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3056/6291] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:22 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:23.237448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-010cd2d2-cc23-4dbb-877a-88a9376628d0 req-94cd32c5-bece-4a69-9ea8-34aee097fa34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67", "tag": "07c6f498-0d27-4cde-91d2-b9c64d64e6e7"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:23.250453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-010cd2d2-cc23-4dbb-877a-88a9376628d0 req-94cd32c5-bece-4a69-9ea8-34aee097fa34 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:23.251775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-010cd2d2-cc23-4dbb-877a-88a9376628d0 req-94cd32c5-bece-4a69-9ea8-34aee097fa34 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:23.252340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-010cd2d2-cc23-4dbb-877a-88a9376628d0 req-94cd32c5-bece-4a69-9ea8-34aee097fa34 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:23.264289 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-010cd2d2-cc23-4dbb-877a-88a9376628d0 req-94cd32c5-bece-4a69-9ea8-34aee097fa34 service nova] Creating event network-changed:07c6f498-0d27-4cde-91d2-b9c64d64e6e7 for instance 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 on nch2-master-1 Aug 06 21:39:23.270021 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-010cd2d2-cc23-4dbb-877a-88a9376628d0 req-94cd32c5-bece-4a69-9ea8-34aee097fa34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036967 Aug 06 21:39:23.270649 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3236/6292] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:23.297141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:23.297763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:23.305190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:23.305683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:23.306134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:23.306930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:23.307387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:23.307973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:23.453503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:23.461759 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b33b4e9b-2817-4176-ab4f-dad728d2ca9b tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1314 microversion: 2.1 time: 0.168540 Aug 06 21:39:23.462365 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3057/6293] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:23 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:24.483360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:24.484066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:24.491554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:24.492258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:24.492861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:24.493998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:24.494619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:24.495096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:24.726084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:24.733967 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8ceacd07-c7b4-44e9-a095-ffcda6da0acb tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1314 microversion: 2.1 time: 0.256018 Aug 06 21:39:24.734569 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3237/6294] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:24 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:25.758030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:25.758672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:25.765543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:25.766021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:25.766488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:25.767366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:25.767849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:25.768275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:25.899595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:25.907101 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72dd02ea-7a88-487c-8a66-5aedd108f806 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1314 microversion: 2.1 time: 0.152899 Aug 06 21:39:25.907740 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3058/6295] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:25 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:26.928089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:26.928708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:26.935592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:26.936078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:26.936782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:26.937477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:26.937936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:26.938368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:27.087212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:27.094750 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-77a428d0-9440-4067-97bf-59775a868718 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1314 microversion: 2.1 time: 0.171250 Aug 06 21:39:27.095932 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3238/6296] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:26 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:28.116704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:28.117365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:28.124338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:28.124829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:28.125277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:28.125982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:28.127282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:28.127720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:28.260173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:28.268405 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-025f0d6d-fd54-4fe7-b3db-c1793361e056 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1314 microversion: 2.1 time: 0.155614 Aug 06 21:39:28.268982 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3059/6297] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:28 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:39:28.984800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bb851f80-7946-4fd3-a0ce-79bfe08b9f66 req-e3bd072a-9356-4d13-82fb-c724549f1241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67", "name": "network-vif-plugged", "status": "completed", "tag": "07c6f498-0d27-4cde-91d2-b9c64d64e6e7"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:28.996341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bb851f80-7946-4fd3-a0ce-79bfe08b9f66 req-e3bd072a-9356-4d13-82fb-c724549f1241 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:28.997067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bb851f80-7946-4fd3-a0ce-79bfe08b9f66 req-e3bd072a-9356-4d13-82fb-c724549f1241 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:28.997405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bb851f80-7946-4fd3-a0ce-79bfe08b9f66 req-e3bd072a-9356-4d13-82fb-c724549f1241 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:29.009241 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bb851f80-7946-4fd3-a0ce-79bfe08b9f66 req-e3bd072a-9356-4d13-82fb-c724549f1241 service nova] Creating event network-vif-plugged:07c6f498-0d27-4cde-91d2-b9c64d64e6e7 for instance 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 on nch2-master-1 Aug 06 21:39:29.014450 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bb851f80-7946-4fd3-a0ce-79bfe08b9f66 req-e3bd072a-9356-4d13-82fb-c724549f1241 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033339 Aug 06 21:39:29.015095 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3239/6298] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:29.289051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:29.289690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:29.296663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:29.297144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:29.297605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:29.298314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:29.298810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:29.299242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:29.363663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8fc6d24-f600-4437-a9fb-c0a92cc36481 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:29.366027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e8fc6d24-f600-4437-a9fb-c0a92cc36481 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:29.372554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fc6d24-f600-4437-a9fb-c0a92cc36481 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:29.373146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fc6d24-f600-4437-a9fb-c0a92cc36481 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:29.373796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fc6d24-f600-4437-a9fb-c0a92cc36481 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:29.374846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fc6d24-f600-4437-a9fb-c0a92cc36481 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:29.375522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fc6d24-f600-4437-a9fb-c0a92cc36481 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:29.376670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8fc6d24-f600-4437-a9fb-c0a92cc36481 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:29.430560 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e8fc6d24-f600-4437-a9fb-c0a92cc36481 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action" status: 200 len: 24563 microversion: 2.1 time: 0.071254 Aug 06 21:39:29.434485 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3240/6299] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:39:29 2022] POST /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20/action => generated 24563 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 21:39:29.443769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:29.452125 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0fee34d8-57cf-473c-8160-cd8161e39b31 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1314 microversion: 2.1 time: 0.166913 Aug 06 21:39:29.452707 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3060/6300] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:29 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:30.474690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:30.475578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:30.483393 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:30.483888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:30.484330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:30.485042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:30.485538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:30.486259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:30.621841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:30.630682 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2b372e59-de26-495b-8a16-f0c43eefabe5 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1499 microversion: 2.1 time: 0.161102 Aug 06 21:39:30.631247 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3241/6301] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:30 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:32.004599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:32.005109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:32.007843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:32.008523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:32.014283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:32.014802 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:32.015255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:32.015962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:32.016431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:32.017427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:32.043385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:39:32.120405 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-475868d2-eaaa-42bf-9e27-ee00f49a8a14 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 204 len: 0 microversion: 2.1 time: 0.119343 Aug 06 21:39:32.121185 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3061/6302] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:39:31 2022] DELETE /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:39:32.129402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:32.130029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:32.132607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:32.139216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:32.139715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:32.140167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:32.140912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:32.141378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:32.141844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:32.275163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:32.283024 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b0783a76-f3b2-4f44-85e6-ba614166bcce tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1505 microversion: 2.1 time: 0.157382 Aug 06 21:39:32.283615 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3242/6303] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:32 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:33.304434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:33.305133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:33.312266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:33.312752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:33.313196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:33.313894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:33.314925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:33.315376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:33.448037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdca6e4d27c748d1bb59781a7e71da37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb11cd2bd34e619347fb2cb0fff071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:33.457363 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6a10fcda-fc88-4be5-afa6-a40ce705e3e3 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 200 len: 1505 microversion: 2.1 time: 0.157209 Aug 06 21:39:33.457946 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3062/6304] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:33 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:33.838506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-efde3465-7df1-42ea-a6b3-974b9cea08a5 req-7b380180-bacc-42bd-b3af-e7bd9e22440a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67", "name": "network-vif-deleted", "tag": "07c6f498-0d27-4cde-91d2-b9c64d64e6e7"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:33.852475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-efde3465-7df1-42ea-a6b3-974b9cea08a5 req-7b380180-bacc-42bd-b3af-e7bd9e22440a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:33.852875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-efde3465-7df1-42ea-a6b3-974b9cea08a5 req-7b380180-bacc-42bd-b3af-e7bd9e22440a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:33.853314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-efde3465-7df1-42ea-a6b3-974b9cea08a5 req-7b380180-bacc-42bd-b3af-e7bd9e22440a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:33.868455 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-efde3465-7df1-42ea-a6b3-974b9cea08a5 req-7b380180-bacc-42bd-b3af-e7bd9e22440a service nova] Creating event network-vif-deleted:07c6f498-0d27-4cde-91d2-b9c64d64e6e7 for instance 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 on nch2-master-1 Aug 06 21:39:33.874794 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-efde3465-7df1-42ea-a6b3-974b9cea08a5 req-7b380180-bacc-42bd-b3af-e7bd9e22440a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041197 Aug 06 21:39:33.875404 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3243/6305] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:34.478849 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:34.479467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] [instance: 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:34.487373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:34.487856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:34.488406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:34.489101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:34.489582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:34.490007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:34.506131 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] HTTP exception thrown: Instance 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 could not be found. Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Request method failure captured: Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 HTTP/1.1 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7t-HpmQpknvBbrZVRq3ecddqR74dScHnG4BbEtxi8DcRXV6BDbNBjsUPOSSTSR2PukYZRqnx_PrC_zn0H1zd7OFu4KhMsUzUWqoAHfkk8Ex_XQxtJl0gxQBsyVTiDKZWhrDygF-7eQ-ms1Ud4QnXlCpr8V1k4wzarxh5SHR8FAfZdEk Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: f7cb11cd2bd34e619347fb2cb0fff071 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-VolumesActionsTest-1884887710 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f7cb11cd2bd34e619347fb2cb0fff071"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f7cb11cd2bd34e619347fb2cb0fff071", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f7cb11cd2bd34e619347fb2cb0fff071"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f7cb11cd2bd34e619347fb2cb0fff071"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-VolumesActionsTest-1884887710 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: f7cb11cd2bd34e619347fb2cb0fff071 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-VolumesActionsTest-1884887710 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-VolumesActionsTest-1884887710-project Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: fdca6e4d27c748d1bb59781a7e71da37 Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-VolumesActionsTest-1884887710-project Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 could not be found. Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67'} Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 could not be found. Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 could not be found. Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:39:34.507781 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 could not be found. Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] Returning 404 to user: Instance 8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b39a9667-d968-4c07-8d62-43752503faf9 tempest-VolumesActionsTest-1884887710 tempest-VolumesActionsTest-1884887710-project] 10.222.0.33 "GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67" status: 404 len: 111 microversion: 2.1 time: 0.034305 Aug 06 21:39:34.511917 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3063/6306] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:34 2022] GET /compute/v2.1/servers/8b4974e2-87f6-49ee-8a6f-1f7b06ba7c67 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:39:35.667387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e6eae8c3-7adc-4a3d-b880-624ddd808853 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:35.668098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e6eae8c3-7adc-4a3d-b880-624ddd808853 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:35.676315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6eae8c3-7adc-4a3d-b880-624ddd808853 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:35.676808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6eae8c3-7adc-4a3d-b880-624ddd808853 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:35.677255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6eae8c3-7adc-4a3d-b880-624ddd808853 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:35.677967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6eae8c3-7adc-4a3d-b880-624ddd808853 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:35.678427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6eae8c3-7adc-4a3d-b880-624ddd808853 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:35.678885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6eae8c3-7adc-4a3d-b880-624ddd808853 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:36.098076 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e6eae8c3-7adc-4a3d-b880-624ddd808853 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1835 microversion: 2.1 time: 0.434675 Aug 06 21:39:36.098596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3244/6307] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:35 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1835 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:37.250233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:37.251626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:37.251976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-83783dcf-b17b-4ec2-96ad-0220f5787155 req-a6fc21c5-55cb-4998-979b-541ea9282258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22747190-ecfe-42ab-80b5-d8e518548d20", "tag": "6c8f483c-53be-43a5-9762-e4ec07e33695"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:37.259654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:37.263035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-83783dcf-b17b-4ec2-96ad-0220f5787155 req-a6fc21c5-55cb-4998-979b-541ea9282258 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:37.263529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-83783dcf-b17b-4ec2-96ad-0220f5787155 req-a6fc21c5-55cb-4998-979b-541ea9282258 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:37.263652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:37.263968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-83783dcf-b17b-4ec2-96ad-0220f5787155 req-a6fc21c5-55cb-4998-979b-541ea9282258 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:37.275221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:37.276187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:37.276753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:37.277168 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-83783dcf-b17b-4ec2-96ad-0220f5787155 req-a6fc21c5-55cb-4998-979b-541ea9282258 service nova] Creating event network-changed:6c8f483c-53be-43a5-9762-e4ec07e33695 for instance 22747190-ecfe-42ab-80b5-d8e518548d20 on nch1-master-1 Aug 06 21:39:37.277319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:37.282332 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-83783dcf-b17b-4ec2-96ad-0220f5787155 req-a6fc21c5-55cb-4998-979b-541ea9282258 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034329 Aug 06 21:39:37.284052 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3245/6308] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:37.315499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:39:37.409502 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-50f03c0f-6a97-47de-997d-a64916a704df tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 204 len: 0 microversion: 2.1 time: 0.163977 Aug 06 21:39:37.410925 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3064/6309] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:39:37 2022] DELETE /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:39:37.426660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:37.427901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:37.435758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:37.436415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:37.437326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:37.438646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:37.439791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:37.440376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:37.614842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:37.622601 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b23d03bf-0324-49b8-9773-30b9fe46ab40 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1690 microversion: 2.1 time: 0.207179 Aug 06 21:39:37.623330 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3246/6310] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:37 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:39:38.646470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:38.647265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:38.654027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:38.654509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:38.654983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:38.655694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:38.656326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:38.656761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:39.015282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:39.023090 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-92217f78-3b1c-4446-9b9e-dde2d2802630 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 200 len: 1690 microversion: 2.1 time: 0.382334 Aug 06 21:39:39.023696 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3065/6311] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:38 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 1690 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:39.301466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-690302d9-f72f-4f4a-b7a0-2f96fd07962c req-eb3b9560-07ae-43ec-ad55-00f91a1fe01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22747190-ecfe-42ab-80b5-d8e518548d20", "name": "network-vif-deleted", "tag": "6c8f483c-53be-43a5-9762-e4ec07e33695"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:39.312611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-690302d9-f72f-4f4a-b7a0-2f96fd07962c req-eb3b9560-07ae-43ec-ad55-00f91a1fe01b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:39.313090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-690302d9-f72f-4f4a-b7a0-2f96fd07962c req-eb3b9560-07ae-43ec-ad55-00f91a1fe01b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:39.313523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-690302d9-f72f-4f4a-b7a0-2f96fd07962c req-eb3b9560-07ae-43ec-ad55-00f91a1fe01b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:39.326463 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-690302d9-f72f-4f4a-b7a0-2f96fd07962c req-eb3b9560-07ae-43ec-ad55-00f91a1fe01b service nova] Creating event network-vif-deleted:6c8f483c-53be-43a5-9762-e4ec07e33695 for instance 22747190-ecfe-42ab-80b5-d8e518548d20 on nch1-master-1 Aug 06 21:39:39.331276 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-690302d9-f72f-4f4a-b7a0-2f96fd07962c req-eb3b9560-07ae-43ec-ad55-00f91a1fe01b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034147 Aug 06 21:39:39.331873 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3247/6312] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:40.045434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:40.046051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 22747190-ecfe-42ab-80b5-d8e518548d20] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:40.053316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:40.053809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:40.054253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:40.055158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:40.055632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:40.056062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:40.070345 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] HTTP exception thrown: Instance 22747190-ecfe-42ab-80b5-d8e518548d20 could not be found. Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Request method failure captured: Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 HTTP/1.1 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7t8rNgq3V_Q91LaUKnlKB0EOv-HPqrYqMUP3CnNFGzZJJ_oXruc1xvRTCSS1B8CIfNTjATeof_edZnytB715tsr9LOwUHONnyWAoDJwY52-_g1r5lupVhjDFpOg7k5rE82TVGM-FuXaJD1ghcPPXzTbJlx5JHaYmJPnjODjJqqV93F0 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 084ca5bfad90430bb2da5f3a13fd76d8 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_084ca5bfad90430bb2da5f3a13fd76d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 084ca5bfad90430bb2da5f3a13fd76d8 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestNetworkAdvancedServerOps-839994066-project Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7c192e32cff047039b46c50e69dfc9c1 Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-839994066-project Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 22747190-ecfe-42ab-80b5-d8e518548d20 could not be found. Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '22747190-ecfe-42ab-80b5-d8e518548d20'} Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22747190-ecfe-42ab-80b5-d8e518548d20 could not be found. Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22747190-ecfe-42ab-80b5-d8e518548d20 could not be found. Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:40.072063 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22747190-ecfe-42ab-80b5-d8e518548d20 could not be found. Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Returning 404 to user: Instance 22747190-ecfe-42ab-80b5-d8e518548d20 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21f738da-722f-4728-884e-1ff122927ea5 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20" status: 404 len: 111 microversion: 2.1 time: 0.031975 Aug 06 21:39:40.075578 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3066/6313] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:40 2022] GET /compute/v2.1/servers/22747190-ecfe-42ab-80b5-d8e518548d20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:39:43.617294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1524f84-1660-4f1a-9191-d81135245a99 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '.version_select at 0x7f729d6cec10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:43.644813 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1524f84-1660-4f1a-9191-d81135245a99 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1415531044" status: 202 len: 0 microversion: 2.1 time: 0.033707 Aug 06 21:39:43.646040 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3248/6314] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Aug 6 21:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1415531044 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:39:43.675495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4ef7a3e4-d331-4a10-8747-d637b8a20c57 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'create', calling method: .version_select at 0x7f729c906790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-652287057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYUorIDIWqt60ZGAb2HybZE9HqOSEt5EqXxrrsiRUtW5wIVrQVpwmUnXK79fPy+6sqBfhqU+ptziH7QHb5qQbn7r1KSWVeXanWFg+N0eLbqBgbp85WANePPloiNr5GUQw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:43.694948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4ef7a3e4-d331-4a10-8747-d637b8a20c57 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:39:43.701570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4ef7a3e4-d331-4a10-8747-d637b8a20c57 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for user 7c192e32cff047039b46c50e69dfc9c1 and project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:39:43.736149 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4ef7a3e4-d331-4a10-8747-d637b8a20c57 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.065000 Aug 06 21:39:43.737576 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3067/6315] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:39:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:50.011072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=50 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:50.015459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1314331425", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "ca99c07a-e0b6-40c4-86e6-a05ec2b94283"}], "key_name": "tempest-TestNetworkAdvancedServerOps-652287057", "security_groups": [{"name": "tempest-secgroup-smoke-840263819"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:50.150287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] validate_networks() for [('ca99c07a-e0b6-40c4-86e6-a05ec2b94283', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:39:50.621951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:39:50.623269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:39:50.623894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:39:50.624489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:39:50.625243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:39:50.640460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:50.641379 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:50.641765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:50.642793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:50.645549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:50.646484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:50.672398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:39:50.681051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for user 7c192e32cff047039b46c50e69dfc9c1 and project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:39:50.702009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:39:50.705433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:39:50.756926 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e027d319-8707-4ad5-aaaf-8fa289007936 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747559 Aug 06 21:39:50.757762 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3249/6316] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:39:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:39:50.769949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-13181b54-2e2e-4a51-ae07-36e94c6d9089 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:50.770735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13181b54-2e2e-4a51-ae07-36e94c6d9089 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:50.779238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:50.780238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:50.860317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13181b54-2e2e-4a51-ae07-36e94c6d9089 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:50.870501 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-13181b54-2e2e-4a51-ae07-36e94c6d9089 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1266 microversion: 2.1 time: 0.105013 Aug 06 21:39:50.871929 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3068/6317] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:50 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:39:51.894095 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:51.895001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:51.900304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:39:51.903469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:51.903977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:51.904418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:51.905267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:51.905743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:51.906338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:52.079589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:52.088113 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2305de50-e052-4cce-8c3d-3a1733228f6b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1326 microversion: 2.1 time: 0.199377 Aug 06 21:39:52.088702 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3250/6318] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:51 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1326 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:53.109498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:53.110031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:53.121803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:53.122309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:53.122796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:53.123537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:53.123997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:53.124429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:53.384670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:53.401781 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c095ed1a-ce69-4d36-93da-079b9ddffb47 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1391 microversion: 2.1 time: 0.296231 Aug 06 21:39:53.402397 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3069/6319] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:53 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1391 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:53.775270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ff5eaec6-540f-4eea-bc4f-6b83ada575c2 req-13c7040e-6b71-48cf-989c-bb6e39ddd58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:53.788657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ff5eaec6-540f-4eea-bc4f-6b83ada575c2 req-13c7040e-6b71-48cf-989c-bb6e39ddd58c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:53.789466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ff5eaec6-540f-4eea-bc4f-6b83ada575c2 req-13c7040e-6b71-48cf-989c-bb6e39ddd58c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:53.790172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ff5eaec6-540f-4eea-bc4f-6b83ada575c2 req-13c7040e-6b71-48cf-989c-bb6e39ddd58c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:53.806461 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ff5eaec6-540f-4eea-bc4f-6b83ada575c2 req-13c7040e-6b71-48cf-989c-bb6e39ddd58c service nova] Creating event network-changed:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch2-master-1 Aug 06 21:39:53.813945 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ff5eaec6-540f-4eea-bc4f-6b83ada575c2 req-13c7040e-6b71-48cf-989c-bb6e39ddd58c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042415 Aug 06 21:39:53.815424 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3251/6320] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:54.423550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:54.424580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:54.431756 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:54.432186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:54.432632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:54.433330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:54.433793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:54.434225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:54.571629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:54.579178 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fca6781c-deb9-4f44-a36d-2db9ba7baa76 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1391 microversion: 2.1 time: 0.159607 Aug 06 21:39:54.579750 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3070/6321] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:54 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:55.602179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:55.602902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:55.609175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:55.609608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:55.610044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:55.610775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:55.611853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:55.612300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:55.744104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:55.751612 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-028672bb-d602-43e2-be8a-8e1ba205d836 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1391 microversion: 2.1 time: 0.154536 Aug 06 21:39:55.752526 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3252/6322] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:55 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:56.772286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:56.772934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:56.779839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:56.780319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:56.780778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:56.781475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:56.781960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:56.782388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:56.921615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:56.929394 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b9f095cd-2037-4192-8f19-da0b0a5b90e6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1391 microversion: 2.1 time: 0.161652 Aug 06 21:39:56.929911 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3071/6323] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:56 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:39:57.951250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:57.951911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:57.959333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:57.959819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:57.960260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:57.960955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:57.961448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:57.961880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:58.096081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:58.104173 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-799759ad-3f4f-4502-91a4-6740291b1343 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1391 microversion: 2.1 time: 0.156919 Aug 06 21:39:58.104746 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3253/6324] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:57 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:39:59.125186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:39:59.125961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:39:59.133836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:59.134334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:59.134808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:59.135519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:59.135991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:59.136428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:59.164412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-1198eac5-9daa-42b9-a8f6-995fbe9bb441 req-8da42a64-b89c-45c3-b104-9ad62847034b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "name": "network-vif-plugged", "status": "completed", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:39:59.176659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1198eac5-9daa-42b9-a8f6-995fbe9bb441 req-8da42a64-b89c-45c3-b104-9ad62847034b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:39:59.177250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1198eac5-9daa-42b9-a8f6-995fbe9bb441 req-8da42a64-b89c-45c3-b104-9ad62847034b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:39:59.177754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1198eac5-9daa-42b9-a8f6-995fbe9bb441 req-8da42a64-b89c-45c3-b104-9ad62847034b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:39:59.193157 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-1198eac5-9daa-42b9-a8f6-995fbe9bb441 req-8da42a64-b89c-45c3-b104-9ad62847034b service nova] Creating event network-vif-plugged:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch2-master-1 Aug 06 21:39:59.198772 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-1198eac5-9daa-42b9-a8f6-995fbe9bb441 req-8da42a64-b89c-45c3-b104-9ad62847034b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038689 Aug 06 21:39:59.199454 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3254/6325] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:39:59.286353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:39:59.294220 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0aa255c1-3ec8-4724-8279-9b45be0620ee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1391 microversion: 2.1 time: 0.172978 Aug 06 21:39:59.294827 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3072/6326] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:39:59 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:00.317524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:00.318295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:00.325507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:00.326006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:00.326621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:00.327338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:00.327800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:00.328240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:00.466865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:00.475191 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-14752993-74f2-43c1-918a-9a8c4eb5422d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1391 microversion: 2.1 time: 0.163527 Aug 06 21:40:00.475772 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3255/6327] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:00 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:01.497191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:01.497726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:01.500455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:01.506872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:01.507361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:01.507833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:01.508530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:01.508993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:01.509427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:01.641960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:01.649708 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c9e6af47-4ee4-4cc6-a423-3c0dff918b04 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1562 microversion: 2.1 time: 0.156572 Aug 06 21:40:01.650285 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3073/6328] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:01 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:01.670470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:01.671131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:01.673158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:01.673851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:01.682168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:01.682691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:01.683132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:01.683835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:01.684289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:01.684713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:01.814994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:01.823446 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-818b8458-1a96-4da7-bf32-5b752a78be44 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1562 microversion: 2.1 time: 0.156788 Aug 06 21:40:01.824037 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3256/6329] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:01 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:03.701849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c70dae7d-86cd-4a3f-a890-92d16a1fe20e req-459a9b16-fec1-46a9-b5bc-c261ed393121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:40:03.706588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:03.707918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:03.720166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:03.720700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:03.720882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c70dae7d-86cd-4a3f-a890-92d16a1fe20e req-459a9b16-fec1-46a9-b5bc-c261ed393121 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:03.721146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:03.721437 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c70dae7d-86cd-4a3f-a890-92d16a1fe20e req-459a9b16-fec1-46a9-b5bc-c261ed393121 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:03.721858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:03.721965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c70dae7d-86cd-4a3f-a890-92d16a1fe20e req-459a9b16-fec1-46a9-b5bc-c261ed393121 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:03.722322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:03.723534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:03.734254 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c70dae7d-86cd-4a3f-a890-92d16a1fe20e req-459a9b16-fec1-46a9-b5bc-c261ed393121 service nova] Creating event network-changed:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch2-master-1 Aug 06 21:40:03.739572 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c70dae7d-86cd-4a3f-a890-92d16a1fe20e req-459a9b16-fec1-46a9-b5bc-c261ed393121 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041626 Aug 06 21:40:03.740434 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3257/6330] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:40:03.871779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:03.880850 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-be926103-3a1d-4d11-a5e2-4ad0352c38ac tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1562 microversion: 2.1 time: 0.185570 Aug 06 21:40:03.886589 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3074/6331] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:03 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:25.170077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=15 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:25.170860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=38 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:25.175610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a80d315-961e-4445-b28e-9d2777403aed tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:40:25.177921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4a80d315-961e-4445-b28e-9d2777403aed tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:25.186741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a80d315-961e-4445-b28e-9d2777403aed tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:25.187237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a80d315-961e-4445-b28e-9d2777403aed tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:25.187678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a80d315-961e-4445-b28e-9d2777403aed tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:25.188387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a80d315-961e-4445-b28e-9d2777403aed tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:25.188844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a80d315-961e-4445-b28e-9d2777403aed tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:25.189279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a80d315-961e-4445-b28e-9d2777403aed tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:25.243904 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a80d315-961e-4445-b28e-9d2777403aed tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action" status: 200 len: 24567 microversion: 2.1 time: 0.075566 Aug 06 21:40:25.244548 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3258/6332] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:40:25 2022] POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action => generated 24567 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:40:36.253173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6e4423fb-5610-467b-803e-3b3a89851024 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:36.253823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6e4423fb-5610-467b-803e-3b3a89851024 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:36.256440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=15 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:36.257112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=36 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:36.263227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e4423fb-5610-467b-803e-3b3a89851024 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:36.263727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e4423fb-5610-467b-803e-3b3a89851024 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:36.264178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e4423fb-5610-467b-803e-3b3a89851024 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:36.264902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e4423fb-5610-467b-803e-3b3a89851024 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:36.265406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e4423fb-5610-467b-803e-3b3a89851024 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:36.265821 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e4423fb-5610-467b-803e-3b3a89851024 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:36.396393 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6e4423fb-5610-467b-803e-3b3a89851024 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1831 microversion: 2.1 time: 0.147091 Aug 06 21:40:36.396967 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3075/6333] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:36 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1831 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:36.418569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:36.419336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:36.422211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:36.422990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:40:36.429175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:36.430402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:36.430878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:36.431598 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:36.432063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:36.432502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:36.567288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:36.574976 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d89ce69-749c-423d-ac9a-0504caad998f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1680 microversion: 2.1 time: 0.161262 Aug 06 21:40:36.575546 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3259/6334] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:36 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:36.678693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6e643823-b470-4277-92d7-1e59a54424c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:40:36.681045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6e643823-b470-4277-92d7-1e59a54424c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:36.687008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e643823-b470-4277-92d7-1e59a54424c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:36.687494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e643823-b470-4277-92d7-1e59a54424c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:36.687930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e643823-b470-4277-92d7-1e59a54424c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:36.688617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e643823-b470-4277-92d7-1e59a54424c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:36.689071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e643823-b470-4277-92d7-1e59a54424c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:36.689499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6e643823-b470-4277-92d7-1e59a54424c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:36.740895 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6e643823-b470-4277-92d7-1e59a54424c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action" status: 200 len: 32638 microversion: 2.1 time: 0.066261 Aug 06 21:40:36.741524 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3076/6335] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:40:36 2022] POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action => generated 32638 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:40:36.902204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:40:36.902740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:36.909300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:36.909788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:36.910227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:36.910956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:36.911434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:36.911881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:36.951177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2daf7e8662ec45b2a5b8d92876546ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee81fb612e64d278277698b4f721414', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:36.951777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] flavor_id is None. Assuming migration. {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 06 21:40:36.952223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:40:37.241731 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d416196-e985-4a7f-b4db-9e2ee12f49e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action" status: 202 len: 0 microversion: 2.1 time: 0.344269 Aug 06 21:40:37.243207 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3260/6336] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:40:36 2022] POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:40:37.251873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:37.252596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:37.261169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:37.261721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:37.262091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:37.262947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:37.263301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:37.263734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:37.406386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:37.415168 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-82ecc16d-eb3c-442b-b68b-1880989a77a4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1689 microversion: 2.1 time: 0.166565 Aug 06 21:40:37.415851 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3077/6337] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:37 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:38.437650 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:38.438317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:38.444861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:38.445594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:38.446044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:38.446794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:38.447258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:38.447690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:38.583882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:38.591988 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5bfbf443-cea8-485b-92ef-b444b5586092 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1689 microversion: 2.1 time: 0.159151 Aug 06 21:40:38.592562 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3261/6338] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:38 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:39.613359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:39.613975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:39.621231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:39.621719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:39.622164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:39.622892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:39.623353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:39.623785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:39.763936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:39.771457 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23ab22bc-b7b3-4a5d-83ae-6c196e319bfa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.162067 Aug 06 21:40:39.772205 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3078/6339] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:39 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:40.794043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:40.794705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:40.801721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:40.802213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:40.802688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:40.803387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:40.803850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:40.804300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:40.943204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:40.951688 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-43033f4e-00c9-4014-973e-8e5211182f24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.161654 Aug 06 21:40:40.952467 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3262/6340] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:40 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:41.973362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:41.974014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:41.980962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:41.981445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:41.981890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:41.982613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:41.983078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:41.983512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:42.113672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:42.121851 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8339c7a4-47d8-4ccf-a1eb-b95921bfbd5c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.152376 Aug 06 21:40:42.122423 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3079/6341] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:41 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:43.143031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:43.143657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:43.151357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:43.151852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:43.152297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:43.153007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:43.153477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:43.153916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:43.287544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:43.295089 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4047001e-352c-47cb-b12a-d90a84ec55fc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.156099 Aug 06 21:40:43.295701 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3263/6342] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:43 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:44.317297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:44.317918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:44.325203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:44.325691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:44.326168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:44.326910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:44.327375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:44.327809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:44.468686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:44.476280 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab6ba4f6-7ac5-4a83-bb1a-668c963a55c3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.163228 Aug 06 21:40:44.477362 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3080/6343] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:44 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:45.498523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:45.499199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:45.506059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:45.506566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:45.507027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:45.507722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:45.508193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:45.508892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:45.644587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:45.652791 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-04c698c3-586d-4d3f-ba45-2179838ca61d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.159019 Aug 06 21:40:45.653371 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3264/6344] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:45 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:46.674460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:46.675513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:46.683191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:46.683684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:46.684132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:46.684839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:46.685307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:46.685747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:46.818982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:46.827558 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-81e8b020-7fce-4afb-b30b-9690004162c1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.157003 Aug 06 21:40:46.828128 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3081/6345] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:46 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:47.849335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:47.849950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:47.857155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:47.857796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:47.858367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:47.859307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:47.859961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:47.860771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:47.992529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:48.000293 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cb7cf4d8-ad9f-4d95-8426-70bec13425db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.154879 Aug 06 21:40:48.000866 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3265/6346] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:47 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:49.021322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:49.021938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:49.029607 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:49.030089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:49.030526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:49.031246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:49.031701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:49.032129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:49.164257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:49.172448 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d7e397ef-560e-41b3-aa8d-0ed3a8ee8363 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.155041 Aug 06 21:40:49.173015 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3082/6347] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:49 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:50.193532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:50.194144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:50.201752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:50.202232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:50.202708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:50.203400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:50.203855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:50.204282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:50.337211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:50.345619 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-472d7dc0-4729-4e4e-86fa-f731d4dd442a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.156204 Aug 06 21:40:50.346191 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3266/6348] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:50 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:51.367352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:51.367997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:51.375707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:51.376188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:51.376627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:51.377321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:51.377773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:51.378197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:51.517276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:51.525414 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-556dc4fe-1ff3-4e1a-a590-c3e86e3003d6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.161398 Aug 06 21:40:51.525997 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3083/6349] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:51 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:52.546215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:52.546931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:52.553865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:52.554359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:52.554859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:52.555550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:52.556017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:52.556619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:52.692826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:52.701105 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-de2236f7-c886-4065-87db-812f89412b94 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.158796 Aug 06 21:40:52.701684 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3267/6350] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:52 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:53.722743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:53.723365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:53.731041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:53.731532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:53.731977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:53.732673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:53.733133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:53.733566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:53.868473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:53.876317 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-845f7011-9a4e-4400-bf87-b4ed34549a2e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.157578 Aug 06 21:40:53.876908 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3084/6351] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:53 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:54.897434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:54.898052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:54.905755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:54.906246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:54.906735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:54.907438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:54.907900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:54.908332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:55.039436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:55.047688 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80e83c02-b543-4f61-b910-e7ed2428580b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1694 microversion: 2.1 time: 0.154320 Aug 06 21:40:55.048262 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3268/6352] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:54 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:56.070191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:56.071318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:56.079429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:56.079919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:56.080361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:56.081059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:56.082085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:56.082768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:56.298172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:56.306086 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-25a386f6-81aa-443a-ae0b-7af7bd682f43 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1693 microversion: 2.1 time: 0.240397 Aug 06 21:40:56.306935 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3085/6353] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:56 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1693 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:56.611539 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-51edb40b-fe3b-4e34-8e14-029066714e7c req-c7c66264-6af5-4cb5-9d74-9520d0acf6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "name": "network-vif-unplugged", "status": "completed", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:40:56.623726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-51edb40b-fe3b-4e34-8e14-029066714e7c req-c7c66264-6af5-4cb5-9d74-9520d0acf6aa service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:56.624321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-51edb40b-fe3b-4e34-8e14-029066714e7c req-c7c66264-6af5-4cb5-9d74-9520d0acf6aa service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:56.624757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-51edb40b-fe3b-4e34-8e14-029066714e7c req-c7c66264-6af5-4cb5-9d74-9520d0acf6aa service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:56.641087 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-51edb40b-fe3b-4e34-8e14-029066714e7c req-c7c66264-6af5-4cb5-9d74-9520d0acf6aa service nova] Creating event network-vif-unplugged:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch1-master-1 Aug 06 21:40:56.646999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-51edb40b-fe3b-4e34-8e14-029066714e7c req-c7c66264-6af5-4cb5-9d74-9520d0acf6aa service nova] Instance 121bb723-4da2-46f3-a04e-5be7744c8464 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:40:56.658785 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-51edb40b-fe3b-4e34-8e14-029066714e7c req-c7c66264-6af5-4cb5-9d74-9520d0acf6aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051419 Aug 06 21:40:56.659715 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3269/6354] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:40:57.328653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:57.329312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:57.336563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:57.337051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:57.338115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:57.339311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:57.339783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:57.340240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:57.549428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:57.557037 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-95192c0e-3575-4b34-a3b7-3e502705b94e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1693 microversion: 2.1 time: 0.232325 Aug 06 21:40:57.557622 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3086/6355] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:57 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1693 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:58.578940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:58.579661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:58.586943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:58.587490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:58.588337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:58.589049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:58.589515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:58.589956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:58.690515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-000105db-3cb9-4a66-b4f0-2066afb322e4 req-ca2bd05d-5cb1-4fec-9aa5-8c429e96d583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:40:58.701252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-000105db-3cb9-4a66-b4f0-2066afb322e4 req-ca2bd05d-5cb1-4fec-9aa5-8c429e96d583 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:58.701741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-000105db-3cb9-4a66-b4f0-2066afb322e4 req-ca2bd05d-5cb1-4fec-9aa5-8c429e96d583 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:58.702182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-000105db-3cb9-4a66-b4f0-2066afb322e4 req-ca2bd05d-5cb1-4fec-9aa5-8c429e96d583 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:58.714188 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-000105db-3cb9-4a66-b4f0-2066afb322e4 req-ca2bd05d-5cb1-4fec-9aa5-8c429e96d583 service nova] Creating event network-changed:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch1-master-1 Aug 06 21:40:58.719844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-000105db-3cb9-4a66-b4f0-2066afb322e4 req-ca2bd05d-5cb1-4fec-9aa5-8c429e96d583 service nova] Instance 121bb723-4da2-46f3-a04e-5be7744c8464 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:40:58.731580 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-000105db-3cb9-4a66-b4f0-2066afb322e4 req-ca2bd05d-5cb1-4fec-9aa5-8c429e96d583 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044696 Aug 06 21:40:58.732404 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3087/6356] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:40:58.734643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:58.742605 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1d7790ad-7d04-4808-9431-71f0af908856 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1691 microversion: 2.1 time: 0.167962 Aug 06 21:40:58.743191 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3270/6357] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:58 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:59.765266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:40:59.765961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:59.773250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:59.773738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:59.774179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:59.775452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:59.775974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:59.776482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:59.911638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:40:59.920396 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6b056f6-9130-4243-a321-1bf1d8397900 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1688 microversion: 2.1 time: 0.159307 Aug 06 21:40:59.920973 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3088/6358] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:40:59 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:40:59.942057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-43e32207-d880-47ed-9275-fdf0b448cfca tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:40:59.942593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-43e32207-d880-47ed-9275-fdf0b448cfca tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:40:59.950129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43e32207-d880-47ed-9275-fdf0b448cfca tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:59.950661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43e32207-d880-47ed-9275-fdf0b448cfca tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:59.951110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43e32207-d880-47ed-9275-fdf0b448cfca tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:40:59.951867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43e32207-d880-47ed-9275-fdf0b448cfca tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:40:59.952335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43e32207-d880-47ed-9275-fdf0b448cfca tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:40:59.952791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43e32207-d880-47ed-9275-fdf0b448cfca tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:00.061563 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-43e32207-d880-47ed-9275-fdf0b448cfca tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action" status: 202 len: 0 microversion: 2.1 time: 0.123477 Aug 06 21:41:00.062531 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3271/6359] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:40:59 2022] POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:41:00.071524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:00.072964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:00.079242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:00.079820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:00.080352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:00.081223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:00.081812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:00.082388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:00.314337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:00.324400 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-039c5642-bac1-48af-b951-be560d5d7d77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1687 microversion: 2.1 time: 0.257461 Aug 06 21:41:00.325247 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3089/6360] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:00 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1687 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:01.348564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:01.349276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:01.357385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:01.357872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:01.358318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:01.359060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:01.359527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:01.359960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:01.375882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:01.499083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:01.506896 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9c605721-213a-4cc2-a87a-328d9f955549 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1687 microversion: 2.1 time: 0.162634 Aug 06 21:41:01.507509 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3272/6361] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:01 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:02.530088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:02.530932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:02.537822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:02.538783 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:02.539394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:02.540247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:02.540885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:02.541458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:02.624160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-cfcd5e7a-7b0c-4e77-96c7-e864b0964690 req-441288b1-b745-4ea6-b44e-53decdd158dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "name": "network-vif-plugged", "status": "completed", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:02.635398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cfcd5e7a-7b0c-4e77-96c7-e864b0964690 req-441288b1-b745-4ea6-b44e-53decdd158dd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:02.635894 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cfcd5e7a-7b0c-4e77-96c7-e864b0964690 req-441288b1-b745-4ea6-b44e-53decdd158dd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:02.636338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-cfcd5e7a-7b0c-4e77-96c7-e864b0964690 req-441288b1-b745-4ea6-b44e-53decdd158dd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:02.650705 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-cfcd5e7a-7b0c-4e77-96c7-e864b0964690 req-441288b1-b745-4ea6-b44e-53decdd158dd service nova] Creating event network-vif-plugged:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch2-master-1 Aug 06 21:41:02.659127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-cfcd5e7a-7b0c-4e77-96c7-e864b0964690 req-441288b1-b745-4ea6-b44e-53decdd158dd service nova] Instance 121bb723-4da2-46f3-a04e-5be7744c8464 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:41:02.672077 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-cfcd5e7a-7b0c-4e77-96c7-e864b0964690 req-441288b1-b745-4ea6-b44e-53decdd158dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051328 Aug 06 21:41:02.673186 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3273/6362] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:41:03.012665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:03.020417 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-42eea068-e6a3-4ce8-931f-5fda939be1dc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1687 microversion: 2.1 time: 0.494918 Aug 06 21:41:03.020995 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3090/6363] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:02 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1687 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:03.202086 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-845c609a-ffff-44d9-ba06-abda30246545 req-a6711cf7-ae71-4acc-a322-374ae294bc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "name": "network-vif-unplugged", "status": "completed", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:03.211948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-845c609a-ffff-44d9-ba06-abda30246545 req-a6711cf7-ae71-4acc-a322-374ae294bc95 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:03.212505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-845c609a-ffff-44d9-ba06-abda30246545 req-a6711cf7-ae71-4acc-a322-374ae294bc95 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:03.213028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-845c609a-ffff-44d9-ba06-abda30246545 req-a6711cf7-ae71-4acc-a322-374ae294bc95 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:03.225274 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-845c609a-ffff-44d9-ba06-abda30246545 req-a6711cf7-ae71-4acc-a322-374ae294bc95 service nova] Creating event network-vif-unplugged:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch2-master-1 Aug 06 21:41:03.231713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-845c609a-ffff-44d9-ba06-abda30246545 req-a6711cf7-ae71-4acc-a322-374ae294bc95 service nova] Instance 121bb723-4da2-46f3-a04e-5be7744c8464 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:41:03.243700 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-845c609a-ffff-44d9-ba06-abda30246545 req-a6711cf7-ae71-4acc-a322-374ae294bc95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045808 Aug 06 21:41:03.245334 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3274/6364] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:41:04.042490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:04.043142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:04.049961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:04.050456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:04.050945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:04.051804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:04.052449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:04.052889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:04.188128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:04.196167 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cda356b4-a1f7-441f-a8a7-cfc35a3d16cb tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1687 microversion: 2.1 time: 0.158096 Aug 06 21:41:04.196747 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3091/6365] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:04 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:05.218261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:05.218983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:05.225233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:05.225718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:05.226153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:05.226876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:05.227340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:05.227770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:05.279862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-2323e743-649e-4781-a012-145190ba5a2a req-23a6ac1d-d022-445b-97b8-576cfc89996c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:05.289917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2323e743-649e-4781-a012-145190ba5a2a req-23a6ac1d-d022-445b-97b8-576cfc89996c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:05.290398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2323e743-649e-4781-a012-145190ba5a2a req-23a6ac1d-d022-445b-97b8-576cfc89996c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:05.291393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-2323e743-649e-4781-a012-145190ba5a2a req-23a6ac1d-d022-445b-97b8-576cfc89996c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:05.295795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:05.304836 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-2323e743-649e-4781-a012-145190ba5a2a req-23a6ac1d-d022-445b-97b8-576cfc89996c service nova] Creating event network-changed:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch2-master-1 Aug 06 21:41:05.311084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-2323e743-649e-4781-a012-145190ba5a2a req-23a6ac1d-d022-445b-97b8-576cfc89996c service nova] Instance 121bb723-4da2-46f3-a04e-5be7744c8464 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:41:05.323035 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-2323e743-649e-4781-a012-145190ba5a2a req-23a6ac1d-d022-445b-97b8-576cfc89996c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046587 Aug 06 21:41:05.323648 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3092/6366] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:41:05.376187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:05.383913 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-abf667f5-7818-48c0-b241-f53fc9fa41e1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1687 microversion: 2.1 time: 0.170723 Aug 06 21:41:05.384964 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3275/6367] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:05 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:06.406173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:06.406940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:06.409758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=37 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:06.415498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:06.416156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:06.416594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:06.417296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:06.417757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:06.418189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:06.558822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:06.566364 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b037d7e-775a-4669-849a-f1545daf5e1e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1680 microversion: 2.1 time: 0.164591 Aug 06 21:41:06.567219 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3093/6368] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:06 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:09.492772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f4096cd8-f159-40ef-9093-0e15c13f3b04 req-d448d75c-8d48-4c40-9886-c3417de68baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "name": "network-vif-plugged", "status": "completed", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:09.499025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=41 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:09.505032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f4096cd8-f159-40ef-9093-0e15c13f3b04 req-d448d75c-8d48-4c40-9886-c3417de68baa service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:09.505523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f4096cd8-f159-40ef-9093-0e15c13f3b04 req-d448d75c-8d48-4c40-9886-c3417de68baa service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:09.506594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f4096cd8-f159-40ef-9093-0e15c13f3b04 req-d448d75c-8d48-4c40-9886-c3417de68baa service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:09.517898 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f4096cd8-f159-40ef-9093-0e15c13f3b04 req-d448d75c-8d48-4c40-9886-c3417de68baa service nova] Creating event network-vif-plugged:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch2-master-1 Aug 06 21:41:09.522941 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f4096cd8-f159-40ef-9093-0e15c13f3b04 req-d448d75c-8d48-4c40-9886-c3417de68baa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033908 Aug 06 21:41:09.523530 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3276/6369] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:41:30.756451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb1698de-463f-459c-8a2e-18145f8602c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:30.758653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb1698de-463f-459c-8a2e-18145f8602c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:30.761011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:30.761867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:30.767678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb1698de-463f-459c-8a2e-18145f8602c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:30.768122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb1698de-463f-459c-8a2e-18145f8602c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:30.768565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb1698de-463f-459c-8a2e-18145f8602c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:30.769260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb1698de-463f-459c-8a2e-18145f8602c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:30.769716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb1698de-463f-459c-8a2e-18145f8602c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:30.770171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb1698de-463f-459c-8a2e-18145f8602c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:30.825159 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb1698de-463f-459c-8a2e-18145f8602c2 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action" status: 200 len: 63256 microversion: 2.1 time: 0.072524 Aug 06 21:41:30.825876 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3094/6370] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:41:30 2022] POST /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464/action => generated 63256 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:41:37.064505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:37.065525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=19 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:37.069667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e9c6f469-e91a-41be-a728-ed204e6755e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:37.070368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e9c6f469-e91a-41be-a728-ed204e6755e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:37.077417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c6f469-e91a-41be-a728-ed204e6755e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:37.077903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c6f469-e91a-41be-a728-ed204e6755e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:37.078349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c6f469-e91a-41be-a728-ed204e6755e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:37.079076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c6f469-e91a-41be-a728-ed204e6755e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:37.079540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c6f469-e91a-41be-a728-ed204e6755e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:37.079971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c6f469-e91a-41be-a728-ed204e6755e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:37.211608 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e9c6f469-e91a-41be-a728-ed204e6755e2 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1831 microversion: 2.1 time: 0.149271 Aug 06 21:41:37.212200 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3277/6371] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:37 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1831 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:38.069527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:38.070168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:38.071293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-39fd4f14-2666-40fb-9360-8d137f2378e7 req-d5995f20-46a2-4fa4-848f-461410359e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:38.076987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:38.077476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:38.077918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:38.078653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:38.079109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:38.079536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:38.083116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-39fd4f14-2666-40fb-9360-8d137f2378e7 req-d5995f20-46a2-4fa4-848f-461410359e24 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:38.083605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-39fd4f14-2666-40fb-9360-8d137f2378e7 req-d5995f20-46a2-4fa4-848f-461410359e24 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:38.084178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-39fd4f14-2666-40fb-9360-8d137f2378e7 req-d5995f20-46a2-4fa4-848f-461410359e24 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:38.097608 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-39fd4f14-2666-40fb-9360-8d137f2378e7 req-d5995f20-46a2-4fa4-848f-461410359e24 service nova] Creating event network-changed:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch2-master-1 Aug 06 21:41:38.103338 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-39fd4f14-2666-40fb-9360-8d137f2378e7 req-d5995f20-46a2-4fa4-848f-461410359e24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036175 Aug 06 21:41:38.104121 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3278/6372] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:41:38.107711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:41:38.201052 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e51d6209-a252-447a-8cdc-ea2052a1c469 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "DELETE /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 204 len: 0 microversion: 2.1 time: 0.135993 Aug 06 21:41:38.204861 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3095/6373] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:41:38 2022] DELETE /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:41:38.212374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:38.213225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:38.220315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:38.220973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:38.221775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:38.222811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:38.223351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:38.223858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:38.384733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:38.392452 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-19d2e563-327e-4843-9341-275c73d9a76b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1686 microversion: 2.1 time: 0.184819 Aug 06 21:41:38.393307 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3279/6374] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:38 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:39.414584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:39.415370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:39.423408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:39.423894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:39.424337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:39.425353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:39.426006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:39.426480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:39.652212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:39.660570 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3ff8b352-598d-400d-863f-6f3218da2049 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 200 len: 1686 microversion: 2.1 time: 0.250262 Aug 06 21:41:39.661247 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3096/6375] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:39 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 1686 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:40.000509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2c290ab2-85cc-4783-ac80-d4ca6de53939 req-db98d842-de56-4fea-9c6c-74ecee0437b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121bb723-4da2-46f3-a04e-5be7744c8464", "name": "network-vif-deleted", "tag": "086ee06f-f4ec-4678-bc9c-7fb4f939ab93"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:40.010850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2c290ab2-85cc-4783-ac80-d4ca6de53939 req-db98d842-de56-4fea-9c6c-74ecee0437b5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:40.011331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2c290ab2-85cc-4783-ac80-d4ca6de53939 req-db98d842-de56-4fea-9c6c-74ecee0437b5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:40.011756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2c290ab2-85cc-4783-ac80-d4ca6de53939 req-db98d842-de56-4fea-9c6c-74ecee0437b5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:40.023623 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2c290ab2-85cc-4783-ac80-d4ca6de53939 req-db98d842-de56-4fea-9c6c-74ecee0437b5 service nova] Creating event network-vif-deleted:086ee06f-f4ec-4678-bc9c-7fb4f939ab93 for instance 121bb723-4da2-46f3-a04e-5be7744c8464 on nch2-master-1 Aug 06 21:41:40.028782 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2c290ab2-85cc-4783-ac80-d4ca6de53939 req-db98d842-de56-4fea-9c6c-74ecee0437b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032015 Aug 06 21:41:40.029379 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3280/6376] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:41:40.681916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:40.682490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 121bb723-4da2-46f3-a04e-5be7744c8464] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:40.689409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:40.689901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:40.690919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:40.691623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:40.692086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:40.692520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:40.709593 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] HTTP exception thrown: Instance 121bb723-4da2-46f3-a04e-5be7744c8464 could not be found. Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Request method failure captured: Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 HTTP/1.1 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7t8rNgq3V_Q91LaUKnlKB0EOv-HPqrYqMUP3CnNFGzZJJ_oXruc1xvRTCSS1B8CIfNTjATeof_edZnytB715tsr9LOwUHONnyWAoDJwY52-_g1r5lupVhjDFpOg7k5rE82TVGM-FuXaJD1ghcPPXzTbJlx5JHaYmJPnjODjJqqV93F0 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 084ca5bfad90430bb2da5f3a13fd76d8 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_084ca5bfad90430bb2da5f3a13fd76d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 084ca5bfad90430bb2da5f3a13fd76d8 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestNetworkAdvancedServerOps-839994066-project Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7c192e32cff047039b46c50e69dfc9c1 Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-839994066-project Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 121bb723-4da2-46f3-a04e-5be7744c8464 could not be found. Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '121bb723-4da2-46f3-a04e-5be7744c8464'} Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121bb723-4da2-46f3-a04e-5be7744c8464 could not be found. Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121bb723-4da2-46f3-a04e-5be7744c8464 could not be found. Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:41:40.711258 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121bb723-4da2-46f3-a04e-5be7744c8464 could not be found. Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Returning 404 to user: Instance 121bb723-4da2-46f3-a04e-5be7744c8464 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-52e9dd5a-a04c-4308-accd-c0f0ab6a542e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464" status: 404 len: 111 microversion: 2.1 time: 0.034756 Aug 06 21:41:40.715624 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3097/6377] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:40 2022] GET /compute/v2.1/servers/121bb723-4da2-46f3-a04e-5be7744c8464 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:41:43.974692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1d6897c-0093-4caa-8531-1ffbbd28ac1c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '.version_select at 0x7f729ddab4c0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:43.978958 ncdv-master-1 devstack@n-api.service[142461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1d6897c-0093-4caa-8531-1ffbbd28ac1c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [c4d64f3f-2c08-4a87-8b71-e45e80e24cdd] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 21:41:44.986242 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1d6897c-0093-4caa-8531-1ffbbd28ac1c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [c4d64f3f-2c08-4a87-8b71-e45e80e24cdd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 39956. Aug 06 21:41:45.005311 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1d6897c-0093-4caa-8531-1ffbbd28ac1c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-652287057" status: 202 len: 0 microversion: 2.1 time: 1.035943 Aug 06 21:41:45.005929 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3281/6378] 10.222.0.33 () {58 vars in 1281 bytes} [Sat Aug 6 21:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-652287057 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:41:45.041435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14ebab5f-dce1-43d0-b2db-775745f6009f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'create', calling method: .version_select at 0x7f729c75f3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1385345373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3NzaMzFm1UV17CqCkMhKntRPqrDe1MMduqjA68ntvVo/TrMexTs8CQNNfHr9i33kywC4SQKOKJ6ItUQmFabs40oo78f1Mf87Ow8WrOBHRL+C0aoxJ85pnrWtqrwqrWIg=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:45.058193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-14ebab5f-dce1-43d0-b2db-775745f6009f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:41:45.064166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-14ebab5f-dce1-43d0-b2db-775745f6009f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for user 7c192e32cff047039b46c50e69dfc9c1 and project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:41:45.087925 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-14ebab5f-dce1-43d0-b2db-775745f6009f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050392 Aug 06 21:41:45.088512 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3098/6379] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:41:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:41:50.558629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=16 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:50.563795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-901847843", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "65d7d35a-c305-43c8-8477-d0b2c3c2833d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1385345373", "security_groups": [{"name": "tempest-secgroup-smoke-931219989"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:50.685754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] validate_networks() for [('65d7d35a-c305-43c8-8477-d0b2c3c2833d', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:41:51.159570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:41:51.160206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:41:51.160699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:41:51.161122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:41:51.161542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:41:51.172324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:51.172827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:51.173474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:51.174957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:51.175701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:51.176137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:51.195335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:41:51.200959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for user 7c192e32cff047039b46c50e69dfc9c1 and project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:41:51.215660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:41:51.218272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:41:51.283135 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fca1dfa3-5188-44d3-8990-65e258b00585 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.726162 Aug 06 21:41:51.284633 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3282/6380] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:41:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:41:51.297751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f9dfb384-c30b-45a9-9732-928adcdb7d03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:51.298381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f9dfb384-c30b-45a9-9732-928adcdb7d03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:51.301582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:41:51.434587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f9dfb384-c30b-45a9-9732-928adcdb7d03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:51.445117 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f9dfb384-c30b-45a9-9732-928adcdb7d03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1266 microversion: 2.1 time: 0.151681 Aug 06 21:41:51.458572 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3099/6381] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:51 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:52.467791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:52.468932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:52.478091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:52.478820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:52.479443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:52.480148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:52.480603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:52.481198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:52.561470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:52.569900 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-547e288c-3a20-41e4-ab5d-36d329e94d24 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1336 microversion: 2.1 time: 0.105907 Aug 06 21:41:52.571104 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3283/6382] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:52 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1336 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:53.591553 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:53.592291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:53.600917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:53.601417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:53.601866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:53.602618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:53.603086 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:53.603522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:53.859150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:53.866795 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d41b310b-0645-469e-b560-6b74a1544157 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1391 microversion: 2.1 time: 0.279125 Aug 06 21:41:53.867372 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3100/6383] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:53 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1391 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:53.932426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-9566b3d3-5abe-4c69-8b64-5428eaf8d8c7 req-e94c8bb2-3516-4ec0-89b6-aa6acc107de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65721f04-4dfc-457d-b46a-c87fe17294cf", "tag": "05124ba9-b1cf-47d2-9463-12d6219d89f6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:53.945138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9566b3d3-5abe-4c69-8b64-5428eaf8d8c7 req-e94c8bb2-3516-4ec0-89b6-aa6acc107de3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:53.945630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9566b3d3-5abe-4c69-8b64-5428eaf8d8c7 req-e94c8bb2-3516-4ec0-89b6-aa6acc107de3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:53.946070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9566b3d3-5abe-4c69-8b64-5428eaf8d8c7 req-e94c8bb2-3516-4ec0-89b6-aa6acc107de3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:53.960517 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-9566b3d3-5abe-4c69-8b64-5428eaf8d8c7 req-e94c8bb2-3516-4ec0-89b6-aa6acc107de3 service nova] Creating event network-changed:05124ba9-b1cf-47d2-9463-12d6219d89f6 for instance 65721f04-4dfc-457d-b46a-c87fe17294cf on nch2-master-1 Aug 06 21:41:53.965709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-9566b3d3-5abe-4c69-8b64-5428eaf8d8c7 req-e94c8bb2-3516-4ec0-89b6-aa6acc107de3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038159 Aug 06 21:41:53.966477 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3284/6384] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:41:54.888217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:54.889109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:54.896592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:54.897081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:54.897521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:54.898221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:54.898715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:54.899143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:55.032055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:55.040190 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eb8ed504-e803-4329-acc0-9927141a01d3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1391 microversion: 2.1 time: 0.156580 Aug 06 21:41:55.040760 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3101/6385] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:54 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:56.062028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:56.062777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:56.070278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:56.070804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:56.071252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:56.071951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:56.072411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:56.072843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:56.210667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:56.218288 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d74010f6-fbc4-4d94-b9e7-63c5d47dcc3d tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1391 microversion: 2.1 time: 0.160691 Aug 06 21:41:56.218917 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3285/6386] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:56 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:57.240025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:57.240645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:57.247672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:57.248155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:57.248600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:57.249299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:57.249760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:57.250192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:57.381955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:57.389441 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-67582f30-01bb-4213-afe0-1858cb13ae03 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1391 microversion: 2.1 time: 0.154572 Aug 06 21:41:57.390018 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3102/6387] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:57 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:58.409565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:58.410175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:58.417212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:58.417695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:58.418134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:58.418874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:58.419315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:58.419741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:58.554871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:58.562390 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd7cad20-d88a-4463-947c-4d2f9a5ef3de tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1391 microversion: 2.1 time: 0.157023 Aug 06 21:41:58.563021 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3286/6388] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:58 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:59.583645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:41:59.584258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:41:59.591047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:59.591527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:59.591966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:59.592661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:59.593118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:59.593543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:59.738355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:41:59.746268 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f2a8f60-3ff1-405e-89c5-200dbaf7d648 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1391 microversion: 2.1 time: 0.166577 Aug 06 21:41:59.746897 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3103/6389] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:41:59 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:41:59.886517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-16aaada3-ce93-42b1-86ef-76c126689a0e req-4b6e2173-d854-4eef-85d3-72a494939edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65721f04-4dfc-457d-b46a-c87fe17294cf", "name": "network-vif-plugged", "status": "completed", "tag": "05124ba9-b1cf-47d2-9463-12d6219d89f6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:41:59.897626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-16aaada3-ce93-42b1-86ef-76c126689a0e req-4b6e2173-d854-4eef-85d3-72a494939edb service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:41:59.898118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-16aaada3-ce93-42b1-86ef-76c126689a0e req-4b6e2173-d854-4eef-85d3-72a494939edb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:41:59.898762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-16aaada3-ce93-42b1-86ef-76c126689a0e req-4b6e2173-d854-4eef-85d3-72a494939edb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:41:59.911421 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-16aaada3-ce93-42b1-86ef-76c126689a0e req-4b6e2173-d854-4eef-85d3-72a494939edb service nova] Creating event network-vif-plugged:05124ba9-b1cf-47d2-9463-12d6219d89f6 for instance 65721f04-4dfc-457d-b46a-c87fe17294cf on nch2-master-1 Aug 06 21:41:59.916359 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-16aaada3-ce93-42b1-86ef-76c126689a0e req-4b6e2173-d854-4eef-85d3-72a494939edb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033802 Aug 06 21:41:59.916968 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3287/6390] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:42:00.767266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:00.767817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:00.771122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:00.776694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:00.777194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:00.777638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:00.778334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:00.778823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:00.779259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:00.912755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:00.920365 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6239c27d-da89-4d30-adaa-f4b78bde87ec tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1391 microversion: 2.1 time: 0.157101 Aug 06 21:42:00.920964 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3104/6391] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:00 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:01.940628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:01.941408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:01.946609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:01.947541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:01.954698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:01.955188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:01.955664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:01.956367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:01.956839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:01.957273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:02.090084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:02.097753 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dcec4313-47f2-4333-bc9a-57ce4e723e60 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1563 microversion: 2.1 time: 0.159010 Aug 06 21:42:02.099046 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3288/6392] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:01 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:02.118361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:02.119014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:02.120863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:02.127230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:02.127711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:02.128150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:02.128840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:02.129292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:02.130253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:02.267440 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:02.276087 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a8c9d50-46f3-4e7b-a8b6-d585384aad41 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1563 microversion: 2.1 time: 0.161557 Aug 06 21:42:02.276663 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3105/6393] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:02 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:03.884511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:03.885149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:03.893662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8af1543c-3b34-4a3a-a035-3d4742f0fc0d req-d7fb4f65-d9fb-4401-9833-9a2b67dc8419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65721f04-4dfc-457d-b46a-c87fe17294cf", "tag": "05124ba9-b1cf-47d2-9463-12d6219d89f6"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:03.904592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:03.904894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8af1543c-3b34-4a3a-a035-3d4742f0fc0d req-d7fb4f65-d9fb-4401-9833-9a2b67dc8419 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:03.905394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8af1543c-3b34-4a3a-a035-3d4742f0fc0d req-d7fb4f65-d9fb-4401-9833-9a2b67dc8419 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:03.905540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:03.905833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8af1543c-3b34-4a3a-a035-3d4742f0fc0d req-d7fb4f65-d9fb-4401-9833-9a2b67dc8419 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:03.906301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:03.907124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:03.907784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:03.908302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:03.918085 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8af1543c-3b34-4a3a-a035-3d4742f0fc0d req-d7fb4f65-d9fb-4401-9833-9a2b67dc8419 service nova] Creating event network-changed:05124ba9-b1cf-47d2-9463-12d6219d89f6 for instance 65721f04-4dfc-457d-b46a-c87fe17294cf on nch2-master-1 Aug 06 21:42:03.923336 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8af1543c-3b34-4a3a-a035-3d4742f0fc0d req-d7fb4f65-d9fb-4401-9833-9a2b67dc8419 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033254 Aug 06 21:42:03.924068 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3106/6394] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:42:04.057271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:04.065614 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-40d48a1d-cac8-459f-8c59-56032cb26a5e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1563 microversion: 2.1 time: 0.185774 Aug 06 21:42:04.066390 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3289/6395] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:03 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:07.327827 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:42:07.328374 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:42:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:42:25.367265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=5 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:25.368017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=38 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:25.372272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cbb27628-7218-431b-b616-49aa067de3bc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:25.374502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cbb27628-7218-431b-b616-49aa067de3bc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:25.381772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbb27628-7218-431b-b616-49aa067de3bc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:25.382262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbb27628-7218-431b-b616-49aa067de3bc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:25.382746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbb27628-7218-431b-b616-49aa067de3bc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:25.383451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbb27628-7218-431b-b616-49aa067de3bc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:25.383911 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbb27628-7218-431b-b616-49aa067de3bc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:25.384340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cbb27628-7218-431b-b616-49aa067de3bc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:25.436571 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cbb27628-7218-431b-b616-49aa067de3bc tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf/action" status: 200 len: 24571 microversion: 2.1 time: 0.071031 Aug 06 21:42:25.437236 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3107/6396] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:42:25 2022] POST /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:42:36.510909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:36.511545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:36.513747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:36.514646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=36 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:36.520944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:36.521466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:36.521911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:36.522646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:36.523114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:36.523580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:36.656101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:36.664948 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-800bfebf-1cb6-428f-b86a-484e2965cf91 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1682 microversion: 2.1 time: 0.158136 Aug 06 21:42:36.665539 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3290/6397] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:36 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:42:36.761031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-47354a0f-c5b7-46cb-8a8c-2b334c9bc40e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:36.763263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-47354a0f-c5b7-46cb-8a8c-2b334c9bc40e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:36.766119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:36.766806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:42:36.775176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47354a0f-c5b7-46cb-8a8c-2b334c9bc40e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:36.775659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47354a0f-c5b7-46cb-8a8c-2b334c9bc40e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:36.776097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47354a0f-c5b7-46cb-8a8c-2b334c9bc40e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:36.776812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47354a0f-c5b7-46cb-8a8c-2b334c9bc40e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:36.777267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47354a0f-c5b7-46cb-8a8c-2b334c9bc40e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:36.777697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47354a0f-c5b7-46cb-8a8c-2b334c9bc40e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:36.826173 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-47354a0f-c5b7-46cb-8a8c-2b334c9bc40e tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf/action" status: 200 len: 32634 microversion: 2.1 time: 0.069283 Aug 06 21:42:36.826811 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3108/6398] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:42:36 2022] POST /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf/action => generated 32634 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:42:36.994467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cf8656ed-867e-4615-8e5b-4439c9d1e1f0 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:36.995121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cf8656ed-867e-4615-8e5b-4439c9d1e1f0 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:37.001280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8656ed-867e-4615-8e5b-4439c9d1e1f0 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:37.001773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8656ed-867e-4615-8e5b-4439c9d1e1f0 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:37.002220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8656ed-867e-4615-8e5b-4439c9d1e1f0 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:37.002959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8656ed-867e-4615-8e5b-4439c9d1e1f0 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:37.003433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8656ed-867e-4615-8e5b-4439c9d1e1f0 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:37.003871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cf8656ed-867e-4615-8e5b-4439c9d1e1f0 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:37.134899 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cf8656ed-867e-4615-8e5b-4439c9d1e1f0 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1833 microversion: 2.1 time: 0.144074 Aug 06 21:42:37.135486 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3291/6399] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:36 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1833 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:37.162792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:37.165372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:37.172511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:37.173002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:37.173449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:37.174158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:37.174650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:37.175089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:37.202350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lazy-loading 'flavor' on Instance uuid 65721f04-4dfc-457d-b46a-c87fe17294cf {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:42:37.214387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Going to try to live migrate instance to another host {{(pid=142462) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 06 21:42:38.573387 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5fb8e154-b641-46a8-a1c6-4d9d42f4eb4e tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf/action" status: 202 len: 0 microversion: 2.1 time: 1.414866 Aug 06 21:42:38.574216 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3109/6400] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:42:37 2022] POST /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf/action => generated 0 bytes in 1416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:42:38.584214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:38.584845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:38.592053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:38.592568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:38.592994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:38.593704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:38.594170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:38.594629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:38.733883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:38.742032 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-939d10e5-c534-4867-81cf-2a5566142ce4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1692 microversion: 2.1 time: 0.162526 Aug 06 21:42:38.742826 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3292/6401] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:38 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:39.636190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5dd096ed-e20e-443a-b62a-67fee72343b2 req-38d08bc1-f541-43f9-ab6f-bd8cdcf23b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65721f04-4dfc-457d-b46a-c87fe17294cf", "name": "network-vif-unplugged", "status": "completed", "tag": "05124ba9-b1cf-47d2-9463-12d6219d89f6"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:39.646994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5dd096ed-e20e-443a-b62a-67fee72343b2 req-38d08bc1-f541-43f9-ab6f-bd8cdcf23b53 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:39.647476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5dd096ed-e20e-443a-b62a-67fee72343b2 req-38d08bc1-f541-43f9-ab6f-bd8cdcf23b53 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:39.647910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5dd096ed-e20e-443a-b62a-67fee72343b2 req-38d08bc1-f541-43f9-ab6f-bd8cdcf23b53 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:39.658951 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-5dd096ed-e20e-443a-b62a-67fee72343b2 req-38d08bc1-f541-43f9-ab6f-bd8cdcf23b53 service nova] Creating event network-vif-unplugged:05124ba9-b1cf-47d2-9463-12d6219d89f6 for instance 65721f04-4dfc-457d-b46a-c87fe17294cf on nch2-master-1 Aug 06 21:42:39.668297 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5dd096ed-e20e-443a-b62a-67fee72343b2 req-38d08bc1-f541-43f9-ab6f-bd8cdcf23b53 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032218 Aug 06 21:42:39.668297 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3110/6402] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:42:39.764419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:39.765223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:39.773535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:39.774150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:39.774628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:39.775750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:39.775864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:39.776233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:39.932067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:39.940496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-70440b72-9a87-463b-931b-65bdface42ab tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1692 microversion: 2.1 time: 0.180085 Aug 06 21:42:39.941563 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3293/6403] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:39 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:40.964966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:40.965670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:40.971908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:40.972388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:40.972824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:40.974133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:40.974612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:40.975043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:41.110744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:41.118443 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2be8d1f9-2f6f-4839-9d61-84a9002fe484 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1692 microversion: 2.1 time: 0.158602 Aug 06 21:42:41.119042 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3111/6404] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:40 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:41.703443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-06407612-8a01-42b2-81a5-f9a041722e4a req-35da7f9e-95d3-4e3d-aaa3-ee5c44c72b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65721f04-4dfc-457d-b46a-c87fe17294cf", "tag": "05124ba9-b1cf-47d2-9463-12d6219d89f6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:41.713933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-06407612-8a01-42b2-81a5-f9a041722e4a req-35da7f9e-95d3-4e3d-aaa3-ee5c44c72b8d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:41.714416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-06407612-8a01-42b2-81a5-f9a041722e4a req-35da7f9e-95d3-4e3d-aaa3-ee5c44c72b8d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:41.714884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-06407612-8a01-42b2-81a5-f9a041722e4a req-35da7f9e-95d3-4e3d-aaa3-ee5c44c72b8d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:41.726209 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-06407612-8a01-42b2-81a5-f9a041722e4a req-35da7f9e-95d3-4e3d-aaa3-ee5c44c72b8d service nova] Creating event network-changed:05124ba9-b1cf-47d2-9463-12d6219d89f6 for instance 65721f04-4dfc-457d-b46a-c87fe17294cf on nch2-master-1 Aug 06 21:42:41.731246 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-06407612-8a01-42b2-81a5-f9a041722e4a req-35da7f9e-95d3-4e3d-aaa3-ee5c44c72b8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031610 Aug 06 21:42:41.731820 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3294/6405] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:42:42.140365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:42.140983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:42.149075 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:42.149569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:42.150018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:42.150759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:42.151222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:42.151660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:42.365434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:42.373422 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c08e78c-e664-4556-82ab-25427b52845b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1692 microversion: 2.1 time: 0.236985 Aug 06 21:42:42.373993 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3112/6406] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:42 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:43.399261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:43.399973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:43.406407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:43.406939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:43.407391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:43.408106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:43.408690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:43.409132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:43.546717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:43.554376 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e8d9bfb0-edb2-41c4-88e4-bed4aeed953a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1692 microversion: 2.1 time: 0.161415 Aug 06 21:42:43.554985 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3295/6407] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:43 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:44.576337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:44.576953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:44.584697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:44.585181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:44.585623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:44.586316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:44.586813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:44.587245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:44.723179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:44.731380 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d30feff9-cde8-443a-9e49-8808790bdf8f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1692 microversion: 2.1 time: 0.158968 Aug 06 21:42:44.731962 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3113/6408] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:44 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:45.752757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:45.753411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:45.760580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:45.761084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:45.762405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:45.763155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:45.763617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:45.764047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:45.898837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:45.907081 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7ba261c9-fa20-45ec-b30d-778ec20d0869 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1692 microversion: 2.1 time: 0.158239 Aug 06 21:42:45.907668 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3296/6409] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:45 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:46.929955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:46.930670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:46.938099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:46.938637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:46.939082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:46.939792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:46.940250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:46.940739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:47.082500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:47.090221 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3a9734a8-f7d6-4062-9bf4-e8f347cffdd0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1682 microversion: 2.1 time: 0.164905 Aug 06 21:42:47.090822 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3114/6410] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:46 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:47.111109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0e1e8cd8-8a53-4a48-af6f-07fcc529f8d1 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:47.111731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0e1e8cd8-8a53-4a48-af6f-07fcc529f8d1 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:47.120180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1e8cd8-8a53-4a48-af6f-07fcc529f8d1 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:47.120669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1e8cd8-8a53-4a48-af6f-07fcc529f8d1 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:47.121109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1e8cd8-8a53-4a48-af6f-07fcc529f8d1 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:47.121815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1e8cd8-8a53-4a48-af6f-07fcc529f8d1 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:47.122272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1e8cd8-8a53-4a48-af6f-07fcc529f8d1 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:47.122731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e1e8cd8-8a53-4a48-af6f-07fcc529f8d1 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:47.263595 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0e1e8cd8-8a53-4a48-af6f-07fcc529f8d1 tempest-TestNetworkAdvancedServerOps-1334422064 tempest-TestNetworkAdvancedServerOps-1334422064-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1833 microversion: 2.1 time: 0.156392 Aug 06 21:42:47.264188 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3297/6411] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:47 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1833 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:47.285176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:47.285978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:47.292306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:47.292803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:47.293252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:47.293964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:47.294427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:47.294889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:47.429439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:47.437067 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55250ef5-9a35-46d0-92a3-19f073801bb6 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1682 microversion: 2.1 time: 0.155715 Aug 06 21:42:47.437649 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3115/6412] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:47 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:47.532744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-858a5f86-c654-4ab6-bae0-3970722fa3d4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:47.534997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-858a5f86-c654-4ab6-bae0-3970722fa3d4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:47.542244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-858a5f86-c654-4ab6-bae0-3970722fa3d4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:47.542855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-858a5f86-c654-4ab6-bae0-3970722fa3d4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:47.543467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-858a5f86-c654-4ab6-bae0-3970722fa3d4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:47.544172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-858a5f86-c654-4ab6-bae0-3970722fa3d4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:47.544629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-858a5f86-c654-4ab6-bae0-3970722fa3d4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:47.545054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-858a5f86-c654-4ab6-bae0-3970722fa3d4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:47.595826 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-858a5f86-c654-4ab6-bae0-3970722fa3d4 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf/action" status: 200 len: 38653 microversion: 2.1 time: 0.066928 Aug 06 21:42:47.596462 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3298/6413] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:42:47 2022] POST /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf/action => generated 38653 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:42:48.563621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5561a43c-97d8-4c36-8582-56ac773032f1 req-070d3846-1db4-4456-b848-aa3141acdfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65721f04-4dfc-457d-b46a-c87fe17294cf", "tag": "05124ba9-b1cf-47d2-9463-12d6219d89f6"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:48.577637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5561a43c-97d8-4c36-8582-56ac773032f1 req-070d3846-1db4-4456-b848-aa3141acdfd5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:48.578168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5561a43c-97d8-4c36-8582-56ac773032f1 req-070d3846-1db4-4456-b848-aa3141acdfd5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:48.578681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5561a43c-97d8-4c36-8582-56ac773032f1 req-070d3846-1db4-4456-b848-aa3141acdfd5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:48.591887 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5561a43c-97d8-4c36-8582-56ac773032f1 req-070d3846-1db4-4456-b848-aa3141acdfd5 service nova] Creating event network-changed:05124ba9-b1cf-47d2-9463-12d6219d89f6 for instance 65721f04-4dfc-457d-b46a-c87fe17294cf on nch1-master-1 Aug 06 21:42:48.597855 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5561a43c-97d8-4c36-8582-56ac773032f1 req-070d3846-1db4-4456-b848-aa3141acdfd5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038251 Aug 06 21:42:48.599143 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3299/6414] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:42:48.625324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:48.625856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:48.632569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:48.633062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:48.633506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:48.634217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:48.634710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:48.635146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:48.677385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:42:48.765229 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b93b1221-efd3-4206-9837-952a8240b83c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "DELETE /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 204 len: 0 microversion: 2.1 time: 0.212307 Aug 06 21:42:48.769104 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3116/6415] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:42:48 2022] DELETE /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:42:48.775979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:48.776695 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:48.783966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:48.784467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:48.784913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:48.785629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:48.786802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:48.787239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:48.927367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:48.936072 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4116ce3a-d728-414b-8a39-925b9e9de7fa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1688 microversion: 2.1 time: 0.164871 Aug 06 21:42:48.936981 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3300/6416] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:48 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:49.807269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-27453cfe-a84c-4d24-b852-57528110405e req-568a2f37-145f-4c43-b0be-34455332c9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65721f04-4dfc-457d-b46a-c87fe17294cf", "name": "network-vif-deleted", "tag": "05124ba9-b1cf-47d2-9463-12d6219d89f6"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:49.822808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-27453cfe-a84c-4d24-b852-57528110405e req-568a2f37-145f-4c43-b0be-34455332c9a7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:49.823609 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-27453cfe-a84c-4d24-b852-57528110405e req-568a2f37-145f-4c43-b0be-34455332c9a7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:49.824044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-27453cfe-a84c-4d24-b852-57528110405e req-568a2f37-145f-4c43-b0be-34455332c9a7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:49.836703 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-27453cfe-a84c-4d24-b852-57528110405e req-568a2f37-145f-4c43-b0be-34455332c9a7 service nova] Creating event network-vif-deleted:05124ba9-b1cf-47d2-9463-12d6219d89f6 for instance 65721f04-4dfc-457d-b46a-c87fe17294cf on nch1-master-1 Aug 06 21:42:49.841603 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-27453cfe-a84c-4d24-b852-57528110405e req-568a2f37-145f-4c43-b0be-34455332c9a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040792 Aug 06 21:42:49.842304 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3117/6417] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:42:49.959636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:49.960303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:49.967902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:49.968535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:49.969055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:49.969776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:49.970240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:49.970706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:50.009658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:50.010071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:50.010517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:50.011020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lazy-loading 'fault' on Instance uuid 65721f04-4dfc-457d-b46a-c87fe17294cf {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:42:50.056242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:42:50.063324 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2d7cafa4-fc1b-4f0d-aed1-bea5eed2d467 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 200 len: 1356 microversion: 2.1 time: 0.108441 Aug 06 21:42:50.064008 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3301/6418] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:49 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:42:51.087547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:51.088245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 65721f04-4dfc-457d-b46a-c87fe17294cf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:42:51.094847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:51.095327 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:51.095765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:51.096455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:42:51.096909 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:42:51.097342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:42:51.110790 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] HTTP exception thrown: Instance 65721f04-4dfc-457d-b46a-c87fe17294cf could not be found. Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Request method failure captured: Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf HTTP/1.1 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7t8rNgq3V_Q91LaUKnlKB0EOv-HPqrYqMUP3CnNFGzZJJ_oXruc1xvRTCSS1B8CIfNTjATeof_edZnytB715tsr9LOwUHONnyWAoDJwY52-_g1r5lupVhjDFpOg7k5rE82TVGM-FuXaJD1ghcPPXzTbJlx5JHaYmJPnjODjJqqV93F0 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 084ca5bfad90430bb2da5f3a13fd76d8 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_084ca5bfad90430bb2da5f3a13fd76d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 084ca5bfad90430bb2da5f3a13fd76d8 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestNetworkAdvancedServerOps-839994066-project Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7c192e32cff047039b46c50e69dfc9c1 Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-839994066-project Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 65721f04-4dfc-457d-b46a-c87fe17294cf could not be found. Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '65721f04-4dfc-457d-b46a-c87fe17294cf'} Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65721f04-4dfc-457d-b46a-c87fe17294cf could not be found. Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65721f04-4dfc-457d-b46a-c87fe17294cf could not be found. Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:42:51.112384 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65721f04-4dfc-457d-b46a-c87fe17294cf could not be found. Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Returning 404 to user: Instance 65721f04-4dfc-457d-b46a-c87fe17294cf could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8eef582d-9d59-4d9c-a22d-e40b73cc88e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf" status: 404 len: 111 microversion: 2.1 time: 0.032128 Aug 06 21:42:51.116966 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3118/6419] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:42:51 2022] GET /compute/v2.1/servers/65721f04-4dfc-457d-b46a-c87fe17294cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:42:54.422175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3d872c13-d421-47ca-9bfa-4b1721ec000b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '.version_select at 0x7f729d6d7af0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:42:54.447484 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3d872c13-d421-47ca-9bfa-4b1721ec000b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1385345373" status: 202 len: 0 microversion: 2.1 time: 0.030797 Aug 06 21:42:54.448438 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3302/6420] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Aug 6 21:42:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1385345373 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:42:54.478624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-df0efbc3-f4f2-45d2-9ebe-de65989f9ed9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'create', calling method: .version_select at 0x7f729c78f160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1536682578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoFuQQVDpwI0dahXF7zHgNjrN8sDssNyat1KMD/khedo9ImDdFIGUrdsD7c4ljVic1FXK73WdKsJl/f9M9Y+kQrpwPfKX4TWXqjo8QKvP3pEd4w1uh07k+n1a1P4o2vNA=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:42:54.495330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-df0efbc3-f4f2-45d2-9ebe-de65989f9ed9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:42:54.501227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-df0efbc3-f4f2-45d2-9ebe-de65989f9ed9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for user 7c192e32cff047039b46c50e69dfc9c1 and project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:42:54.525088 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-df0efbc3-f4f2-45d2-9ebe-de65989f9ed9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050612 Aug 06 21:42:54.525696 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3119/6421] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:42:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:43:00.495141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1834852688", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "6625a9d7-4694-4cea-a55a-29b5a25d19de"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1536682578", "security_groups": [{"name": "tempest-secgroup-smoke-1998306019"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:43:00.514507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=64 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:00.633884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] validate_networks() for [('6625a9d7-4694-4cea-a55a-29b5a25d19de', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:43:01.089034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:43:01.089691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:43:01.090228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:43:01.090683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:43:01.091101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:43:01.100568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:01.101052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:01.101881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:01.102358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:01.102846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:01.103274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:01.121181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:43:01.126467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Getting quotas for user 7c192e32cff047039b46c50e69dfc9c1 and project 084ca5bfad90430bb2da5f3a13fd76d8. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:43:01.139821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:43:01.141996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:43:01.189654 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4138ecd8-8cdb-4dbc-9b8c-953fff3de3aa tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.699670 Aug 06 21:43:01.190761 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3303/6422] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:43:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:43:01.200833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:01.205614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6b685291-d2d1-4a2e-b2b2-5166343500c0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:01.206275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6b685291-d2d1-4a2e-b2b2-5166343500c0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:01.272429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6b685291-d2d1-4a2e-b2b2-5166343500c0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:01.284964 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6b685291-d2d1-4a2e-b2b2-5166343500c0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1267 microversion: 2.1 time: 0.085890 Aug 06 21:43:01.293647 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3120/6423] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:01 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:02.307938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:02.308559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:02.317365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:02.318149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:02.318950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:02.320681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:02.324567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:02.325518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:02.419809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:02.432160 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8f88ca93-f0f4-436c-b406-25eb9a0b35e3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1327 microversion: 2.1 time: 0.129579 Aug 06 21:43:02.433073 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3304/6424] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:02 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:03.455420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:03.456048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:03.466990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:03.467508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:03.467962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:03.468788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:03.469293 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:03.469814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:03.687192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:03.694838 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d520dd20-adcb-4737-b565-d1f6529a7b01 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1393 microversion: 2.1 time: 0.244317 Aug 06 21:43:03.696410 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3121/6425] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:03 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1393 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:03.950455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b2938209-87a2-400c-b663-abeb31a5ac1f req-b1c5fde4-600e-47c0-9a04-346347106a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f73b985-56d9-4e40-91c7-aca9b3bce2bf", "tag": "c36d0733-dafe-4835-9764-c2193612bf90"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:43:03.961014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b2938209-87a2-400c-b663-abeb31a5ac1f req-b1c5fde4-600e-47c0-9a04-346347106a44 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:03.961717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b2938209-87a2-400c-b663-abeb31a5ac1f req-b1c5fde4-600e-47c0-9a04-346347106a44 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:03.962166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b2938209-87a2-400c-b663-abeb31a5ac1f req-b1c5fde4-600e-47c0-9a04-346347106a44 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:03.974316 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b2938209-87a2-400c-b663-abeb31a5ac1f req-b1c5fde4-600e-47c0-9a04-346347106a44 service nova] Creating event network-changed:c36d0733-dafe-4835-9764-c2193612bf90 for instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf on nch2-master-1 Aug 06 21:43:03.979548 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b2938209-87a2-400c-b663-abeb31a5ac1f req-b1c5fde4-600e-47c0-9a04-346347106a44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034908 Aug 06 21:43:03.980158 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3305/6426] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:43:04.716623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:04.717238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:04.724318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:04.724804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:04.725242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:04.725962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:04.726489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:04.727017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:04.865521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:04.873776 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e8809e3a-ecdc-4dab-a9c9-810f24e83902 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1393 microversion: 2.1 time: 0.161091 Aug 06 21:43:04.874342 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3122/6427] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:04 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:05.896863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:05.897540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:05.904660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:05.905142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:05.905582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:05.906275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:05.906764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:05.907194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:06.042051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:06.049772 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4f3abd4e-0979-4a18-b40b-2a25ef331211 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1393 microversion: 2.1 time: 0.158138 Aug 06 21:43:06.050343 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3306/6428] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:05 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:07.069768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:07.070624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:07.073534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:07.079216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:07.079706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:07.080148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:07.080852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:07.081313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:07.081769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:07.220500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:07.229061 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ca6e92c6-9fed-4eee-b7c4-65b3ccd46c38 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1393 microversion: 2.1 time: 0.163165 Aug 06 21:43:07.229627 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3123/6429] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:07 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:08.249298 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:08.249935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:08.252861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:08.259326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:08.259761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:08.260210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:08.260930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:08.261392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:08.261866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:08.398988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:08.406864 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6f61fd8a-4879-4214-88d1-7ac9265a7f65 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1393 microversion: 2.1 time: 0.161442 Aug 06 21:43:08.407883 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3307/6430] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:08 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:09.427969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:09.428596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:09.436042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:09.436531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:09.436974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:09.437674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:09.438136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:09.438608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:09.570719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:09.578647 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-795845b4-7de7-4eec-b937-c988a897b88c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1393 microversion: 2.1 time: 0.154510 Aug 06 21:43:09.579236 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3124/6431] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:09 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:10.157524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-033b8071-3881-4261-a9b9-e6e685a7e573 req-c3678091-8b0b-4653-8ad0-bb94ccb623a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f73b985-56d9-4e40-91c7-aca9b3bce2bf", "name": "network-vif-plugged", "status": "completed", "tag": "c36d0733-dafe-4835-9764-c2193612bf90"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:43:10.167360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-033b8071-3881-4261-a9b9-e6e685a7e573 req-c3678091-8b0b-4653-8ad0-bb94ccb623a2 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:10.167840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-033b8071-3881-4261-a9b9-e6e685a7e573 req-c3678091-8b0b-4653-8ad0-bb94ccb623a2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:10.168271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-033b8071-3881-4261-a9b9-e6e685a7e573 req-c3678091-8b0b-4653-8ad0-bb94ccb623a2 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:10.179271 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-033b8071-3881-4261-a9b9-e6e685a7e573 req-c3678091-8b0b-4653-8ad0-bb94ccb623a2 service nova] Creating event network-vif-plugged:c36d0733-dafe-4835-9764-c2193612bf90 for instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf on nch2-master-1 Aug 06 21:43:10.185042 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-033b8071-3881-4261-a9b9-e6e685a7e573 req-c3678091-8b0b-4653-8ad0-bb94ccb623a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102414 Aug 06 21:43:10.185719 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3308/6432] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:43:10.600623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:10.601252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:10.608463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:10.608951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:10.609396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:10.610099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:10.610568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:10.611018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:10.749131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:10.756679 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2b56a05b-f9db-423e-9565-057d4d5f6bef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1393 microversion: 2.1 time: 0.160080 Aug 06 21:43:10.757263 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3125/6433] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:10 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:11.777161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:11.778059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:11.782741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:11.783458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:11.791311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:11.791802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:11.792247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:11.792949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:11.793418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:11.793853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:11.931084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:11.938768 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3dda4a82-6455-4a09-b377-0f79112d0c77 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1564 microversion: 2.1 time: 0.163332 Aug 06 21:43:11.939364 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3309/6434] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:11 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:11.959448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:11.959970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:11.962490 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:11.968515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:11.969009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:11.969455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:11.970161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:11.970681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:11.971130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:12.102904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:12.110418 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21e1be65-5199-4fe0-bdaa-6ffdc0b24334 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1564 microversion: 2.1 time: 0.154919 Aug 06 21:43:12.111028 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3126/6435] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:11 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:14.423452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:14.424656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:14.426439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ecb51688-7db0-4ea8-a0ba-2ef09872af54 req-dd10450f-8dd1-4a7c-879d-f381964275e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f73b985-56d9-4e40-91c7-aca9b3bce2bf", "tag": "c36d0733-dafe-4835-9764-c2193612bf90"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:43:14.431706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:14.432201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:14.432644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:14.433484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:14.433943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:14.434587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:14.438152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ecb51688-7db0-4ea8-a0ba-2ef09872af54 req-dd10450f-8dd1-4a7c-879d-f381964275e6 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:14.439022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ecb51688-7db0-4ea8-a0ba-2ef09872af54 req-dd10450f-8dd1-4a7c-879d-f381964275e6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:14.439665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ecb51688-7db0-4ea8-a0ba-2ef09872af54 req-dd10450f-8dd1-4a7c-879d-f381964275e6 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:14.452162 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ecb51688-7db0-4ea8-a0ba-2ef09872af54 req-dd10450f-8dd1-4a7c-879d-f381964275e6 service nova] Creating event network-changed:c36d0733-dafe-4835-9764-c2193612bf90 for instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf on nch2-master-1 Aug 06 21:43:14.457733 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ecb51688-7db0-4ea8-a0ba-2ef09872af54 req-dd10450f-8dd1-4a7c-879d-f381964275e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035236 Aug 06 21:43:14.458948 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3127/6436] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:43:14.577388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:14.586254 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f9df0a2b-c4ad-464e-a56c-b35925536e56 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1683 microversion: 2.1 time: 0.166385 Aug 06 21:43:14.587142 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3310/6437] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:14 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:35.834351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=9 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:35.835131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=38 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:35.839957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f18ff8a1-125d-4285-add1-01e34fc83e87 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:43:35.842178 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f18ff8a1-125d-4285-add1-01e34fc83e87 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:35.849090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f18ff8a1-125d-4285-add1-01e34fc83e87 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:35.849570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f18ff8a1-125d-4285-add1-01e34fc83e87 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:35.850009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f18ff8a1-125d-4285-add1-01e34fc83e87 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:35.850760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f18ff8a1-125d-4285-add1-01e34fc83e87 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:35.851204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f18ff8a1-125d-4285-add1-01e34fc83e87 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:35.851629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f18ff8a1-125d-4285-add1-01e34fc83e87 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:35.903040 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f18ff8a1-125d-4285-add1-01e34fc83e87 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf/action" status: 200 len: 24569 microversion: 2.1 time: 0.070385 Aug 06 21:43:35.903786 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3128/6438] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:43:35 2022] POST /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf/action => generated 24569 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:43:46.791082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:43:46.793961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:46.796197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=7 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:46.797000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=36 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:46.802573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:46.803060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:46.803508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:46.804215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:46.804683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:46.805121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:46.883179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:43:46.883610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:43:46.884784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:43:46.885200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:43:46.885619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:43:46.944252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:46.951122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:46.951618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:46.952064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:46.952776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:46.953235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:46.953672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:46.980998 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b81dd141-1a16-4f2b-bdac-8cb9da7c2e8a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf/action" status: 202 len: 1137 microversion: 2.1 time: 0.194093 Aug 06 21:43:46.987361 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3311/6439] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:43:46 2022] POST /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf/action => generated 1137 bytes in 196 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 06 21:43:47.002078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:47.002830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:47.005839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:47.007232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:43:47.014630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:47.015215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:47.015754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:47.016482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:47.016955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:47.017392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:47.161668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:47.171272 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cf87a2c3-7380-43e5-a2cf-1d4935be230b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.173746 Aug 06 21:43:47.171855 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3129/6440] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:46 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:48.193762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:48.194395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:48.201973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:48.202470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:48.202951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:48.203660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:48.204130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:48.204571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:48.341251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:48.348881 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8224034b-a5ce-4ba0-8bdf-a2902ca11c9c tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.159122 Aug 06 21:43:48.349471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3312/6441] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:48 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:49.370594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:49.371223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:49.379199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:49.379687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:49.380128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:49.380822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:49.381278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:49.381705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:49.518987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:49.526737 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a2ac0e87-58e8-4916-99f7-cd539b458af0 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.160833 Aug 06 21:43:49.527490 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3130/6442] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:49 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:50.549118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:50.549671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:50.557839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:50.558353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:50.558833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:50.559643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:50.560100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:50.560526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:50.697107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:50.705073 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cfcfa806-e65a-498a-80fa-348505bc6cee tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.160043 Aug 06 21:43:50.705661 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3313/6443] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:50 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:51.726743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:51.727391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:51.735129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:51.735633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:51.736084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:51.736790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:51.737256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:51.737691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:51.875111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:51.882717 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8e77963a-4fe4-470e-8511-3521a25bd104 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.159935 Aug 06 21:43:51.883286 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3131/6444] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:51 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:52.904085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:52.904746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:52.911832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:52.912328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:52.912782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:52.913493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:52.913963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:52.914401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:53.055030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:53.063358 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ff91e4b3-5deb-4a21-accc-d5efbe55f48a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.163274 Aug 06 21:43:53.063932 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3314/6445] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:52 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:54.084284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:54.084930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:54.092364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:54.092844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:54.093280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:54.094005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:54.094458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:54.094906 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:54.304771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:54.312451 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b2880d84-09e4-43a5-b847-0f74bca39cef tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.232058 Aug 06 21:43:54.313029 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3132/6446] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:54 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:55.333719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:55.334335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:55.342242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:55.342758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:55.343205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:55.343903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:55.344367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:55.344799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:55.480633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:55.488171 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0ab14832-6fa3-43e5-9451-4b26ef05405f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.158395 Aug 06 21:43:55.488746 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3315/6447] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:55 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:56.510427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:56.511101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:56.517854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:56.518368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:56.518837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:56.519529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:56.520089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:56.520525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:56.652860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:56.660373 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-63eb778e-2840-426f-8318-c07abdec92d1 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.154506 Aug 06 21:43:56.660934 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3133/6448] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:56 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:57.681294 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:57.682274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:57.689385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:57.689903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:57.690423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:57.691144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:57.691609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:57.692043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:57.876869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:57.885009 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fecce1f7-de24-4684-ab6a-b1cb8b029665 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.207051 Aug 06 21:43:57.885954 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3316/6449] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:57 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:43:58.906788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:43:58.907404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:43:58.914358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:58.914881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:58.915326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:58.916219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:43:58.916487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:43:58.916919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:43:59.053516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:43:59.061148 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6d417966-ea16-4841-aed9-81a3d7fb9a0a tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.158277 Aug 06 21:43:59.061727 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3134/6450] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:43:58 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:44:00.082495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:00.083155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:00.090295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:00.090810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:00.091250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:00.091945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:00.092401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:00.092828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:00.227735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:44:00.236295 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-994c5a22-80c4-4302-ab9b-dacc07bfb9b3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.157822 Aug 06 21:44:00.236875 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3317/6451] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:44:00 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:44:01.257723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:01.258335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:01.265253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:01.265735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:01.266174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:01.266893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:01.267357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:01.267785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:01.399063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:44:01.406649 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b06bbac-d39c-4397-a2bf-2605bc9910db tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.152745 Aug 06 21:44:01.407224 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3135/6452] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:44:01 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:44:02.428451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:02.429076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:02.436863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:02.437386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:02.437822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:02.438605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:02.439067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:02.439519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:02.570023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:44:02.578454 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-17179869-83e0-44b4-89ec-6d935d829bc8 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.154065 Aug 06 21:44:02.579052 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3318/6453] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:44:02 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:44:03.600107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:03.600748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:03.607654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:03.608147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:03.608594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:03.609302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:03.609760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:03.610194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:03.745160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:44:03.752745 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-68d46db1-e824-4220-9aa4-860cbf1b3c12 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1692 microversion: 2.1 time: 0.156542 Aug 06 21:44:03.753322 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3136/6454] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:44:03 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:44:04.774496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:04.775153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:04.782916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:04.783411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:04.783867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:04.784577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:04.785049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:04.785485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:04.922063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:44:04.929733 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5dff2c05-fa11-4d39-9ee1-e6a4d43be2d9 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1698 microversion: 2.1 time: 0.159133 Aug 06 21:44:04.930243 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3319/6455] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:44:04 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:44:05.952660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:05.953276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:05.960395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:05.960881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:05.961323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:05.962022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:05.962477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:05.962937 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:06.098037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:44:06.106815 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1daf9506-e84f-4cff-bb60-93e492274d1f tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1683 microversion: 2.1 time: 0.159455 Aug 06 21:44:06.107396 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3137/6456] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:44:05 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:44:08.419335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e68af5dd-7664-419d-9552-5125c0cd77fc req-32bd836b-27bd-4552-88ca-dddd01099e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f73b985-56d9-4e40-91c7-aca9b3bce2bf", "name": "network-vif-plugged", "status": "completed", "tag": "c36d0733-dafe-4835-9764-c2193612bf90"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:44:08.432247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e68af5dd-7664-419d-9552-5125c0cd77fc req-32bd836b-27bd-4552-88ca-dddd01099e3e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:08.433257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e68af5dd-7664-419d-9552-5125c0cd77fc req-32bd836b-27bd-4552-88ca-dddd01099e3e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:08.433912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e68af5dd-7664-419d-9552-5125c0cd77fc req-32bd836b-27bd-4552-88ca-dddd01099e3e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:08.449602 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e68af5dd-7664-419d-9552-5125c0cd77fc req-32bd836b-27bd-4552-88ca-dddd01099e3e service nova] Creating event network-vif-plugged:c36d0733-dafe-4835-9764-c2193612bf90 for instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf on nch2-master-1 Aug 06 21:44:08.455005 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e68af5dd-7664-419d-9552-5125c0cd77fc req-32bd836b-27bd-4552-88ca-dddd01099e3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039592 Aug 06 21:44:08.455878 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3320/6457] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:44:30.300966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-abd9758a-da2a-460b-936e-e157575ed0f3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:44:30.303224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-abd9758a-da2a-460b-936e-e157575ed0f3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:30.305586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=18 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:30.306243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=54 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:30.312230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abd9758a-da2a-460b-936e-e157575ed0f3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:30.312719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abd9758a-da2a-460b-936e-e157575ed0f3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:30.313157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abd9758a-da2a-460b-936e-e157575ed0f3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:30.313852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abd9758a-da2a-460b-936e-e157575ed0f3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:30.314303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abd9758a-da2a-460b-936e-e157575ed0f3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:30.314755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abd9758a-da2a-460b-936e-e157575ed0f3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:30.369110 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-abd9758a-da2a-460b-936e-e157575ed0f3 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "POST /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf/action" status: 200 len: 24560 microversion: 2.1 time: 0.071913 Aug 06 21:44:30.369748 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3138/6458] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:44:30 2022] POST /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf/action => generated 24560 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:44:42.219960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:42.220553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:42.223055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:42.224441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=24 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:42.224567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:42.225077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:44:42.229975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:42.231588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:42.232166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:42.233175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:42.233729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:42.234376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:42.268878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:44:42.303805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-c0863bc5-344e-4a58-9ad6-c50626d655f1 req-65a7695d-df2c-4688-8065-bacf8e18ceb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f73b985-56d9-4e40-91c7-aca9b3bce2bf", "tag": "c36d0733-dafe-4835-9764-c2193612bf90"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:44:42.383151 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1cf857c5-521e-4474-9376-a1910635bc15 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 204 len: 0 microversion: 2.1 time: 0.167720 Aug 06 21:44:42.384136 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3321/6459] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:44:42 2022] DELETE /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:44:42.394227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:42.395073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:42.401563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:42.402753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:42.403315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:42.404242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:42.404824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:42.405323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:42.562066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:44:42.570280 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0aa9200e-0ee5-4b99-aa52-e7cd3b4bf3ce tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1689 microversion: 2.1 time: 0.180351 Aug 06 21:44:42.571541 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3322/6460] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:44:42 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:44:42.588249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c0863bc5-344e-4a58-9ad6-c50626d655f1 req-65a7695d-df2c-4688-8065-bacf8e18ceb9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:42.588745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c0863bc5-344e-4a58-9ad6-c50626d655f1 req-65a7695d-df2c-4688-8065-bacf8e18ceb9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:42.589191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-c0863bc5-344e-4a58-9ad6-c50626d655f1 req-65a7695d-df2c-4688-8065-bacf8e18ceb9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:42.600815 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-c0863bc5-344e-4a58-9ad6-c50626d655f1 req-65a7695d-df2c-4688-8065-bacf8e18ceb9 service nova] Creating event network-changed:c36d0733-dafe-4835-9764-c2193612bf90 for instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf on nch2-master-1 Aug 06 21:44:42.606273 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-c0863bc5-344e-4a58-9ad6-c50626d655f1 req-65a7695d-df2c-4688-8065-bacf8e18ceb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.388354 Aug 06 21:44:42.606911 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3139/6461] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:44:43.594073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:43.594729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:43.601683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:43.602178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:43.602651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:43.603364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:43.603828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:43.604260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:43.814931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c192e32cff047039b46c50e69dfc9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ca5bfad90430bb2da5f3a13fd76d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:44:43.823231 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b480307d-aa68-43ff-b54a-e8d0814cdd3b tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 200 len: 1689 microversion: 2.1 time: 0.233749 Aug 06 21:44:43.824910 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3323/6462] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:44:43 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 1689 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:44:44.259085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1ddf9a23-aad8-4458-89bf-35d3315ff7fc req-04428dc0-ffbd-4359-836f-c277bf11a6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f73b985-56d9-4e40-91c7-aca9b3bce2bf", "name": "network-vif-deleted", "tag": "c36d0733-dafe-4835-9764-c2193612bf90"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:44:44.271569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1ddf9a23-aad8-4458-89bf-35d3315ff7fc req-04428dc0-ffbd-4359-836f-c277bf11a6ea service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:44.272061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1ddf9a23-aad8-4458-89bf-35d3315ff7fc req-04428dc0-ffbd-4359-836f-c277bf11a6ea service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:44.272498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1ddf9a23-aad8-4458-89bf-35d3315ff7fc req-04428dc0-ffbd-4359-836f-c277bf11a6ea service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:44.284372 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1ddf9a23-aad8-4458-89bf-35d3315ff7fc req-04428dc0-ffbd-4359-836f-c277bf11a6ea service nova] Creating event network-vif-deleted:c36d0733-dafe-4835-9764-c2193612bf90 for instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf on nch2-master-1 Aug 06 21:44:44.289808 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1ddf9a23-aad8-4458-89bf-35d3315ff7fc req-04428dc0-ffbd-4359-836f-c277bf11a6ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097823 Aug 06 21:44:44.290431 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3140/6463] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:44:44.847680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:44.848305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] [instance: 2f73b985-56d9-4e40-91c7-aca9b3bce2bf] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:44:44.855370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:44.855826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:44.856266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:44.857049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:44:44.857558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:44:44.858055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:44:44.871867 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] HTTP exception thrown: Instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf could not be found. Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Request method failure captured: Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf HTTP/1.1 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7t8rNgq3V_Q91LaUKnlKB0EOv-HPqrYqMUP3CnNFGzZJJ_oXruc1xvRTCSS1B8CIfNTjATeof_edZnytB715tsr9LOwUHONnyWAoDJwY52-_g1r5lupVhjDFpOg7k5rE82TVGM-FuXaJD1ghcPPXzTbJlx5JHaYmJPnjODjJqqV93F0 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 084ca5bfad90430bb2da5f3a13fd76d8 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_084ca5bfad90430bb2da5f3a13fd76d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/084ca5bfad90430bb2da5f3a13fd76d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 084ca5bfad90430bb2da5f3a13fd76d8 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-839994066 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TestNetworkAdvancedServerOps-839994066-project Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7c192e32cff047039b46c50e69dfc9c1 Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TestNetworkAdvancedServerOps-839994066-project Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf could not be found. Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '2f73b985-56d9-4e40-91c7-aca9b3bce2bf'} Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf could not be found. Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf could not be found. Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:44:44.873525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf could not be found. Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Returning 404 to user: Instance 2f73b985-56d9-4e40-91c7-aca9b3bce2bf could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3fcb78dd-7fbd-4072-9985-4438e9b91814 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf" status: 404 len: 111 microversion: 2.1 time: 0.031269 Aug 06 21:44:44.877560 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3324/6464] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:44:44 2022] GET /compute/v2.1/servers/2f73b985-56d9-4e40-91c7-aca9b3bce2bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:44:48.142269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce1ff819-8a13-4905-9733-e65ef54fb057 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] Calling method '.version_select at 0x7f729c746700>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:44:48.164537 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce1ff819-8a13-4905-9733-e65ef54fb057 tempest-TestNetworkAdvancedServerOps-839994066 tempest-TestNetworkAdvancedServerOps-839994066-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1536682578" status: 202 len: 0 microversion: 2.1 time: 0.027815 Aug 06 21:44:48.165255 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3141/6465] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Aug 6 21:44:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1536682578 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:45:00.468800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:00.469542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:00.580048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1490239590", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:00.633748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] validate_networks() for None {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:45:00.906317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:45:00.906796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:45:00.907285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:45:00.907707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:45:00.908132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:45:00.917289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:00.918376 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:00.918859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:00.919604 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:00.920069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:00.920505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:00.938705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Getting quotas for project bd60ac6ebd8c4ae48c9fcf9aa86a7d45. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:45:00.944073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Getting quotas for user d8f2e0934e5f416abee4bc74e57941e8 and project bd60ac6ebd8c4ae48c9fcf9aa86a7d45. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:45:00.956758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:45:00.959054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:45:01.002995 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b1fa8790-e107-4dcc-8164-e1b6e00ceec4 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539213 Aug 06 21:45:01.003658 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3325/6466] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:45:01.016063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6753f538-fdf9-463f-9251-005da740623c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:01.016903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6753f538-fdf9-463f-9251-005da740623c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:01.023670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:01.029460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:01.083654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6753f538-fdf9-463f-9251-005da740623c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:01.091212 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6753f538-fdf9-463f-9251-005da740623c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1222 microversion: 2.1 time: 0.079265 Aug 06 21:45:01.098987 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3142/6467] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:01 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:02.113280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:02.113900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:02.121361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:02.122049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:02.122518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:02.123261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:02.123720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:02.124152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:02.195325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:02.203119 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-90f51aee-94f0-4041-9b9d-79442c14aa92 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1280 microversion: 2.1 time: 0.094738 Aug 06 21:45:02.203700 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3326/6468] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:02 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:03.225296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:03.225923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:03.233203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:03.233702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:03.234146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:03.234881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:03.235342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:03.235773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:03.336719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-8ce7d13d-cb18-4220-a1b5-cd08e51ee823 req-95803baa-37ba-4fd1-946c-f2446f348d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70a6d71-5f54-477e-983f-a6654bf2fff8", "tag": "85e14bab-02ae-43ac-b999-4b58352e060c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:03.349076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8ce7d13d-cb18-4220-a1b5-cd08e51ee823 req-95803baa-37ba-4fd1-946c-f2446f348d90 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:03.349809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8ce7d13d-cb18-4220-a1b5-cd08e51ee823 req-95803baa-37ba-4fd1-946c-f2446f348d90 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:03.350409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8ce7d13d-cb18-4220-a1b5-cd08e51ee823 req-95803baa-37ba-4fd1-946c-f2446f348d90 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:03.363197 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-8ce7d13d-cb18-4220-a1b5-cd08e51ee823 req-95803baa-37ba-4fd1-946c-f2446f348d90 service nova] Creating event network-changed:85e14bab-02ae-43ac-b999-4b58352e060c for instance d70a6d71-5f54-477e-983f-a6654bf2fff8 on nch2-master-1 Aug 06 21:45:03.368826 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-8ce7d13d-cb18-4220-a1b5-cd08e51ee823 req-95803baa-37ba-4fd1-946c-f2446f348d90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035721 Aug 06 21:45:03.369799 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3327/6469] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:45:03.385528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:03.394488 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-83080bb5-27b3-43ee-bc58-b8a3247852af tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1322 microversion: 2.1 time: 0.173017 Aug 06 21:45:03.395116 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3143/6470] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:03 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:04.416217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:04.416913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:04.424482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:04.425208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:04.425907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:04.426687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:04.427155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:04.427592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:04.564811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:04.572354 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e2010171-e9fe-48a5-97c9-abe7e6d25f5c tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1322 microversion: 2.1 time: 0.161253 Aug 06 21:45:04.572926 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3328/6471] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:04 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:05.593622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:05.594166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:05.601112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:05.601598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:05.602043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:05.602780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:05.603245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:05.603679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:05.735460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:05.743006 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c007f37-20ce-4780-a3d9-21e49897dd00 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1322 microversion: 2.1 time: 0.153649 Aug 06 21:45:05.743580 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3144/6472] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:05 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:06.764331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:06.764947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:06.771901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:06.772411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:06.772853 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:06.773545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:06.774003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:06.774430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:06.908787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:06.916548 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-72014266-d64f-4fd8-b776-7ae200d9df9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1322 microversion: 2.1 time: 0.156219 Aug 06 21:45:06.917141 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3329/6473] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:06 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:07.938395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:07.938985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:07.945748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:07.946242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:07.946728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:07.947444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:07.947943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:07.948386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:08.080552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:08.088147 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-172c351a-4d2f-4bb2-9fdb-283ed8b4790a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1322 microversion: 2.1 time: 0.154470 Aug 06 21:45:08.088710 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3145/6474] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:07 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:08.650836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-067cc8ec-1f34-479b-aadf-9538dd2eb2f5 req-03748fb3-7bd9-4868-8b21-25c2e3c4b5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70a6d71-5f54-477e-983f-a6654bf2fff8", "name": "network-vif-plugged", "status": "completed", "tag": "85e14bab-02ae-43ac-b999-4b58352e060c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:08.661425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-067cc8ec-1f34-479b-aadf-9538dd2eb2f5 req-03748fb3-7bd9-4868-8b21-25c2e3c4b5a1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:08.661916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-067cc8ec-1f34-479b-aadf-9538dd2eb2f5 req-03748fb3-7bd9-4868-8b21-25c2e3c4b5a1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:08.662372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-067cc8ec-1f34-479b-aadf-9538dd2eb2f5 req-03748fb3-7bd9-4868-8b21-25c2e3c4b5a1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:08.675487 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-067cc8ec-1f34-479b-aadf-9538dd2eb2f5 req-03748fb3-7bd9-4868-8b21-25c2e3c4b5a1 service nova] Creating event network-vif-plugged:85e14bab-02ae-43ac-b999-4b58352e060c for instance d70a6d71-5f54-477e-983f-a6654bf2fff8 on nch2-master-1 Aug 06 21:45:08.680483 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-067cc8ec-1f34-479b-aadf-9538dd2eb2f5 req-03748fb3-7bd9-4868-8b21-25c2e3c4b5a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033389 Aug 06 21:45:08.681252 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3330/6475] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:45:09.109441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:09.109982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:09.116846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:09.117331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:09.117774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:09.118470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:09.118953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:09.119383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:09.251067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:09.258586 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb8c49af-4b8c-4ed5-9566-2e6293292c9a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1322 microversion: 2.1 time: 0.153299 Aug 06 21:45:09.259159 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3146/6476] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:09 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:10.282254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:10.282994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:10.289373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:10.289860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:10.290303 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:10.291025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:10.291485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:10.291916 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:10.423823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:10.431613 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1b09bb4-315a-4b5d-9393-d77fb462ac39 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1472 microversion: 2.1 time: 0.155326 Aug 06 21:45:10.432212 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3331/6477] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:10 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1472 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:10.509423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d0b69158-0218-422b-9052-ecf828cf39ec tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Calling method '.version_select at 0x7f729c8dddc0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:10.578408 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d0b69158-0218-422b-9052-ecf828cf39ec tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/4715401611d0493fa27da4233f2d2fc1" status: 200 len: 371 microversion: 2.1 time: 0.128242 Aug 06 21:45:10.579031 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3147/6478] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:45:10 2022] GET /compute/v2.1/os-quota-sets/4715401611d0493fa27da4233f2d2fc1 => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:45:10.592230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3b81cb5c-8c4d-40b5-9deb-aa1adcb1570e tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-430431204", "id": 1436752717, "os-flavor-access:is_public": "True"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:10.595308 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:45:10.595308 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:45:10.612741 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3b81cb5c-8c4d-40b5-9deb-aa1adcb1570e tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.025697 Aug 06 21:45:10.613340 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3332/6479] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:45:10 2022] POST /compute/v2.1/flavors => generated 437 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:45:10.625128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1436752717"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:10.627469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:10.633628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:10.634158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:10.634639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:10.635351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:10.635831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:10.636302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:10.818296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd0b6bf5588944f38ff123a8d2bc3e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4715401611d0493fa27da4233f2d2fc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:10.825339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-430431204 {{(pid=142462) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:45:10.831852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:10.832345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:10.832795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:10.833540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:10.834008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:10.834448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:10.855336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Getting quotas for project bd60ac6ebd8c4ae48c9fcf9aa86a7d45. Resources: {'ram', 'cores'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:45:10.861071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Getting quotas for user d8f2e0934e5f416abee4bc74e57941e8 and project bd60ac6ebd8c4ae48c9fcf9aa86a7d45. Resources: {'ram', 'cores'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:45:10.873303 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.compute.api [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] ram quota exceeded for 4715401611d0493fa27da4233f2d2fc1, tried to resize instance. Aug 06 21:45:10.873849 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Request method failure captured: Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8/action HTTP/1.1 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 39 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uDceQAJV1ZMEZ9LRaMDBqPc5QqC4NIpSFxkfcnlVi7FXUkeDgZG-8neUWTNlZGzCtJPjPw_XClBfX0IiKVXbokOAvFTuOQeRA6VDSZvddZt_zAttt7Y419vnFPltNwsPUgB8y9OaD4QENeDD9qg_nYsRSVDIzFc5pLa5rACD4Y37tE Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 4715401611d0493fa27da4233f2d2fc1 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-333704937 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Role: admin,member,reader Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: admin,member,reader Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4715401611d0493fa27da4233f2d2fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4715401611d0493fa27da4233f2d2fc1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4715401611d0493fa27da4233f2d2fc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4715401611d0493fa27da4233f2d2fc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-333704937 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 4715401611d0493fa27da4233f2d2fc1 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-333704937 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersAdminNegativeTestJSON-333704937-project-admin Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: dd0b6bf5588944f38ff123a8d2bc3e49 Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-333704937-project-admin Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: {"resize": {"flavorRef": "1436752717"}} Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'd70a6d71-5f54-477e-983f-a6654bf2fff8', 'body': {'resize': {'flavorRef': '1436752717'}}} Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:45:10.875964 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-75a67f6b-a409-43f3-8be5-457db943acb8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8/action" status: 403 len: 118 microversion: 2.1 time: 0.256237 Aug 06 21:45:10.880278 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3148/6480] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:45:10 2022] POST /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8/action => generated 118 bytes in 257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:45:10.886494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3021b7c9-58fd-4a2f-93a8-754045feb31e tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:10.887900 ncdv-master-1 devstack@n-api.service[142461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:45:10.887900 ncdv-master-1 devstack@n-api.service[142461]: warnings.warn(msg) Aug 06 21:45:10.904712 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3021b7c9-58fd-4a2f-93a8-754045feb31e tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1436752717" status: 202 len: 0 microversion: 2.1 time: 0.021944 Aug 06 21:45:10.905262 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3333/6481] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 21:45:10 2022] DELETE /compute/v2.1/flavors/1436752717 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:45:10.913105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-be35f427-3d07-490d-9f81-0c1e549529e7 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:10.933174 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-be35f427-3d07-490d-9f81-0c1e549529e7 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023727 Aug 06 21:45:10.933730 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3149/6482] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:45:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:10.953563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5bb75be5-2e1b-4bdb-960b-85ef4828932d tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Calling method '.version_select at 0x7f72a362b5e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:10.961581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:10.962337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:11.026444 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5bb75be5-2e1b-4bdb-960b-85ef4828932d tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/4715401611d0493fa27da4233f2d2fc1" status: 200 len: 371 microversion: 2.1 time: 0.077135 Aug 06 21:45:11.027249 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3334/6483] 10.222.0.33 () {58 vars in 1242 bytes} [Sat Aug 6 21:45:10 2022] GET /compute/v2.1/os-quota-sets/4715401611d0493fa27da4233f2d2fc1 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:45:11.040045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-90db697f-b00d-4d2c-a719-74f196d650a9 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-773153257", "id": 1193122789, "os-flavor-access:is_public": "True"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:11.043087 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:45:11.043087 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:45:11.057195 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-90db697f-b00d-4d2c-a719-74f196d650a9 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021135 Aug 06 21:45:11.057778 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3150/6484] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:45:11 2022] POST /compute/v2.1/flavors => generated 436 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:45:11.069526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1193122789"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:11.071922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:11.078943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:11.079433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:11.079879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:11.080575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:11.081036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:11.081465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:11.167200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dd0b6bf5588944f38ff123a8d2bc3e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4715401611d0493fa27da4233f2d2fc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:11.174401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-773153257 {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:45:11.180827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:11.181308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:11.181748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:11.182481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:11.182965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:11.183391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:11.208469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Getting quotas for project bd60ac6ebd8c4ae48c9fcf9aa86a7d45. Resources: {'ram', 'cores'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:45:11.213512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Getting quotas for user d8f2e0934e5f416abee4bc74e57941e8 and project bd60ac6ebd8c4ae48c9fcf9aa86a7d45. Resources: {'ram', 'cores'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:45:11.225554 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.compute.api [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] cores quota exceeded for 4715401611d0493fa27da4233f2d2fc1, tried to resize instance. Aug 06 21:45:11.226092 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Request method failure captured: Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8/action HTTP/1.1 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 39 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uDceQAJV1ZMEZ9LRaMDBqPc5QqC4NIpSFxkfcnlVi7FXUkeDgZG-8neUWTNlZGzCtJPjPw_XClBfX0IiKVXbokOAvFTuOQeRA6VDSZvddZt_zAttt7Y419vnFPltNwsPUgB8y9OaD4QENeDD9qg_nYsRSVDIzFc5pLa5rACD4Y37tE Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4715401611d0493fa27da4233f2d2fc1 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-333704937 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Role: admin,member,reader Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: admin,member,reader Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4715401611d0493fa27da4233f2d2fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4715401611d0493fa27da4233f2d2fc1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4715401611d0493fa27da4233f2d2fc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4715401611d0493fa27da4233f2d2fc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersAdminNegativeTestJSON-333704937 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4715401611d0493fa27da4233f2d2fc1 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-333704937 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersAdminNegativeTestJSON-333704937-project-admin Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: dd0b6bf5588944f38ff123a8d2bc3e49 Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersAdminNegativeTestJSON-333704937-project-admin Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: {"resize": {"flavorRef": "1193122789"}} Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'd70a6d71-5f54-477e-983f-a6654bf2fff8', 'body': {'resize': {'flavorRef': '1193122789'}}} Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:45:11.228195 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8292230a-1b00-4c5f-9125-35e255b82117 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8/action" status: 403 len: 113 microversion: 2.1 time: 0.163997 Aug 06 21:45:11.232632 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3335/6485] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:45:11 2022] POST /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8/action => generated 113 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:45:11.238977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4171ee43-7c35-4736-85a8-8dad79999f3e tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:11.239971 ncdv-master-1 devstack@n-api.service[142462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 21:45:11.239971 ncdv-master-1 devstack@n-api.service[142462]: warnings.warn(msg) Aug 06 21:45:11.257485 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4171ee43-7c35-4736-85a8-8dad79999f3e tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1193122789" status: 202 len: 0 microversion: 2.1 time: 0.022244 Aug 06 21:45:11.258385 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3151/6486] 10.222.0.33 () {58 vars in 1161 bytes} [Sat Aug 6 21:45:11 2022] DELETE /compute/v2.1/flavors/1193122789 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:45:11.266647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-68c5cc8c-5ae3-4729-ab78-c853e7a223b8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:11.287666 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-68c5cc8c-5ae3-4729-ab78-c853e7a223b8 tempest-ServersAdminNegativeTestJSON-333704937 tempest-ServersAdminNegativeTestJSON-333704937-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024683 Aug 06 21:45:11.288231 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3336/6487] 10.222.0.33 () {58 vars in 1146 bytes} [Sat Aug 6 21:45:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:11.308216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:11.308657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:11.315286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:11.315768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:11.316211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:11.316908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:11.317369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:11.317801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:11.343651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:45:11.421649 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-00aa9f29-3b6c-4480-be73-5db908114eb6 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 204 len: 0 microversion: 2.1 time: 0.116959 Aug 06 21:45:11.422367 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3152/6488] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:45:11 2022] DELETE /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:45:11.430586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:11.431214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:11.437538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:11.438026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:11.438691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:11.439395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:11.439857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:11.440292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:11.572266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:11.580392 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-45663bfc-5b3e-440c-af06-714758427b0a tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1478 microversion: 2.1 time: 0.153864 Aug 06 21:45:11.580965 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3337/6489] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:11 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1478 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:12.602014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:12.602677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:12.610348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:12.610878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:12.611331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:12.612040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:12.612508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:12.612946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:12.754501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8f2e0934e5f416abee4bc74e57941e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd60ac6ebd8c4ae48c9fcf9aa86a7d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:12.762186 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5243bcea-0d2a-4c2e-8902-b2f4c83c5792 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 200 len: 1478 microversion: 2.1 time: 0.164623 Aug 06 21:45:12.762861 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3153/6490] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:12 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 1478 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:13.148369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e56898f6-1301-4698-8d40-f6b168479a2f req-7ea379a4-c6ee-4e4e-b1b9-78ce86bcc639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70a6d71-5f54-477e-983f-a6654bf2fff8", "name": "network-vif-deleted", "tag": "85e14bab-02ae-43ac-b999-4b58352e060c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:13.164104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e56898f6-1301-4698-8d40-f6b168479a2f req-7ea379a4-c6ee-4e4e-b1b9-78ce86bcc639 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:13.164491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e56898f6-1301-4698-8d40-f6b168479a2f req-7ea379a4-c6ee-4e4e-b1b9-78ce86bcc639 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:13.165126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e56898f6-1301-4698-8d40-f6b168479a2f req-7ea379a4-c6ee-4e4e-b1b9-78ce86bcc639 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:13.178112 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e56898f6-1301-4698-8d40-f6b168479a2f req-7ea379a4-c6ee-4e4e-b1b9-78ce86bcc639 service nova] Creating event network-vif-deleted:85e14bab-02ae-43ac-b999-4b58352e060c for instance d70a6d71-5f54-477e-983f-a6654bf2fff8 on nch2-master-1 Aug 06 21:45:13.184851 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e56898f6-1301-4698-8d40-f6b168479a2f req-7ea379a4-c6ee-4e4e-b1b9-78ce86bcc639 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039793 Aug 06 21:45:13.185597 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3338/6491] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:45:13.783393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:13.783947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] [instance: d70a6d71-5f54-477e-983f-a6654bf2fff8] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:13.791027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:13.791524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:13.791983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:13.792694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:13.793164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:13.793608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:13.810850 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] HTTP exception thrown: Instance d70a6d71-5f54-477e-983f-a6654bf2fff8 could not be found. Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Request method failure captured: Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 HTTP/1.1 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uDbkkj1o_fDl5UAb54afvrbyhU2cKWXWoN00M5vKu_O_7lst6_poPGWaLiK_ZsvCjYxh95jugbgrx7c_I4MzEAqrUbvSLD18cnsSKvA5NaEQxzcsEetZbu1NAylKB2XVIcMaWZleVvcAxR6Kz1OgF4zDb5VakVxdkKvI90xHIHuFOw Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: bd60ac6ebd8c4ae48c9fcf9aa86a7d45 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1496146105 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd60ac6ebd8c4ae48c9fcf9aa86a7d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd60ac6ebd8c4ae48c9fcf9aa86a7d45", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd60ac6ebd8c4ae48c9fcf9aa86a7d45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd60ac6ebd8c4ae48c9fcf9aa86a7d45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1496146105 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: bd60ac6ebd8c4ae48c9fcf9aa86a7d45 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1496146105 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersAdminNegativeTestJSON-1496146105-project Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: d8f2e0934e5f416abee4bc74e57941e8 Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1496146105-project Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance d70a6d71-5f54-477e-983f-a6654bf2fff8 could not be found. Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'd70a6d71-5f54-477e-983f-a6654bf2fff8'} Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70a6d71-5f54-477e-983f-a6654bf2fff8 could not be found. Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70a6d71-5f54-477e-983f-a6654bf2fff8 could not be found. Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:13.812508 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70a6d71-5f54-477e-983f-a6654bf2fff8 could not be found. Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] Returning 404 to user: Instance d70a6d71-5f54-477e-983f-a6654bf2fff8 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-917d8f74-c966-44d8-8fad-b8b3cdd1d304 tempest-ServersAdminNegativeTestJSON-1496146105 tempest-ServersAdminNegativeTestJSON-1496146105-project] 10.222.0.33 "GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8" status: 404 len: 111 microversion: 2.1 time: 0.034727 Aug 06 21:45:13.816699 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3154/6492] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:13 2022] GET /compute/v2.1/servers/d70a6d71-5f54-477e-983f-a6654bf2fff8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:45:19.658202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2023136809", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "c49dea1d-64ab-444b-897a-6a3e7390c7e2"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:19.732246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] validate_networks() for [('c49dea1d-64ab-444b-897a-6a3e7390c7e2', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:45:20.128914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:45:20.129340 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:45:20.129820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:45:20.130236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:45:20.130721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:45:20.144103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:20.145275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:20.145786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:20.146603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:20.147081 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:20.147522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:20.166680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Getting quotas for project 2dd9f422e6e34a65bbc620eba89593ad. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:45:20.173833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Getting quotas for user 6311a8ce4c4848cea0cf3af1730ca67b and project 2dd9f422e6e34a65bbc620eba89593ad. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:45:20.208919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:45:20.211469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:45:20.265452 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5fa3b045-0a33-4aea-ac62-b77460204ffc tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736227 Aug 06 21:45:20.266419 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3339/6493] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:45:20.277417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b78ac58e-f4d5-42f8-987a-c24c9c2e1e23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:20.279284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b78ac58e-f4d5-42f8-987a-c24c9c2e1e23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:20.353385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b78ac58e-f4d5-42f8-987a-c24c9c2e1e23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:20.365408 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b78ac58e-f4d5-42f8-987a-c24c9c2e1e23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1215 microversion: 2.1 time: 0.091834 Aug 06 21:45:20.366213 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3155/6494] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:20 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:21.387794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a06c6484-37d7-4695-a833-ea9edd35cfa6 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:21.389107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a06c6484-37d7-4695-a833-ea9edd35cfa6 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:21.447055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a06c6484-37d7-4695-a833-ea9edd35cfa6 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:21.455200 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a06c6484-37d7-4695-a833-ea9edd35cfa6 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1215 microversion: 2.1 time: 0.072638 Aug 06 21:45:21.455783 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3340/6495] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:21 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:22.476537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32b216d5-d6a2-47bc-a9e9-ca363595ae32 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:22.477167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-32b216d5-d6a2-47bc-a9e9-ca363595ae32 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:22.483400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:22.547563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-32b216d5-d6a2-47bc-a9e9-ca363595ae32 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:22.555510 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-32b216d5-d6a2-47bc-a9e9-ca363595ae32 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1215 microversion: 2.1 time: 0.082688 Aug 06 21:45:22.568240 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3156/6496] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:22 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:23.577178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f7489f25-1b77-4941-adff-73d92108d28b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:23.577787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f7489f25-1b77-4941-adff-73d92108d28b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:23.631439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f7489f25-1b77-4941-adff-73d92108d28b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:23.638356 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f7489f25-1b77-4941-adff-73d92108d28b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1215 microversion: 2.1 time: 0.065991 Aug 06 21:45:23.639125 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3341/6497] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:23 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:24.659869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:24.660620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:24.663688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:24.670897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:24.671498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:24.672024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:24.672952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:24.673574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:24.674172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:24.743284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:24.751884 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-65b0c94a-d453-4bdf-8222-cf3255c4cc26 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1273 microversion: 2.1 time: 0.096289 Aug 06 21:45:24.752474 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3157/6498] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:24 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:45:25.773345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:25.774172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:25.781620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:25.782112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:25.782574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:25.783353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:25.783832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:25.784258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:25.902987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ece67f7d-6baf-4da8-8cdb-f068a367bbc7 req-449640b5-1c8a-400d-b346-b901a4e7adda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc0fa49b-14ab-4bf1-8910-6915f950a006", "tag": "8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:25.915388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ece67f7d-6baf-4da8-8cdb-f068a367bbc7 req-449640b5-1c8a-400d-b346-b901a4e7adda service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:25.915903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ece67f7d-6baf-4da8-8cdb-f068a367bbc7 req-449640b5-1c8a-400d-b346-b901a4e7adda service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:25.916545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ece67f7d-6baf-4da8-8cdb-f068a367bbc7 req-449640b5-1c8a-400d-b346-b901a4e7adda service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:25.929932 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ece67f7d-6baf-4da8-8cdb-f068a367bbc7 req-449640b5-1c8a-400d-b346-b901a4e7adda service nova] Creating event network-changed:8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c for instance fc0fa49b-14ab-4bf1-8910-6915f950a006 on nch2-master-1 Aug 06 21:45:25.935865 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ece67f7d-6baf-4da8-8cdb-f068a367bbc7 req-449640b5-1c8a-400d-b346-b901a4e7adda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036273 Aug 06 21:45:25.936703 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3158/6499] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:45:26.024932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:26.033312 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-25332e19-ee4f-4a57-ad30-e12855ee45fe tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1315 microversion: 2.1 time: 0.263813 Aug 06 21:45:26.033984 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3342/6500] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:25 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:27.055971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:27.056694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:27.063692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:27.064193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:27.064647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:27.065364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:27.065837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:27.066289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:27.201678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:27.209514 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-01d538ad-6aca-46a9-b3e6-c40b121e1ded tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1315 microversion: 2.1 time: 0.158749 Aug 06 21:45:27.210110 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3159/6501] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:27 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:27.337302 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:45:27.337537 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:45:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:45:28.230775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:28.231419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:28.239782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:28.240287 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:28.240722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:28.241439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:28.241905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:28.242336 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:28.379357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:28.386995 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e9c4858-4995-4381-8e3c-5656ff403dfb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1315 microversion: 2.1 time: 0.160193 Aug 06 21:45:28.387566 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3343/6502] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:28 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:29.408041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:29.408656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:29.415565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:29.416049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:29.416488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:29.417185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:29.417674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:29.418105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:29.559515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:29.567040 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dbbb88da-2ad5-4084-831f-4b438e480a23 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1315 microversion: 2.1 time: 0.163598 Aug 06 21:45:29.567606 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3160/6503] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:29 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:30.589021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:30.589560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:30.592882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=5 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:30.593946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:30.605038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:30.606459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:30.607122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:30.607905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:30.608454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:30.609000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:30.614677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=66 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:30.753230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:30.761156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-15ffb6a6-3359-4e09-b9b4-acecc8a6ceac req-de49267f-6c99-4ce1-af74-dcfbdcf95ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc0fa49b-14ab-4bf1-8910-6915f950a006", "name": "network-vif-plugged", "status": "completed", "tag": "8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:30.761701 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-76da6868-9172-44d3-9b57-e8d590a38024 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1315 microversion: 2.1 time: 0.176245 Aug 06 21:45:30.762045 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3344/6504] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:30 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:30.775081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-15ffb6a6-3359-4e09-b9b4-acecc8a6ceac req-de49267f-6c99-4ce1-af74-dcfbdcf95ee3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:30.775595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-15ffb6a6-3359-4e09-b9b4-acecc8a6ceac req-de49267f-6c99-4ce1-af74-dcfbdcf95ee3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:30.776032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-15ffb6a6-3359-4e09-b9b4-acecc8a6ceac req-de49267f-6c99-4ce1-af74-dcfbdcf95ee3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:30.788084 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-15ffb6a6-3359-4e09-b9b4-acecc8a6ceac req-de49267f-6c99-4ce1-af74-dcfbdcf95ee3 service nova] Creating event network-vif-plugged:8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c for instance fc0fa49b-14ab-4bf1-8910-6915f950a006 on nch2-master-1 Aug 06 21:45:30.793133 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-15ffb6a6-3359-4e09-b9b4-acecc8a6ceac req-de49267f-6c99-4ce1-af74-dcfbdcf95ee3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035794 Aug 06 21:45:30.794040 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3161/6505] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:45:31.782157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:31.782814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:31.789718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:31.790211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:31.790682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:31.791388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:31.791854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:31.792296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:31.926377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:31.933934 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5daba573-e6e1-4ecf-b6c8-ad6dbfadc868 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1315 microversion: 2.1 time: 0.155870 Aug 06 21:45:31.934515 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3345/6506] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:31 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:32.955689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=8 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:32.960138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:32.960879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:32.962764 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:32.970318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:32.970836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:32.971330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:32.972054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:32.972515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:32.972951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:33.120238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:33.128601 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b892040-3a7f-4835-84ce-224d5413c14b tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1502 microversion: 2.1 time: 0.175339 Aug 06 21:45:33.129185 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3162/6507] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:32 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:33.156463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:45:33.159009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:33.167980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:33.168599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:33.169189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:33.170721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:33.171404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:33.171923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:33.246492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:33.252731 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Old instance type m1.heat2, new instance type m1.heat {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:45:33.258814 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:45:33.259244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:45:33.259720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:45:33.260129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:45:33.260542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:45:33.368802 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-29efafaf-8c94-42b2-ad03-675440fa06ca tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "POST /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006/action" status: 202 len: 0 microversion: 2.1 time: 0.217125 Aug 06 21:45:33.369425 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3346/6508] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:45:33 2022] POST /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:45:33.377711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:33.378424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:33.385047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:33.385619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:33.386143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:33.386888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:33.387353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:33.387787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:33.527342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:33.535908 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aa041997-99ee-453d-849f-a3cc769872ac tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1511 microversion: 2.1 time: 0.162286 Aug 06 21:45:33.536506 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3163/6509] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:33 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:34.553966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=12 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:34.558991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:34.559601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:34.572395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:34.572881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:34.573317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:34.574013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:34.574474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:34.574932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:34.721826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:34.729480 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-240ef88a-9e97-46dc-9b59-faa62437d038 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1511 microversion: 2.1 time: 0.176353 Aug 06 21:45:34.730045 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3347/6510] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:34 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:35.752036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:35.752664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:35.759630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:35.760127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:35.760577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:35.761288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:35.761754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:35.762196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:35.898652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:35.906265 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dce65b0b-54d9-449c-8479-a59e39f1f4a3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.158976 Aug 06 21:45:35.906875 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3164/6511] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:35 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:36.927472 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:36.928001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:36.934955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:36.935447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:36.936440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:36.937139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:36.937606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:36.938042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:37.068670 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:37.077739 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a9f6081-5154-4c6a-898c-d79c2d0721a5 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.154214 Aug 06 21:45:37.078330 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3348/6512] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:36 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:38.099372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:38.099995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:38.106808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:38.107294 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:38.107766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:38.108463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:38.108928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:38.109371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:38.239616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:38.247269 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2379a44d-9e5b-45ad-a1b8-945538ca4ec3 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.151866 Aug 06 21:45:38.247842 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3165/6513] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:38 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:45:39.269165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:39.269786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:39.276745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:39.277233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:39.277676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:39.278375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:39.278869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:39.279302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:39.419183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:39.427389 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e84d8e90-ee5c-49d7-856b-be8d5f0ad501 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.162796 Aug 06 21:45:39.427967 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3349/6514] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:39 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:40.448219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:40.448851 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:40.456239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:40.456741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:40.457194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:40.457904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:40.458373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:40.458836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:40.594844 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:40.602499 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f2e81e89-6b95-4a12-8493-29ac02545690 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.158216 Aug 06 21:45:40.603103 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3166/6515] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:40 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:41.626035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:41.626714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:41.633702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:41.634197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:41.634674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:41.635377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:41.635837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:41.636267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:41.765623 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:41.773357 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78e259d6-204f-4b0b-8b31-6cddf5744681 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.152452 Aug 06 21:45:41.773931 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3350/6516] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:41 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:42.793513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:42.794125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:42.801532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:42.802014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:42.802455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:42.803188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:42.803653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:42.804080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:42.935046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:42.944113 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0242fd1a-df05-4984-8c29-80a9a0db00ba tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.154466 Aug 06 21:45:42.944704 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3167/6517] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:42 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:43.965281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:43.965882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:43.972876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:43.973370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:43.973809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:43.974507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:43.975000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:43.975432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:44.109150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:44.117445 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6648e9b5-fd80-488c-aba2-2e3b49d833c7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.156105 Aug 06 21:45:44.118017 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3351/6518] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:43 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:45.138570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:45.139176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:45.148648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:45.149145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:45.149596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:45.150312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:45.150810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:45.151251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:45.287362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:45.294943 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f08aa77f-88e7-4975-9031-37c28151d313 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.160326 Aug 06 21:45:45.295531 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3168/6519] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:45 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:46.317886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:46.318513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:46.325869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:46.326360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:46.326830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:46.327535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:46.327997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:46.328431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:46.463045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:46.470554 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b0b4110e-f533-40da-88fc-4037d5d07c62 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.157385 Aug 06 21:45:46.471658 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3352/6520] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:46 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:47.492773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:47.493414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:47.500482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:47.500979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:47.501429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:47.502139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:47.502639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:47.503082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:47.639570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:47.647898 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ca1798cd-2ccb-4360-bab3-ccf7604e1a08 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.159161 Aug 06 21:45:47.648480 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3169/6521] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:47 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:48.669274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:48.670497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:48.678049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:48.678565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:48.679024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:48.679746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:48.680215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:48.680651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:48.812058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:48.820233 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c0222a23-ed6e-49d0-872d-30e052d54d70 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.154949 Aug 06 21:45:48.820820 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3353/6522] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:48 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:49.841411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:49.842052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:49.849469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:49.849966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:49.850415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:49.851205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:49.851673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:49.852108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:49.981751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:49.989957 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-484344b7-08e2-49c9-8de5-074fa54a501c tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.152626 Aug 06 21:45:49.990531 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3170/6523] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:49 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:51.010821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:51.011445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:51.018993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:51.019487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:51.019933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:51.020661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:51.021127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:51.021559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:51.155912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:51.164389 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eff6ff3e-ffc1-4b01-9fcc-7f7382411058 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.157527 Aug 06 21:45:51.164972 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3354/6524] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:51 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:52.185463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:52.186119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:52.193304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:52.193795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:52.194246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:52.194982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:52.195450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:52.195889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:52.338934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:52.347299 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8952418c-9dff-42f9-8af4-118c1a004b89 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.165025 Aug 06 21:45:52.347883 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3171/6525] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:52 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:53.372971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:53.373571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:53.380565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:53.381055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:53.381495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:53.382196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:53.382708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:53.383141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:53.510767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:53.518974 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f83bcb48-4dca-42dd-8a92-5cf283a15be0 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.149240 Aug 06 21:45:53.519555 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3355/6526] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:53 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:54.539633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:54.540255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:54.547340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:54.547778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:54.548222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:54.548928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:54.550107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:54.550827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:54.683554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:54.691939 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c44f6f44-731e-42e6-9da7-2a0ed2ab96a2 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.156249 Aug 06 21:45:54.692512 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3172/6527] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:54 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:55.713349 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:55.713963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:55.720781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:55.721478 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:55.721934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:55.722644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:55.723104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:55.723528 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:55.853684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:55.861110 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-83d6be19-07cc-4cc9-8a52-5009928cccf8 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.151763 Aug 06 21:45:55.862266 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3356/6528] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:55 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:56.883316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:56.883934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:56.890881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:56.891368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:56.891811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:56.892507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:56.892967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:56.893399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:56.895965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=89 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:45:57.025698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:57.033375 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6113a8c0-c53a-4382-a36e-81305801d0d7 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.153941 Aug 06 21:45:57.034530 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3173/6529] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:56 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:58.054440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:58.055099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:58.062019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:58.062499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:58.062967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:58.063656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:58.064111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:58.064535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:58.193658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:58.201491 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-56d5b686-10d5-47ca-aec3-f8f4cf21e36a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.150886 Aug 06 21:45:58.202074 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3357/6530] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:58 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:45:59.222955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:45:59.223586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:45:59.230536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:59.231062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:59.231536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:59.232249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:45:59.232717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:45:59.233157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:45:59.365029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:45:59.372641 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce9f2886-99c9-4e02-99c2-bb83068f22f9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.153678 Aug 06 21:45:59.373220 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3174/6531] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:45:59 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:00.394093 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:00.394792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:00.404178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:00.404675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:00.405120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:00.405831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:00.406296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:00.406837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:00.535242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:00.542873 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a6fce3a5-49ed-46e3-92ba-1b9a9aea7c21 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.152759 Aug 06 21:46:00.543449 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3358/6532] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:00 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:01.564241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:01.565484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:01.572422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:01.572918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:01.573371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:01.574084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:01.574579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:01.575018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:01.709934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:01.717742 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e12991af-2eb4-4622-a55b-f3b1ffd1f526 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1516 microversion: 2.1 time: 0.157480 Aug 06 21:46:01.718440 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3175/6533] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:01 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:02.738788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:02.739404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:02.742324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=34 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:02.748377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:02.748880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:02.749330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:02.750074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:02.750567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:02.751004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:02.756059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:02.788633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f87b23ee-9bdb-4ef1-85f9-08d99b59c277 req-c67fb441-73ad-4093-ae0f-2974e4a1b236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc0fa49b-14ab-4bf1-8910-6915f950a006", "name": "network-vif-unplugged", "status": "completed", "tag": "8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:02.800126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f87b23ee-9bdb-4ef1-85f9-08d99b59c277 req-c67fb441-73ad-4093-ae0f-2974e4a1b236 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:02.801228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f87b23ee-9bdb-4ef1-85f9-08d99b59c277 req-c67fb441-73ad-4093-ae0f-2974e4a1b236 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:02.801857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f87b23ee-9bdb-4ef1-85f9-08d99b59c277 req-c67fb441-73ad-4093-ae0f-2974e4a1b236 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:02.814528 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f87b23ee-9bdb-4ef1-85f9-08d99b59c277 req-c67fb441-73ad-4093-ae0f-2974e4a1b236 service nova] Creating event network-vif-unplugged:8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c for instance fc0fa49b-14ab-4bf1-8910-6915f950a006 on nch1-master-1 Aug 06 21:46:02.821686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-f87b23ee-9bdb-4ef1-85f9-08d99b59c277 req-c67fb441-73ad-4093-ae0f-2974e4a1b236 service nova] Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:46:02.834249 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f87b23ee-9bdb-4ef1-85f9-08d99b59c277 req-c67fb441-73ad-4093-ae0f-2974e4a1b236 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051265 Aug 06 21:46:02.835530 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3176/6534] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:46:02.898391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:02.907367 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-17443895-4c34-46b2-9532-f3fe380f9182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1515 microversion: 2.1 time: 0.173114 Aug 06 21:46:02.908693 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3359/6535] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:02 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:03.932845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:03.933472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:03.935456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=30 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:03.941162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:03.941647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:03.942082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:03.942809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:03.943266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:03.943696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:04.089816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:04.097954 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-324de463-909d-4133-a959-959416c1ffea tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1513 microversion: 2.1 time: 0.170576 Aug 06 21:46:04.098524 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3177/6536] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:03 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:04.850036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b88ca8cb-1a39-4d63-bb65-cb1a8aad7103 req-bdd391c0-9d47-476c-b8d2-46f31848080e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc0fa49b-14ab-4bf1-8910-6915f950a006", "tag": "8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:04.860542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b88ca8cb-1a39-4d63-bb65-cb1a8aad7103 req-bdd391c0-9d47-476c-b8d2-46f31848080e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:04.861021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b88ca8cb-1a39-4d63-bb65-cb1a8aad7103 req-bdd391c0-9d47-476c-b8d2-46f31848080e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:04.861451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b88ca8cb-1a39-4d63-bb65-cb1a8aad7103 req-bdd391c0-9d47-476c-b8d2-46f31848080e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:04.875762 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b88ca8cb-1a39-4d63-bb65-cb1a8aad7103 req-bdd391c0-9d47-476c-b8d2-46f31848080e service nova] Creating event network-changed:8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c for instance fc0fa49b-14ab-4bf1-8910-6915f950a006 on nch1-master-1 Aug 06 21:46:04.882562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-b88ca8cb-1a39-4d63-bb65-cb1a8aad7103 req-bdd391c0-9d47-476c-b8d2-46f31848080e service nova] Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:46:04.894135 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b88ca8cb-1a39-4d63-bb65-cb1a8aad7103 req-bdd391c0-9d47-476c-b8d2-46f31848080e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047376 Aug 06 21:46:04.895139 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3360/6537] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:46:05.118887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:05.119556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:05.126718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:05.127722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:05.128229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:05.129085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:05.129751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:05.130187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:05.677576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:05.685646 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7cbf6976-ee78-4421-97de-866a623767ce tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1510 microversion: 2.1 time: 0.570791 Aug 06 21:46:05.686451 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3178/6538] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:05 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1510 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:05.707559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:05.708169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:05.714906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:05.715405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:05.716031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:05.716923 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:05.717396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:05.717838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:05.745861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:46:05.801732 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.compute.api [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Found an unconfirmed migration during delete, id: 16, status: finished Aug 06 21:46:07.105653 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eb92f3ef-fd4e-4159-a053-17ab2a387182 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 204 len: 0 microversion: 2.1 time: 1.402067 Aug 06 21:46:07.106379 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3361/6539] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:46:05 2022] DELETE /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 0 bytes in 1404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:46:07.114827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:07.115456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:07.122468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:07.123003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:07.123453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:07.124219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:07.124663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:07.125101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:07.263892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:07.271559 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23dbcc93-3a95-4478-bd42-6f4321aafa36 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1502 microversion: 2.1 time: 0.160789 Aug 06 21:46:07.272134 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3179/6540] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:07 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:07.832169 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-0d30fe41-b11a-4545-bfb6-02bbc939a42f req-a8a13fcd-30b0-4162-a498-379b764b734f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc0fa49b-14ab-4bf1-8910-6915f950a006", "name": "network-vif-plugged", "status": "completed", "tag": "8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:07.842627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0d30fe41-b11a-4545-bfb6-02bbc939a42f req-a8a13fcd-30b0-4162-a498-379b764b734f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:07.843117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0d30fe41-b11a-4545-bfb6-02bbc939a42f req-a8a13fcd-30b0-4162-a498-379b764b734f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:07.843559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-0d30fe41-b11a-4545-bfb6-02bbc939a42f req-a8a13fcd-30b0-4162-a498-379b764b734f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:07.856022 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-0d30fe41-b11a-4545-bfb6-02bbc939a42f req-a8a13fcd-30b0-4162-a498-379b764b734f service nova] Creating event network-vif-plugged:8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c for instance fc0fa49b-14ab-4bf1-8910-6915f950a006 on nch1-master-1 Aug 06 21:46:07.860771 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-0d30fe41-b11a-4545-bfb6-02bbc939a42f req-a8a13fcd-30b0-4162-a498-379b764b734f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033628 Aug 06 21:46:07.861369 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3362/6541] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:46:08.292344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:08.292963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:08.300450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:08.300959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:08.301386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:08.302096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:08.302570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:08.303004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:08.511661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6311a8ce4c4848cea0cf3af1730ca67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd9f422e6e34a65bbc620eba89593ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:08.519988 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f4b2381-91e4-435b-99c2-d877da96ea56 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 200 len: 1502 microversion: 2.1 time: 0.231513 Aug 06 21:46:08.520581 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3180/6542] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:08 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:46:08.883407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-baf6e66b-2e08-4cda-8d17-86d4a415c22d req-65417d4d-d450-453c-b9cd-c94d039f3d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc0fa49b-14ab-4bf1-8910-6915f950a006", "name": "network-vif-deleted", "tag": "8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:08.895550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-baf6e66b-2e08-4cda-8d17-86d4a415c22d req-65417d4d-d450-453c-b9cd-c94d039f3d40 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:08.896028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-baf6e66b-2e08-4cda-8d17-86d4a415c22d req-65417d4d-d450-453c-b9cd-c94d039f3d40 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:08.896455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-baf6e66b-2e08-4cda-8d17-86d4a415c22d req-65417d4d-d450-453c-b9cd-c94d039f3d40 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:08.909533 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-baf6e66b-2e08-4cda-8d17-86d4a415c22d req-65417d4d-d450-453c-b9cd-c94d039f3d40 service nova] Creating event network-vif-deleted:8ed0a4ba-93e0-4a58-9d20-1a20ce4a099c for instance fc0fa49b-14ab-4bf1-8910-6915f950a006 on nch1-master-1 Aug 06 21:46:08.915606 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-baf6e66b-2e08-4cda-8d17-86d4a415c22d req-65417d4d-d450-453c-b9cd-c94d039f3d40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039587 Aug 06 21:46:08.916244 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3363/6543] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:46:09.540726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:09.541467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:09.548082 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:09.548564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:09.549526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:09.550233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:09.550724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:09.551157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:09.565792 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] HTTP exception thrown: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Request method failure captured: Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 HTTP/1.1 Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uDvdat3af_iMfv8RNpbKjWjvNdt4Ej3HOPOcBMN4kjBOT6dwf0Ybc1DShJXBcuHxHWJjNWTeUNlI7OIJKTfDFXV6JSPj64rYSkuaidQJLkX7i4x7cQC_jP4jPCJIW_LddKgIJ2U__tPya-muJ50-C04pThJ1J1GgyxOzYaGxEfcfxM Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 2dd9f422e6e34a65bbc620eba89593ad Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersTestJSON-860446175 Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2dd9f422e6e34a65bbc620eba89593ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2dd9f422e6e34a65bbc620eba89593ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2dd9f422e6e34a65bbc620eba89593ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2dd9f422e6e34a65bbc620eba89593ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersTestJSON-860446175 Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 2dd9f422e6e34a65bbc620eba89593ad Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersTestJSON-860446175 Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersTestJSON-860446175-project Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 6311a8ce4c4848cea0cf3af1730ca67b Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersTestJSON-860446175-project Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'fc0fa49b-14ab-4bf1-8910-6915f950a006'} Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:46:09.567466 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Returning 404 to user: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-12d8b31d-3679-44e0-b2cb-e94c6b7778fb tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 404 len: 111 microversion: 2.1 time: 0.032144 Aug 06 21:46:09.571994 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3181/6544] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:09 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:46:09.584284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:09.584882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:09.591649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:09.592140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:09.592580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:09.593311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:09.593773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:09.594201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:09.608177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] HTTP exception thrown: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Request method failure captured: Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 HTTP/1.1 Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uDvdat3af_iMfv8RNpbKjWjvNdt4Ej3HOPOcBMN4kjBOT6dwf0Ybc1DShJXBcuHxHWJjNWTeUNlI7OIJKTfDFXV6JSPj64rYSkuaidQJLkX7i4x7cQC_jP4jPCJIW_LddKgIJ2U__tPya-muJ50-C04pThJ1J1GgyxOzYaGxEfcfxM Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 2dd9f422e6e34a65bbc620eba89593ad Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-DeleteServersTestJSON-860446175 Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2dd9f422e6e34a65bbc620eba89593ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2dd9f422e6e34a65bbc620eba89593ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2dd9f422e6e34a65bbc620eba89593ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2dd9f422e6e34a65bbc620eba89593ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-DeleteServersTestJSON-860446175 Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 2dd9f422e6e34a65bbc620eba89593ad Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-DeleteServersTestJSON-860446175 Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-DeleteServersTestJSON-860446175-project Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 6311a8ce4c4848cea0cf3af1730ca67b Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-DeleteServersTestJSON-860446175-project Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'fc0fa49b-14ab-4bf1-8910-6915f950a006'} Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:46:09.609795 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Returning 404 to user: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3fc62d55-9481-49b7-abf6-2893655bd85a tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 404 len: 111 microversion: 2.1 time: 0.031459 Aug 06 21:46:09.614664 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3364/6545] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:46:09 2022] DELETE /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:46:09.620557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:09.621179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] [instance: fc0fa49b-14ab-4bf1-8910-6915f950a006] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:09.627449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:09.628061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:09.628507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:09.629197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:09.629658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:09.630088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:09.643587 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] HTTP exception thrown: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Request method failure captured: Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 HTTP/1.1 Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uDvdat3af_iMfv8RNpbKjWjvNdt4Ej3HOPOcBMN4kjBOT6dwf0Ybc1DShJXBcuHxHWJjNWTeUNlI7OIJKTfDFXV6JSPj64rYSkuaidQJLkX7i4x7cQC_jP4jPCJIW_LddKgIJ2U__tPya-muJ50-C04pThJ1J1GgyxOzYaGxEfcfxM Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 2dd9f422e6e34a65bbc620eba89593ad Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-DeleteServersTestJSON-860446175 Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2dd9f422e6e34a65bbc620eba89593ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2dd9f422e6e34a65bbc620eba89593ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2dd9f422e6e34a65bbc620eba89593ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2dd9f422e6e34a65bbc620eba89593ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-DeleteServersTestJSON-860446175 Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 2dd9f422e6e34a65bbc620eba89593ad Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-DeleteServersTestJSON-860446175 Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-DeleteServersTestJSON-860446175-project Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 6311a8ce4c4848cea0cf3af1730ca67b Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-DeleteServersTestJSON-860446175-project Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'fc0fa49b-14ab-4bf1-8910-6915f950a006'} Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:46:09.645103 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] Returning 404 to user: Instance fc0fa49b-14ab-4bf1-8910-6915f950a006 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0e35c540-621a-48fd-a154-4de1d25e96c9 tempest-DeleteServersTestJSON-860446175 tempest-DeleteServersTestJSON-860446175-project] 10.222.0.33 "GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006" status: 404 len: 111 microversion: 2.1 time: 0.029795 Aug 06 21:46:09.649328 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3182/6546] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:09 2022] GET /compute/v2.1/servers/fc0fa49b-14ab-4bf1-8910-6915f950a006 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:46:18.323648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1377470029", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "7e8a176b-34c5-47ea-9ac1-3fd3caf5c132"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:18.379762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] validate_networks() for [('7e8a176b-34c5-47ea-9ac1-3fd3caf5c132', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:46:18.761807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:46:18.762238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:46:18.762762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:46:18.763210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:46:18.763630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:46:18.772669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:18.773142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:18.773582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:18.774312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:18.774832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:18.775283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:18.794634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Getting quotas for project 1f27f640dfae44bd939f5b63372929a1. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:46:18.800883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Getting quotas for user 82eb6abeb4a549499466ea0425b60f86 and project 1f27f640dfae44bd939f5b63372929a1. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:46:18.813817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:46:18.816360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:46:18.862143 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b1ae930-370f-4074-b658-4e510d7b7645 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662184 Aug 06 21:46:18.863184 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3365/6547] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:46:18.874083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-08b7ebf2-dd3f-45de-bdcf-60a76e081f47 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:18.875442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-08b7ebf2-dd3f-45de-bdcf-60a76e081f47 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:18.933737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-08b7ebf2-dd3f-45de-bdcf-60a76e081f47 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:18.953492 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-08b7ebf2-dd3f-45de-bdcf-60a76e081f47 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1218 microversion: 2.1 time: 0.083472 Aug 06 21:46:18.954101 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3183/6548] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:18 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:19.976550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:19.977760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:19.984657 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:19.985495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:19.986106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:19.987037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:19.987762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:19.988400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:20.061771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:20.069970 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e599ad82-bf77-4d56-9804-e049b63dc496 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1288 microversion: 2.1 time: 0.099894 Aug 06 21:46:20.070813 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3366/6549] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:19 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:21.093169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:21.094674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:21.099858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=49 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:21.117258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:21.119967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:21.120653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:21.121643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:21.122111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:21.122559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:21.371922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:21.384564 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b66cb283-6305-4c50-8f6b-902ec9046f34 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1318 microversion: 2.1 time: 0.296178 Aug 06 21:46:21.385179 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3184/6550] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:21 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:21.627541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-40b0c923-92f7-4067-85b0-d9664747b8c0 req-c9ef4365-43b7-4588-8ea7-769691b6d0bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "206a3213-326c-4128-86cb-430aad60058e", "tag": "a95b3e1b-9df9-4fa4-be09-fcbde3830db3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:21.640666 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-40b0c923-92f7-4067-85b0-d9664747b8c0 req-c9ef4365-43b7-4588-8ea7-769691b6d0bf service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:21.641495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-40b0c923-92f7-4067-85b0-d9664747b8c0 req-c9ef4365-43b7-4588-8ea7-769691b6d0bf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:21.641937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-40b0c923-92f7-4067-85b0-d9664747b8c0 req-c9ef4365-43b7-4588-8ea7-769691b6d0bf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:21.653772 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-40b0c923-92f7-4067-85b0-d9664747b8c0 req-c9ef4365-43b7-4588-8ea7-769691b6d0bf service nova] Creating event network-changed:a95b3e1b-9df9-4fa4-be09-fcbde3830db3 for instance 206a3213-326c-4128-86cb-430aad60058e on nch1-master-1 Aug 06 21:46:21.659922 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-40b0c923-92f7-4067-85b0-d9664747b8c0 req-c9ef4365-43b7-4588-8ea7-769691b6d0bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036471 Aug 06 21:46:21.660530 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3367/6551] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:46:22.407302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:22.407921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:22.415244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:22.415734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:22.416181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:22.416890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:22.417350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:22.417780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:22.553639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:22.561272 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6fe22030-9b0a-40d5-86aa-e73d40dc5d5c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1318 microversion: 2.1 time: 0.157997 Aug 06 21:46:22.561859 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3185/6552] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:22 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:23.585018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:23.585729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:23.591988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:23.592474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:23.592915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:23.593612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:23.594071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:23.594498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:23.725404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:23.733001 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b3560f2-0d69-41db-bed1-95ad0f2140a3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1318 microversion: 2.1 time: 0.153735 Aug 06 21:46:23.733575 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3368/6553] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:23 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:24.754635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:24.755297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:24.762251 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:24.762767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:24.763219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:24.763932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:24.764396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:24.764834 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:24.900673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:24.908716 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-943892c0-edc5-4480-aaea-a8ffda9fdfb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1318 microversion: 2.1 time: 0.158118 Aug 06 21:46:24.909891 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3186/6554] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:24 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:25.927766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f084a6fe-ac6f-43ad-be8b-3de639ee0b5f req-9daa3468-385c-4928-8d66-8c0d23a9b1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206a3213-326c-4128-86cb-430aad60058e", "name": "network-vif-plugged", "status": "completed", "tag": "a95b3e1b-9df9-4fa4-be09-fcbde3830db3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:25.940192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:25.940903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:25.948196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f084a6fe-ac6f-43ad-be8b-3de639ee0b5f req-9daa3468-385c-4928-8d66-8c0d23a9b1d7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:25.948388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:25.948689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f084a6fe-ac6f-43ad-be8b-3de639ee0b5f req-9daa3468-385c-4928-8d66-8c0d23a9b1d7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:25.948865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:25.949126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f084a6fe-ac6f-43ad-be8b-3de639ee0b5f req-9daa3468-385c-4928-8d66-8c0d23a9b1d7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:25.949305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:25.950017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:25.950647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:25.951081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:25.962343 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f084a6fe-ac6f-43ad-be8b-3de639ee0b5f req-9daa3468-385c-4928-8d66-8c0d23a9b1d7 service nova] Creating event network-vif-plugged:a95b3e1b-9df9-4fa4-be09-fcbde3830db3 for instance 206a3213-326c-4128-86cb-430aad60058e on nch1-master-1 Aug 06 21:46:25.967181 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f084a6fe-ac6f-43ad-be8b-3de639ee0b5f req-9daa3468-385c-4928-8d66-8c0d23a9b1d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043524 Aug 06 21:46:25.968175 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3369/6555] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:46:26.128797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:26.136460 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-68358e39-7761-41b4-a4e9-62eabe8e1224 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1318 microversion: 2.1 time: 0.200669 Aug 06 21:46:26.137059 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3187/6556] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:25 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:27.159236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:27.159956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:27.166276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.166802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.167244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.167949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.168411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.168843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.309357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:27.317733 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6dd96a13-5087-4c8c-a3b8-aa257dae26d3 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1509 microversion: 2.1 time: 0.164221 Aug 06 21:46:27.318308 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3370/6557] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:27 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:27.338438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:27.339144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:27.346345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.346886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.347343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.348059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.348528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.348970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.478414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:27.486119 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8518a146-9189-419c-b209-6e786796c13f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1509 microversion: 2.1 time: 0.151691 Aug 06 21:46:27.487259 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3188/6558] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:27 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:27.507235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-09636dab-76f3-40c1-a991-e4be36e9322f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:27.509639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-09636dab-76f3-40c1-a991-e4be36e9322f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:27.516083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09636dab-76f3-40c1-a991-e4be36e9322f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.516572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09636dab-76f3-40c1-a991-e4be36e9322f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.517020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09636dab-76f3-40c1-a991-e4be36e9322f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.518232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09636dab-76f3-40c1-a991-e4be36e9322f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.518720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09636dab-76f3-40c1-a991-e4be36e9322f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.519158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-09636dab-76f3-40c1-a991-e4be36e9322f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.582373 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-09636dab-76f3-40c1-a991-e4be36e9322f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "PUT /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1081 microversion: 2.1 time: 0.079042 Aug 06 21:46:27.584974 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3371/6559] 10.222.0.33 () {60 vars in 1256 bytes} [Sat Aug 6 21:46:27 2022] PUT /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1081 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:27.601112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:27.601739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:27.607820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.608310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.608759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.609463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.609929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.610370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.741812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:27.749360 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3a5b6cbf-76ae-4561-94f5-8dd38a3ba840 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1507 microversion: 2.1 time: 0.152616 Aug 06 21:46:27.749938 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3189/6560] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:27 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:27.770166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:27.770816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:27.776882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.777371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.777811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.778505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.779026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.779458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.910024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:27.917637 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd681571-edc1-4d38-93b4-3f4f61d14744 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1507 microversion: 2.1 time: 0.152152 Aug 06 21:46:27.918212 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3372/6561] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:27 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:27.937260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:27.940664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:27.946814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.947249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.947698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.948431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:27.948894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:27.949329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:27.981801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:27.988637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Old instance type m1.heat2, new instance type m1.heat {{(pid=142462) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:46:27.995155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:46:27.995587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:46:27.996101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:46:27.996526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:46:27.996946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:46:28.062194 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d9b3b0d9-f814-42f8-a466-f1c900136cb5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "POST /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e/action" status: 202 len: 0 microversion: 2.1 time: 0.128826 Aug 06 21:46:28.062854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3190/6562] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:46:27 2022] POST /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:46:28.070981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:28.071629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:28.077902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:28.078397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:28.078877 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:28.079659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:28.080642 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:28.081204 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:28.244452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:28.252118 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3a1c0ace-2b17-4976-957c-2ac622e50817 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1518 microversion: 2.1 time: 0.184931 Aug 06 21:46:28.253141 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3373/6563] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:28 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:29.270938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:29.276594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:29.277318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:29.285631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:29.286234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:29.286774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:29.287489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:29.287994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:29.288804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:29.459347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:29.469825 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-65508216-947a-4ee6-93a2-5511060704c6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1518 microversion: 2.1 time: 0.200666 Aug 06 21:46:29.470422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3191/6564] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:29 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1518 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:30.491173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:30.491861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:30.493929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:30.494959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:30.502250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:30.502774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:30.503215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:30.503919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:30.504448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:30.504881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:30.639011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:30.647384 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-31ab6451-b96c-4e10-83f7-61d5e9716d95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.160080 Aug 06 21:46:30.647947 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3374/6565] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:30 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:31.671248 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:31.672202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:31.681113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:31.681595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:31.682033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:31.682785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:31.683239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:31.683684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:31.821599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:31.829461 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-48472ebd-ae08-4a5c-bcbb-db1433c9fac0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.164443 Aug 06 21:46:31.830652 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3192/6566] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:31 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:32.852068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:32.852684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:32.855410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:32.860777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:32.861910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:32.862636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:32.863346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:32.863811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:32.864248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:32.867656 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:33.001029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:33.009609 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fe920f17-3f41-4a31-8e8d-89acad54f690 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.161466 Aug 06 21:46:33.010192 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3375/6567] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:32 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:34.034994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:34.035840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:34.039188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=38 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:34.045533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:34.046030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:34.046475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:34.047254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:34.047775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:34.048671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:34.188862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:34.196881 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-31ca97b6-e765-420a-a4f1-a5d47278da46 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.170360 Aug 06 21:46:34.197463 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3193/6568] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:34 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:35.218421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:35.219089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:35.226824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:35.227321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:35.227763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:35.228460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:35.228920 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:35.229348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:35.369488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:35.377404 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42295e13-4aec-40c3-8287-829fc57d24e9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.162646 Aug 06 21:46:35.378043 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3376/6569] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:35 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:36.398318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:36.398985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:36.406210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:36.406733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:36.407182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:36.407954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:36.408425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:36.408857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:36.547054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:36.554867 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab57fd1d-f83e-4561-9045-b9f4831fe6e2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.160445 Aug 06 21:46:36.555448 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3194/6570] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:36 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:37.576343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:37.577217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:37.584235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:37.584743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:37.585184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:37.585882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:37.586342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:37.586801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:37.721933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:37.729634 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bc383a7e-017a-460e-a9e1-4680c7acdd62 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.157283 Aug 06 21:46:37.730217 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3377/6571] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:37 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:38.751131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:38.751809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:38.758655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:38.759141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:38.759580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:38.760277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:38.760735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:38.761164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:38.895896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:38.903827 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-243cf17d-0495-477f-a56c-b210eaa3bc95 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.156657 Aug 06 21:46:38.904422 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3195/6572] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:38 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:39.925502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:39.926029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:39.933070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:39.933548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:39.933983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:39.934714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:39.935217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:39.935643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:40.065967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:40.073492 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-732c28d8-eb97-4156-b51c-3e94615b514f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.152594 Aug 06 21:46:40.074066 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3378/6573] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:39 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:41.095175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:41.096719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:41.104679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:41.105172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:41.105614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:41.106324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:41.106813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:41.107355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:41.244573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:41.252922 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b86df1c1-8204-46cb-8b89-a3fdb7ba6404 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.161710 Aug 06 21:46:41.253497 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3196/6574] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:41 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:42.273505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:42.274117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:42.281235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:42.281717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:42.282151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:42.282982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:42.283520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:42.283992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:42.421259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:42.429634 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5a8ca64-8d42-451d-8716-69bd560615c5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.159991 Aug 06 21:46:42.430210 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3379/6575] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:42 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:43.451261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:43.452152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:43.459239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:43.459729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:43.460176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:43.460878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:43.461344 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:43.461780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:43.592004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:43.600211 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b83e28ad-a84f-491f-a2b4-1ab2387d3501 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.153006 Aug 06 21:46:43.600792 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3197/6576] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:43 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:46:44.621812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:44.622375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:44.629409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:44.629890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:44.630325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:44.631110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:44.631564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:44.631987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:44.766622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:44.774699 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-66fd60ad-db62-4f41-9c43-99627eed3ca4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.156856 Aug 06 21:46:44.775284 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3380/6577] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:44 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:45.796229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:45.796846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:45.805019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:45.805505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:45.805951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:45.806679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:45.807139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:45.807570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:45.937741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:45.945451 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-63db89c5-a1f5-42fb-8940-5b39ef7d38ba tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.153188 Aug 06 21:46:45.946042 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3198/6578] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:45 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:46.966398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:46.967040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:46.974276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:46.974795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:46.975238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:46.975924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:46.976383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:46.976804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:47.105237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:47.113403 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1cbe86c2-70e2-4e89-8d50-0d69208f3b04 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.150875 Aug 06 21:46:47.113980 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3381/6579] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:46 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:48.134002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:48.134646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:48.141840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:48.143095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:48.143549 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:48.144250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:48.144710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:48.145141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:48.149138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:46:48.280451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:48.288054 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f87e6f2-b34e-401b-88d7-e7c4058864a0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.158155 Aug 06 21:46:48.288632 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3199/6580] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:48 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:49.309735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:49.311632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:49.317830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:49.318357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:49.318841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:49.319548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:49.320010 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:49.320441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:49.455602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:49.462948 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7922cf69-3d94-4b12-8bb2-ce981d67d53f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.157100 Aug 06 21:46:49.463521 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3382/6581] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:49 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:50.483999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:50.484661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:50.492134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:50.492629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:50.493098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:50.493812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:50.494283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:50.494766 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:50.626933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:50.634507 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f1b78874-f995-40fb-9d2d-22007bd4e508 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.154688 Aug 06 21:46:50.635123 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3200/6582] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:50 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:51.655857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:51.656383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:51.663915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:51.664408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:51.664858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:51.665564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:51.666027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:51.666457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:51.797577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:51.805705 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f931eb4-01d1-428c-88f4-ec3dd699ece2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.153847 Aug 06 21:46:51.806281 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3383/6583] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:51 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:52.826677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:52.827565 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:52.835306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:52.835800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:52.836253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:52.836971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:52.837438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:52.837881 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:52.976390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:52.984063 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a68b9ed7-c4cf-4e83-8119-f18218afb5f5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.161325 Aug 06 21:46:52.984646 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3201/6584] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:52 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:54.005296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:54.005909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:54.012815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:54.013296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:54.013735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:54.014427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:54.014904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:54.015330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:54.149082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:54.156862 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67da3182-92fc-4bde-b2a6-4bd30b4d11cf tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.156007 Aug 06 21:46:54.157470 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3384/6585] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:53 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:55.178249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:55.178900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:55.185875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:55.186366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:55.186841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:55.187545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:55.188009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:55.188446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:55.320321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:55.329335 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0087bcfd-e81e-46d2-be47-3091ebaab2ca tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.155022 Aug 06 21:46:55.329952 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3202/6586] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:55 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:56.350011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:56.350686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:56.357547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:56.358026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:56.358460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:56.359175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:56.359628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:56.360053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:56.495216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:56.502751 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e074376c-89f8-4e67-bf96-f763fc18a8e7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1523 microversion: 2.1 time: 0.156707 Aug 06 21:46:56.503350 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3385/6587] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:56 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:57.356511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-532aff55-ce48-4329-b252-aeda4126dd70 req-1d5d65df-f275-418a-9785-ade64868d855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206a3213-326c-4128-86cb-430aad60058e", "name": "network-vif-unplugged", "status": "completed", "tag": "a95b3e1b-9df9-4fa4-be09-fcbde3830db3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:57.368003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-532aff55-ce48-4329-b252-aeda4126dd70 req-1d5d65df-f275-418a-9785-ade64868d855 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:57.368495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-532aff55-ce48-4329-b252-aeda4126dd70 req-1d5d65df-f275-418a-9785-ade64868d855 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:57.368936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-532aff55-ce48-4329-b252-aeda4126dd70 req-1d5d65df-f275-418a-9785-ade64868d855 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:57.382110 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-532aff55-ce48-4329-b252-aeda4126dd70 req-1d5d65df-f275-418a-9785-ade64868d855 service nova] Creating event network-vif-unplugged:a95b3e1b-9df9-4fa4-be09-fcbde3830db3 for instance 206a3213-326c-4128-86cb-430aad60058e on nch2-master-1 Aug 06 21:46:57.387663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-532aff55-ce48-4329-b252-aeda4126dd70 req-1d5d65df-f275-418a-9785-ade64868d855 service nova] Instance 206a3213-326c-4128-86cb-430aad60058e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:46:57.398830 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-532aff55-ce48-4329-b252-aeda4126dd70 req-1d5d65df-f275-418a-9785-ade64868d855 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046604 Aug 06 21:46:57.399453 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3203/6588] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:46:57.523767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:57.524308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:57.531021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:57.531507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:57.531949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:57.533308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:57.533881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:57.534322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:57.792636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:57.800499 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-303c8ded-30d5-4eab-891f-294543da1c40 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1522 microversion: 2.1 time: 0.280732 Aug 06 21:46:57.801091 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3386/6589] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:57 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:58.823195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:46:58.823915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:46:58.831018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:58.831515 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:58.831966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:58.832668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:58.833133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:58.833569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:58.972755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:46:58.980440 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a0be3b1c-7e27-432f-90c0-e70e2154d010 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1520 microversion: 2.1 time: 0.162476 Aug 06 21:46:58.981018 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3204/6590] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:58 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:46:59.431181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-74182383-3f10-4862-949e-1ff3f8af1a31 req-a7ab10d5-b874-40d1-99b6-869d9d31212e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "206a3213-326c-4128-86cb-430aad60058e", "tag": "a95b3e1b-9df9-4fa4-be09-fcbde3830db3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:46:59.441209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-74182383-3f10-4862-949e-1ff3f8af1a31 req-a7ab10d5-b874-40d1-99b6-869d9d31212e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:46:59.441672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-74182383-3f10-4862-949e-1ff3f8af1a31 req-a7ab10d5-b874-40d1-99b6-869d9d31212e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:46:59.442104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-74182383-3f10-4862-949e-1ff3f8af1a31 req-a7ab10d5-b874-40d1-99b6-869d9d31212e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:46:59.453813 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-74182383-3f10-4862-949e-1ff3f8af1a31 req-a7ab10d5-b874-40d1-99b6-869d9d31212e service nova] Creating event network-changed:a95b3e1b-9df9-4fa4-be09-fcbde3830db3 for instance 206a3213-326c-4128-86cb-430aad60058e on nch2-master-1 Aug 06 21:46:59.459219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-74182383-3f10-4862-949e-1ff3f8af1a31 req-a7ab10d5-b874-40d1-99b6-869d9d31212e service nova] Instance 206a3213-326c-4128-86cb-430aad60058e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:46:59.469552 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-74182383-3f10-4862-949e-1ff3f8af1a31 req-a7ab10d5-b874-40d1-99b6-869d9d31212e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042308 Aug 06 21:46:59.470666 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3387/6591] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:47:00.002751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:00.003481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:00.010674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:00.011171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:00.011616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:00.012335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:00.012801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:00.013242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:00.156027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:00.164756 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36be877a-0454-48f8-b1dd-38494b32555a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1517 microversion: 2.1 time: 0.167328 Aug 06 21:47:00.165335 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3205/6592] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:46:59 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:47:00.185663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53830412-f2ae-41fa-becf-89e6949e645e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:00.186289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-53830412-f2ae-41fa-becf-89e6949e645e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:00.193625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53830412-f2ae-41fa-becf-89e6949e645e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:00.194117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53830412-f2ae-41fa-becf-89e6949e645e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:00.194588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53830412-f2ae-41fa-becf-89e6949e645e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:00.195277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53830412-f2ae-41fa-becf-89e6949e645e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:00.195735 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53830412-f2ae-41fa-becf-89e6949e645e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:00.196167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53830412-f2ae-41fa-becf-89e6949e645e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:00.257087 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53830412-f2ae-41fa-becf-89e6949e645e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "POST /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e/action" status: 204 len: 0 microversion: 2.1 time: 0.075516 Aug 06 21:47:00.257716 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3388/6593] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:47:00 2022] POST /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:47:00.265776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:00.266408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:00.273463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:00.273954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:00.274485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:00.275356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:00.275835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:00.276322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:00.487256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:00.494872 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0d3a24c5-d61b-4717-ab85-7058ee4d3b0a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1517 microversion: 2.1 time: 0.232914 Aug 06 21:47:00.495461 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3206/6594] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:00 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:01.517526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:01.518236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:01.524596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:01.525096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:01.525540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:01.526252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:01.526746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:01.527183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:01.663152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:01.672567 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0d17cdd3-e012-467c-94d5-b580cbb33f72 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1517 microversion: 2.1 time: 0.160119 Aug 06 21:47:01.673851 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3389/6595] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:01 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:02.693375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:02.694041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:02.701095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:02.701591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:02.702314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:02.703057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:02.703531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:02.703971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:02.833360 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:02.841088 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c48fcc84-2f89-40f3-8113-128595addf9f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1509 microversion: 2.1 time: 0.151704 Aug 06 21:47:02.841674 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3207/6596] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:02 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:02.861692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:02.862314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:02.869195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:02.869718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:02.870157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:02.870953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:02.871377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:02.871801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:03.004574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:03.007026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:03.014581 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d32c7c6-387f-47ff-baed-e0a1f6e61ab2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1509 microversion: 2.1 time: 0.156606 Aug 06 21:47:03.015333 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3390/6597] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:02 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:03.038896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-70033b5e-37c6-4e67-b2af-2f10d9cedb1f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Action: 'create', calling method: .version_select at 0x7f729e1413a0>, body: {"keypair": {"name": "tempest-keypair-1990362959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaOSIinY529ses+jRL2OpD1AwgLGk2wykjEv90PaNNYYFwuNATnJwnXTGeLnu0MaGbs9Zh8G7/jbmZojYh90Eyr4/ei8J+k6NTU2OnN29/nxRTxtr04LCe0b2kMdzYmfw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:03.056174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-70033b5e-37c6-4e67-b2af-2f10d9cedb1f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Getting quotas for project 1f27f640dfae44bd939f5b63372929a1. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:47:03.061330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-70033b5e-37c6-4e67-b2af-2f10d9cedb1f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Getting quotas for user 82eb6abeb4a549499466ea0425b60f86 and project 1f27f640dfae44bd939f5b63372929a1. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:47:03.086467 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-70033b5e-37c6-4e67-b2af-2f10d9cedb1f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051648 Aug 06 21:47:03.087357 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3208/6598] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:47:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:47:03.157932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-6c25f75f-ad10-4149-8128-1091dbc9c12f req-2775a8ce-0e28-4d7f-95ef-4f413878e78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206a3213-326c-4128-86cb-430aad60058e", "name": "network-vif-plugged", "status": "completed", "tag": "a95b3e1b-9df9-4fa4-be09-fcbde3830db3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:03.163572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=32 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:03.171028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6c25f75f-ad10-4149-8128-1091dbc9c12f req-2775a8ce-0e28-4d7f-95ef-4f413878e78e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:03.171583 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6c25f75f-ad10-4149-8128-1091dbc9c12f req-2775a8ce-0e28-4d7f-95ef-4f413878e78e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:03.172074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-6c25f75f-ad10-4149-8128-1091dbc9c12f req-2775a8ce-0e28-4d7f-95ef-4f413878e78e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:03.186398 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-6c25f75f-ad10-4149-8128-1091dbc9c12f req-2775a8ce-0e28-4d7f-95ef-4f413878e78e service nova] Creating event network-vif-plugged:a95b3e1b-9df9-4fa4-be09-fcbde3830db3 for instance 206a3213-326c-4128-86cb-430aad60058e on nch2-master-1 Aug 06 21:47:03.192678 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-6c25f75f-ad10-4149-8128-1091dbc9c12f req-2775a8ce-0e28-4d7f-95ef-4f413878e78e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038476 Aug 06 21:47:03.193496 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3391/6599] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:47:04.561432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:04.562059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:04.565123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:04.575067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:04.575694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:04.576281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:04.577278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:04.577728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:04.578162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:04.717359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:04.725232 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-42b1c57f-b695-4eba-a203-2101aecc53a6 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 200 len: 1509 microversion: 2.1 time: 0.168634 Aug 06 21:47:04.725826 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3209/6600] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:04 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:04.745988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:04.746601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:04.754937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:04.755424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:04.755861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:04.756551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:04.757006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:04.757433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:04.785904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:47:04.859632 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-84d5a3b3-fee3-4b43-a447-aafa45bb97df tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "DELETE /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 204 len: 0 microversion: 2.1 time: 0.117801 Aug 06 21:47:04.860218 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3392/6601] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:47:04 2022] DELETE /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:47:04.919611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1422315155", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "7e8a176b-34c5-47ea-9ac1-3fd3caf5c132"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:04.974433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] validate_networks() for [('7e8a176b-34c5-47ea-9ac1-3fd3caf5c132', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:47:05.366623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:47:05.367056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:47:05.367538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:47:05.367954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:47:05.368373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:47:05.377534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:05.378016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:05.378457 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:05.379230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:05.379689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:05.380120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:05.396781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Getting quotas for project 1f27f640dfae44bd939f5b63372929a1. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:47:05.402022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Getting quotas for user 82eb6abeb4a549499466ea0425b60f86 and project 1f27f640dfae44bd939f5b63372929a1. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:47:05.414871 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:47:05.417129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:47:05.463884 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-258580c7-e484-4159-87b5-da1c718c7c93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548143 Aug 06 21:47:05.464540 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3210/6602] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:47:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:47:05.475864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-723642c4-dcbb-4173-829e-a0f23f7008fe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:05.476563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-723642c4-dcbb-4173-829e-a0f23f7008fe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:05.531367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-723642c4-dcbb-4173-829e-a0f23f7008fe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:05.539237 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-723642c4-dcbb-4173-829e-a0f23f7008fe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1218 microversion: 2.1 time: 0.067574 Aug 06 21:47:05.539817 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3393/6603] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:05 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:06.561133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:06.561749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:06.570198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:06.570743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:06.571201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:06.571919 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:06.572554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:06.573743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:06.668102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:06.676980 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3463ac80-bd8c-4391-b4c0-c85cb9315aa4 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1270 microversion: 2.1 time: 0.120896 Aug 06 21:47:06.677936 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3211/6604] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:06 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:06.963227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b77997d8-969d-49f8-85a9-1a9197ad3cff req-6ddb8abc-ee69-4851-9374-1d286eda0200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206a3213-326c-4128-86cb-430aad60058e", "name": "network-vif-deleted", "tag": "a95b3e1b-9df9-4fa4-be09-fcbde3830db3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:06.976074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b77997d8-969d-49f8-85a9-1a9197ad3cff req-6ddb8abc-ee69-4851-9374-1d286eda0200 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:06.976575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b77997d8-969d-49f8-85a9-1a9197ad3cff req-6ddb8abc-ee69-4851-9374-1d286eda0200 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:06.977019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b77997d8-969d-49f8-85a9-1a9197ad3cff req-6ddb8abc-ee69-4851-9374-1d286eda0200 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:06.992753 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b77997d8-969d-49f8-85a9-1a9197ad3cff req-6ddb8abc-ee69-4851-9374-1d286eda0200 service nova] Creating event network-vif-deleted:a95b3e1b-9df9-4fa4-be09-fcbde3830db3 for instance 206a3213-326c-4128-86cb-430aad60058e on nch2-master-1 Aug 06 21:47:06.997670 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b77997d8-969d-49f8-85a9-1a9197ad3cff req-6ddb8abc-ee69-4851-9374-1d286eda0200 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038072 Aug 06 21:47:06.998490 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3394/6605] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:47:07.697509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:07.698134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:07.705942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:07.706428 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:07.706896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:07.707605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:07.708066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:07.708499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:07.927494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:07.935273 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-62d6f4de-44a5-4110-905a-b23a7b0019b9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1318 microversion: 2.1 time: 0.241863 Aug 06 21:47:07.935856 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3212/6606] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:07 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:08.085618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-3135a78e-fdbf-46f1-a25f-da7f38c65c05 req-ae291b06-a0c2-409b-ab7c-b6b9d522d8fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b775ebe-a94e-4404-ae3a-3e2041caf29d", "tag": "7bde3884-017c-47e3-984e-81a878bf1a49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:08.096586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3135a78e-fdbf-46f1-a25f-da7f38c65c05 req-ae291b06-a0c2-409b-ab7c-b6b9d522d8fd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:08.097074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3135a78e-fdbf-46f1-a25f-da7f38c65c05 req-ae291b06-a0c2-409b-ab7c-b6b9d522d8fd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:08.097507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-3135a78e-fdbf-46f1-a25f-da7f38c65c05 req-ae291b06-a0c2-409b-ab7c-b6b9d522d8fd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:08.109413 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-3135a78e-fdbf-46f1-a25f-da7f38c65c05 req-ae291b06-a0c2-409b-ab7c-b6b9d522d8fd service nova] Creating event network-changed:7bde3884-017c-47e3-984e-81a878bf1a49 for instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d on nch2-master-1 Aug 06 21:47:08.114240 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-3135a78e-fdbf-46f1-a25f-da7f38c65c05 req-ae291b06-a0c2-409b-ab7c-b6b9d522d8fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033971 Aug 06 21:47:08.115081 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3395/6607] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:47:08.957815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:08.958406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:08.965468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:08.965962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:08.966415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:08.967155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:08.967625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:08.968068 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:09.097122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:09.104625 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1308c5a9-0420-488c-aa59-2cfa8fa16a71 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1318 microversion: 2.1 time: 0.151790 Aug 06 21:47:09.105203 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3213/6608] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:08 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:10.130535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:10.131296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:10.138128 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:10.138664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:10.139112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:10.139817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:10.140285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:10.140752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:10.271324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:10.278956 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fd1ab2e6-ce56-4039-82a9-ba4919cfc46c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1318 microversion: 2.1 time: 0.155937 Aug 06 21:47:10.279534 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3396/6609] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:10 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:11.299347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:11.299977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:11.307496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:11.308063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:11.308529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:11.309343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:11.309813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:11.310253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:11.442374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:11.451306 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f68afee2-2bf0-4609-81b9-0998102d88bd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1318 microversion: 2.1 time: 0.156344 Aug 06 21:47:11.451907 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3214/6610] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:11 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:12.473036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:12.473664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:12.480720 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:12.481211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:12.481658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:12.482365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:12.482868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:12.483309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:12.615398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:12.623012 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-90f93da6-f3a2-4734-b798-138290e8f32f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1318 microversion: 2.1 time: 0.153932 Aug 06 21:47:12.623580 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3397/6611] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:12 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:13.227747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7603ef72-386b-4d8f-99f5-8702a8d4c549 req-82b46f54-3c20-4cfb-9315-1d0575929687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b775ebe-a94e-4404-ae3a-3e2041caf29d", "name": "network-vif-plugged", "status": "completed", "tag": "7bde3884-017c-47e3-984e-81a878bf1a49"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:13.240621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7603ef72-386b-4d8f-99f5-8702a8d4c549 req-82b46f54-3c20-4cfb-9315-1d0575929687 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:13.241366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7603ef72-386b-4d8f-99f5-8702a8d4c549 req-82b46f54-3c20-4cfb-9315-1d0575929687 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:13.241815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7603ef72-386b-4d8f-99f5-8702a8d4c549 req-82b46f54-3c20-4cfb-9315-1d0575929687 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:13.254311 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7603ef72-386b-4d8f-99f5-8702a8d4c549 req-82b46f54-3c20-4cfb-9315-1d0575929687 service nova] Creating event network-vif-plugged:7bde3884-017c-47e3-984e-81a878bf1a49 for instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d on nch2-master-1 Aug 06 21:47:13.259465 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7603ef72-386b-4d8f-99f5-8702a8d4c549 req-82b46f54-3c20-4cfb-9315-1d0575929687 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035727 Aug 06 21:47:13.260261 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3215/6612] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:47:13.643924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:13.644462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:13.651519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:13.652003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:13.652455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:13.653136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:13.653595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:13.654023 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:13.783988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:13.791464 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-76036284-92be-423a-8691-c7f684e467fc tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1318 microversion: 2.1 time: 0.151548 Aug 06 21:47:13.792029 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3398/6613] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:13 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:14.812944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:14.814247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:14.821477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:14.821987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:14.822431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:14.823156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:14.823616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:14.824045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:14.959416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:14.967146 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55e22e45-ac7c-4192-9029-1e5360ae5483 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1509 microversion: 2.1 time: 0.158519 Aug 06 21:47:14.967727 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3216/6614] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:14 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:14.988041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:14.988658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:14.995679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:14.996167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:14.996606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:14.997300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:14.997765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:14.998195 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:15.125162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:15.133568 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4f897495-4e32-4f63-bccc-0fe8336e5069 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1509 microversion: 2.1 time: 0.150037 Aug 06 21:47:15.134134 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3399/6615] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:14 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:15.153721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:15.156174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:15.162862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:15.163353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:15.163796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:15.164500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:15.164962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:15.165396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:15.193781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:15.199617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Old instance type m1.heat2, new instance type m1.heat {{(pid=142462) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:47:15.206288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:47:15.206688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:47:15.207187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:47:15.207596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:47:15.208016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:47:15.238091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:15.270856 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9d63ff99-781e-42d5-86a4-e1d5b52662fd tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "POST /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d/action" status: 202 len: 0 microversion: 2.1 time: 0.121016 Aug 06 21:47:15.271549 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3217/6616] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:47:15 2022] POST /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:47:15.279722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:15.280378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:15.289890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:15.290761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:15.291505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:15.292890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:15.293807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:15.294855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:15.457102 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:15.464803 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0771c9ca-46df-4c50-b257-e60a823242fa tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1516 microversion: 2.1 time: 0.188980 Aug 06 21:47:15.465568 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3400/6617] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:15 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:16.483447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:16.484864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=10 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:16.490522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:16.491151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:16.498271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:16.498827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:16.499268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:16.499977 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:16.500444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:16.500915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:16.717153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:16.725216 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8cf7cdcc-c7cf-45e0-b7b2-6222c439552a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1516 microversion: 2.1 time: 0.242504 Aug 06 21:47:16.725802 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3218/6618] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:16 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1516 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:17.746927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:17.747540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:17.749504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:17.756447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:17.756937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:17.757370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:17.758063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:17.758515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:17.758966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:17.892661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:17.900188 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-08554d38-c7e5-480d-b2ad-350fa8ffefb1 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.157147 Aug 06 21:47:17.900759 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3401/6619] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:17 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:18.921382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:18.922001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:18.929066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:18.929498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:18.929941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:18.930668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:18.931127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:18.931556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:19.065444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:19.073110 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e54d8586-e8b0-40bf-8a61-58f0f6b9f5f0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.155691 Aug 06 21:47:19.073694 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3219/6620] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:18 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:20.093389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:20.093987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:20.101454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:20.101935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:20.102372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:20.103090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:20.103545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:20.103969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:20.246912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:20.255418 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-def507a8-ca3c-41b2-8851-dc20d2c5018d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.165840 Aug 06 21:47:20.256007 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3402/6621] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:20 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:21.276557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:21.277205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:21.284161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:21.284643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:21.285085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:21.285785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:21.286241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:21.286709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:21.424503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:21.432374 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a15559e-3c71-40e7-89e8-a5f671928542 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.159751 Aug 06 21:47:21.432964 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3220/6622] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:21 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:22.455319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:22.455972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:22.462874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:22.463362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:22.463806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:22.464498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:22.464956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:22.465386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:22.599575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:22.607101 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e360a0d8-c4b5-42f0-9fb3-07dbcd61b82e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.157080 Aug 06 21:47:22.607670 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3403/6623] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:22 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:23.627953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:23.628574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:23.635606 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:23.636080 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:23.636525 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:23.637224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:23.637683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:23.638117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:23.772129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:23.779836 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d05feec8-c09a-45fa-b928-14825f083ace tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.155885 Aug 06 21:47:23.780414 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3221/6624] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:23 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:24.802881 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:24.803498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:24.810210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:24.810762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:24.811178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:24.811872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:24.812334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:24.812792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:24.943042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:24.950598 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f7f36b6b-f3c6-412b-ba0c-95dc6d2cb59e tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.152873 Aug 06 21:47:24.951170 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3404/6625] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:24 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:25.972304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:25.972941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:25.979963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:25.980452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:25.980898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:25.981594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:25.982054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:25.982484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:26.118289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:26.125989 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c96ad95-2897-4f34-8ba5-2de7cecc25ea tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.157599 Aug 06 21:47:26.126589 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3222/6626] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:25 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:27.147306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:27.147927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:27.154954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:27.155441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:27.155883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:27.156573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:27.157091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:27.157632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:27.288885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:27.296403 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ca352589-719f-4656-af40-e46e3b865a1d tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.153033 Aug 06 21:47:27.296970 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3405/6627] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:27 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:47:28.318229 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:28.318914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:28.327891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:28.328392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:28.328843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:28.329715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:28.330191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:28.330664 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:28.466403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:28.474520 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1c7cf25c-4159-43f8-8f1b-23f960a7cbbe tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.160256 Aug 06 21:47:28.475125 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3223/6628] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:28 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:29.495863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:29.496481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:29.503995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:29.504484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:29.504925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:29.505620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:29.506082 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:29.506513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:29.644006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:29.651768 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7e788935-b22a-4377-ac0a-022373d820b7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.160031 Aug 06 21:47:29.652343 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3406/6629] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:29 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:30.673422 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:30.674000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:30.680967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:30.681447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:30.681892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:30.682629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:30.683115 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:30.683548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:30.819921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:30.827944 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f72b371d-4ea6-4d18-95e1-b13643245560 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.158604 Aug 06 21:47:30.828535 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3224/6630] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:30 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:31.849084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:31.849707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:31.856692 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:31.857177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:31.857617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:31.858305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:31.858797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:31.859228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:31.990020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:31.997646 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67d90fdf-a102-4c19-98ea-2d59b5fb9844 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.152707 Aug 06 21:47:31.998231 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3407/6631] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:31 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:33.018993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:33.019624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:33.026687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:33.027183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:33.027640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:33.028356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:33.028859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:33.029297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:33.164981 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:33.173312 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6a0d661-1685-440a-9215-84c5b73d1d36 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.157726 Aug 06 21:47:33.173891 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3225/6632] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:33 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:34.193505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:34.194117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:34.196828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:34.202166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:34.202927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:34.203364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:34.204679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:34.205135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:34.205563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:34.338719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:34.340974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:34.348821 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2e7ca6d8-f238-4801-a27c-5b48df1554d5 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.159128 Aug 06 21:47:34.349631 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3408/6633] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:34 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:47:35.370006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:35.370666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:35.373389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:35.378823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:35.379317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:35.379769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:35.380478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:35.380940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:35.381376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:35.513531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:35.521557 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ee12b497-376f-4aba-8fd0-7bd2266a9ae8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.155501 Aug 06 21:47:35.522146 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3226/6634] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:35 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:36.542189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:36.542835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:36.550798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:36.551280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:36.551721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:36.552414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:36.552868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:36.553292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:36.683068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:36.691680 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-823eabd7-a7c8-4212-9785-580e7e604ae9 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.153502 Aug 06 21:47:36.692266 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3409/6635] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:36 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:37.713858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:37.714481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:37.721678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:37.722160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:37.722646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:37.723350 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:37.723809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:37.724240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:37.859507 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:37.868113 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-58cea82e-b4c1-420b-a591-bb4ec6e21f50 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.158243 Aug 06 21:47:37.868698 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3227/6636] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:37 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:38.892302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:38.893036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:38.900088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:38.900574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:38.901016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:38.901708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:38.902166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:38.902632 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:39.042297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:39.051977 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-97abb4a6-644f-4463-99fd-5414634f8f57 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.164507 Aug 06 21:47:39.052554 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3410/6637] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:38 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:40.074050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:40.074702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:40.082326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:40.082850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:40.083302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:40.084009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:40.084472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:40.084907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:40.217988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:40.225846 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-932735f7-101c-4183-8715-e4f5fd6be1a8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.155722 Aug 06 21:47:40.226426 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3228/6638] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:40 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:41.246992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:41.247617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:41.254746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:41.255242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:41.255689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:41.256396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:41.256860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:41.257297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:41.386520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:41.394064 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a03e4647-d364-4913-9680-03a333a48b08 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.151130 Aug 06 21:47:41.394677 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3411/6639] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:41 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:47:42.415631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:42.416257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:42.423820 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:42.424413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:42.424860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:42.425560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:42.426017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:42.426447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:42.556371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:42.564759 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4475396e-4a3c-40e2-a18e-9ba26768cf06 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.153159 Aug 06 21:47:42.565338 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3229/6640] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:42 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:43.585924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:43.586565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:43.593468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:43.593957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:43.594399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:43.595131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:43.595914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:43.596536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:43.733133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:43.741879 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e04f83a8-ba65-4bfe-891a-6face8b55307 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1521 microversion: 2.1 time: 0.159826 Aug 06 21:47:43.742579 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3412/6641] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:43 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:44.256391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-6948c6bb-0425-4c54-a3f5-1aadbb424ee9 req-c26e60c4-6e59-44e0-8723-007d0767fe35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b775ebe-a94e-4404-ae3a-3e2041caf29d", "name": "network-vif-unplugged", "status": "completed", "tag": "7bde3884-017c-47e3-984e-81a878bf1a49"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:44.267091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6948c6bb-0425-4c54-a3f5-1aadbb424ee9 req-c26e60c4-6e59-44e0-8723-007d0767fe35 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:44.267954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6948c6bb-0425-4c54-a3f5-1aadbb424ee9 req-c26e60c4-6e59-44e0-8723-007d0767fe35 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:44.268658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6948c6bb-0425-4c54-a3f5-1aadbb424ee9 req-c26e60c4-6e59-44e0-8723-007d0767fe35 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:44.282523 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-6948c6bb-0425-4c54-a3f5-1aadbb424ee9 req-c26e60c4-6e59-44e0-8723-007d0767fe35 service nova] Creating event network-vif-unplugged:7bde3884-017c-47e3-984e-81a878bf1a49 for instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d on nch1-master-1 Aug 06 21:47:44.288860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-6948c6bb-0425-4c54-a3f5-1aadbb424ee9 req-c26e60c4-6e59-44e0-8723-007d0767fe35 service nova] Instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:47:44.300944 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-6948c6bb-0425-4c54-a3f5-1aadbb424ee9 req-c26e60c4-6e59-44e0-8723-007d0767fe35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048091 Aug 06 21:47:44.301574 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3230/6642] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:47:44.762815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:44.763440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:44.771524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:44.772021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:44.772435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:44.773133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:44.773591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:44.774055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:44.914558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:44.922409 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-802df940-f71b-42eb-86d1-63a896b1ec93 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1520 microversion: 2.1 time: 0.163498 Aug 06 21:47:44.923029 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3413/6643] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:44 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:45.946041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:45.946803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:45.953359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:45.953857 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:45.954370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:45.955713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:45.956183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:45.956626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:45.959489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:47:46.096211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:46.103987 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-525efeb4-d511-4233-9c96-8062000afbd0 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1518 microversion: 2.1 time: 0.163331 Aug 06 21:47:46.104561 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3231/6644] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:45 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:46.316870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-543c9165-509d-4e66-9985-8c90ed7f790c req-9999e85e-06b3-4434-a3b0-59cbf025233d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b775ebe-a94e-4404-ae3a-3e2041caf29d", "tag": "7bde3884-017c-47e3-984e-81a878bf1a49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:46.327075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-543c9165-509d-4e66-9985-8c90ed7f790c req-9999e85e-06b3-4434-a3b0-59cbf025233d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:46.327813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-543c9165-509d-4e66-9985-8c90ed7f790c req-9999e85e-06b3-4434-a3b0-59cbf025233d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:46.328255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-543c9165-509d-4e66-9985-8c90ed7f790c req-9999e85e-06b3-4434-a3b0-59cbf025233d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:46.339982 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-543c9165-509d-4e66-9985-8c90ed7f790c req-9999e85e-06b3-4434-a3b0-59cbf025233d service nova] Creating event network-changed:7bde3884-017c-47e3-984e-81a878bf1a49 for instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d on nch1-master-1 Aug 06 21:47:46.346047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-543c9165-509d-4e66-9985-8c90ed7f790c req-9999e85e-06b3-4434-a3b0-59cbf025233d service nova] Instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:47:46.356813 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-543c9165-509d-4e66-9985-8c90ed7f790c req-9999e85e-06b3-4434-a3b0-59cbf025233d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044277 Aug 06 21:47:46.357603 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3414/6645] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:47:47.125477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:47.126110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:47.134268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:47.134788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:47.135237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:47.135943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:47.136400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:47.137392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:47.430596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:47.438316 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f357bd36-6728-4d10-9b1c-37e7388bf42c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1515 microversion: 2.1 time: 0.316818 Aug 06 21:47:47.438949 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3232/6646] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:47 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1515 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:47.460754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b330e872-6b78-427a-a21b-698163b936b8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:47.461408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b330e872-6b78-427a-a21b-698163b936b8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:47.467544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b330e872-6b78-427a-a21b-698163b936b8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:47.468029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b330e872-6b78-427a-a21b-698163b936b8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:47.468466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b330e872-6b78-427a-a21b-698163b936b8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:47.469160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b330e872-6b78-427a-a21b-698163b936b8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:47.469610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b330e872-6b78-427a-a21b-698163b936b8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:47.470031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b330e872-6b78-427a-a21b-698163b936b8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:47.528115 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b330e872-6b78-427a-a21b-698163b936b8 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "POST /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d/action" status: 204 len: 0 microversion: 2.1 time: 0.072879 Aug 06 21:47:47.528821 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3415/6647] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:47:47 2022] POST /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:47:47.538426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:47.539101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:47.546405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:47.546932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:47.547383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:47.548296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:47.548995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:47.549496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:47.803133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:47.810835 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d41fab78-2868-4de9-b50d-c36eb2534ac2 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1515 microversion: 2.1 time: 0.277814 Aug 06 21:47:47.811425 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3233/6648] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:47 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:48.834490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:48.835237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:48.842163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:48.842994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:48.843505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:48.844649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:48.845153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:48.845754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:48.981689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:48.989777 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8b0588d5-3fe0-48a0-96cd-c48bfdbf744b tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1507 microversion: 2.1 time: 0.160886 Aug 06 21:47:48.990348 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3416/6649] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:48 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:49.010046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:49.010722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:49.018272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.018826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.019285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.020012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.020467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.020908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.154302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:49.162305 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f50bfde8-3452-440e-af8f-5c010141fa70 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1507 microversion: 2.1 time: 0.156210 Aug 06 21:47:49.163030 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3234/6650] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:49 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:49.183076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:49.183689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:49.190359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.190884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.191426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.192118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.192570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.192993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.328602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:49.336410 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-800bfc9f-7eed-4687-99f3-365a4d4faa7c tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1507 microversion: 2.1 time: 0.157450 Aug 06 21:47:49.336975 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3417/6651] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:49 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:49.357269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:49.357706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:49.364367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.364853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.365297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.365999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.366463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.366953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.392072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:47:49.466203 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2c47181d-9b7d-4448-8600-b7679ec529ab tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 204 len: 0 microversion: 2.1 time: 0.112962 Aug 06 21:47:49.466876 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3235/6652] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:47:49 2022] DELETE /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:47:49.480109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:49.480625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:49.487956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.488456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.488882 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.489591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.490039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.490464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.515537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:47:49.563712 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.compute.api [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Instance is already in deleting state, ignoring this request Aug 06 21:47:49.564565 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80ca49c6-5cd6-4ed9-951e-66a48562c724 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 204 len: 0 microversion: 2.1 time: 0.088379 Aug 06 21:47:49.565130 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3418/6653] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:47:49 2022] DELETE /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:47:49.573921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:49.574684 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:49.581206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.581704 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.582162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.582924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:49.583394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:49.583837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:49.723935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:49.731766 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d926fea-5157-4b59-9615-ccbe9f94b10a tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1513 microversion: 2.1 time: 0.162071 Aug 06 21:47:49.732350 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3236/6654] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:49 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:47:50.311677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-7bb41986-b637-4d27-b821-d64b311fe700 req-eec1500c-dce5-4e9c-bb87-902bbdbff4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b775ebe-a94e-4404-ae3a-3e2041caf29d", "name": "network-vif-plugged", "status": "completed", "tag": "7bde3884-017c-47e3-984e-81a878bf1a49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:50.323339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7bb41986-b637-4d27-b821-d64b311fe700 req-eec1500c-dce5-4e9c-bb87-902bbdbff4ff service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:50.323829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7bb41986-b637-4d27-b821-d64b311fe700 req-eec1500c-dce5-4e9c-bb87-902bbdbff4ff service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:50.324342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-7bb41986-b637-4d27-b821-d64b311fe700 req-eec1500c-dce5-4e9c-bb87-902bbdbff4ff service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:50.337474 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-7bb41986-b637-4d27-b821-d64b311fe700 req-eec1500c-dce5-4e9c-bb87-902bbdbff4ff service nova] Creating event network-vif-plugged:7bde3884-017c-47e3-984e-81a878bf1a49 for instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d on nch1-master-1 Aug 06 21:47:50.342332 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-7bb41986-b637-4d27-b821-d64b311fe700 req-eec1500c-dce5-4e9c-bb87-902bbdbff4ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Aug 06 21:47:50.343148 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3419/6655] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:47:50.753460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:50.754087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:50.761394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:50.761891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:50.762348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:50.763104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:50.763567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:50.764006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:51.013921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82eb6abeb4a549499466ea0425b60f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f27f640dfae44bd939f5b63372929a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:47:51.022119 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb23d80e-955f-4649-a7d7-bcc80ccde7de tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 200 len: 1513 microversion: 2.1 time: 0.273561 Aug 06 21:47:51.022833 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3237/6656] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:50 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:47:51.296454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c6519b0d-757f-4d1e-b327-71a1fa960bfd req-5e375b90-9d67-4cab-a09d-06d0d1c4a60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b775ebe-a94e-4404-ae3a-3e2041caf29d", "name": "network-vif-deleted", "tag": "7bde3884-017c-47e3-984e-81a878bf1a49"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:47:51.310627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c6519b0d-757f-4d1e-b327-71a1fa960bfd req-5e375b90-9d67-4cab-a09d-06d0d1c4a60f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:51.311112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c6519b0d-757f-4d1e-b327-71a1fa960bfd req-5e375b90-9d67-4cab-a09d-06d0d1c4a60f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:51.311540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c6519b0d-757f-4d1e-b327-71a1fa960bfd req-5e375b90-9d67-4cab-a09d-06d0d1c4a60f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:51.330745 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c6519b0d-757f-4d1e-b327-71a1fa960bfd req-5e375b90-9d67-4cab-a09d-06d0d1c4a60f service nova] Creating event network-vif-deleted:7bde3884-017c-47e3-984e-81a878bf1a49 for instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d on nch1-master-1 Aug 06 21:47:51.338222 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c6519b0d-757f-4d1e-b327-71a1fa960bfd req-5e375b90-9d67-4cab-a09d-06d0d1c4a60f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046373 Aug 06 21:47:51.339251 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3420/6657] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:47:52.043194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:52.043923 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 8b775ebe-a94e-4404-ae3a-3e2041caf29d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:52.052022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:52.052535 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:52.052967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:52.053681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:52.054140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:52.054667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:52.069678 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] HTTP exception thrown: Instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d could not be found. Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Request method failure captured: Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d HTTP/1.1 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uEqp-uC5mGd07pX1AUTnCiKTns4ttxNBeK-pn11pUeRnFjIIkEZkRh_7zAeEJPiJYxoKmiimdH13sY3TSSgnxgTWPUBQbqhqSifJeovCxNmwX62o1n1CJ2JcfjvVyQ9Gzb1O7TX34vQHHBZTKFlqwG9Vl5vE7RkNf0-yACHJPd4tgU Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1f27f640dfae44bd939f5b63372929a1 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerDiskConfigTestJSON-341424826 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f27f640dfae44bd939f5b63372929a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f27f640dfae44bd939f5b63372929a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f27f640dfae44bd939f5b63372929a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f27f640dfae44bd939f5b63372929a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerDiskConfigTestJSON-341424826 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1f27f640dfae44bd939f5b63372929a1 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-341424826 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerDiskConfigTestJSON-341424826-project Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 82eb6abeb4a549499466ea0425b60f86 Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerDiskConfigTestJSON-341424826-project Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d could not be found. Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '8b775ebe-a94e-4404-ae3a-3e2041caf29d'} Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d could not be found. Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d could not be found. Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:47:52.071554 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d could not be found. Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Returning 404 to user: Instance 8b775ebe-a94e-4404-ae3a-3e2041caf29d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-097d9354-875e-49cc-9ec8-d7a34f9e370f tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d" status: 404 len: 111 microversion: 2.1 time: 0.033916 Aug 06 21:47:52.076552 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3238/6658] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:52 2022] GET /compute/v2.1/servers/8b775ebe-a94e-4404-ae3a-3e2041caf29d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:47:52.083124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e2418661-70a9-4ecc-81e9-91aed827ee33 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '.version_select at 0x7f729d68cee0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:52.088812 ncdv-master-1 devstack@n-api.service[142461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e2418661-70a9-4ecc-81e9-91aed827ee33 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [c4d64f3f-2c08-4a87-8b71-e45e80e24cdd] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 21:47:53.096828 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [None req-e2418661-70a9-4ecc-81e9-91aed827ee33 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [c4d64f3f-2c08-4a87-8b71-e45e80e24cdd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 41162. Aug 06 21:47:53.119990 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e2418661-70a9-4ecc-81e9-91aed827ee33 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990362959" status: 202 len: 0 microversion: 2.1 time: 1.041022 Aug 06 21:47:53.120575 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3421/6659] 10.222.0.33 () {58 vars in 1221 bytes} [Sat Aug 6 21:47:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990362959 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:47:53.729119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:53.729636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:53.737120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:53.737611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:53.738057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:53.738793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:53.739266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:53.739702 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:53.754054 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] HTTP exception thrown: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Request method failure captured: Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e HTTP/1.1 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uEqp-uC5mGd07pX1AUTnCiKTns4ttxNBeK-pn11pUeRnFjIIkEZkRh_7zAeEJPiJYxoKmiimdH13sY3TSSgnxgTWPUBQbqhqSifJeovCxNmwX62o1n1CJ2JcfjvVyQ9Gzb1O7TX34vQHHBZTKFlqwG9Vl5vE7RkNf0-yACHJPd4tgU Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1f27f640dfae44bd939f5b63372929a1 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerDiskConfigTestJSON-341424826 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f27f640dfae44bd939f5b63372929a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f27f640dfae44bd939f5b63372929a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f27f640dfae44bd939f5b63372929a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f27f640dfae44bd939f5b63372929a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerDiskConfigTestJSON-341424826 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1f27f640dfae44bd939f5b63372929a1 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-341424826 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerDiskConfigTestJSON-341424826-project Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 82eb6abeb4a549499466ea0425b60f86 Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerDiskConfigTestJSON-341424826-project Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '206a3213-326c-4128-86cb-430aad60058e'} Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:47:53.755641 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Returning 404 to user: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-73d7509a-82ba-45bf-b400-450cafd59ef7 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "DELETE /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 404 len: 111 microversion: 2.1 time: 0.031961 Aug 06 21:47:53.759896 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3239/6660] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:47:53 2022] DELETE /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:47:53.767419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:47:53.768441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] [instance: 206a3213-326c-4128-86cb-430aad60058e] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:47:53.774714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:53.775205 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:53.775706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:53.776408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:47:53.776870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:47:53.777300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:47:53.791553 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] HTTP exception thrown: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Request method failure captured: Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e HTTP/1.1 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uEqp-uC5mGd07pX1AUTnCiKTns4ttxNBeK-pn11pUeRnFjIIkEZkRh_7zAeEJPiJYxoKmiimdH13sY3TSSgnxgTWPUBQbqhqSifJeovCxNmwX62o1n1CJ2JcfjvVyQ9Gzb1O7TX34vQHHBZTKFlqwG9Vl5vE7RkNf0-yACHJPd4tgU Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 1f27f640dfae44bd939f5b63372929a1 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerDiskConfigTestJSON-341424826 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1f27f640dfae44bd939f5b63372929a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1f27f640dfae44bd939f5b63372929a1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f27f640dfae44bd939f5b63372929a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1f27f640dfae44bd939f5b63372929a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerDiskConfigTestJSON-341424826 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 1f27f640dfae44bd939f5b63372929a1 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-341424826 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerDiskConfigTestJSON-341424826-project Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 82eb6abeb4a549499466ea0425b60f86 Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerDiskConfigTestJSON-341424826-project Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '206a3213-326c-4128-86cb-430aad60058e'} Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:47:53.793190 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] Returning 404 to user: Instance 206a3213-326c-4128-86cb-430aad60058e could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2705041-efc5-4139-b550-8b15b7bc2665 tempest-ServerDiskConfigTestJSON-341424826 tempest-ServerDiskConfigTestJSON-341424826-project] 10.222.0.33 "GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e" status: 404 len: 111 microversion: 2.1 time: 0.032833 Aug 06 21:47:53.797648 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3422/6661] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:47:53 2022] GET /compute/v2.1/servers/206a3213-326c-4128-86cb-430aad60058e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 21:48:02.084738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1133d9cb-1cb9-477b-be77-35100bcc81b7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'create', calling method: .version_select at 0x7f729c70b820>, body: {"keypair": {"name": "tempest-keypair-478934283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfaf1G0Xd+27GlxAZ/L7fwTW5iOqUdOYy6ezgeDhM2Q7nGH90OgLYnYQXbq8Ncgu4C5FpGt09iThpGNwYn+3w6EKteFD4O/cRVaupT1USKbKPEcZHxvwB5k6bKWbMyzAQ=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:48:02.101214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-1133d9cb-1cb9-477b-be77-35100bcc81b7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:48:02.106597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-1133d9cb-1cb9-477b-be77-35100bcc81b7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for user 7e3cdb291b6146bb8d30f96ed07f1a46 and project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:48:02.138513 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1133d9cb-1cb9-477b-be77-35100bcc81b7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.175338 Aug 06 21:48:02.139509 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3240/6662] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:48:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:48:03.510710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-649133985", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f7fb0e6-e9c5-4229-9db8-bc1390556ef6"}], "security_groups": [{"name": "tempest-securitygroup--719424010"}], "key_name": "tempest-keypair-478934283", "user_data": "}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:48:03.616879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] validate_networks() for [('6f7fb0e6-e9c5-4229-9db8-bc1390556ef6', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:48:03.781912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:04.057618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:48:04.058052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:48:04.058772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:48:04.059194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:48:04.059797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:48:04.069997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:04.070487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:04.071061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:04.071866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:04.072327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:04.072785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:04.090721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:48:04.096268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for user 7e3cdb291b6146bb8d30f96ed07f1a46 and project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:48:04.108687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:48:04.111051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:48:04.156912 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42332053-c146-4381-916f-5eafd7e3c9db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.650557 Aug 06 21:48:04.157592 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3423/6663] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:48:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:48:04.166342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:04.170864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-109be499-ca18-4dc5-bd6e-9eaa82aa77fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:04.171787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-109be499-ca18-4dc5-bd6e-9eaa82aa77fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:04.233869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-109be499-ca18-4dc5-bd6e-9eaa82aa77fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:04.241614 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-109be499-ca18-4dc5-bd6e-9eaa82aa77fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1237 microversion: 2.1 time: 0.076843 Aug 06 21:48:04.242210 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3241/6664] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:04 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:05.263999 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:05.264681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:05.268443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:05.275964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:05.276480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:05.276910 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:05.277902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:05.278579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:05.279500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:05.385641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:05.396508 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3810171b-02b1-451e-979f-fae0a3266833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1297 microversion: 2.1 time: 0.136786 Aug 06 21:48:05.397432 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3424/6665] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:05 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1297 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:06.417351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:06.417990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:06.426368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:06.431659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:06.432222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:06.432876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:06.433620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:06.434096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:06.434562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:06.754338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:06.762230 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6407d551-099d-4c8e-8397-e41a14a9b7d0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1362 microversion: 2.1 time: 0.348753 Aug 06 21:48:06.762855 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3242/6666] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:06 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:07.086712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f0e3f2de-8d09-46c3-9cdc-3cb2ebefa01f req-4926c0ad-87f8-4e6c-9ccc-cedb99a64bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca718ce-7050-465b-87aa-fc22f7f9ba4d", "tag": "a829e1de-98c6-4678-9b74-b78544533576"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:48:07.098994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f0e3f2de-8d09-46c3-9cdc-3cb2ebefa01f req-4926c0ad-87f8-4e6c-9ccc-cedb99a64bb9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:07.099646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f0e3f2de-8d09-46c3-9cdc-3cb2ebefa01f req-4926c0ad-87f8-4e6c-9ccc-cedb99a64bb9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:07.100186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f0e3f2de-8d09-46c3-9cdc-3cb2ebefa01f req-4926c0ad-87f8-4e6c-9ccc-cedb99a64bb9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:07.112188 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f0e3f2de-8d09-46c3-9cdc-3cb2ebefa01f req-4926c0ad-87f8-4e6c-9ccc-cedb99a64bb9 service nova] Creating event network-changed:a829e1de-98c6-4678-9b74-b78544533576 for instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d on nch1-master-1 Aug 06 21:48:07.117310 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f0e3f2de-8d09-46c3-9cdc-3cb2ebefa01f req-4926c0ad-87f8-4e6c-9ccc-cedb99a64bb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034756 Aug 06 21:48:07.118004 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3425/6667] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:48:07.783577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:07.784201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:07.791427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:07.791953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:07.792398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:07.793106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:07.793570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:07.794011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:07.928165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:07.935779 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c9c5732e-5611-4507-9153-d94801ace4a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1362 microversion: 2.1 time: 0.156829 Aug 06 21:48:07.936355 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3243/6668] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:07 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:08.957787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:08.958520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:08.964760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:08.965244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:08.965683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:08.966370 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:08.966854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:08.967283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:09.104834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:09.113476 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6fca6961-571d-4c7e-b46b-7180c6e0b852 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1362 microversion: 2.1 time: 0.161072 Aug 06 21:48:09.114051 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3426/6669] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:08 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:10.133868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:10.134486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:10.141475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:10.141966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:10.142506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:10.143232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:10.143694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:10.144127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:10.283150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:10.291368 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aa295ad8-1ce5-45b7-be16-16303a137d1f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1362 microversion: 2.1 time: 0.161419 Aug 06 21:48:10.292006 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3244/6670] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:10 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:11.311477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:11.312049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:11.319042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:11.319527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:11.319972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:11.320667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:11.321126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:11.321553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:11.452500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:11.461316 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6c923672-b854-4212-832f-5ef08a43498f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1362 microversion: 2.1 time: 0.153884 Aug 06 21:48:11.461901 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3427/6671] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:11 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:12.472236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-725747a2-d949-4b4f-82aa-afe9c39d3054 req-85934800-31ac-4666-9442-b40e7b437089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca718ce-7050-465b-87aa-fc22f7f9ba4d", "name": "network-vif-plugged", "status": "completed", "tag": "a829e1de-98c6-4678-9b74-b78544533576"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:48:12.481912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-725747a2-d949-4b4f-82aa-afe9c39d3054 req-85934800-31ac-4666-9442-b40e7b437089 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:12.482456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-725747a2-d949-4b4f-82aa-afe9c39d3054 req-85934800-31ac-4666-9442-b40e7b437089 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:12.482599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:12.483008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-725747a2-d949-4b4f-82aa-afe9c39d3054 req-85934800-31ac-4666-9442-b40e7b437089 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:12.483114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:12.491980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:12.492481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:12.492957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:12.493675 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:12.494138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:12.494590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:12.495702 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-725747a2-d949-4b4f-82aa-afe9c39d3054 req-85934800-31ac-4666-9442-b40e7b437089 service nova] Creating event network-vif-plugged:a829e1de-98c6-4678-9b74-b78544533576 for instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d on nch1-master-1 Aug 06 21:48:12.500718 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-725747a2-d949-4b4f-82aa-afe9c39d3054 req-85934800-31ac-4666-9442-b40e7b437089 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098491 Aug 06 21:48:12.501401 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3245/6672] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:48:12.634708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:12.643772 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-da75da31-085f-430a-8914-20e260b07813 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1362 microversion: 2.1 time: 0.165498 Aug 06 21:48:12.644375 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3428/6673] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:12 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:13.666043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:13.666945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:13.674826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:13.675458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:13.675803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:13.676966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:13.677056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:13.677469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:13.813250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:13.821671 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d3210a7-91b5-4059-bba3-47b440cf9889 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1362 microversion: 2.1 time: 0.160940 Aug 06 21:48:13.822259 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3246/6674] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:13 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:14.842773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:14.843368 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:14.846272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:14.846985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:14.853282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:14.853783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:14.854229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:14.855209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:14.855743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:14.856209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:14.990518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:14.999209 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bdb802cf-f577-49c4-a984-b7852c10ea8b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1548 microversion: 2.1 time: 0.160399 Aug 06 21:48:14.999784 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3429/6675] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:14 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:15.020070 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f7570cd8-fc40-4e11-8161-a4a2e0774189 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:15.020616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f7570cd8-fc40-4e11-8161-a4a2e0774189 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:15.022574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:15.028916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7570cd8-fc40-4e11-8161-a4a2e0774189 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:15.029406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7570cd8-fc40-4e11-8161-a4a2e0774189 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:15.029853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7570cd8-fc40-4e11-8161-a4a2e0774189 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:15.030576 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7570cd8-fc40-4e11-8161-a4a2e0774189 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:15.031042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7570cd8-fc40-4e11-8161-a4a2e0774189 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:15.031473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f7570cd8-fc40-4e11-8161-a4a2e0774189 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:15.141149 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f7570cd8-fc40-4e11-8161-a4a2e0774189 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125024 Aug 06 21:48:15.142123 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3247/6676] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:48:15 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:48:16.091369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-1e778141-ff30-4e3a-a033-58bb9dffbe34 req-992f602c-09c5-40de-b48a-cb8f819324cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca718ce-7050-465b-87aa-fc22f7f9ba4d", "tag": "a829e1de-98c6-4678-9b74-b78544533576"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:48:16.102280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1e778141-ff30-4e3a-a033-58bb9dffbe34 req-992f602c-09c5-40de-b48a-cb8f819324cf service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:16.102799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1e778141-ff30-4e3a-a033-58bb9dffbe34 req-992f602c-09c5-40de-b48a-cb8f819324cf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:16.103243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-1e778141-ff30-4e3a-a033-58bb9dffbe34 req-992f602c-09c5-40de-b48a-cb8f819324cf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:16.115040 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-1e778141-ff30-4e3a-a033-58bb9dffbe34 req-992f602c-09c5-40de-b48a-cb8f819324cf service nova] Creating event network-changed:a829e1de-98c6-4678-9b74-b78544533576 for instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d on nch1-master-1 Aug 06 21:48:16.120066 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-1e778141-ff30-4e3a-a033-58bb9dffbe34 req-992f602c-09c5-40de-b48a-cb8f819324cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032325 Aug 06 21:48:16.121014 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3430/6677] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:48:50.172747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=11 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:50.173568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=30 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:50.178094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:50.178744 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:50.185518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.186007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.186455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.187185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.188237 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.188831 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.322614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:50.331062 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c6466ef-1b70-421c-9b7e-1bbde71817a5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1667 microversion: 2.1 time: 0.160786 Aug 06 21:48:50.331640 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3248/6678] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:50 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:50.349163 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=13 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:50.349940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=36 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:48:50.354040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:50.354779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:50.362074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.362586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.363035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.363724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.364183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.364609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.496447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:50.504114 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b21a136-65ee-4779-a7ea-7c835ae79814 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1667 microversion: 2.1 time: 0.156992 Aug 06 21:48:50.504688 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3431/6679] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:50 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:50.524084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:50.524705 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:50.530980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.532243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.532855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.533554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.534015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.534446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.670426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:50.679635 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b5a7ef95-c523-404d-be01-c440f9cd4a19 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1667 microversion: 2.1 time: 0.159360 Aug 06 21:48:50.680348 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3249/6680] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:50 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:50.700358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:48:50.702524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:50.709153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.709635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.710075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.710802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.711260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.711687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.740549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:50.746359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Old instance type m1.heat2, new instance type m1.heat {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:48:50.753747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:48:50.754175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:48:50.754690 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:48:50.755106 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:48:50.755526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:48:50.819346 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2ec76e12-2f97-4ca8-a88b-737438d95f5e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d/action" status: 202 len: 0 microversion: 2.1 time: 0.122966 Aug 06 21:48:50.820023 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3432/6681] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:48:50 2022] POST /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:48:50.828266 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:50.829156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:50.835216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.835707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.836172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.836882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:50.837346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:50.837779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:50.975687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:50.983614 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-64bcec73-a323-45f6-8067-48d51dea4102 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1676 microversion: 2.1 time: 0.159240 Aug 06 21:48:50.984200 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3250/6682] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:50 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:52.005233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:52.005851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:52.012743 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:52.013227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:52.013664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:52.014354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:52.014835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:52.015258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:52.153377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:52.161920 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3338139b-8ce3-4931-a007-cc1c4310ec14 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1676 microversion: 2.1 time: 0.160599 Aug 06 21:48:52.162508 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3433/6683] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:52 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:53.183604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:53.184227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:53.191194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:53.191680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:53.192125 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:53.192816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:53.193271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:53.193701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:53.325020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:53.333034 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2fd33b75-2cf6-4a91-9651-69401ce144be tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.153376 Aug 06 21:48:53.333630 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3251/6684] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:53 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:54.354494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:54.355134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:54.362332 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:54.362845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:54.363286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:54.363976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:54.364438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:54.364865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:54.498011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:54.506233 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-595af2ce-0839-4cc0-bfcc-cd488911468c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.155784 Aug 06 21:48:54.506840 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3434/6685] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:54 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:55.527205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:55.527798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:55.535342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:55.535827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:55.536271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:55.536965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:55.537426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:55.537859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:55.740289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:55.747863 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8f5ba1c8-61b1-45d8-b922-499f19a45fc8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.224537 Aug 06 21:48:55.748440 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3252/6686] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:55 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:56.770794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:56.771447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:56.778372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:56.778888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:56.779331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:56.780035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:56.780486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:56.780915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:56.913208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:56.920859 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-123c89d5-d88b-4e9a-b882-0d2aaeef5e12 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.154328 Aug 06 21:48:56.921425 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3435/6687] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:56 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:57.942194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:57.942770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:57.949686 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:57.950172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:57.950635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:57.951333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:57.951792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:57.952228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:58.084326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:58.091991 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1968cdc4-7fbf-468d-b148-9a087ea9ce5c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.154145 Aug 06 21:48:58.092581 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3253/6688] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:57 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:48:59.114364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:48:59.115001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:48:59.121903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:59.122384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:59.122841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:59.123531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:48:59.123984 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:48:59.124403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:48:59.309049 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:48:59.317011 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b5f0804a-0cf2-48de-8f39-8643989f9f50 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.206500 Aug 06 21:48:59.317591 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3436/6689] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:48:59 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:00.338469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:00.339136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:00.346419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:00.346948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:00.347401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:00.348113 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:00.348582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:00.349022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:00.483627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:00.491883 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-58129ebe-df8f-4506-9616-c672ec19ed5d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.157404 Aug 06 21:49:00.492464 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3254/6690] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:00 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:01.513414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:01.514020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:01.521263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:01.521744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:01.522179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:01.522895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:01.523467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:01.523898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:01.660734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:01.668515 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ec1293f4-7b0b-47fd-b17c-4ae0258a01c4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.159095 Aug 06 21:49:01.669281 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3437/6691] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:01 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:02.692814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:02.693473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:02.700543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:02.701045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:02.701494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:02.702209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:02.702711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:02.703166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:02.832354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:02.839942 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-39427d95-4128-41e2-be42-9dcf9814b674 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.151166 Aug 06 21:49:02.840525 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3255/6692] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:02 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:03.862710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:03.863328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:03.870238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:03.870756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:03.871200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:03.871893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:03.872369 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:03.872786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:04.001171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:04.008718 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba3c0208-3768-4c14-8a98-dab0342893d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1681 microversion: 2.1 time: 0.150732 Aug 06 21:49:04.009288 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3438/6693] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:03 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:05.031194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:05.032193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:05.039259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:05.039758 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:05.040207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:05.040921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:05.041388 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:05.041825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:05.180722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-759b9cfc-7da8-41a6-b348-96900c65ba2c req-e085a4ad-6d43-48c6-8ba1-4270e359f9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca718ce-7050-465b-87aa-fc22f7f9ba4d", "name": "network-vif-unplugged", "status": "completed", "tag": "a829e1de-98c6-4678-9b74-b78544533576"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:05.191144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-759b9cfc-7da8-41a6-b348-96900c65ba2c req-e085a4ad-6d43-48c6-8ba1-4270e359f9f7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:05.191624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-759b9cfc-7da8-41a6-b348-96900c65ba2c req-e085a4ad-6d43-48c6-8ba1-4270e359f9f7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:05.192084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-759b9cfc-7da8-41a6-b348-96900c65ba2c req-e085a4ad-6d43-48c6-8ba1-4270e359f9f7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:05.204312 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-759b9cfc-7da8-41a6-b348-96900c65ba2c req-e085a4ad-6d43-48c6-8ba1-4270e359f9f7 service nova] Creating event network-vif-unplugged:a829e1de-98c6-4678-9b74-b78544533576 for instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d on nch2-master-1 Aug 06 21:49:05.211292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-759b9cfc-7da8-41a6-b348-96900c65ba2c req-e085a4ad-6d43-48c6-8ba1-4270e359f9f7 service nova] Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:49:05.223701 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-759b9cfc-7da8-41a6-b348-96900c65ba2c req-e085a4ad-6d43-48c6-8ba1-4270e359f9f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046898 Aug 06 21:49:05.224317 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3439/6694] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:49:05.296257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:05.304706 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-aad8f5c9-94a3-4787-a7e1-0033ef040e1a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1680 microversion: 2.1 time: 0.277722 Aug 06 21:49:05.305301 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3256/6695] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:05 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1680 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:06.327193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:06.328428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:06.335780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:06.336263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:06.336703 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:06.337440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:06.337846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:06.338269 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:06.475662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:06.483178 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2207cbb-cbad-425d-8461-01fd07c12272 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1678 microversion: 2.1 time: 0.160642 Aug 06 21:49:06.483775 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3440/6696] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:06 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:07.256346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-42561b22-b59b-4295-af0e-898eea2a02bf req-3566a370-73c5-46d7-b43a-51c793817b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca718ce-7050-465b-87aa-fc22f7f9ba4d", "tag": "a829e1de-98c6-4678-9b74-b78544533576"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:07.266975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-42561b22-b59b-4295-af0e-898eea2a02bf req-3566a370-73c5-46d7-b43a-51c793817b9d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:07.267459 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-42561b22-b59b-4295-af0e-898eea2a02bf req-3566a370-73c5-46d7-b43a-51c793817b9d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:07.267892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-42561b22-b59b-4295-af0e-898eea2a02bf req-3566a370-73c5-46d7-b43a-51c793817b9d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:07.279623 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-42561b22-b59b-4295-af0e-898eea2a02bf req-3566a370-73c5-46d7-b43a-51c793817b9d service nova] Creating event network-changed:a829e1de-98c6-4678-9b74-b78544533576 for instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d on nch2-master-1 Aug 06 21:49:07.285073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-42561b22-b59b-4295-af0e-898eea2a02bf req-3566a370-73c5-46d7-b43a-51c793817b9d service nova] Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:49:07.296252 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-42561b22-b59b-4295-af0e-898eea2a02bf req-3566a370-73c5-46d7-b43a-51c793817b9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043818 Aug 06 21:49:07.297763 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3257/6697] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:49:07.504749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:07.505292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:07.512132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:07.512621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:07.513058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:07.513756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:07.514210 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:07.514671 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:07.672724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:07.679855 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6b00c472-a638-4164-8543-bfaa2f0995c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1678 microversion: 2.1 time: 0.179317 Aug 06 21:49:07.680559 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3441/6698] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:07 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:08.701613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:08.702335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:08.709668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:08.710163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:08.710651 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:08.711375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:08.711846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:08.712289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:08.845862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:08.853479 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b4059a3-9684-4a2e-95cf-a5bee0a0f2c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1675 microversion: 2.1 time: 0.156359 Aug 06 21:49:08.854065 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3258/6699] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:08 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:08.874107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9ac0d86c-60ae-4054-9f01-5c4f1261130e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:08.874717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9ac0d86c-60ae-4054-9f01-5c4f1261130e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:08.882037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ac0d86c-60ae-4054-9f01-5c4f1261130e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:08.882611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ac0d86c-60ae-4054-9f01-5c4f1261130e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:08.883172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ac0d86c-60ae-4054-9f01-5c4f1261130e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:08.883905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ac0d86c-60ae-4054-9f01-5c4f1261130e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:08.884449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ac0d86c-60ae-4054-9f01-5c4f1261130e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:08.885043 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9ac0d86c-60ae-4054-9f01-5c4f1261130e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:08.944395 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9ac0d86c-60ae-4054-9f01-5c4f1261130e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d/action" status: 204 len: 0 microversion: 2.1 time: 0.073943 Aug 06 21:49:08.944949 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3442/6700] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:49:08 2022] POST /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:49:08.953040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:08.954021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:08.960203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:08.960693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:08.961133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:08.961836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:08.962533 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:08.963047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:09.185117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:09.193026 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-106229a1-d647-461b-aab7-bc1a840ababc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1675 microversion: 2.1 time: 0.243808 Aug 06 21:49:09.193624 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3259/6701] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:08 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:10.215572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:10.216278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:10.223454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.223546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.223958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.224673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.225131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.225716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.360783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:10.368360 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ba5fd6ee-e9c1-40e5-8ee9-7ca5ab25a79f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1667 microversion: 2.1 time: 0.157981 Aug 06 21:49:10.368930 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3443/6702] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:10 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:10.388665 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:10.389323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:10.397055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.397446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.397894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.398633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.399102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.399541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.532700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:10.540636 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9025d5f0-873e-4bb9-b16f-461820a5c27c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1667 microversion: 2.1 time: 0.155877 Aug 06 21:49:10.541225 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3260/6703] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:10 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:10.561158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:10.561708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:10.567919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.568404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.568845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.569533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.569992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.570422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.702040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:10.711004 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9def82a3-7558-4730-8e55-d31070866a37 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1667 microversion: 2.1 time: 0.153916 Aug 06 21:49:10.711606 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3444/6704] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:10 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:10.731223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:10.731727 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:10.738464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.738985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.739424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.740121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.740582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.741013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.767058 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:49:10.845077 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4cc704de-9564-43a2-a01b-350e5843b319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 204 len: 0 microversion: 2.1 time: 0.117275 Aug 06 21:49:10.845705 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3261/6705] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:49:10 2022] DELETE /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:49:10.854912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:10.855529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:10.862147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.862660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.863118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.863811 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:10.864271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:10.864700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:10.880629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:10.995435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:11.003800 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-160ba3e0-3943-4f4f-8454-f5cacb8a6a47 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1673 microversion: 2.1 time: 0.153582 Aug 06 21:49:11.004372 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3445/6706] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:10 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:11.733135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-3c5ffe33-7396-45a5-937b-146184c2ea87 req-5609582f-cabb-476f-abac-58dacffdd7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca718ce-7050-465b-87aa-fc22f7f9ba4d", "name": "network-vif-plugged", "status": "completed", "tag": "a829e1de-98c6-4678-9b74-b78544533576"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:11.748715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3c5ffe33-7396-45a5-937b-146184c2ea87 req-5609582f-cabb-476f-abac-58dacffdd7c9 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:11.749210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3c5ffe33-7396-45a5-937b-146184c2ea87 req-5609582f-cabb-476f-abac-58dacffdd7c9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:11.750157 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-3c5ffe33-7396-45a5-937b-146184c2ea87 req-5609582f-cabb-476f-abac-58dacffdd7c9 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:11.761128 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-3c5ffe33-7396-45a5-937b-146184c2ea87 req-5609582f-cabb-476f-abac-58dacffdd7c9 service nova] Creating event network-vif-plugged:a829e1de-98c6-4678-9b74-b78544533576 for instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d on nch2-master-1 Aug 06 21:49:11.767095 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-3c5ffe33-7396-45a5-937b-146184c2ea87 req-5609582f-cabb-476f-abac-58dacffdd7c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037907 Aug 06 21:49:11.767864 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3262/6707] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:49:12.023991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:12.024614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:12.031785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:12.032270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:12.032710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:12.033417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:12.033875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:12.034302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:12.488818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:12.496553 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0ef9a1a8-a997-48e4-b728-4b69d9fc6fce tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 200 len: 1673 microversion: 2.1 time: 0.476493 Aug 06 21:49:12.497131 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3446/6708] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:12 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 1673 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:13.083950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f92df360-703e-4d4c-bf13-29b0857b43ad req-fa5a928d-e6b3-401d-bf5d-f24c1503f175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca718ce-7050-465b-87aa-fc22f7f9ba4d", "name": "network-vif-deleted", "tag": "a829e1de-98c6-4678-9b74-b78544533576"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:13.094978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f92df360-703e-4d4c-bf13-29b0857b43ad req-fa5a928d-e6b3-401d-bf5d-f24c1503f175 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:13.095884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f92df360-703e-4d4c-bf13-29b0857b43ad req-fa5a928d-e6b3-401d-bf5d-f24c1503f175 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:13.095884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f92df360-703e-4d4c-bf13-29b0857b43ad req-fa5a928d-e6b3-401d-bf5d-f24c1503f175 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:13.107652 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f92df360-703e-4d4c-bf13-29b0857b43ad req-fa5a928d-e6b3-401d-bf5d-f24c1503f175 service nova] Creating event network-vif-deleted:a829e1de-98c6-4678-9b74-b78544533576 for instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d on nch2-master-1 Aug 06 21:49:13.113705 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f92df360-703e-4d4c-bf13-29b0857b43ad req-fa5a928d-e6b3-401d-bf5d-f24c1503f175 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036123 Aug 06 21:49:13.114317 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3263/6709] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:49:13.518209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:13.518886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:13.525860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:13.526341 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:13.526835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:13.527533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:13.527981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:13.528401 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:13.541722 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d HTTP/1.1 Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7ca718ce-7050-465b-87aa-fc22f7f9ba4d'} Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:49:13.543525 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bf1c6c03-bccf-40c5-80e7-ffc174ea39eb tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 404 len: 111 microversion: 2.1 time: 0.031439 Aug 06 21:49:13.548013 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3447/6710] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:13 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:49:13.556717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:13.557458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:13.564860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:13.565352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:13.565795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:13.566498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:13.566986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:13.567419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:13.582346 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d HTTP/1.1 Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7ca718ce-7050-465b-87aa-fc22f7f9ba4d'} Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:49:13.584240 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-43225de7-0e5a-4c05-b7ae-ee154f13587a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 404 len: 111 microversion: 2.1 time: 0.033081 Aug 06 21:49:13.588473 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3264/6711] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:13 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:49:13.635673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1564394983", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "6f7fb0e6-e9c5-4229-9db8-bc1390556ef6"}], "security_groups": [{"name": "tempest-securitygroup--719424010"}], "key_name": "tempest-keypair-478934283", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:13.750884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] validate_networks() for [('6f7fb0e6-e9c5-4229-9db8-bc1390556ef6', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:49:14.128593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:49:14.129069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:49:14.129582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:49:14.130027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:49:14.130492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:49:14.139402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:14.139885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:14.140888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:14.141620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:14.142076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:14.142500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:14.159381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:49:14.164739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for user 7e3cdb291b6146bb8d30f96ed07f1a46 and project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:49:14.177582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:49:14.179924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:49:14.230137 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-285723d4-10ef-49f4-a686-2daa35de8279 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.598425 Aug 06 21:49:14.231174 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3448/6712] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:49:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:49:14.242745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e50d84af-0463-4c59-b868-fcfc8d07f406 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:14.243517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e50d84af-0463-4c59-b868-fcfc8d07f406 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:14.301531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e50d84af-0463-4c59-b868-fcfc8d07f406 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:14.309251 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e50d84af-0463-4c59-b868-fcfc8d07f406 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1238 microversion: 2.1 time: 0.070616 Aug 06 21:49:14.309826 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3265/6713] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:14 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:15.331590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:15.332810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:15.342002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:15.342503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:15.342986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:15.343705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:15.344176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:15.344611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:15.408244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:15.416008 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-adc6e3af-4417-49e8-bd67-0f22f14f6e4c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1296 microversion: 2.1 time: 0.089438 Aug 06 21:49:15.416586 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3449/6714] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:15 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:16.440636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:16.441540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:16.449538 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:16.450033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:16.450479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:16.451234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:16.451699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:16.452175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:16.459419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:16.475051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5e166375-405c-4fbe-9e67-bc81c3fa1f3f req-c2e2ac71-c3bc-4e45-8bb3-085565a15a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0", "tag": "7b3f2e61-ebdb-4991-b154-2ca4005cc36b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:16.506579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5e166375-405c-4fbe-9e67-bc81c3fa1f3f req-c2e2ac71-c3bc-4e45-8bb3-085565a15a66 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:16.507792 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5e166375-405c-4fbe-9e67-bc81c3fa1f3f req-c2e2ac71-c3bc-4e45-8bb3-085565a15a66 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:16.508576 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5e166375-405c-4fbe-9e67-bc81c3fa1f3f req-c2e2ac71-c3bc-4e45-8bb3-085565a15a66 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:16.530751 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5e166375-405c-4fbe-9e67-bc81c3fa1f3f req-c2e2ac71-c3bc-4e45-8bb3-085565a15a66 service nova] Creating event network-changed:7b3f2e61-ebdb-4991-b154-2ca4005cc36b for instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 on nch2-master-1 Aug 06 21:49:16.538688 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5e166375-405c-4fbe-9e67-bc81c3fa1f3f req-c2e2ac71-c3bc-4e45-8bb3-085565a15a66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074874 Aug 06 21:49:16.539505 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3450/6715] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:49:16.756968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:16.764655 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5a6b09c7-73a5-4e58-8b8a-c5697e588e62 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1363 microversion: 2.1 time: 0.329804 Aug 06 21:49:16.765322 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3266/6716] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:16 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:17.787242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:17.787949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:17.794083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:17.794584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:17.795027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:17.795723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:17.796815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:17.797244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:17.928634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:17.936124 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6942bba9-bd55-4a65-95b9-8a6fed51a3db tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1363 microversion: 2.1 time: 0.153921 Aug 06 21:49:17.936701 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3451/6717] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:17 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:18.957739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:18.958303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:18.965493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:18.965985 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:18.966427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:18.967182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:18.967643 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:18.968659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:19.104792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:19.112385 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-09e4259e-66ea-4beb-ace6-8498a9b84518 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1363 microversion: 2.1 time: 0.158903 Aug 06 21:49:19.112964 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3267/6718] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:18 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:20.133453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:20.134089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:20.141686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:20.142119 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:20.142584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:20.143279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:20.143734 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:20.144157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:20.280758 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:20.288520 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c83df8de-4c44-4334-94db-6e53bfb0d248 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1363 microversion: 2.1 time: 0.159046 Aug 06 21:49:20.289097 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3452/6719] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:20 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:21.309561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:21.310186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:21.313419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:21.319470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:21.319976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:21.320431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:21.321144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:21.321615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:21.322056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:21.455155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:21.462828 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-990c6584-5c43-4f4f-a3d7-8dc18e57f8f5 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1363 microversion: 2.1 time: 0.157399 Aug 06 21:49:21.463400 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3268/6720] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:21 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:21.786068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5c6ae01a-150e-4448-8dc9-7743c1eeb14e req-7ce17403-420a-4023-8b28-806fd31c005b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0", "name": "network-vif-plugged", "status": "completed", "tag": "7b3f2e61-ebdb-4991-b154-2ca4005cc36b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:21.792191 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:21.799810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5c6ae01a-150e-4448-8dc9-7743c1eeb14e req-7ce17403-420a-4023-8b28-806fd31c005b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:21.800305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5c6ae01a-150e-4448-8dc9-7743c1eeb14e req-7ce17403-420a-4023-8b28-806fd31c005b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:21.800746 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5c6ae01a-150e-4448-8dc9-7743c1eeb14e req-7ce17403-420a-4023-8b28-806fd31c005b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:21.812155 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5c6ae01a-150e-4448-8dc9-7743c1eeb14e req-7ce17403-420a-4023-8b28-806fd31c005b service nova] Creating event network-vif-plugged:7b3f2e61-ebdb-4991-b154-2ca4005cc36b for instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 on nch2-master-1 Aug 06 21:49:21.817182 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5c6ae01a-150e-4448-8dc9-7743c1eeb14e req-7ce17403-420a-4023-8b28-806fd31c005b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034836 Aug 06 21:49:21.818099 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3453/6721] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:49:22.483616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:22.484385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:22.491419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:22.491910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:22.492351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:22.493048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:22.493509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:22.493944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:22.625619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:22.633093 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-468a8270-05ed-4f9d-bf63-1fa3e7adebab tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1363 microversion: 2.1 time: 0.153458 Aug 06 21:49:22.633660 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3269/6722] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:22 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:23.657103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:23.657819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:23.664275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:23.664808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:23.665254 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:23.665960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:23.666425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:23.666884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:23.797772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:23.805304 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42ea1374-8701-4691-8ba4-c7b63c303663 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1549 microversion: 2.1 time: 0.153951 Aug 06 21:49:23.805864 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3454/6723] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:23 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:23.825853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dbd661c0-5c81-4ebf-9ed4-2ebdc3242dfe tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:23.826348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dbd661c0-5c81-4ebf-9ed4-2ebdc3242dfe tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:23.834439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd661c0-5c81-4ebf-9ed4-2ebdc3242dfe tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:23.834979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd661c0-5c81-4ebf-9ed4-2ebdc3242dfe tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:23.835431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd661c0-5c81-4ebf-9ed4-2ebdc3242dfe tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:23.836146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd661c0-5c81-4ebf-9ed4-2ebdc3242dfe tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:23.836615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd661c0-5c81-4ebf-9ed4-2ebdc3242dfe tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:23.837057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dbd661c0-5c81-4ebf-9ed4-2ebdc3242dfe tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:23.917847 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dbd661c0-5c81-4ebf-9ed4-2ebdc3242dfe tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095880 Aug 06 21:49:23.918484 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3270/6724] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:49:23 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:49:24.860719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-55e79986-30ed-4d06-9a5c-5e8f2fa81dc2 req-d5e8c3ab-d50d-412d-861d-a3290db9c711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0", "tag": "7b3f2e61-ebdb-4991-b154-2ca4005cc36b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:24.865545 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:24.866243 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:24.874849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-55e79986-30ed-4d06-9a5c-5e8f2fa81dc2 req-d5e8c3ab-d50d-412d-861d-a3290db9c711 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:24.875335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-55e79986-30ed-4d06-9a5c-5e8f2fa81dc2 req-d5e8c3ab-d50d-412d-861d-a3290db9c711 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:24.875774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-55e79986-30ed-4d06-9a5c-5e8f2fa81dc2 req-d5e8c3ab-d50d-412d-861d-a3290db9c711 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:24.887597 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-55e79986-30ed-4d06-9a5c-5e8f2fa81dc2 req-d5e8c3ab-d50d-412d-861d-a3290db9c711 service nova] Creating event network-changed:7b3f2e61-ebdb-4991-b154-2ca4005cc36b for instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 on nch2-master-1 Aug 06 21:49:24.892550 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-55e79986-30ed-4d06-9a5c-5e8f2fa81dc2 req-d5e8c3ab-d50d-412d-861d-a3290db9c711 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036107 Aug 06 21:49:24.893162 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3455/6725] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:49:57.791865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:57.793955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=5 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:57.794635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=26 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:57.799846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-35d84be0-ff40-4c20-ad66-a742c0dfb3fc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:49:57.807374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35d84be0-ff40-4c20-ad66-a742c0dfb3fc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:57.807866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35d84be0-ff40-4c20-ad66-a742c0dfb3fc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:57.808313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35d84be0-ff40-4c20-ad66-a742c0dfb3fc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:57.831775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-35d84be0-ff40-4c20-ad66-a742c0dfb3fc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Going to try to stop instance {{(pid=142462) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 21:49:57.874361 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-35d84be0-ff40-4c20-ad66-a742c0dfb3fc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/action" status: 202 len: 0 microversion: 2.1 time: 0.082028 Aug 06 21:49:57.874731 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3271/6726] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:49:57 2022] POST /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:49:57.881274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=5 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:57.882665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=43 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:49:57.888600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:57.890098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:57.904167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:57.904634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:57.905913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:57.907083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:57.907725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:57.908306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:58.048108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:58.055594 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e89ae0e9-3d74-4024-a749-4487c1425b5f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.176301 Aug 06 21:49:58.056172 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3456/6727] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:57 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:49:59.079329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:49:59.080045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:49:59.086453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:59.086974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:59.087418 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:59.088121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:49:59.088580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:49:59.089013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:49:59.220777 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:49:59.228383 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ffe9d810-f8cd-4eec-8bcb-61e28d1a8879 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.155042 Aug 06 21:49:59.228961 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3272/6728] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:49:59 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:00.249608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:00.250220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:00.256747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:00.257226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:00.257660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:00.258347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:00.258826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:00.259252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:00.393558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:00.401261 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ef9d4a1a-b94e-491b-8b6e-f8e4e4e7266a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.155922 Aug 06 21:50:00.401930 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3457/6729] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:00 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:01.423233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:01.423880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:01.430904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:01.431393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:01.431839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:01.432541 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:01.432999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:01.433435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:01.566149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:01.573906 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d8bc609d-4a9b-4c20-8d4d-1e27b0415979 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.154612 Aug 06 21:50:01.574491 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3273/6730] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:01 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:02.596301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:02.596936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:02.603805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:02.604277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:02.604708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:02.605391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:02.605845 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:02.606265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:02.735866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:02.743649 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-574222bd-3a59-4850-aa21-04a0239f2d74 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.151307 Aug 06 21:50:02.744235 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3458/6731] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:02 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:03.765182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:03.765800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:03.772905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:03.773398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:03.773840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:03.774537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:03.775021 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:03.775454 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:03.904638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:03.912236 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ac33737f-ae18-4db1-b741-10b335d83631 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.151597 Aug 06 21:50:03.912820 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3274/6732] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:03 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:04.933334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:04.933887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:04.941565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:04.942042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:04.942477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:04.943193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:04.943647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:04.944068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:05.071194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:05.079624 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-63b5561c-aba7-49f0-9687-3f7a70bcc1c1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.149991 Aug 06 21:50:05.080199 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3459/6733] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:04 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:06.100566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:06.101189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:06.108121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:06.108608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:06.109050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:06.109748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:06.110207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:06.110672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:06.243599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:06.251922 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-02dd85f1-9f76-4445-b4fc-933937ecdf61 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.155313 Aug 06 21:50:06.252533 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3275/6734] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:06 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:07.273546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:07.274168 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:07.281898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:07.282416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:07.282867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:07.283570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:07.284036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:07.284471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:07.422174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:07.429820 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-29d59a45-0dd4-4547-9b15-e796261e6cb6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.160223 Aug 06 21:50:07.430419 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3460/6735] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:07 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:08.452055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:08.452870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:08.460003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:08.460529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:08.460980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:08.461696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:08.462175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:08.462647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:08.612223 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:08.620073 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9687c5f9-3e23-4323-9920-547426624be3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1655 microversion: 2.1 time: 0.172636 Aug 06 21:50:08.620687 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3276/6736] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:08 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1655 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:08.640958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:08.643245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:08.650142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:08.650660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:08.651099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:08.651789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:08.652241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:08.652663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:08.681985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:08.688185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Old instance type m1.heat2, new instance type m1.heat {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:50:08.694454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:50:08.694922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:50:08.695409 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:50:08.695830 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:50:08.696250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:50:08.758612 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-96b31681-f3d6-41d3-a1b3-f1565469703b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/action" status: 202 len: 0 microversion: 2.1 time: 0.122246 Aug 06 21:50:08.759231 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3461/6737] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:50:08 2022] POST /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:50:08.768118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:08.768955 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:08.775034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:08.775536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:08.775986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:08.776695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:08.777158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:08.777598 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:08.918779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:08.927564 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6faaf9c1-dd99-4bef-946f-1d57e34c4890 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.163949 Aug 06 21:50:08.928143 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3277/6738] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:08 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:09.948426 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:09.949041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:09.956780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:09.957266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:09.957701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:09.958392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:09.958880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:09.959307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:10.104201 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:10.112935 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c0726f79-5534-4cfc-9c27-1e2fb252f319 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1678 microversion: 2.1 time: 0.169222 Aug 06 21:50:10.113518 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3462/6739] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:09 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:11.135026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:11.135652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:11.143255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:11.143737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:11.144175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:11.144873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:11.145330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:11.145769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:11.282444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:11.291001 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3b630059-a1a8-4f09-98ea-4a56c572ff83 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1683 microversion: 2.1 time: 0.159789 Aug 06 21:50:11.291602 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3278/6740] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:11 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:12.313218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:12.313953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:12.321070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:12.321554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:12.322202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:12.323007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:12.323484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:12.323895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:12.467009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:12.475002 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f8cb6242-7a03-4b0b-99b7-ae6c97b30a5b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1683 microversion: 2.1 time: 0.166409 Aug 06 21:50:12.475590 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3463/6741] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:12 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:12.900342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-792ee1ea-279f-444e-8696-6dd87d52359d req-18084223-14bc-431d-9332-6b413bf88866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0", "name": "network-vif-unplugged", "status": "completed", "tag": "7b3f2e61-ebdb-4991-b154-2ca4005cc36b"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:12.910124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-792ee1ea-279f-444e-8696-6dd87d52359d req-18084223-14bc-431d-9332-6b413bf88866 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:12.910640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-792ee1ea-279f-444e-8696-6dd87d52359d req-18084223-14bc-431d-9332-6b413bf88866 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:12.911093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-792ee1ea-279f-444e-8696-6dd87d52359d req-18084223-14bc-431d-9332-6b413bf88866 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:12.923337 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-792ee1ea-279f-444e-8696-6dd87d52359d req-18084223-14bc-431d-9332-6b413bf88866 service nova] Creating event network-vif-unplugged:7b3f2e61-ebdb-4991-b154-2ca4005cc36b for instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 on nch1-master-1 Aug 06 21:50:12.929016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-792ee1ea-279f-444e-8696-6dd87d52359d req-18084223-14bc-431d-9332-6b413bf88866 service nova] Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:50:12.941059 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-792ee1ea-279f-444e-8696-6dd87d52359d req-18084223-14bc-431d-9332-6b413bf88866 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111588 Aug 06 21:50:12.941778 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3279/6742] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:50:13.496876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:13.497616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:13.504926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:13.505447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:13.505896 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:13.506749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:13.507182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:13.507614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:13.643878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:13.651639 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c922eb61-cb43-4365-ad7a-63da9ae47654 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1682 microversion: 2.1 time: 0.158796 Aug 06 21:50:13.652223 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3464/6743] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:13 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:14.675726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:14.676518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:14.682710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:14.683205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:14.683647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:14.684378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:14.684838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:14.685273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:14.817370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:14.824942 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-34d37e98-1e9f-4c18-a663-e18dc4df47d1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1680 microversion: 2.1 time: 0.155383 Aug 06 21:50:14.825529 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3280/6744] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:14 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:14.959630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b0b1950f-92b1-4847-8608-1217a8d5d480 req-9b54ce25-bc5d-4d4f-92fa-969d47fe2e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0", "tag": "7b3f2e61-ebdb-4991-b154-2ca4005cc36b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:14.970617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b0b1950f-92b1-4847-8608-1217a8d5d480 req-9b54ce25-bc5d-4d4f-92fa-969d47fe2e5d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:14.971099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b0b1950f-92b1-4847-8608-1217a8d5d480 req-9b54ce25-bc5d-4d4f-92fa-969d47fe2e5d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:14.971534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b0b1950f-92b1-4847-8608-1217a8d5d480 req-9b54ce25-bc5d-4d4f-92fa-969d47fe2e5d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:14.986884 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b0b1950f-92b1-4847-8608-1217a8d5d480 req-9b54ce25-bc5d-4d4f-92fa-969d47fe2e5d service nova] Creating event network-changed:7b3f2e61-ebdb-4991-b154-2ca4005cc36b for instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 on nch1-master-1 Aug 06 21:50:14.992377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-b0b1950f-92b1-4847-8608-1217a8d5d480 req-9b54ce25-bc5d-4d4f-92fa-969d47fe2e5d service nova] Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:50:15.003060 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b0b1950f-92b1-4847-8608-1217a8d5d480 req-9b54ce25-bc5d-4d4f-92fa-969d47fe2e5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048377 Aug 06 21:50:15.003673 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3465/6745] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:50:15.846353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:15.846938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:15.853757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:15.854249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:15.854718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:15.855420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:15.855876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:15.856306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:16.002171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:16.009775 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e32b32b1-1596-4fc9-8571-289bd3cf2821 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1676 microversion: 2.1 time: 0.167686 Aug 06 21:50:16.010341 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3281/6746] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:15 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:16.031744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49b40b7b-c06c-4c1a-b392-4300c409e0de tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:16.032377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-49b40b7b-c06c-4c1a-b392-4300c409e0de tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:16.038767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b40b7b-c06c-4c1a-b392-4300c409e0de tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:16.039257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b40b7b-c06c-4c1a-b392-4300c409e0de tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:16.039702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b40b7b-c06c-4c1a-b392-4300c409e0de tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:16.040402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b40b7b-c06c-4c1a-b392-4300c409e0de tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:16.040863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b40b7b-c06c-4c1a-b392-4300c409e0de tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:16.041295 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49b40b7b-c06c-4c1a-b392-4300c409e0de tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:16.098767 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-49b40b7b-c06c-4c1a-b392-4300c409e0de tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/action" status: 204 len: 0 microversion: 2.1 time: 0.072197 Aug 06 21:50:16.099359 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3466/6747] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:50:16 2022] POST /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:50:16.108342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:16.109691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:16.115875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:16.116373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:16.116811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:16.117574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:16.118221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:16.118718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:16.324329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:16.332635 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-19008eb4-147b-4765-ba4b-e17738de9791 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1676 microversion: 2.1 time: 0.228913 Aug 06 21:50:16.333352 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3282/6748] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:16 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:17.355016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:17.355899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:17.363360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:17.363854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:17.364266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:17.364963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:17.365417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:17.365841 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:17.499937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:17.508040 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2ae19705-1c98-44fd-b61d-d55c1072348b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1655 microversion: 2.1 time: 0.157380 Aug 06 21:50:17.508610 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3467/6749] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:17 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:17.528356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:17.528984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:17.536597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:17.537094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:17.537546 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:17.538260 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:17.538767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:17.539209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:17.675162 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:17.682938 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0ce58d10-5ecc-4d3c-85f9-0a3a3f5f72f0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1655 microversion: 2.1 time: 0.158427 Aug 06 21:50:17.683521 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3283/6750] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:17 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:17.704019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c2c338e5-7919-4f9c-9f44-2957bcff4d1b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:17.710364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2c338e5-7919-4f9c-9f44-2957bcff4d1b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:17.710892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2c338e5-7919-4f9c-9f44-2957bcff4d1b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:17.711335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c2c338e5-7919-4f9c-9f44-2957bcff4d1b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:17.733454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c2c338e5-7919-4f9c-9f44-2957bcff4d1b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Going to try to start instance {{(pid=142461) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 21:50:17.774644 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c2c338e5-7919-4f9c-9f44-2957bcff4d1b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/action" status: 202 len: 0 microversion: 2.1 time: 0.074855 Aug 06 21:50:17.775230 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3468/6751] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:50:17 2022] POST /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:50:17.784272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:17.784907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:17.791521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:17.792142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:17.792645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:17.793531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:17.794001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:17.795071 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:18.022862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:18.030715 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-78f10623-4cb7-43a0-98d9-fec34fd5d9ee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1664 microversion: 2.1 time: 0.251153 Aug 06 21:50:18.031308 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3284/6752] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:17 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1664 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:18.909875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e1a0cb5d-4c19-4182-b19a-3cc5c12f345e req-8671d147-bebd-4890-a69c-2f50c70f8825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0", "name": "network-vif-plugged", "status": "completed", "tag": "7b3f2e61-ebdb-4991-b154-2ca4005cc36b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:18.920960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e1a0cb5d-4c19-4182-b19a-3cc5c12f345e req-8671d147-bebd-4890-a69c-2f50c70f8825 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:18.921445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e1a0cb5d-4c19-4182-b19a-3cc5c12f345e req-8671d147-bebd-4890-a69c-2f50c70f8825 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:18.921880 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e1a0cb5d-4c19-4182-b19a-3cc5c12f345e req-8671d147-bebd-4890-a69c-2f50c70f8825 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:18.938130 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e1a0cb5d-4c19-4182-b19a-3cc5c12f345e req-8671d147-bebd-4890-a69c-2f50c70f8825 service nova] Creating event network-vif-plugged:7b3f2e61-ebdb-4991-b154-2ca4005cc36b for instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 on nch1-master-1 Aug 06 21:50:18.942917 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e1a0cb5d-4c19-4182-b19a-3cc5c12f345e req-8671d147-bebd-4890-a69c-2f50c70f8825 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037332 Aug 06 21:50:18.943596 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3469/6753] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:50:19.052315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:19.052920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:19.059950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:19.060441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:19.060884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:19.061591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:19.062049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:19.062478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:19.269190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:19.277450 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-49a9626e-319f-4de4-944a-a66e6b49cfb4 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1668 microversion: 2.1 time: 0.229153 Aug 06 21:50:19.278084 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3285/6754] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:19 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1668 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:19.299706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:19.300286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:19.308581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:19.309471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:19.310706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:19.311311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:19.311778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:19.312208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:19.317285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:19.340664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:50:19.423094 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2fff5131-82c2-4094-a7ff-90b347a90eba tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 204 len: 0 microversion: 2.1 time: 0.127259 Aug 06 21:50:19.423662 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3470/6755] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:50:19 2022] DELETE /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:50:19.432511 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:19.433262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:19.440310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:19.440795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:19.441234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:19.441941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:19.442408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:19.442877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:19.582291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:19.585883 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:19.590915 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4f8e1bb2-ce8e-4bfd-a046-f566df2d8c2f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1674 microversion: 2.1 time: 0.162455 Aug 06 21:50:19.591495 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3286/6756] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:19 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:20.613305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:20.614209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:20.620983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:20.621465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:20.621902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:20.622620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:20.623075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:20.623496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:20.758246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:20.767396 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-beeb84a3-c116-4895-b41c-23c43400d8fa tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1674 microversion: 2.1 time: 0.158663 Aug 06 21:50:20.769265 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3471/6757] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:20 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:21.790362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:21.791354 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:21.800893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:21.801486 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:21.802018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:21.802838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:21.803381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:21.803891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:21.885736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:21.894951 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ce121d94-34c9-430d-95e6-8d9dfa013649 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 200 len: 1607 microversion: 2.1 time: 0.108459 Aug 06 21:50:21.895551 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3287/6758] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:21 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 1607 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:50:21.924673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ed28be3e-d139-49b9-a4c8-11e74d52594c req-619085f2-459f-42bc-a0c6-19d3e770234a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0", "name": "network-vif-deleted", "tag": "7b3f2e61-ebdb-4991-b154-2ca4005cc36b"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:21.935805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ed28be3e-d139-49b9-a4c8-11e74d52594c req-619085f2-459f-42bc-a0c6-19d3e770234a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:21.936460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ed28be3e-d139-49b9-a4c8-11e74d52594c req-619085f2-459f-42bc-a0c6-19d3e770234a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:21.936911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ed28be3e-d139-49b9-a4c8-11e74d52594c req-619085f2-459f-42bc-a0c6-19d3e770234a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:21.949402 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ed28be3e-d139-49b9-a4c8-11e74d52594c req-619085f2-459f-42bc-a0c6-19d3e770234a service nova] Creating event network-vif-deleted:7b3f2e61-ebdb-4991-b154-2ca4005cc36b for instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 on nch1-master-1 Aug 06 21:50:21.955953 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ed28be3e-d139-49b9-a4c8-11e74d52594c req-619085f2-459f-42bc-a0c6-19d3e770234a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035562 Aug 06 21:50:21.956568 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3472/6759] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:50:22.916305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:22.916960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:22.923933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:22.924431 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:22.924882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:22.925597 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:22.926065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:22.926508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:22.940680 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 HTTP/1.1 Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0'} Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:50:22.942304 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c9b61476-4501-4e88-a1a0-93bbe741b1b6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 404 len: 111 microversion: 2.1 time: 0.031518 Aug 06 21:50:22.947774 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3288/6760] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:22 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:50:22.962496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:22.963776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:22.973127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:22.973621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:22.974068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:22.974964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:22.975430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:22.975862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:22.989856 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 HTTP/1.1 Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0'} Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:50:22.991535 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b4192887-beda-4c8d-a275-a45e1f6682ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 404 len: 111 microversion: 2.1 time: 0.034882 Aug 06 21:50:22.995672 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3473/6761] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:22 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:50:23.045190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-196808487", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "6f7fb0e6-e9c5-4229-9db8-bc1390556ef6"}], "security_groups": [{"name": "tempest-securitygroup--719424010"}], "key_name": "tempest-keypair-478934283", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:23.164718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] validate_networks() for [('6f7fb0e6-e9c5-4229-9db8-bc1390556ef6', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:50:23.602194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:50:23.602666 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:50:23.603155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:50:23.603573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:50:23.603993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:50:23.613221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:23.613709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:23.614154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:23.614940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:23.615406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:23.615843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:23.632990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:50:23.638334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for user 7e3cdb291b6146bb8d30f96ed07f1a46 and project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:50:23.651706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:50:23.653993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:50:23.699748 ncdv-master-1 devstack@n-api.service[142462]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [145598bf-e9a4-484e-9aef-c4918af3b725] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 21:50:24.707510 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [145598bf-e9a4-484e-9aef-c4918af3b725] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 41592. Aug 06 21:50:24.711306 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8f96df8b-409a-408b-8dfd-56a1c038d27a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.670311 Aug 06 21:50:24.711976 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3289/6762] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:50:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:50:24.723449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-610902af-491a-446d-8a4c-6620b82ee1c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:24.724247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-610902af-491a-446d-8a4c-6620b82ee1c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:24.785465 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-610902af-491a-446d-8a4c-6620b82ee1c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:24.793967 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-610902af-491a-446d-8a4c-6620b82ee1c3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1237 microversion: 2.1 time: 0.074795 Aug 06 21:50:24.803301 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3474/6763] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:24 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:25.818761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:25.819385 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:25.825641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:25.826133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:25.826599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:25.827308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:25.827768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:25.828322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:25.900429 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:25.908742 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bf358488-548a-4a18-a9bc-7859e498351a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1295 microversion: 2.1 time: 0.095851 Aug 06 21:50:25.909328 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3290/6764] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:25 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:26.930007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:26.930641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:26.937618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:26.938189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:26.938722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:26.939423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:26.939875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:26.940374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:26.972918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7598ce4f-f4fd-4b25-b705-aeeeee3ed215 req-0df7bc10-ec29-46a4-9654-eaa330deaacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd28800-1fd7-49cf-a930-9107020e49a5", "tag": "d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:27.003442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7598ce4f-f4fd-4b25-b705-aeeeee3ed215 req-0df7bc10-ec29-46a4-9654-eaa330deaacd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:27.004067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7598ce4f-f4fd-4b25-b705-aeeeee3ed215 req-0df7bc10-ec29-46a4-9654-eaa330deaacd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:27.004579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7598ce4f-f4fd-4b25-b705-aeeeee3ed215 req-0df7bc10-ec29-46a4-9654-eaa330deaacd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:27.019222 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7598ce4f-f4fd-4b25-b705-aeeeee3ed215 req-0df7bc10-ec29-46a4-9654-eaa330deaacd service nova] Creating event network-changed:d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325 for instance 0fd28800-1fd7-49cf-a930-9107020e49a5 on nch2-master-1 Aug 06 21:50:27.024431 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7598ce4f-f4fd-4b25-b705-aeeeee3ed215 req-0df7bc10-ec29-46a4-9654-eaa330deaacd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056705 Aug 06 21:50:27.025294 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3291/6765] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:50:27.092980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:27.100736 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b170ff57-2314-466a-a06d-6ebeaf53e453 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1362 microversion: 2.1 time: 0.174693 Aug 06 21:50:27.101304 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3475/6766] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:26 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:28.123591 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:28.124317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:28.126677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:28.132192 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:28.132690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:28.133143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:28.133855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:28.134323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:28.134799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:28.354245 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:28.362115 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7e690c2d-ba48-42dc-862a-57b6bcd86306 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1362 microversion: 2.1 time: 0.243697 Aug 06 21:50:28.362870 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3292/6767] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:28 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:29.384079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:29.384733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:29.387664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:29.396126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:29.396934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:29.397644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:29.398365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:29.398858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:29.399296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:29.531718 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:29.539937 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e9c1f98a-8ae4-473c-8dba-99fe881630b0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1362 microversion: 2.1 time: 0.159833 Aug 06 21:50:29.540511 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3476/6768] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:29 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:30.561386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:30.562006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:30.570130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:30.570656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:30.571130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:30.571843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:30.572309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:30.572750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:30.705364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:30.713010 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2d912da6-9e09-456b-8216-0ce772711833 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1362 microversion: 2.1 time: 0.155587 Aug 06 21:50:30.713599 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3293/6769] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:30 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:31.734054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:31.734679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:31.741710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:31.742189 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:31.742661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:31.743351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:31.743806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:31.744230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:31.874429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:31.882177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-49dac0bf-22f6-48ec-a5dd-e41ae0488b13 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1362 microversion: 2.1 time: 0.151982 Aug 06 21:50:31.882772 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3477/6770] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:31 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:32.123750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-80e2b79d-b07f-41fa-b281-8f37499d1b68 req-3dcb6633-6ba3-45c6-a515-dbfa556884c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd28800-1fd7-49cf-a930-9107020e49a5", "name": "network-vif-plugged", "status": "completed", "tag": "d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:32.135505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-80e2b79d-b07f-41fa-b281-8f37499d1b68 req-3dcb6633-6ba3-45c6-a515-dbfa556884c7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:32.135997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-80e2b79d-b07f-41fa-b281-8f37499d1b68 req-3dcb6633-6ba3-45c6-a515-dbfa556884c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:32.136446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-80e2b79d-b07f-41fa-b281-8f37499d1b68 req-3dcb6633-6ba3-45c6-a515-dbfa556884c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:32.149110 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-80e2b79d-b07f-41fa-b281-8f37499d1b68 req-3dcb6633-6ba3-45c6-a515-dbfa556884c7 service nova] Creating event network-vif-plugged:d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325 for instance 0fd28800-1fd7-49cf-a930-9107020e49a5 on nch2-master-1 Aug 06 21:50:32.154050 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-80e2b79d-b07f-41fa-b281-8f37499d1b68 req-3dcb6633-6ba3-45c6-a515-dbfa556884c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034115 Aug 06 21:50:32.154680 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3294/6771] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:50:32.904312 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:32.904931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:32.912314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:32.912801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:32.913233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:32.913929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:32.914383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:32.914871 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:33.045667 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:33.054082 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-69219161-2c33-47e5-b920-f05c698fac56 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1362 microversion: 2.1 time: 0.153667 Aug 06 21:50:33.054672 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3478/6772] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:32 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:34.073822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:34.074748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:50:34.079629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:34.080359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:34.087608 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:34.088105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:34.088559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:34.089271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:34.089742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:34.090186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:34.220483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:50:34.228171 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b5b32e0b-e690-44e8-9ad8-1eafcfdc48cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1549 microversion: 2.1 time: 0.156138 Aug 06 21:50:34.228758 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3295/6773] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:50:34 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:50:34.248995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-53e2f07b-5f06-46d3-9ded-37311bdd0959 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:50:34.249507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-53e2f07b-5f06-46d3-9ded-37311bdd0959 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:50:34.256679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53e2f07b-5f06-46d3-9ded-37311bdd0959 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:34.257161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53e2f07b-5f06-46d3-9ded-37311bdd0959 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:34.257595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53e2f07b-5f06-46d3-9ded-37311bdd0959 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:34.258281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53e2f07b-5f06-46d3-9ded-37311bdd0959 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:34.258808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53e2f07b-5f06-46d3-9ded-37311bdd0959 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:34.259237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-53e2f07b-5f06-46d3-9ded-37311bdd0959 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:34.340415 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-53e2f07b-5f06-46d3-9ded-37311bdd0959 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095177 Aug 06 21:50:34.341014 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3479/6774] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:50:34 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:50:35.325497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5561d9b2-ceff-4431-bcb3-bd3a7f733d33 req-6e979957-60cd-4f39-86b8-a400e5046adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd28800-1fd7-49cf-a930-9107020e49a5", "tag": "d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:50:35.335581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5561d9b2-ceff-4431-bcb3-bd3a7f733d33 req-6e979957-60cd-4f39-86b8-a400e5046adb service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:50:35.336062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5561d9b2-ceff-4431-bcb3-bd3a7f733d33 req-6e979957-60cd-4f39-86b8-a400e5046adb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:50:35.336500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5561d9b2-ceff-4431-bcb3-bd3a7f733d33 req-6e979957-60cd-4f39-86b8-a400e5046adb service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:50:35.348592 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-5561d9b2-ceff-4431-bcb3-bd3a7f733d33 req-6e979957-60cd-4f39-86b8-a400e5046adb service nova] Creating event network-changed:d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325 for instance 0fd28800-1fd7-49cf-a930-9107020e49a5 on nch2-master-1 Aug 06 21:50:35.355402 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5561d9b2-ceff-4431-bcb3-bd3a7f733d33 req-6e979957-60cd-4f39-86b8-a400e5046adb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098151 Aug 06 21:50:35.356015 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3296/6775] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:50:57.751370 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:50:57.752009 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:50:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:51:08.151911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:08.153789 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=7 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:08.154438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:08.159003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:08.161214 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:08.168969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:08.169456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:08.169899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:08.170653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:08.171114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:08.171544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:08.201014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:08.208116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Old instance type m1.heat2, new instance type m1.heat {{(pid=142461) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:51:08.214260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:51:08.214714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:51:08.215223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:51:08.215639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:51:08.216051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:51:08.278471 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3c4848a3-86e5-4f4f-b166-6682ecbb882a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5/action" status: 202 len: 0 microversion: 2.1 time: 0.127172 Aug 06 21:51:08.279304 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3480/6776] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:51:08 2022] POST /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:51:08.288817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:08.289536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:08.291669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=9 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:08.292526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=40 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:08.299348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:08.299848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:08.300295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:08.301012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:08.301519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:08.302043 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:08.441199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:08.448933 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-23ac01a6-da42-444e-ab22-7c29f2719f00 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1677 microversion: 2.1 time: 0.164865 Aug 06 21:51:08.449511 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3297/6777] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:08 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:09.472360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:09.472981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:09.479025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:09.479515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:09.479959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:09.480658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:09.481120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:09.481559 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:09.615946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:09.624178 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6e1b82e8-a3b0-4e1e-801e-e3e478f73eee tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1677 microversion: 2.1 time: 0.157337 Aug 06 21:51:09.624693 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3481/6778] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:09 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:10.645540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:10.646164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:10.653226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:10.653712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:10.654154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:10.654880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:10.655338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:10.655767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:10.790472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:10.798801 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8c93cfbe-e722-442c-8e46-58bc830888a1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.157182 Aug 06 21:51:10.799396 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3298/6779] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:10 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:11.820309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:11.820931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:11.827856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:11.828342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:11.828781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:11.830694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:11.831165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:11.831603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:11.964813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:11.973107 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3459da4c-337c-4260-96b9-21e5c2a2236b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.156826 Aug 06 21:51:11.973682 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3482/6780] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:11 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:12.994621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:12.995273 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:13.003636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:13.004126 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:13.004567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:13.005264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:13.005723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:13.006155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:13.141364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:13.149152 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f11d16c6-d9a5-4dda-a769-c2b0eb30f3b2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.158490 Aug 06 21:51:13.149728 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3299/6781] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:12 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:14.170672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:14.171292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:14.178691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:14.179178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:14.179615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:14.180311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:14.180770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:14.181197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:14.312333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:14.320425 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42ea7a05-f04d-4074-aac6-674e28936139 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.153684 Aug 06 21:51:14.320984 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3483/6782] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:14 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:15.341380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:15.342001 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:15.349865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:15.350352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:15.350826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:15.351528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:15.351989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:15.352423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:15.486387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:15.493761 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d5fc000d-a8f2-4ecf-b0d7-437eabc6c02d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.156278 Aug 06 21:51:15.494345 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3300/6783] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:15 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:16.515088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:16.515713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:16.524069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:16.524561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:16.525000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:16.525698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:16.526159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:16.526619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:16.656323 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:16.664381 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f42e89ce-4fe7-4d2c-abfa-657327fe1d0c tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.153136 Aug 06 21:51:16.664959 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3484/6784] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:16 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:17.685302 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:17.685934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:17.693031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:17.693526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:17.693975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:17.694729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:17.695198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:17.695634 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:17.830144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:17.837923 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0b2f86b3-9807-4955-a252-af5b194f5f57 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.156588 Aug 06 21:51:17.838503 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3301/6785] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:17 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:18.859391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:18.860531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:18.868104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:18.868590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:18.869031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:18.869727 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:18.870181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:18.870638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:19.005684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:19.013373 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-490f43d0-22de-4d2a-8b56-36fc29b19e49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.157883 Aug 06 21:51:19.014115 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3485/6786] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:18 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:20.035343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:20.036079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:20.042767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:20.043253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:20.043696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:20.044389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:20.044847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:20.045282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:20.178481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:20.186379 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c2941516-379d-4dda-bb23-249c3b7e725a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.155384 Aug 06 21:51:20.186999 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3302/6787] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:20 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:21.208581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:21.209237 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:21.216149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:21.216639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:21.217117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:21.217837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:21.218283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:21.218747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:21.346772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:21.354396 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-166d23f5-bc7c-470a-b0d3-b8d79d9a5b8a tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.150459 Aug 06 21:51:21.355010 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3486/6788] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:21 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:22.376217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:22.377575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:22.384500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:22.384999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:22.385482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:22.386198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:22.386695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:22.387139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:22.521403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:22.529030 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e01e31c2-5497-4300-83bb-f09621fe8b6d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.156779 Aug 06 21:51:22.529600 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3303/6789] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:22 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:23.549932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:23.550558 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:23.557228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:23.557709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:23.558143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:23.558876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:23.559356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:23.559803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:23.695190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:23.702806 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5f481b30-93f9-4e51-ad4e-9e36fdb91a0b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.156807 Aug 06 21:51:23.703369 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3487/6790] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:23 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:24.725467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:24.726023 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:24.732996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:24.733483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:24.733933 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:24.734661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:24.735132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:24.735567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:24.872892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:24.881523 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9b12c53a-cbc0-435c-9c33-0ad65a550c69 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.160070 Aug 06 21:51:24.882101 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3304/6791] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:24 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:25.902949 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:25.903589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:25.911389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:25.911879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:25.912306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:25.912992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:25.913475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:25.913902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:26.044649 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:26.052169 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a7526701-157b-4b4e-a6dd-20a9f6093809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1682 microversion: 2.1 time: 0.153121 Aug 06 21:51:26.052737 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3488/6792] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:25 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:27.073212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:27.074024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:27.081528 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:27.082020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:27.082581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:27.083196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:27.083988 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:27.084580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:27.288908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:27.296457 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d3395d4-2628-484a-88e7-ad135c8c2c02 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1681 microversion: 2.1 time: 0.227242 Aug 06 21:51:27.297035 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3305/6793] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:27 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:27.519810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b13ee295-d1c0-46ae-9a76-08371d70ddf1 req-7645c97b-fd78-4a3a-801f-31268e4e0d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd28800-1fd7-49cf-a930-9107020e49a5", "name": "network-vif-unplugged", "status": "completed", "tag": "d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:27.530862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b13ee295-d1c0-46ae-9a76-08371d70ddf1 req-7645c97b-fd78-4a3a-801f-31268e4e0d1b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:27.531347 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b13ee295-d1c0-46ae-9a76-08371d70ddf1 req-7645c97b-fd78-4a3a-801f-31268e4e0d1b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:27.531782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b13ee295-d1c0-46ae-9a76-08371d70ddf1 req-7645c97b-fd78-4a3a-801f-31268e4e0d1b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:27.547866 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b13ee295-d1c0-46ae-9a76-08371d70ddf1 req-7645c97b-fd78-4a3a-801f-31268e4e0d1b service nova] Creating event network-vif-unplugged:d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325 for instance 0fd28800-1fd7-49cf-a930-9107020e49a5 on nch1-master-1 Aug 06 21:51:27.555857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-b13ee295-d1c0-46ae-9a76-08371d70ddf1 req-7645c97b-fd78-4a3a-801f-31268e4e0d1b service nova] Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:51:27.568763 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b13ee295-d1c0-46ae-9a76-08371d70ddf1 req-7645c97b-fd78-4a3a-801f-31268e4e0d1b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053928 Aug 06 21:51:27.569393 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3489/6794] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:51:28.318011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:28.318715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:28.325887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:28.326391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:28.326875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:28.327602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:28.328078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:28.328522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:28.544840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:28.553464 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fdec4480-b9f7-4b2b-a2df-19047b8268cc tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1681 microversion: 2.1 time: 0.240036 Aug 06 21:51:28.554047 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3306/6795] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:28 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:29.576541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:29.577245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:29.584774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:29.585259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:29.585694 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:29.586384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:29.586870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:29.587297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:29.719809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:29.728084 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0f9dcd21-cb7d-4ae5-bb58-6e222fc01cc6 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1679 microversion: 2.1 time: 0.156794 Aug 06 21:51:29.728660 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3490/6796] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:29 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:29.874859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-839218ab-1d0a-443b-84cc-40d22b55f067 req-0a98970f-adf6-4fe3-bf3e-f6c786dcba98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd28800-1fd7-49cf-a930-9107020e49a5", "tag": "d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:29.885105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-839218ab-1d0a-443b-84cc-40d22b55f067 req-0a98970f-adf6-4fe3-bf3e-f6c786dcba98 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:29.885613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-839218ab-1d0a-443b-84cc-40d22b55f067 req-0a98970f-adf6-4fe3-bf3e-f6c786dcba98 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:29.886088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-839218ab-1d0a-443b-84cc-40d22b55f067 req-0a98970f-adf6-4fe3-bf3e-f6c786dcba98 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:29.899576 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-839218ab-1d0a-443b-84cc-40d22b55f067 req-0a98970f-adf6-4fe3-bf3e-f6c786dcba98 service nova] Creating event network-changed:d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325 for instance 0fd28800-1fd7-49cf-a930-9107020e49a5 on nch1-master-1 Aug 06 21:51:29.904918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-839218ab-1d0a-443b-84cc-40d22b55f067 req-0a98970f-adf6-4fe3-bf3e-f6c786dcba98 service nova] Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:51:29.916787 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-839218ab-1d0a-443b-84cc-40d22b55f067 req-0a98970f-adf6-4fe3-bf3e-f6c786dcba98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045679 Aug 06 21:51:29.917383 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3307/6797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:51:30.749313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:30.749935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:30.757230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:30.757717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:30.758157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:30.758885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:30.759345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:30.759773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:30.900548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:30.908731 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f00ae64b-143e-41ee-8ef3-7975f2d86fe1 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1676 microversion: 2.1 time: 0.163299 Aug 06 21:51:30.909315 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3491/6798] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:30 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:30.931411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:30.932052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:30.938625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:30.939165 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:30.939620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:30.940347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:30.940815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:30.941259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:30.979095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:30.979506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:30.979960 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:30.980700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:30.981166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:30.981605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:31.002966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'ram', 'cores'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:51:31.008179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for user 7e3cdb291b6146bb8d30f96ed07f1a46 and project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'ram', 'cores'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:51:31.110326 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5138a913-e955-49e2-a87c-beca5dfa31f8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5/action" status: 202 len: 0 microversion: 2.1 time: 0.183959 Aug 06 21:51:31.111463 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3308/6799] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:51:30 2022] POST /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:51:31.119532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:31.120179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:31.126804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:31.127279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:31.127706 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:31.128518 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:31.128993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:31.129408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:31.263225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:31.271137 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-693ae170-8ca5-4eef-8aef-026d568817ad tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1675 microversion: 2.1 time: 0.155485 Aug 06 21:51:31.271658 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3492/6800] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:31 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:32.293304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:32.294006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:32.301381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:32.301862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:32.302303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:32.303039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:32.303498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:32.303927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:32.434201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:32.442791 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a68f21d-07a0-439e-886e-0cf2ff1c1809 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1675 microversion: 2.1 time: 0.154589 Aug 06 21:51:32.443369 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3309/6801] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:32 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:33.465206 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:33.465784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:33.473193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:33.473624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:33.474064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:33.474813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:33.475279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:33.475710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:33.616363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:33.624638 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d32f6736-55bd-4118-bd81-de991df07828 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1675 microversion: 2.1 time: 0.163698 Aug 06 21:51:33.625216 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3493/6802] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:33 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:34.320803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-45c534c3-a0c5-4e0f-be14-2a4950b4f485 req-d55ca95e-1fb9-4b48-aa82-84b59ea644e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd28800-1fd7-49cf-a930-9107020e49a5", "tag": "d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:34.334183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-45c534c3-a0c5-4e0f-be14-2a4950b4f485 req-d55ca95e-1fb9-4b48-aa82-84b59ea644e3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:34.334703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-45c534c3-a0c5-4e0f-be14-2a4950b4f485 req-d55ca95e-1fb9-4b48-aa82-84b59ea644e3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:34.335149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-45c534c3-a0c5-4e0f-be14-2a4950b4f485 req-d55ca95e-1fb9-4b48-aa82-84b59ea644e3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:34.351762 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-45c534c3-a0c5-4e0f-be14-2a4950b4f485 req-d55ca95e-1fb9-4b48-aa82-84b59ea644e3 service nova] Creating event network-changed:d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325 for instance 0fd28800-1fd7-49cf-a930-9107020e49a5 on nch2-master-1 Aug 06 21:51:34.357498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-45c534c3-a0c5-4e0f-be14-2a4950b4f485 req-d55ca95e-1fb9-4b48-aa82-84b59ea644e3 service nova] Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:51:34.368380 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-45c534c3-a0c5-4e0f-be14-2a4950b4f485 req-d55ca95e-1fb9-4b48-aa82-84b59ea644e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051360 Aug 06 21:51:34.369369 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3310/6803] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:51:34.646054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:34.646945 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:34.654006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:34.654491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:34.654964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:34.655658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:34.656114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:34.656536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:34.791063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:34.798975 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3b6d6c06-597f-4f7e-b749-3166c7f191d9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1675 microversion: 2.1 time: 0.157618 Aug 06 21:51:34.799558 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3494/6804] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:34 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:35.821654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:35.822296 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:35.828639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:35.829128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:35.830129 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:35.830927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:35.831399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:35.831841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:35.836025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:35.968748 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:35.976426 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-16a4f507-fd4c-49b1-ad90-3638d4883aa3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1675 microversion: 2.1 time: 0.159983 Aug 06 21:51:35.977000 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3311/6805] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:35 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:36.997928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:36.998627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:37.006634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.007130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.007689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.008402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.008870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.009304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.030688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:37.158912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:37.166712 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e72f9cff-4b74-415e-ba5a-8bc8a9282c76 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1668 microversion: 2.1 time: 0.172661 Aug 06 21:51:37.167297 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3495/6806] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:36 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:51:37.187701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:37.188328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:37.195435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.195914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.196363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.197066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.197526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.197963 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.328812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:37.337609 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-dd34961d-3be9-4bb3-8295-7d1ac425404d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1668 microversion: 2.1 time: 0.153777 Aug 06 21:51:37.338391 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3312/6807] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:37 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:37.357747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:37.358381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:37.364490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.364972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.365406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.366091 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.366596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.366994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.497673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:37.505863 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1dc32fc7-1512-4bb8-aa1f-be02508565a2 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1668 microversion: 2.1 time: 0.151986 Aug 06 21:51:37.506428 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3496/6808] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:37 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:37.526190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:37.526770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:37.533045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.533523 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.533998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.534725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.535201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.535647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.566409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:51:37.642875 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-42d867f1-b083-47cd-8954-2d86627c205f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 204 len: 0 microversion: 2.1 time: 0.119449 Aug 06 21:51:37.643501 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3313/6809] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:51:37 2022] DELETE /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:51:37.652633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:37.653255 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:37.661108 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.661662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.662105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.662843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:37.663373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:37.663804 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:37.791579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:37.799372 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a47ebd59-e0cc-40c8-9457-e282ea7ac3ec tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1674 microversion: 2.1 time: 0.150758 Aug 06 21:51:37.799947 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3497/6810] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:37 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:38.821470 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:38.822176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:38.824713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:38.831214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:38.831718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:38.832172 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:38.832949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:38.833419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:38.833862 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:39.098730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:39.110034 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-61e09fce-0798-4c52-8ed7-9e5f984eaca8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1674 microversion: 2.1 time: 0.293049 Aug 06 21:51:39.123608 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3314/6811] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:38 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1674 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:39.808001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-496840d2-c1e0-49ca-8d84-65588bc88d0f req-3fa976d9-9b9c-4937-acff-f9cf1feb6c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd28800-1fd7-49cf-a930-9107020e49a5", "name": "network-vif-deleted", "tag": "d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:39.819497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=41 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:39.825757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-496840d2-c1e0-49ca-8d84-65588bc88d0f req-3fa976d9-9b9c-4937-acff-f9cf1feb6c9d service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:39.826250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-496840d2-c1e0-49ca-8d84-65588bc88d0f req-3fa976d9-9b9c-4937-acff-f9cf1feb6c9d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:39.826725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-496840d2-c1e0-49ca-8d84-65588bc88d0f req-3fa976d9-9b9c-4937-acff-f9cf1feb6c9d service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:39.839065 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-496840d2-c1e0-49ca-8d84-65588bc88d0f req-3fa976d9-9b9c-4937-acff-f9cf1feb6c9d service nova] Creating event network-vif-deleted:d3a3d2e9-426c-4ba8-837d-1f6a3a5cd325 for instance 0fd28800-1fd7-49cf-a930-9107020e49a5 on nch2-master-1 Aug 06 21:51:39.843907 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-496840d2-c1e0-49ca-8d84-65588bc88d0f req-3fa976d9-9b9c-4937-acff-f9cf1feb6c9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039752 Aug 06 21:51:39.844541 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3498/6812] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:51:40.132612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:40.133303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:40.141269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:40.143005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:40.143899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:40.144782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:40.145408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:40.146003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:40.181387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:40.181886 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:40.182335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:40.182843 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lazy-loading 'fault' on Instance uuid 0fd28800-1fd7-49cf-a930-9107020e49a5 {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:51:40.244854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:40.255014 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6524707b-5972-4e8b-9bc1-188948893141 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 200 len: 1327 microversion: 2.1 time: 0.126347 Aug 06 21:51:40.256490 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3315/6813] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:40 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:41.278872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:41.279582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:41.286710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:41.287199 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:41.287672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:41.288375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:41.288832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:41.289260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:41.302698 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 HTTP/1.1 Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '0fd28800-1fd7-49cf-a930-9107020e49a5'} Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:51:41.304301 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7799def4-9d64-420d-b525-a9f4713404e9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 404 len: 111 microversion: 2.1 time: 0.032158 Aug 06 21:51:41.309207 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3499/6814] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:41 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:51:41.321832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:41.322473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:41.324497 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:41.331555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:41.332045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:41.332500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:41.333209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:41.333673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:41.334111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:41.348404 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 HTTP/1.1 Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '0fd28800-1fd7-49cf-a930-9107020e49a5'} Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:51:41.350059 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab096673-cc64-4915-8417-0eed9bb6323d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 404 len: 111 microversion: 2.1 time: 0.033485 Aug 06 21:51:41.355373 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3316/6815] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:41 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:51:41.399309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-241154406", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "6f7fb0e6-e9c5-4229-9db8-bc1390556ef6"}], "security_groups": [{"name": "tempest-securitygroup--719424010"}], "key_name": "tempest-keypair-478934283", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:41.505769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] validate_networks() for [('6f7fb0e6-e9c5-4229-9db8-bc1390556ef6', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:51:42.181593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:51:42.182062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:51:42.182561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:51:42.183000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:51:42.183473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:51:42.192563 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:42.193056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:42.193500 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:42.194241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:42.194738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:42.195174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:42.213857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:51:42.219238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Getting quotas for user 7e3cdb291b6146bb8d30f96ed07f1a46 and project 31dd0cdecacf498d8623f2be190dc57c. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:51:42.233072 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:51:42.236152 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:51:42.280677 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b93c33ee-a5f3-49fd-916d-0f73f70ddd46 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.885226 Aug 06 21:51:42.281608 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3500/6816] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:51:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:51:42.292989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-13d80deb-f6ca-4104-b56b-a51674364f6f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:42.293637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13d80deb-f6ca-4104-b56b-a51674364f6f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:42.412728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13d80deb-f6ca-4104-b56b-a51674364f6f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:42.423877 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-13d80deb-f6ca-4104-b56b-a51674364f6f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1237 microversion: 2.1 time: 0.134811 Aug 06 21:51:42.424461 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3317/6817] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:42 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1237 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:43.445310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:43.446618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:43.454684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:43.456220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:43.456953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:43.457672 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:43.458136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:43.458668 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:43.561171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:43.569320 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a884ffe3-b5ee-4a3e-b380-cadceec88a27 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1295 microversion: 2.1 time: 0.127795 Aug 06 21:51:43.569828 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3501/6818] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:43 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:44.530132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1978e503-d247-42bb-a70f-268aa0d12682 req-00a924d8-e4ad-4f6a-a34e-a6b3a5d90920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec78825d-c939-4f04-ac18-79f127a7a542", "tag": "a2c5bcd0-3904-4aac-ade8-b34ac144b5f5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:44.542037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1978e503-d247-42bb-a70f-268aa0d12682 req-00a924d8-e4ad-4f6a-a34e-a6b3a5d90920 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:44.542646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1978e503-d247-42bb-a70f-268aa0d12682 req-00a924d8-e4ad-4f6a-a34e-a6b3a5d90920 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:44.543158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1978e503-d247-42bb-a70f-268aa0d12682 req-00a924d8-e4ad-4f6a-a34e-a6b3a5d90920 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:44.555342 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1978e503-d247-42bb-a70f-268aa0d12682 req-00a924d8-e4ad-4f6a-a34e-a6b3a5d90920 service nova] Creating event network-changed:a2c5bcd0-3904-4aac-ade8-b34ac144b5f5 for instance ec78825d-c939-4f04-ac18-79f127a7a542 on nch2-master-1 Aug 06 21:51:44.560166 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1978e503-d247-42bb-a70f-268aa0d12682 req-00a924d8-e4ad-4f6a-a34e-a6b3a5d90920 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034016 Aug 06 21:51:44.560951 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3318/6819] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:51:44.592381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:44.593008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:44.601763 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:44.602759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:44.603207 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:44.603921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:44.604384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:44.604815 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:44.738511 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:44.746303 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67562ec5-dea0-4289-9320-dd62833a7d49 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1362 microversion: 2.1 time: 0.157939 Aug 06 21:51:44.746986 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3502/6820] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:44 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:45.769017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:45.770375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:45.777137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:45.777137 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:45.777594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:45.778316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:45.778815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:45.779259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:45.994434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:46.002362 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7985b387-e4e6-4375-86b3-29b6f0fb2c79 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1362 microversion: 2.1 time: 0.238468 Aug 06 21:51:46.003207 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3319/6821] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:45 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:47.023439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:47.024087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:47.031113 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:47.031600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:47.032040 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:47.032955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:47.033641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:47.034111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:47.247208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:47.255334 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-739ba8a3-97a8-4c93-9614-c10d1de3a339 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1362 microversion: 2.1 time: 0.235768 Aug 06 21:51:47.255909 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3503/6822] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:47 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:48.277442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:48.278076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:48.285757 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:48.286258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:48.286747 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:48.287468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:48.287940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:48.288382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:48.511602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:48.519833 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5efabfa1-67a2-4e04-b132-f438baf36ce8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1362 microversion: 2.1 time: 0.246416 Aug 06 21:51:48.520419 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3320/6823] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:48 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:49.541289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:49.543750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:49.549154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:49.549622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:49.550061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:49.550796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:49.551250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:49.551673 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:49.685614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:49.694120 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5d430f9b-8f50-47d2-bf65-b791029496b8 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1362 microversion: 2.1 time: 0.157060 Aug 06 21:51:49.694735 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3504/6824] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:49 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:50.406173 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-d5c333b8-633d-47c3-860f-83717d16a953 req-96ad3b5f-817a-47cc-8a57-2ade916d1d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec78825d-c939-4f04-ac18-79f127a7a542", "name": "network-vif-plugged", "status": "completed", "tag": "a2c5bcd0-3904-4aac-ade8-b34ac144b5f5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:50.417190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d5c333b8-633d-47c3-860f-83717d16a953 req-96ad3b5f-817a-47cc-8a57-2ade916d1d1e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:50.417681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d5c333b8-633d-47c3-860f-83717d16a953 req-96ad3b5f-817a-47cc-8a57-2ade916d1d1e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:50.418133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-d5c333b8-633d-47c3-860f-83717d16a953 req-96ad3b5f-817a-47cc-8a57-2ade916d1d1e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:50.430773 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-d5c333b8-633d-47c3-860f-83717d16a953 req-96ad3b5f-817a-47cc-8a57-2ade916d1d1e service nova] Creating event network-vif-plugged:a2c5bcd0-3904-4aac-ade8-b34ac144b5f5 for instance ec78825d-c939-4f04-ac18-79f127a7a542 on nch2-master-1 Aug 06 21:51:50.435836 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-d5c333b8-633d-47c3-860f-83717d16a953 req-96ad3b5f-817a-47cc-8a57-2ade916d1d1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033613 Aug 06 21:51:50.436458 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3321/6825] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:51:50.714948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:50.715572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:50.722818 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:50.723306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:50.723747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:50.724445 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:50.724903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:50.725331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:50.856423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:50.864795 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-35b5ddf0-4ab3-4db7-8f6a-aa1d97178730 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1362 microversion: 2.1 time: 0.153829 Aug 06 21:51:50.865375 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3505/6826] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:50 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:51.888252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:51.888974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:51.896730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:51.897220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:51.897693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:51.898408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:51.898903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:51.899337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:52.028978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:51:52.036667 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e4d94055-3ffb-4a47-b3bc-e5b645a644dd tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1548 microversion: 2.1 time: 0.153775 Aug 06 21:51:52.037254 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3322/6827] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:51:51 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:51:52.057358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eb73be91-0d75-4d67-bca0-c21662278234 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:51:52.057874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb73be91-0d75-4d67-bca0-c21662278234 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:51:52.065225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb73be91-0d75-4d67-bca0-c21662278234 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:52.065715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb73be91-0d75-4d67-bca0-c21662278234 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:52.066162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb73be91-0d75-4d67-bca0-c21662278234 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:52.066890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb73be91-0d75-4d67-bca0-c21662278234 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:52.067354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb73be91-0d75-4d67-bca0-c21662278234 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:52.067785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb73be91-0d75-4d67-bca0-c21662278234 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:52.147824 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eb73be91-0d75-4d67-bca0-c21662278234 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094263 Aug 06 21:51:52.148433 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3506/6828] 10.222.0.33 () {58 vars in 1275 bytes} [Sat Aug 6 21:51:52 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:51:53.075581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-4f525e42-6161-404a-90f4-e46e943ccf4f req-00ec0499-6682-471a-8c84-cb167765fc43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec78825d-c939-4f04-ac18-79f127a7a542", "tag": "a2c5bcd0-3904-4aac-ade8-b34ac144b5f5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:51:53.081263 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:51:53.088079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4f525e42-6161-404a-90f4-e46e943ccf4f req-00ec0499-6682-471a-8c84-cb167765fc43 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:51:53.088560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4f525e42-6161-404a-90f4-e46e943ccf4f req-00ec0499-6682-471a-8c84-cb167765fc43 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:51:53.088997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-4f525e42-6161-404a-90f4-e46e943ccf4f req-00ec0499-6682-471a-8c84-cb167765fc43 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:51:53.100952 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-4f525e42-6161-404a-90f4-e46e943ccf4f req-00ec0499-6682-471a-8c84-cb167765fc43 service nova] Creating event network-changed:a2c5bcd0-3904-4aac-ade8-b34ac144b5f5 for instance ec78825d-c939-4f04-ac18-79f127a7a542 on nch2-master-1 Aug 06 21:51:53.105753 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-4f525e42-6161-404a-90f4-e46e943ccf4f req-00ec0499-6682-471a-8c84-cb167765fc43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033893 Aug 06 21:51:53.106593 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3323/6829] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:52:29.320987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:29.321787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:29.324330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:29.325418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=54 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:29.330308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:29.330950 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:29.339728 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:29.340410 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:29.340854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:29.341547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:29.342046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:29.342574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:29.477742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:29.485269 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f047c005-521d-44c0-a5a2-3a25017b8d87 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1667 microversion: 2.1 time: 0.165109 Aug 06 21:52:29.485834 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3507/6830] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:29 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:29.636407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=23 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:29.637975 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:29.642692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:29.643326 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:29.651108 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:29.651605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:29.652059 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:29.652770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:29.653236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:29.653679 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:29.681199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:52:29.761436 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-707fafcc-0654-4e39-b06c-5667b644f8c7 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 204 len: 0 microversion: 2.1 time: 0.127192 Aug 06 21:52:29.762125 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3324/6831] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:52:29 2022] DELETE /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:52:29.770363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:29.771906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:29.777846 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:29.778274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:29.778740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:29.779431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:29.779887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:29.780333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:29.909475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:29.917898 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-30b0e9d7-1407-407c-a4f1-b09817cda07e tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1673 microversion: 2.1 time: 0.151504 Aug 06 21:52:29.918466 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3508/6832] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:29 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:30.940264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:30.940896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:30.948015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:30.948502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:30.948948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:30.949655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:30.950118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:30.950573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:31.125056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:31.133669 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-92021a9d-13a1-4995-8dd3-d94157b478c0 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1673 microversion: 2.1 time: 0.198527 Aug 06 21:52:31.134501 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3325/6833] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:30 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:32.154683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:32.155297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:32.162047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:32.162529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:32.162985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:32.163683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:32.164137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:32.164557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:32.233952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3cdb291b6146bb8d30f96ed07f1a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd0cdecacf498d8623f2be190dc57c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:32.243492 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6e493eb-ec7e-47b1-800b-1d6e5cdd1311 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 200 len: 1606 microversion: 2.1 time: 0.092606 Aug 06 21:52:32.244288 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3509/6834] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:32 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 1606 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:32.416754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8a9a9a18-49e8-47a4-9a2f-0b53f9bfb66e req-211e1d86-ba86-488f-9850-81498b78f1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec78825d-c939-4f04-ac18-79f127a7a542", "name": "network-vif-deleted", "tag": "a2c5bcd0-3904-4aac-ade8-b34ac144b5f5"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:52:32.426530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8a9a9a18-49e8-47a4-9a2f-0b53f9bfb66e req-211e1d86-ba86-488f-9850-81498b78f1cf service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:32.427732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8a9a9a18-49e8-47a4-9a2f-0b53f9bfb66e req-211e1d86-ba86-488f-9850-81498b78f1cf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:32.428183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8a9a9a18-49e8-47a4-9a2f-0b53f9bfb66e req-211e1d86-ba86-488f-9850-81498b78f1cf service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:32.439833 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8a9a9a18-49e8-47a4-9a2f-0b53f9bfb66e req-211e1d86-ba86-488f-9850-81498b78f1cf service nova] Creating event network-vif-deleted:a2c5bcd0-3904-4aac-ade8-b34ac144b5f5 for instance ec78825d-c939-4f04-ac18-79f127a7a542 on nch2-master-1 Aug 06 21:52:32.445928 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8a9a9a18-49e8-47a4-9a2f-0b53f9bfb66e req-211e1d86-ba86-488f-9850-81498b78f1cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101340 Aug 06 21:52:32.446569 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3326/6835] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:52:33.265224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:33.265848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ec78825d-c939-4f04-ac18-79f127a7a542] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:33.273646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.274127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.274600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.275333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.275799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.276229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.289669 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance ec78825d-c939-4f04-ac18-79f127a7a542 could not be found. Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 HTTP/1.1 Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ec78825d-c939-4f04-ac18-79f127a7a542 could not be found. Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ec78825d-c939-4f04-ac18-79f127a7a542'} Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec78825d-c939-4f04-ac18-79f127a7a542 could not be found. Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec78825d-c939-4f04-ac18-79f127a7a542 could not be found. Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.291230 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec78825d-c939-4f04-ac18-79f127a7a542 could not be found. Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance ec78825d-c939-4f04-ac18-79f127a7a542 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d1bd91e-8e0c-43c1-a604-648af354cc38 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542" status: 404 len: 111 microversion: 2.1 time: 0.031400 Aug 06 21:52:33.299051 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3510/6836] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:33 2022] GET /compute/v2.1/servers/ec78825d-c939-4f04-ac18-79f127a7a542 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:52:33.302189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:33.302952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:33.309321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.309806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.310250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.310976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.311437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.311870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.325728 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 HTTP/1.1 Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '0fd28800-1fd7-49cf-a930-9107020e49a5'} Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:52:33.327397 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0ca200f3-dfe7-49ae-9d67-c886d46c7373 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 404 len: 111 microversion: 2.1 time: 0.031242 Aug 06 21:52:33.331852 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3327/6837] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:52:33 2022] DELETE /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:52:33.338372 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:33.339024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 0fd28800-1fd7-49cf-a930-9107020e49a5] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:33.345057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.345544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.345985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.346716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.347179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.347611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.361178 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 HTTP/1.1 Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '0fd28800-1fd7-49cf-a930-9107020e49a5'} Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.362691 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance 0fd28800-1fd7-49cf-a930-9107020e49a5 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80536fe9-ed9b-4c81-a6da-fa617168c946 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5" status: 404 len: 111 microversion: 2.1 time: 0.029646 Aug 06 21:52:33.368608 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3511/6838] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:33 2022] GET /compute/v2.1/servers/0fd28800-1fd7-49cf-a930-9107020e49a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:52:33.373504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:33.374022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:33.381700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.382193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.382691 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.383410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.383887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.384330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.398170 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 HTTP/1.1 Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0'} Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:52:33.399750 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-43ec3dd2-9e4e-45d2-b140-fae8db54d51d tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 404 len: 111 microversion: 2.1 time: 0.031676 Aug 06 21:52:33.403688 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3328/6839] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:52:33 2022] DELETE /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:52:33.409655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:33.410277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:33.416662 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.417149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.417593 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.418288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.418784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.419218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.433145 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 HTTP/1.1 Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0'} Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.434698 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3a3f6946-ca4e-4ff3-9d01-6f01dfa097a3 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0" status: 404 len: 111 microversion: 2.1 time: 0.030252 Aug 06 21:52:33.439289 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3512/6840] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:33 2022] GET /compute/v2.1/servers/ebaf9aa1-3bae-4fb2-b0f2-a5a9772c2af0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:52:33.444829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:33.445337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:33.451453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.451940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.452381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.453077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.453537 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.453969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.468157 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: request: DELETE /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d HTTP/1.1 Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '7ca718ce-7050-465b-87aa-fc22f7f9ba4d'} Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:52:33.469723 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-94813581-5e5d-4557-9005-62d1f0b42ba9 tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 404 len: 111 microversion: 2.1 time: 0.030541 Aug 06 21:52:33.476477 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3329/6841] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:52:33 2022] DELETE /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:52:33.482707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:33.483350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] [instance: 7ca718ce-7050-465b-87aa-fc22f7f9ba4d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:33.489510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.490390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.490918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.491615 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:33.492078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:33.492503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:33.507806 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] HTTP exception thrown: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Request method failure captured: Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d HTTP/1.1 Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uGRvlC4q3fLKYBTJjCaUSuCM8CLj4adLXwy38fMdCYuYwumwDFQqzziWYCvGxGX7AfvTDebFOeUdx065c2N2Wo7yxvNIQ2IbzjKqniLQVPR23pJ7NEFNQiWmf91WaceCY3OXtUk8EOqs4Rff25QLDhi8zXeXzj8MYXh-973A5x0qTw Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31dd0cdecacf498d8623f2be190dc57c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31dd0cdecacf498d8623f2be190dc57c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 31dd0cdecacf498d8623f2be190dc57c Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServerActionsTestJSON-2138063730 Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 7e3cdb291b6146bb8d30f96ed07f1a46 Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServerActionsTestJSON-2138063730-project Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '7ca718ce-7050-465b-87aa-fc22f7f9ba4d'} Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:52:33.509308 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Returning 404 to user: Instance 7ca718ce-7050-465b-87aa-fc22f7f9ba4d could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-02503578-00df-4181-ade5-ed8d9106720f tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d" status: 404 len: 111 microversion: 2.1 time: 0.031977 Aug 06 21:52:33.513943 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3513/6842] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:33 2022] GET /compute/v2.1/servers/7ca718ce-7050-465b-87aa-fc22f7f9ba4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:52:33.519291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-32e618f8-2bda-4165-8cf0-6b5a30a6875b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] Calling method '.version_select at 0x7f72a34d81f0>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:33.542778 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-32e618f8-2bda-4165-8cf0-6b5a30a6875b tempest-ServerActionsTestJSON-2138063730 tempest-ServerActionsTestJSON-2138063730-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-478934283" status: 202 len: 0 microversion: 2.1 time: 0.027197 Aug 06 21:52:33.543348 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3330/6843] 10.222.0.33 () {58 vars in 1218 bytes} [Sat Aug 6 21:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-478934283 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:52:42.800219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-440689753", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "00047da3-d35b-4031-916f-cc5767bbd53b"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:52:42.862507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] validate_networks() for [('00047da3-d35b-4031-916f-cc5767bbd53b', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:52:43.343589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:52:43.344019 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:52:43.344495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:52:43.344906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:52:43.345325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:52:43.355174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:43.355781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:43.356225 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:43.356955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:43.357413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:43.357842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:43.376129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Getting quotas for project 4f472e712d724af589c11ca6a4d4be0f. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:52:43.382060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Getting quotas for user 3704af7501d24e93935fbc61a532d293 and project 4f472e712d724af589c11ca6a4d4be0f. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:52:43.397226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:52:43.399494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:52:43.444713 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7b287b21-90e7-4d68-82d6-e2de7526b83d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789945 Aug 06 21:52:43.445375 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3514/6844] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:52:43.458590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-086c2075-a9bf-44e2-8e81-d1b799ee7950 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:43.459230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-086c2075-a9bf-44e2-8e81-d1b799ee7950 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:43.461291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:43.520850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-086c2075-a9bf-44e2-8e81-d1b799ee7950 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:43.528707 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-086c2075-a9bf-44e2-8e81-d1b799ee7950 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1216 microversion: 2.1 time: 0.076176 Aug 06 21:52:43.529363 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3331/6845] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:43 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:52:44.550442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:44.551051 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:44.562795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:44.567572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:44.568134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:44.568995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:44.569618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:44.570148 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:44.651640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:44.662475 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b295dfbd-d9e8-4c03-8d75-7ec1354a4863 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1274 microversion: 2.1 time: 0.116959 Aug 06 21:52:44.677713 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3515/6846] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:44 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:45.685574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:45.686319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:45.694077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:45.694621 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:45.695153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:45.695978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:45.696672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:45.697279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:45.882107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-8cb47465-6fff-4f1e-88fe-da227b471a2c req-22788a85-63fe-45c6-a4ee-96878239039b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af586a93-3666-451f-b68e-c3eff93d317f", "tag": "771db531-e826-471e-911f-96675db50e51"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:52:45.892567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8cb47465-6fff-4f1e-88fe-da227b471a2c req-22788a85-63fe-45c6-a4ee-96878239039b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:45.893333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8cb47465-6fff-4f1e-88fe-da227b471a2c req-22788a85-63fe-45c6-a4ee-96878239039b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:45.893968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-8cb47465-6fff-4f1e-88fe-da227b471a2c req-22788a85-63fe-45c6-a4ee-96878239039b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:45.913378 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-8cb47465-6fff-4f1e-88fe-da227b471a2c req-22788a85-63fe-45c6-a4ee-96878239039b service nova] Creating event network-changed:771db531-e826-471e-911f-96675db50e51 for instance af586a93-3666-451f-b68e-c3eff93d317f on nch2-master-1 Aug 06 21:52:45.921626 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-8cb47465-6fff-4f1e-88fe-da227b471a2c req-22788a85-63fe-45c6-a4ee-96878239039b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043764 Aug 06 21:52:45.923382 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3516/6847] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:52:45.952029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:45.961369 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-64474e2e-adea-4c8c-a8c6-1456123d4af9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1316 microversion: 2.1 time: 0.280878 Aug 06 21:52:45.962105 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3332/6848] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:45 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:46.982863 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:46.983541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:46.990745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:46.991290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:46.991733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:46.992452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:46.992909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:46.993357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:47.122438 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:47.131515 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0a568fcd-c42f-4854-ae10-0067f0c85774 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1316 microversion: 2.1 time: 0.152869 Aug 06 21:52:47.132318 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3517/6849] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:46 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:48.152530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:48.153152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:48.160940 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:48.161464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:48.161916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:48.162675 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:48.163141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:48.163582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:48.293640 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:48.301222 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-abe3467e-551a-4b3f-b684-e76f36c30b00 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1316 microversion: 2.1 time: 0.152685 Aug 06 21:52:48.301801 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3333/6850] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:48 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:49.322939 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:49.323566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:49.330990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:49.331482 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:49.331924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:49.332627 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:49.333087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:49.334297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:49.465745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:49.473477 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b8b35d5-6d57-41ea-89d7-638015d0a4d6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1316 microversion: 2.1 time: 0.154639 Aug 06 21:52:49.474082 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3518/6851] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:49 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:50.495073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:50.495701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:50.502438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:50.502959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:50.503404 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:50.504104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:50.504569 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:50.505005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:50.642146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:50.651128 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-89903028-f239-4860-84cb-e8d305b2156e tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1316 microversion: 2.1 time: 0.159943 Aug 06 21:52:50.651968 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3334/6852] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:50 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:50.889942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-9042c146-6d35-402a-9bad-c4813eec249d req-677a0d50-ea7a-472a-879f-87baea1c535a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af586a93-3666-451f-b68e-c3eff93d317f", "name": "network-vif-plugged", "status": "completed", "tag": "771db531-e826-471e-911f-96675db50e51"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:52:50.899943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9042c146-6d35-402a-9bad-c4813eec249d req-677a0d50-ea7a-472a-879f-87baea1c535a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:50.900634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9042c146-6d35-402a-9bad-c4813eec249d req-677a0d50-ea7a-472a-879f-87baea1c535a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:50.901066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9042c146-6d35-402a-9bad-c4813eec249d req-677a0d50-ea7a-472a-879f-87baea1c535a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:50.912784 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-9042c146-6d35-402a-9bad-c4813eec249d req-677a0d50-ea7a-472a-879f-87baea1c535a service nova] Creating event network-vif-plugged:771db531-e826-471e-911f-96675db50e51 for instance af586a93-3666-451f-b68e-c3eff93d317f on nch2-master-1 Aug 06 21:52:50.917738 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-9042c146-6d35-402a-9bad-c4813eec249d req-677a0d50-ea7a-472a-879f-87baea1c535a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088855 Aug 06 21:52:50.918464 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3519/6853] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:52:51.672522 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:51.673207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:51.680760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:51.681257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:51.681706 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:51.682411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:51.682922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:51.683348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:51.813041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:51.821337 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-205a019d-2e27-452d-9385-b9a9746f1cf9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1316 microversion: 2.1 time: 0.152770 Aug 06 21:52:51.821919 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3335/6854] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:51 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:52.847165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:52.847870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:52.854661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:52.855146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:52.855580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:52.856268 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:52.856719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:52.857140 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:52.988241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:52.996438 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ebec8607-c9c2-4429-ab2f-ef35ad080835 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1504 microversion: 2.1 time: 0.154346 Aug 06 21:52:52.997007 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3520/6855] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:52 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:53.111280 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-565158496", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "00047da3-d35b-4031-916f-cc5767bbd53b"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:52:53.165999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] validate_networks() for [('00047da3-d35b-4031-916f-cc5767bbd53b', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:52:53.525392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:53.870066 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:52:53.870484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:52:53.871361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:52:53.871916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:52:53.872465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:52:53.883622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:53.884111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:53.884726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:53.885585 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:53.886120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:53.886636 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:53.906039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Getting quotas for project 4f472e712d724af589c11ca6a4d4be0f. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:52:53.912965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Getting quotas for user 3704af7501d24e93935fbc61a532d293 and project 4f472e712d724af589c11ca6a4d4be0f. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:52:53.926128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:52:53.929361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:52:53.975205 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f12e86c-f165-4b56-b17a-721846576446 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867747 Aug 06 21:52:53.978592 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3336/6856] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:52:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:52:53.986730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f88aa883-80f8-40b9-a904-38aea9326cb7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:53.987353 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f88aa883-80f8-40b9-a904-38aea9326cb7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:53.991159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:53.991828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:54.047462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f88aa883-80f8-40b9-a904-38aea9326cb7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:54.057032 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f88aa883-80f8-40b9-a904-38aea9326cb7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1216 microversion: 2.1 time: 0.074214 Aug 06 21:52:54.057624 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3521/6857] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:53 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:52:55.078676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:55.079303 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:55.086518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:55.087046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:55.087492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:55.088242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:55.088708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:55.089143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:55.173719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:55.182233 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6bf7b533-79c2-49df-bda4-c1cec6098a80 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1274 microversion: 2.1 time: 0.108419 Aug 06 21:52:55.182851 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3337/6858] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:55 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:56.203424 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:56.204065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:56.215733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:56.216222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:56.216663 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:56.217364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:56.217825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:56.218256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:56.277093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1455449b-f1ed-4130-b93e-ac088637513b req-e8ee748f-4932-49f3-9bf4-873010372a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a586e3-5308-4887-bdfe-b1d203a84ede", "tag": "8984756c-6e6c-440f-8a7f-959a6606d06a"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:52:56.291481 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1455449b-f1ed-4130-b93e-ac088637513b req-e8ee748f-4932-49f3-9bf4-873010372a7f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:56.292359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1455449b-f1ed-4130-b93e-ac088637513b req-e8ee748f-4932-49f3-9bf4-873010372a7f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:56.293003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1455449b-f1ed-4130-b93e-ac088637513b req-e8ee748f-4932-49f3-9bf4-873010372a7f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:56.307394 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1455449b-f1ed-4130-b93e-ac088637513b req-e8ee748f-4932-49f3-9bf4-873010372a7f service nova] Creating event network-changed:8984756c-6e6c-440f-8a7f-959a6606d06a for instance 41a586e3-5308-4887-bdfe-b1d203a84ede on nch1-master-1 Aug 06 21:52:56.312484 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1455449b-f1ed-4130-b93e-ac088637513b req-e8ee748f-4932-49f3-9bf4-873010372a7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042505 Aug 06 21:52:56.313105 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3338/6859] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:52:56.371132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:56.378762 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-43870ea3-13db-4fc8-a4eb-9203a3863aac tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1316 microversion: 2.1 time: 0.179242 Aug 06 21:52:56.379350 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3522/6860] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:56 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:57.400091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:57.400836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:57.408038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:57.408512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:57.408954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:57.409657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:57.410114 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:57.410566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:57.594573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:57.602192 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5bb4b78e-8174-4ee3-8b31-c4c5f6fbd0c1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1316 microversion: 2.1 time: 0.206933 Aug 06 21:52:57.602808 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3339/6861] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:57 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:58.622592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:58.623220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:58.630782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:58.631277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:58.631722 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:58.632427 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:58.632891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:58.633326 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:58.761172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:58.768761 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-14d53b93-4915-4b2f-92ef-aa962ba7324d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1316 microversion: 2.1 time: 0.149992 Aug 06 21:52:58.769272 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3523/6862] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:58 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:52:59.790131 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:52:59.790730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:52:59.795924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:52:59.802814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:59.803316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:59.803769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:59.804483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:52:59.804944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:52:59.805383 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:52:59.956722 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:52:59.966921 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-59291455-14b4-4485-9d0e-e519cb50c1ed tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1316 microversion: 2.1 time: 0.181320 Aug 06 21:52:59.967774 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3340/6863] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:52:59 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:00.988200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:00.988823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:00.994001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:01.000281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:01.000776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:01.001221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:01.001926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:01.002385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:01.002838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:01.008835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=69 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:01.141654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:01.149378 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aaba2f0d-4f42-4749-b562-0e4e82f65dbd tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1316 microversion: 2.1 time: 0.165267 Aug 06 21:53:01.149956 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3524/6864] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:00 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:01.649879 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-56ac51f8-5ae8-44c5-b746-1848dd7133d5 req-d9f91676-d49f-4a9a-b3e8-bbb586ccb7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a586e3-5308-4887-bdfe-b1d203a84ede", "name": "network-vif-plugged", "status": "completed", "tag": "8984756c-6e6c-440f-8a7f-959a6606d06a"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:53:01.661040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-56ac51f8-5ae8-44c5-b746-1848dd7133d5 req-d9f91676-d49f-4a9a-b3e8-bbb586ccb7db service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:01.661530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-56ac51f8-5ae8-44c5-b746-1848dd7133d5 req-d9f91676-d49f-4a9a-b3e8-bbb586ccb7db service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:01.661974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-56ac51f8-5ae8-44c5-b746-1848dd7133d5 req-d9f91676-d49f-4a9a-b3e8-bbb586ccb7db service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:01.677339 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-56ac51f8-5ae8-44c5-b746-1848dd7133d5 req-d9f91676-d49f-4a9a-b3e8-bbb586ccb7db service nova] Creating event network-vif-plugged:8984756c-6e6c-440f-8a7f-959a6606d06a for instance 41a586e3-5308-4887-bdfe-b1d203a84ede on nch1-master-1 Aug 06 21:53:01.682338 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-56ac51f8-5ae8-44c5-b746-1848dd7133d5 req-d9f91676-d49f-4a9a-b3e8-bbb586ccb7db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037335 Aug 06 21:53:01.683014 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3341/6865] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:53:02.169446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:02.169980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:02.177094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:02.177589 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:02.178921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:02.179633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:02.180099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:02.180532 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:02.308837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:02.316377 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f57ff66c-6a4e-4c2d-9017-5dd64e61b57f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1316 microversion: 2.1 time: 0.150976 Aug 06 21:53:02.316957 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3525/6866] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:02 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:03.339198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:03.339917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:03.346194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:03.346730 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:03.347183 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:03.347892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:03.348356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:03.348793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:03.480668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:03.488661 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d3317b20-faeb-48c3-ba4b-b003a31f1282 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1504 microversion: 2.1 time: 0.155094 Aug 06 21:53:03.490042 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3342/6867] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:03 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:03.509362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:03.509864 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:03.516859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:03.517348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:03.517786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:03.518481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:03.518967 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:03.519392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:03.544944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:53:03.621208 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7de544a0-87d1-4eb7-9295-f201d1cbaaaa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "DELETE /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 204 len: 0 microversion: 2.1 time: 0.115458 Aug 06 21:53:03.622957 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3526/6868] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:53:03 2022] DELETE /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:53:03.630954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:03.631580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:03.637697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:03.638220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:03.638754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:03.639466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:03.639932 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:03.640370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:03.780371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:03.788149 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1ea9f662-2e12-496f-9ffa-37328254119f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1510 microversion: 2.1 time: 0.161051 Aug 06 21:53:03.789674 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3343/6869] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:03 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:04.813761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:04.814485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:04.816494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:04.823951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:04.824442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:04.824874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:04.825572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:04.826026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:04.826476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:04.969221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:04.977461 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3863c31d-38ea-4577-92f0-0fa81f52fdc9 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 200 len: 1510 microversion: 2.1 time: 0.167899 Aug 06 21:53:04.978044 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3527/6870] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:04 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:05.350164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-e9564fb7-fc83-4f5f-9999-f969724e5935 req-6f10565e-8edf-40cc-ad7c-71b6433da6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a586e3-5308-4887-bdfe-b1d203a84ede", "name": "network-vif-deleted", "tag": "8984756c-6e6c-440f-8a7f-959a6606d06a"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:53:05.355638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:05.356829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:05.383438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e9564fb7-fc83-4f5f-9999-f969724e5935 req-6f10565e-8edf-40cc-ad7c-71b6433da6d5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:05.383920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e9564fb7-fc83-4f5f-9999-f969724e5935 req-6f10565e-8edf-40cc-ad7c-71b6433da6d5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:05.384357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-e9564fb7-fc83-4f5f-9999-f969724e5935 req-6f10565e-8edf-40cc-ad7c-71b6433da6d5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:05.404193 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-e9564fb7-fc83-4f5f-9999-f969724e5935 req-6f10565e-8edf-40cc-ad7c-71b6433da6d5 service nova] Creating event network-vif-deleted:8984756c-6e6c-440f-8a7f-959a6606d06a for instance 41a586e3-5308-4887-bdfe-b1d203a84ede on nch1-master-1 Aug 06 21:53:05.409800 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-e9564fb7-fc83-4f5f-9999-f969724e5935 req-6f10565e-8edf-40cc-ad7c-71b6433da6d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063196 Aug 06 21:53:05.411511 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3344/6871] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:53:05.998925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:05.999579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:06.006361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.006962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.007489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.008362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.008823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.009252 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.023408 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] HTTP exception thrown: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Request method failure captured: Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede HTTP/1.1 Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uKquA-4hjE5PzKglMwIyrl98jouqOMhb5ljyt9Tc3mHJ6dBTbDOGxpm9sW9pCi-3lr6d9moIbF5JuATFx9R6n8QYKTjb2993y6_p0oXJ2DWzjUrsKg9S1nbqzx4HFHWvAqJtTjOON9BhoPtM8UqEWdsQedTYoVP2v3Qg3M65e6tQD4 Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4f472e712d724af589c11ca6a4d4be0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3704af7501d24e93935fbc61a532d293 Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '41a586e3-5308-4887-bdfe-b1d203a84ede'} Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:06.025212 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Returning 404 to user: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e8b7472c-d6ed-43da-9705-063def798dbb tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 404 len: 111 microversion: 2.1 time: 0.032145 Aug 06 21:53:06.029531 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3528/6872] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:05 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:53:06.036914 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:06.037624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:06.044770 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.045262 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.045701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.046670 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.047133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.047581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.182837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:06.190452 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb18a977-f6fe-4331-be0e-be01be3a67f6 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1504 microversion: 2.1 time: 0.157842 Aug 06 21:53:06.191060 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3345/6873] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:06 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:06.211274 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67996ec6-7c15-471a-a220-8a5ce3823392 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:53:06.213531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-67996ec6-7c15-471a-a220-8a5ce3823392 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: def3ef8f-119d-40a3-a120-6d9825065ef9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:06.219639 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-67996ec6-7c15-471a-a220-8a5ce3823392 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] HTTP exception thrown: Instance def3ef8f-119d-40a3-a120-6d9825065ef9 could not be found. Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67996ec6-7c15-471a-a220-8a5ce3823392 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Request method failure captured: Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/def3ef8f-119d-40a3-a120-6d9825065ef9/action HTTP/1.1 Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 32 Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uKquA-4hjE5PzKglMwIyrl98jouqOMhb5ljyt9Tc3mHJ6dBTbDOGxpm9sW9pCi-3lr6d9moIbF5JuATFx9R6n8QYKTjb2993y6_p0oXJ2DWzjUrsKg9S1nbqzx4HFHWvAqJtTjOON9BhoPtM8UqEWdsQedTYoVP2v3Qg3M65e6tQD4 Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4f472e712d724af589c11ca6a4d4be0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3704af7501d24e93935fbc61a532d293 Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: {"resize": {"flavorRef": "452"}} Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance def3ef8f-119d-40a3-a120-6d9825065ef9 could not be found. Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'def3ef8f-119d-40a3-a120-6d9825065ef9', 'body': {'resize': {'flavorRef': '452'}}} Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def3ef8f-119d-40a3-a120-6d9825065ef9 could not be found. Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:53:06.221193 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def3ef8f-119d-40a3-a120-6d9825065ef9 could not be found. Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def3ef8f-119d-40a3-a120-6d9825065ef9 could not be found. Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-67996ec6-7c15-471a-a220-8a5ce3823392 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Returning 404 to user: Instance def3ef8f-119d-40a3-a120-6d9825065ef9 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-67996ec6-7c15-471a-a220-8a5ce3823392 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "POST /compute/v2.1/servers/def3ef8f-119d-40a3-a120-6d9825065ef9/action" status: 404 len: 111 microversion: 2.1 time: 0.015533 Aug 06 21:53:06.225508 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3529/6874] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:53:06 2022] POST /compute/v2.1/servers/def3ef8f-119d-40a3-a120-6d9825065ef9/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:53:06.231311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:06.231931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:06.238048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.238527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.239008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.239699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.240155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.240588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.376805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:06.385519 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-217f430a-415a-4886-85e4-f8b191bd9a8c tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1504 microversion: 2.1 time: 0.158098 Aug 06 21:53:06.386101 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3346/6875] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:06 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:06.405827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:06.406434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:06.413381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.414836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.415277 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.415965 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.416420 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.416844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.551570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:06.559385 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-18311ceb-8690-4a83-9ab8-1b86ca2eaa3f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1504 microversion: 2.1 time: 0.157403 Aug 06 21:53:06.559951 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3530/6876] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:06 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:06.580334 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "b48b8c30-688b-45e6-afc7-7317fd79dc66"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:53:06.582806 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:06.589461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.589944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.590381 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.591112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.591568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.591998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.620650 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:06.626006 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] HTTP exception thrown: Flavor b48b8c30-688b-45e6-afc7-7317fd79dc66 could not be found. Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Request method failure captured: Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: request: POST /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f/action HTTP/1.1 Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 65 Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uKquA-4hjE5PzKglMwIyrl98jouqOMhb5ljyt9Tc3mHJ6dBTbDOGxpm9sW9pCi-3lr6d9moIbF5JuATFx9R6n8QYKTjb2993y6_p0oXJ2DWzjUrsKg9S1nbqzx4HFHWvAqJtTjOON9BhoPtM8UqEWdsQedTYoVP2v3Qg3M65e6tQD4 Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4f472e712d724af589c11ca6a4d4be0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3704af7501d24e93935fbc61a532d293 Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: {"resize": {"flavorRef": "b48b8c30-688b-45e6-afc7-7317fd79dc66"}} Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: exception: Flavor b48b8c30-688b-45e6-afc7-7317fd79dc66 could not be found. Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'af586a93-3666-451f-b68e-c3eff93d317f', 'body': {'resize': {'flavorRef': 'b48b8c30-688b-45e6-afc7-7317fd79dc66'}}} Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 21:53:06.631121 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b48b8c30-688b-45e6-afc7-7317fd79dc66 could not be found. Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor b48b8c30-688b-45e6-afc7-7317fd79dc66 could not be found. Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b48b8c30-688b-45e6-afc7-7317fd79dc66 could not be found. Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Returning 400 to user: Flavor b48b8c30-688b-45e6-afc7-7317fd79dc66 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-016a6b82-d331-4059-aa0e-e32898626523 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "POST /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f/action" status: 400 len: 107 microversion: 2.1 time: 0.056445 Aug 06 21:53:06.636550 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3347/6877] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:53:06 2022] POST /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f/action => generated 107 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:53:06.642005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:06.642652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:06.649383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.649866 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.650307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.651037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.651502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.651955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.779829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:06.787293 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e6c9cebc-06f3-424f-aabd-cea9b983a95d tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1504 microversion: 2.1 time: 0.149167 Aug 06 21:53:06.787863 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3531/6878] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:06 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:06.808292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:06.808921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:06.814999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.815496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.815941 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.816647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:06.817120 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:06.817558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:06.956512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:06.964796 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-101a3697-fdb3-4c24-ad01-a5271a4a85a7 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1504 microversion: 2.1 time: 0.160903 Aug 06 21:53:06.965365 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3348/6879] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:06 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:06.984573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-df87d240-4d73-484c-8191-1b16bc9ec9e0 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-df87d240-4d73-484c-8191-1b16bc9ec9e0 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Request method failure captured: Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: request: POST /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f/action HTTP/1.1 Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 29 Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uKquA-4hjE5PzKglMwIyrl98jouqOMhb5ljyt9Tc3mHJ6dBTbDOGxpm9sW9pCi-3lr6d9moIbF5JuATFx9R6n8QYKTjb2993y6_p0oXJ2DWzjUrsKg9S1nbqzx4HFHWvAqJtTjOON9BhoPtM8UqEWdsQedTYoVP2v3Qg3M65e6tQD4 Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4f472e712d724af589c11ca6a4d4be0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3704af7501d24e93935fbc61a532d293 Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: {"resize": {"flavorRef": ""}} Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'af586a93-3666-451f-b68e-c3eff93d317f', 'body': {'resize': {'flavorRef': ''}}} Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise error Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi '' Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.988130 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-df87d240-4d73-484c-8191-1b16bc9ec9e0 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-df87d240-4d73-484c-8191-1b16bc9ec9e0 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "POST /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f/action" status: 400 len: 113 microversion: 2.1 time: 0.008930 Aug 06 21:53:06.993827 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3532/6880] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:53:06 2022] POST /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 21:53:06.998181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:06.998893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:07.004854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.005331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.005771 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.006460 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.006944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.007989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.139732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:07.147403 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3e14ba33-e6aa-4cdb-be26-9df0dac30dd1 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1504 microversion: 2.1 time: 0.152985 Aug 06 21:53:07.148016 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3349/6881] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:06 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:07.172278 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:07.172787 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:07.180802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.181293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.181771 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.182479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.182976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.183411 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.197005 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] HTTP exception thrown: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Request method failure captured: Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: request: DELETE /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede HTTP/1.1 Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uKquA-4hjE5PzKglMwIyrl98jouqOMhb5ljyt9Tc3mHJ6dBTbDOGxpm9sW9pCi-3lr6d9moIbF5JuATFx9R6n8QYKTjb2993y6_p0oXJ2DWzjUrsKg9S1nbqzx4HFHWvAqJtTjOON9BhoPtM8UqEWdsQedTYoVP2v3Qg3M65e6tQD4 Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4f472e712d724af589c11ca6a4d4be0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3704af7501d24e93935fbc61a532d293 Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '41a586e3-5308-4887-bdfe-b1d203a84ede'} Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:53:07.198565 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Returning 404 to user: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2cc53b46-885c-4301-8c65-5653922b9e20 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "DELETE /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 404 len: 111 microversion: 2.1 time: 0.032362 Aug 06 21:53:07.202531 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3533/6882] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:53:07 2022] DELETE /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:53:07.208888 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:07.209503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: 41a586e3-5308-4887-bdfe-b1d203a84ede] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:07.215662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.216146 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.216587 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.217281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.217737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.218164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.232385 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] HTTP exception thrown: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Request method failure captured: Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede HTTP/1.1 Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uKquA-4hjE5PzKglMwIyrl98jouqOMhb5ljyt9Tc3mHJ6dBTbDOGxpm9sW9pCi-3lr6d9moIbF5JuATFx9R6n8QYKTjb2993y6_p0oXJ2DWzjUrsKg9S1nbqzx4HFHWvAqJtTjOON9BhoPtM8UqEWdsQedTYoVP2v3Qg3M65e6tQD4 Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4f472e712d724af589c11ca6a4d4be0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 3704af7501d24e93935fbc61a532d293 Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '41a586e3-5308-4887-bdfe-b1d203a84ede'} Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:07.233903 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Returning 404 to user: Instance 41a586e3-5308-4887-bdfe-b1d203a84ede could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fcfbc5f8-9c8a-4459-944a-fb7da63e8a8f tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede" status: 404 len: 111 microversion: 2.1 time: 0.030539 Aug 06 21:53:07.238584 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3350/6883] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:07 2022] GET /compute/v2.1/servers/41a586e3-5308-4887-bdfe-b1d203a84ede => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:53:07.244972 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:07.245479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:07.251461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.251942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.252375 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.253064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.253524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.253948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.279753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:53:07.355334 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-84da8b1d-49a7-4fb3-995e-7765fcf622aa tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "DELETE /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 204 len: 0 microversion: 2.1 time: 0.114383 Aug 06 21:53:07.355827 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3534/6884] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:53:07 2022] DELETE /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:53:07.364656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:07.365278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:07.372132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.372622 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.373065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.373765 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:07.374224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:07.374710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:07.507064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:07.515239 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4465e2ca-def5-4cfe-980d-d8fba1c41798 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1510 microversion: 2.1 time: 0.154589 Aug 06 21:53:07.515827 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3351/6885] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:07 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:08.537386 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:08.538105 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:08.545770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:08.546266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:08.546742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:08.547443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:08.547908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:08.548339 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:08.683773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3704af7501d24e93935fbc61a532d293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f472e712d724af589c11ca6a4d4be0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:08.692144 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bb42db6a-5209-4c39-bcf3-91e28d38a542 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 200 len: 1510 microversion: 2.1 time: 0.159043 Aug 06 21:53:08.692719 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3535/6886] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:08 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:09.109288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-fb3282f2-5d00-4a9d-b0e0-74f699dd1dbe req-f193533f-1941-4b20-8d7d-3e00430a6f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af586a93-3666-451f-b68e-c3eff93d317f", "name": "network-vif-deleted", "tag": "771db531-e826-471e-911f-96675db50e51"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:53:09.123892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fb3282f2-5d00-4a9d-b0e0-74f699dd1dbe req-f193533f-1941-4b20-8d7d-3e00430a6f8e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:09.124786 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fb3282f2-5d00-4a9d-b0e0-74f699dd1dbe req-f193533f-1941-4b20-8d7d-3e00430a6f8e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:09.125314 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fb3282f2-5d00-4a9d-b0e0-74f699dd1dbe req-f193533f-1941-4b20-8d7d-3e00430a6f8e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:09.129746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=100 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:09.141097 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-fb3282f2-5d00-4a9d-b0e0-74f699dd1dbe req-f193533f-1941-4b20-8d7d-3e00430a6f8e service nova] Creating event network-vif-deleted:771db531-e826-471e-911f-96675db50e51 for instance af586a93-3666-451f-b68e-c3eff93d317f on nch2-master-1 Aug 06 21:53:09.147475 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-fb3282f2-5d00-4a9d-b0e0-74f699dd1dbe req-f193533f-1941-4b20-8d7d-3e00430a6f8e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041892 Aug 06 21:53:09.149216 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3352/6887] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:53:09.714143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:09.714802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] [instance: af586a93-3666-451f-b68e-c3eff93d317f] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:09.721843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:09.722334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:09.722822 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:09.723524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:09.723988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:09.724421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:09.740177 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] HTTP exception thrown: Instance af586a93-3666-451f-b68e-c3eff93d317f could not be found. Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Request method failure captured: Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f HTTP/1.1 Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uKquA-4hjE5PzKglMwIyrl98jouqOMhb5ljyt9Tc3mHJ6dBTbDOGxpm9sW9pCi-3lr6d9moIbF5JuATFx9R6n8QYKTjb2993y6_p0oXJ2DWzjUrsKg9S1nbqzx4HFHWvAqJtTjOON9BhoPtM8UqEWdsQedTYoVP2v3Qg3M65e6tQD4 Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4f472e712d724af589c11ca6a4d4be0f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4f472e712d724af589c11ca6a4d4be0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 4f472e712d724af589c11ca6a4d4be0f Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1787337829 Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: 3704af7501d24e93935fbc61a532d293 Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-ServersNegativeTestJSON-1787337829-project Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance af586a93-3666-451f-b68e-c3eff93d317f could not be found. Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': 'af586a93-3666-451f-b68e-c3eff93d317f'} Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af586a93-3666-451f-b68e-c3eff93d317f could not be found. Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af586a93-3666-451f-b68e-c3eff93d317f could not be found. Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:53:09.742463 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af586a93-3666-451f-b68e-c3eff93d317f could not be found. Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] Returning 404 to user: Instance af586a93-3666-451f-b68e-c3eff93d317f could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3c0005c5-f7ce-42c5-89c6-f86e90fcf4c4 tempest-ServersNegativeTestJSON-1787337829 tempest-ServersNegativeTestJSON-1787337829-project] 10.222.0.33 "GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f" status: 404 len: 111 microversion: 2.1 time: 0.033804 Aug 06 21:53:09.747188 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3536/6888] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:09 2022] GET /compute/v2.1/servers/af586a93-3666-451f-b68e-c3eff93d317f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:53:43.661951 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:53:43.663533 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 21:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:53:50.613912 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a204bbe8-9844-4a91-8118-4bcfa2d4f0e8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Action: 'create', calling method: .version_select at 0x7f72a367ee50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-367488819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSsaV5o9bimXYopCZ+GONnpCOdx6I2bcq0DiyyJ4eahfFKH3CpddZOhXVE0IWqfe01836nv3Mxo1D0lkrbgcqgWv3b8TFsbwuZxSnJ356BQ3j05/9t6AKoqo20Xm/ovOg=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:53:50.620707 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=27 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:50.637474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a204bbe8-9844-4a91-8118-4bcfa2d4f0e8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Getting quotas for project 429e90fa99b8422db34aff5fe9d28430. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:53:50.642741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-a204bbe8-9844-4a91-8118-4bcfa2d4f0e8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Getting quotas for user a4d571e08f5a4eb6a79cc1ef853e53a9 and project 429e90fa99b8422db34aff5fe9d28430. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:53:50.670669 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a204bbe8-9844-4a91-8118-4bcfa2d4f0e8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061207 Aug 06 21:53:50.671367 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3353/6889] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:53:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:53:50.722076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-831900519", "imageRef": "b5e6e485-a838-412c-864d-907fe1d5789e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-367488819", "networks": [{"uuid": "cb99427c-d902-4ef4-ab0d-e3e7346cebe9"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:53:50.731220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:50.731879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:53:50.776917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] validate_networks() for [('cb99427c-d902-4ef4-ab0d-e3e7346cebe9', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:53:51.149107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:53:51.149531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:53:51.150031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:53:51.150439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:53:51.150878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:53:51.162367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:51.163249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:51.163683 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:51.164435 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:51.164893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:51.165321 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:51.185785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Getting quotas for project 429e90fa99b8422db34aff5fe9d28430. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:53:51.191181 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Getting quotas for user a4d571e08f5a4eb6a79cc1ef853e53a9 and project 429e90fa99b8422db34aff5fe9d28430. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:53:51.204090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:53:51.206568 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5e6e485-a838-412c-864d-907fe1d5789e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:53:51.252267 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d472e0fb-2b2e-42f5-a3c7-860811516695 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534249 Aug 06 21:53:51.252904 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3537/6890] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:53:51.264322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f99826b-d91b-4ecb-a5fa-3620c43b02ad tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:51.265064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f99826b-d91b-4ecb-a5fa-3620c43b02ad tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:51.321451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2f99826b-d91b-4ecb-a5fa-3620c43b02ad tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:51.328474 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f99826b-d91b-4ecb-a5fa-3620c43b02ad tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1257 microversion: 2.1 time: 0.068018 Aug 06 21:53:51.329057 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3354/6891] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:51 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:52.350628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:52.351348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:52.357436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:52.357930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:52.358378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:52.359127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:52.359591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:52.360028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:52.435134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:52.444877 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4299847f-4b4b-40c1-8e82-663368683a54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1317 microversion: 2.1 time: 0.099266 Aug 06 21:53:52.445528 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3538/6892] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:52 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1317 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:53.466482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:53.467142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:53.477652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:53.478743 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:53.479494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:53.480781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:53.481506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:53.482152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:53.658829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:53.668937 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-80657b0b-ea20-46ef-b5d7-dac2e17be518 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.206425 Aug 06 21:53:53.671277 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3355/6893] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:53 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:54.691994 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:54.692611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:54.701319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:54.701893 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:54.702494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:54.703403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:54.703937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:54.704499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:54.915421 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:54.923476 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-deaa4fe7-5670-4f2b-b35f-94cdc8ba6a04 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.235480 Aug 06 21:53:54.924052 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3539/6894] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:54 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:55.944899 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:55.945568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:55.952761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:55.953264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:55.953719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:55.954451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:55.954951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:55.955681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:56.111519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:56.119890 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ab8dfc9e-7047-4c6b-9dd6-becc4d249fbc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.179043 Aug 06 21:53:56.120549 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3356/6895] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:55 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:57.141363 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:57.142242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:57.150674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:57.151200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:57.151773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:57.152495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:57.152954 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:57.153408 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:57.311451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:57.322043 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7383e487-0dd7-4e69-bf53-eb41307a9843 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.184252 Aug 06 21:53:57.323751 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3540/6896] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:57 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:58.345382 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:58.346139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:58.357746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:58.358473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:58.358967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:58.359938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:58.360413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:58.360854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:58.507485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:58.523274 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6c072d5-0646-4a8f-bd71-6d0d1a2fcfcd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.181214 Aug 06 21:53:58.524523 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3357/6897] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:58 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:53:59.545633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:53:59.546265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:53:59.554813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:59.555307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:59.555747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:59.556449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:53:59.556911 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:53:59.557371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:53:59.686959 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:53:59.694570 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ec6b2751-ebd3-4e6b-a6b5-29714e52abc6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.153793 Aug 06 21:53:59.695141 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3541/6898] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:53:59 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:00.426153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-f91d9d52-62c4-4a21-98f0-2ec76a7fa170 req-cdd3337a-667c-4b84-817e-ae147ac113f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c725275-6202-4b81-bc98-c3542205e0d9", "tag": "4b27ab3f-4630-4d69-98db-1789f3a71fc7"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:00.440133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f91d9d52-62c4-4a21-98f0-2ec76a7fa170 req-cdd3337a-667c-4b84-817e-ae147ac113f3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:00.440632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f91d9d52-62c4-4a21-98f0-2ec76a7fa170 req-cdd3337a-667c-4b84-817e-ae147ac113f3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:00.441136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-f91d9d52-62c4-4a21-98f0-2ec76a7fa170 req-cdd3337a-667c-4b84-817e-ae147ac113f3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:00.456606 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-f91d9d52-62c4-4a21-98f0-2ec76a7fa170 req-cdd3337a-667c-4b84-817e-ae147ac113f3 service nova] Creating event network-changed:4b27ab3f-4630-4d69-98db-1789f3a71fc7 for instance 3c725275-6202-4b81-bc98-c3542205e0d9 on nch2-master-1 Aug 06 21:54:00.462771 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-f91d9d52-62c4-4a21-98f0-2ec76a7fa170 req-cdd3337a-667c-4b84-817e-ae147ac113f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040960 Aug 06 21:54:00.463498 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3358/6899] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:54:00.715548 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:00.716175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:00.723151 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:00.723633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:00.724070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:00.724773 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:00.725783 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:00.726282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:00.865292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:00.874381 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-72beffee-8def-4ebe-a637-0782c645cf71 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.162771 Aug 06 21:54:00.874992 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3542/6900] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:00 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:01.895614 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:01.896468 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:01.899271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:01.906078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:01.906617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:01.907144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:01.907891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:01.908365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:01.908836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:02.120143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:02.127892 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f08a5001-b564-4b4b-8869-60c47283dcff tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.236480 Aug 06 21:54:02.128479 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3359/6901] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:01 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:03.149261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:03.149805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:03.151829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:03.152556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:03.162425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:03.162975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:03.163573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:03.164280 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:03.164739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:03.165165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:03.299104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:03.307377 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bcdb35a6-090a-480e-a22d-c852bd424a4d tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.162111 Aug 06 21:54:03.307985 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3543/6902] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:03 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:04.328483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:04.329132 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:04.336925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:04.337433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:04.337868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:04.338626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:04.339092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:04.339526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:04.491829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:04.500363 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3c430da3-a8f0-46fa-ae3d-91b4763dffdc tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.175735 Aug 06 21:54:04.500963 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3360/6903] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:04 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:05.043997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b4763870-24d7-46fb-83bc-f840534fde9e req-23c6af76-053a-4a38-8ec9-a63c752069d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c725275-6202-4b81-bc98-c3542205e0d9", "name": "network-vif-plugged", "status": "completed", "tag": "4b27ab3f-4630-4d69-98db-1789f3a71fc7"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:05.055318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b4763870-24d7-46fb-83bc-f840534fde9e req-23c6af76-053a-4a38-8ec9-a63c752069d0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:05.055833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b4763870-24d7-46fb-83bc-f840534fde9e req-23c6af76-053a-4a38-8ec9-a63c752069d0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:05.056279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b4763870-24d7-46fb-83bc-f840534fde9e req-23c6af76-053a-4a38-8ec9-a63c752069d0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:05.067458 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b4763870-24d7-46fb-83bc-f840534fde9e req-23c6af76-053a-4a38-8ec9-a63c752069d0 service nova] Creating event network-vif-plugged:4b27ab3f-4630-4d69-98db-1789f3a71fc7 for instance 3c725275-6202-4b81-bc98-c3542205e0d9 on nch2-master-1 Aug 06 21:54:05.073305 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b4763870-24d7-46fb-83bc-f840534fde9e req-23c6af76-053a-4a38-8ec9-a63c752069d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033129 Aug 06 21:54:05.073900 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3544/6904] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:54:05.521338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:05.521967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:05.529604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:05.530091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:05.530540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:05.531268 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:05.531734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:05.532174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:05.660898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:05.668618 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b36efcf3-cfb0-4fb6-8150-376da258ee56 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1357 microversion: 2.1 time: 0.151153 Aug 06 21:54:05.669209 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3361/6905] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:05 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:06.692094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:06.692652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:06.699506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:06.700001 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:06.700447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:06.701159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:06.701625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:06.702061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:06.833600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:06.842002 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80867833-f5ee-4732-bca5-537c7f72d14c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1548 microversion: 2.1 time: 0.155277 Aug 06 21:54:06.842612 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3545/6906] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:06 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:06.861962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:06.862626 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:06.869536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:06.870027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:06.870475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:06.871247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:06.871716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:06.872154 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:07.006379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:07.014838 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d792d7d6-9527-4fc0-89e0-2548aff180c6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1548 microversion: 2.1 time: 0.156708 Aug 06 21:54:07.015427 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3362/6907] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:06 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:54:07.034917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:07.039626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:07.040387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Searching by: {'deleted': False, 'project_id': '429e90fa99b8422db34aff5fe9d28430'} {{(pid=142461) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:54:07.045810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:07.046285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:07.046767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:07.047487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:07.047937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:07.048356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:07.073318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.multi_cell_list [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:54:07.100165 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a627d29c-1e19-4565-b255-3c0cd8cfe057 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069015 Aug 06 21:54:07.100746 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3546/6908] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:54:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:54:07.112408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:07.113032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:07.119945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:07.120436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:07.120885 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:07.121590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:07.122053 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:07.122491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:07.253372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:07.261361 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-703e5f6e-3169-48bd-8414-59cbc4460923 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1548 microversion: 2.1 time: 0.152789 Aug 06 21:54:07.261947 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3363/6909] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:07 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:08.950164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:08.950697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:08.957802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:08.958288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:08.958757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:08.959451 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:08.959912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:08.960346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:08.985016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:54:09.061444 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-201ee2c4-09f1-4874-8cd4-6d4f84a418e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 204 len: 0 microversion: 2.1 time: 0.114899 Aug 06 21:54:09.062046 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3547/6910] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:54:08 2022] DELETE /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:54:09.070931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:09.071654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:09.078322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:09.078864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:09.079318 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:09.080028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:09.080754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:09.081196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:09.215329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:09.223022 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-618d65bc-a07a-4905-9d6b-3f228ab60f54 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1554 microversion: 2.1 time: 0.156483 Aug 06 21:54:09.223607 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3364/6911] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:09 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:10.244689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:10.245365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:10.252594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:10.253247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:10.253904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:10.254843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:10.255452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:10.255971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:10.394978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:10.402964 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a0138563-d2bb-458a-956b-1301c81c7b91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 200 len: 1554 microversion: 2.1 time: 0.162686 Aug 06 21:54:10.403550 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3548/6912] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:10 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:10.786855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-68cb768c-51a7-41ed-8e4e-b7ab7fec318c req-84466b54-9004-4dde-886e-4ff1771e512b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c725275-6202-4b81-bc98-c3542205e0d9", "name": "network-vif-deleted", "tag": "4b27ab3f-4630-4d69-98db-1789f3a71fc7"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:10.799311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-68cb768c-51a7-41ed-8e4e-b7ab7fec318c req-84466b54-9004-4dde-886e-4ff1771e512b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:10.800010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-68cb768c-51a7-41ed-8e4e-b7ab7fec318c req-84466b54-9004-4dde-886e-4ff1771e512b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:10.800450 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-68cb768c-51a7-41ed-8e4e-b7ab7fec318c req-84466b54-9004-4dde-886e-4ff1771e512b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:10.813565 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-68cb768c-51a7-41ed-8e4e-b7ab7fec318c req-84466b54-9004-4dde-886e-4ff1771e512b service nova] Creating event network-vif-deleted:4b27ab3f-4630-4d69-98db-1789f3a71fc7 for instance 3c725275-6202-4b81-bc98-c3542205e0d9 on nch2-master-1 Aug 06 21:54:10.819054 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-68cb768c-51a7-41ed-8e4e-b7ab7fec318c req-84466b54-9004-4dde-886e-4ff1771e512b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036217 Aug 06 21:54:10.819787 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3365/6913] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:54:11.424544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:11.425099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: 3c725275-6202-4b81-bc98-c3542205e0d9] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:11.432625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:11.433112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:11.433551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:11.434251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:11.434744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:11.435178 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:11.448549 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.wsgi [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] HTTP exception thrown: Instance 3c725275-6202-4b81-bc98-c3542205e0d9 could not be found. Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Request method failure captured: Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: request: GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 HTTP/1.1 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: Accept: application/json Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: Accept-Encoding: identity Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: Connection: close Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: Content-Length: 0 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: Content-Type: application/json Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: Host: 10.222.0.33 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: Openstack-System-Scope: None Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: User-Agent: python-urllib3/1.26.11 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Auth-Token: gAAAAABi7uLfI7abSKkYmS43c-dKJHSCiWnYXjJcHvC7zs1tk59G1fgcQLIRwbxTS6XWwg-rv9N6p0-IHhBYpNw_Mb3qjpN9cNGz8H9gnVXKuLwm1UlizhoUUH2v4f43YRI1rJ_TApMhgUor85hQbXuhexnkbzKZmtc8TLz2FpU6Q3EcJNPGw24 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Id: None Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Domain-Name: None Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Identity-Status: Confirmed Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Is-Admin-Project: True Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Id: default Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Domain-Name: Default Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Id: 429e90fa99b8422db34aff5fe9d28430 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Project-Name: tempest-TestMinimumBasicScenario-1499479873 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Role: member,reader Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Roles: member,reader Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/429e90fa99b8422db34aff5fe9d28430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_429e90fa99b8422db34aff5fe9d28430", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/429e90fa99b8422db34aff5fe9d28430"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/429e90fa99b8422db34aff5fe9d28430"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant: tempest-TestMinimumBasicScenario-1499479873 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Id: 429e90fa99b8422db34aff5fe9d28430 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1499479873 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-User: tempest-TestMinimumBasicScenario-1499479873-project Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Id: default Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-User-Domain-Name: Default Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-User-Id: a4d571e08f5a4eb6a79cc1ef853e53a9 Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: X-User-Name: tempest-TestMinimumBasicScenario-1499479873-project Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: method: > Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: exception: Instance 3c725275-6202-4b81-bc98-c3542205e0d9 could not be found. Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: action_args: {'id': '3c725275-6202-4b81-bc98-c3542205e0d9'} Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c725275-6202-4b81-bc98-c3542205e0d9 could not be found. Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c725275-6202-4b81-bc98-c3542205e0d9 could not be found. Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:54:11.450176 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c725275-6202-4b81-bc98-c3542205e0d9 could not be found. Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: ERROR nova.api.openstack.wsgi Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Returning 404 to user: Instance 3c725275-6202-4b81-bc98-c3542205e0d9 could not be found. {{(pid=142461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3c8845b0-c6cd-4a29-b2c5-a1ea3f5f3a9c tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9" status: 404 len: 111 microversion: 2.1 time: 0.031155 Aug 06 21:54:11.455793 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3549/6914] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:11 2022] GET /compute/v2.1/servers/3c725275-6202-4b81-bc98-c3542205e0d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:54:11.461321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf3c546a-238c-4667-9734-095f95fad8a3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '.version_select at 0x7f729d2b1550>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:11.482019 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bf3c546a-238c-4667-9734-095f95fad8a3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-367488819" status: 202 len: 0 microversion: 2.1 time: 0.025097 Aug 06 21:54:11.482625 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3366/6915] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-367488819 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:54:20.417013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f159643-0a03-448e-bf72-f909c8d607ae tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Action: 'create', calling method: .version_select at 0x7f729dc7ff70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-528833158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI+RCxdAdBxhJKhrZwCeShAE4YxdmfElJ5lz87+PbwcVhRuvVQdDK0g2yuinkSzm5Ewc9EbCp+hKwdNDKmOd0NuzqMzmmJIegvQeL4b5GMEGMgAQQ+vlmpbxLnRhj9V3w=="}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:20.423289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:20.439068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-2f159643-0a03-448e-bf72-f909c8d607ae tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Getting quotas for project 429e90fa99b8422db34aff5fe9d28430. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:54:20.444283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-2f159643-0a03-448e-bf72-f909c8d607ae tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Getting quotas for user a4d571e08f5a4eb6a79cc1ef853e53a9 and project 429e90fa99b8422db34aff5fe9d28430. Resources: {'key_pairs'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:54:20.471277 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f159643-0a03-448e-bf72-f909c8d607ae tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058699 Aug 06 21:54:20.471875 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3550/6916] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:54:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:54:20.524644 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1456992180", "imageRef": "741e4e58-4da2-452e-963f-e4674ebfddbf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-528833158", "networks": [{"uuid": "cb99427c-d902-4ef4-ab0d-e3e7346cebe9"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:20.576762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] validate_networks() for [('cb99427c-d902-4ef4-ab0d-e3e7346cebe9', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:54:20.761233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:20.806688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=58 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:21.100589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:54:21.101036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:54:21.102047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:54:21.102473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:54:21.102928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:54:21.111995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:21.112492 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:21.112938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:21.113685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:21.114151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:21.114613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:21.135762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Getting quotas for project 429e90fa99b8422db34aff5fe9d28430. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:54:21.141092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Getting quotas for user a4d571e08f5a4eb6a79cc1ef853e53a9 and project 429e90fa99b8422db34aff5fe9d28430. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:54:21.154211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:54:21.156578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='741e4e58-4da2-452e-963f-e4674ebfddbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:54:21.201316 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cb7d7a3e-85f7-46ce-bc0e-a58ec1a9ff4a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682321 Aug 06 21:54:21.201975 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3367/6917] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:54:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:54:21.214153 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aa17d3b7-5b35-46ad-a077-2c72144bc283 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:21.214807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aa17d3b7-5b35-46ad-a077-2c72144bc283 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:21.216697 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:21.277687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aa17d3b7-5b35-46ad-a077-2c72144bc283 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:21.284830 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aa17d3b7-5b35-46ad-a077-2c72144bc283 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1258 microversion: 2.1 time: 0.075258 Aug 06 21:54:21.285406 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3551/6918] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:21 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:22.306915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:22.307801 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:22.315588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:22.316145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:22.316603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:22.317315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:22.317772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:22.318203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:22.413136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:22.425322 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e2b938b9-99d1-47df-811c-e48e776e123e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1328 microversion: 2.1 time: 0.123593 Aug 06 21:54:22.425987 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3368/6919] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:22 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:23.448124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:23.449462 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:23.459304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:23.461541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:23.462311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:23.463027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:23.463855 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:23.464748 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:23.465284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:23.627223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:23.635767 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-33c25017-ff29-4953-9b84-36b28ee9d252 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.192356 Aug 06 21:54:23.636350 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3552/6920] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:23 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:24.656768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:24.657400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:24.665458 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:24.665958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:24.666412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:24.667179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:24.667649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:24.668106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:24.814927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:24.823771 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-22807e04-3a1d-4da1-afc6-38bd284f1cb0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.170892 Aug 06 21:54:24.824378 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3369/6921] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:24 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:25.847684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:25.848449 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:25.857459 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:25.858063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:25.858512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:25.859259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:25.859717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:25.860147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:26.002809 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:26.012400 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f8404984-8cb3-4646-a3d6-edbd508184b4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.170635 Aug 06 21:54:26.012998 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3553/6922] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:25 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:27.034698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:27.036495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:27.044987 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:27.045493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:27.046218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:27.047220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:27.047693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:27.048133 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:27.212692 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:27.221001 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-eac42dfb-33fd-469b-8c14-01135085aac0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.191329 Aug 06 21:54:27.222383 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3370/6923] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:27 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:28.243335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:28.244041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:28.251018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:28.251509 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:28.251952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:28.252681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:28.253173 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:28.253603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:28.395494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:28.412087 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f5ee4ebe-75c1-4128-9b83-dc41b1ce697a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.172886 Aug 06 21:54:28.413114 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3554/6924] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:28 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:29.433594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:29.434213 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:29.441141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:29.441635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:29.442078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:29.442805 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:29.443269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:29.443703 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:29.587169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:29.609898 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e54ade13-fa2b-4832-b5c8-1dc97f2490f6 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.180629 Aug 06 21:54:29.611112 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3371/6925] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:29 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:30.630960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:30.631582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:30.638915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:30.639397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:30.639828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:30.640520 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:30.640971 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:30.641395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:30.776677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:30.784214 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5c1ea3d-c649-4c9e-8d7e-c83241184390 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.157304 Aug 06 21:54:30.784800 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3555/6926] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:30 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:31.279620 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-7aed1839-27c5-4139-8acd-7389538e08a5 req-a9e37bae-08bb-4d88-b848-86c8a06b8042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efa580ad-d56a-47df-9a5c-089b23fb4c4c", "tag": "41dd6cd7-e601-4e19-81e2-2909b758d3a3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:31.285506 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:31.286496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:31.293061 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7aed1839-27c5-4139-8acd-7389538e08a5 req-a9e37bae-08bb-4d88-b848-86c8a06b8042 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:31.293550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7aed1839-27c5-4139-8acd-7389538e08a5 req-a9e37bae-08bb-4d88-b848-86c8a06b8042 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:31.293992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-7aed1839-27c5-4139-8acd-7389538e08a5 req-a9e37bae-08bb-4d88-b848-86c8a06b8042 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:31.305841 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-7aed1839-27c5-4139-8acd-7389538e08a5 req-a9e37bae-08bb-4d88-b848-86c8a06b8042 service nova] Creating event network-changed:41dd6cd7-e601-4e19-81e2-2909b758d3a3 for instance efa580ad-d56a-47df-9a5c-089b23fb4c4c on nch2-master-1 Aug 06 21:54:31.310777 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-7aed1839-27c5-4139-8acd-7389538e08a5 req-a9e37bae-08bb-4d88-b848-86c8a06b8042 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034938 Aug 06 21:54:31.312033 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3372/6927] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:54:31.806333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:31.806991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:31.808922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:31.815460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:31.815868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:31.816311 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:31.817020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:31.817597 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:31.818009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:31.958087 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:31.966866 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0faa1219-1cfe-48b1-9a6b-d522759a57b8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.165257 Aug 06 21:54:31.967521 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3556/6928] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:31 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:32.989471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:32.990186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:32.998369 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:32.999309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:32.999751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:33.000462 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:33.000947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:33.001378 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:33.138798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:33.146427 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e945852f-8b3b-4686-abd8-de9d5d392bd8 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.162097 Aug 06 21:54:33.147036 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3373/6929] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:32 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:34.168506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:34.169124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:34.175989 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:34.176474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:34.176917 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:34.177618 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:34.178076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:34.178506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:34.311906 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:34.319468 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c82b3f3f-2872-433e-8030-229269b2b119 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.155742 Aug 06 21:54:34.320045 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3557/6930] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:34 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:35.340619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:35.341190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:35.348101 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:35.348589 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:35.349035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:35.349733 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:35.350195 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:35.350662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:35.485745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:35.494869 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-15f1c158-6837-4cb2-95d5-e15901b0bf91 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.158493 Aug 06 21:54:35.495475 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3374/6931] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:35 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:36.515535 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:36.516146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:36.523005 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:36.524122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:36.524643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:36.525331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:36.525788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:36.526213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:36.938800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:36.946289 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e7c404ba-98f5-4e37-bc8a-bda731924512 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.434660 Aug 06 21:54:36.946876 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3558/6932] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:36 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:37.172556 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-fbd987b2-e6e9-4b9b-8b62-7ae3921042a3 req-18ecbf82-148a-4353-aab5-805cda673e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa580ad-d56a-47df-9a5c-089b23fb4c4c", "name": "network-vif-plugged", "status": "completed", "tag": "41dd6cd7-e601-4e19-81e2-2909b758d3a3"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:37.185401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fbd987b2-e6e9-4b9b-8b62-7ae3921042a3 req-18ecbf82-148a-4353-aab5-805cda673e35 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:37.185927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fbd987b2-e6e9-4b9b-8b62-7ae3921042a3 req-18ecbf82-148a-4353-aab5-805cda673e35 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:37.186386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fbd987b2-e6e9-4b9b-8b62-7ae3921042a3 req-18ecbf82-148a-4353-aab5-805cda673e35 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:37.198744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-fbd987b2-e6e9-4b9b-8b62-7ae3921042a3 req-18ecbf82-148a-4353-aab5-805cda673e35 service nova] Creating event network-vif-plugged:41dd6cd7-e601-4e19-81e2-2909b758d3a3 for instance efa580ad-d56a-47df-9a5c-089b23fb4c4c on nch2-master-1 Aug 06 21:54:37.203700 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-fbd987b2-e6e9-4b9b-8b62-7ae3921042a3 req-18ecbf82-148a-4353-aab5-805cda673e35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034915 Aug 06 21:54:37.204475 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3375/6933] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:54:37.967417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:37.968038 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:37.974840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:37.975324 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:37.975765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:37.976962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:37.977430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:37.977861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:38.106389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:38.113990 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8c762720-a91c-4447-92c2-435502ffc595 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1358 microversion: 2.1 time: 0.150512 Aug 06 21:54:38.114582 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3559/6934] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:37 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:39.137087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:39.137808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:39.144078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:39.144567 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:39.145015 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:39.145734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:39.146185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:39.146645 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:39.277957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:39.285601 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1a89a0d3-c721-403b-84e1-30fb4a07066a tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1548 microversion: 2.1 time: 0.154239 Aug 06 21:54:39.286178 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3376/6935] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:39 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:39.306307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:39.306955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:39.313751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:39.314239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:39.314721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:39.315492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:39.315955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:39.316423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:39.797838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:39.806291 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-13e5b3a0-d887-48eb-858f-9ac1c3d3f8e3 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1548 microversion: 2.1 time: 0.503970 Aug 06 21:54:39.806900 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3560/6936] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:39 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1548 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:39.833004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:39.839060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:39.839845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Searching by: {'deleted': False, 'project_id': '429e90fa99b8422db34aff5fe9d28430'} {{(pid=142462) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 21:54:39.845405 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:39.845893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:39.846339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:39.847127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:39.847575 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:39.848009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:39.876951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.multi_cell_list [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=142462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 21:54:39.907394 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-380a5136-825a-4ab0-82dd-e68396f3e1f9 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.081362 Aug 06 21:54:39.907989 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3377/6937] 10.222.0.33 () {58 vars in 1125 bytes} [Sat Aug 6 21:54:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:54:39.922801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:39.923865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:39.933839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:39.934574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:39.935325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:39.936470 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:39.936924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:39.937360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:40.080048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:40.089544 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-269c86f4-4904-4d48-90ad-315ed46203e4 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1548 microversion: 2.1 time: 0.172804 Aug 06 21:54:40.090505 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3561/6938] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:39 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:41.589313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:41.589811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:41.596824 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:41.597315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:41.597762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:41.598466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:41.598950 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:41.599413 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:41.624918 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:54:41.699958 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b1dc797c-55e5-444a-9bb6-a4bf89c28e19 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "DELETE /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 204 len: 0 microversion: 2.1 time: 0.114884 Aug 06 21:54:41.700575 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3378/6939] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:54:41 2022] DELETE /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:54:41.709145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:41.709823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:41.717251 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:41.717747 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:41.718183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:41.718943 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:41.719404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:41.719870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:41.853725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:41.861328 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b339360a-87e2-46c9-9f3e-9c0d7c45f5f0 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1554 microversion: 2.1 time: 0.156364 Aug 06 21:54:41.861907 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3562/6940] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:41 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:42.881917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:42.882713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:42.893123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:42.893637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:42.894073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:42.894957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:42.895415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:42.895841 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:43.107809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d571e08f5a4eb6a79cc1ef853e53a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429e90fa99b8422db34aff5fe9d28430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:43.115508 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-21925c4b-fff0-4f7b-8231-e303e7ece553 tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 200 len: 1554 microversion: 2.1 time: 0.237994 Aug 06 21:54:43.116087 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3379/6941] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:42 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:54:43.480677 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-db0ca683-5631-4538-985c-c2d96aa1f8f9 req-0983af2a-eef6-44e9-8822-f75c95fe1eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efa580ad-d56a-47df-9a5c-089b23fb4c4c", "name": "network-vif-deleted", "tag": "41dd6cd7-e601-4e19-81e2-2909b758d3a3"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:43.492891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-db0ca683-5631-4538-985c-c2d96aa1f8f9 req-0983af2a-eef6-44e9-8822-f75c95fe1eb5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:43.493387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-db0ca683-5631-4538-985c-c2d96aa1f8f9 req-0983af2a-eef6-44e9-8822-f75c95fe1eb5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:43.493823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-db0ca683-5631-4538-985c-c2d96aa1f8f9 req-0983af2a-eef6-44e9-8822-f75c95fe1eb5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:43.505664 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-db0ca683-5631-4538-985c-c2d96aa1f8f9 req-0983af2a-eef6-44e9-8822-f75c95fe1eb5 service nova] Creating event network-vif-deleted:41dd6cd7-e601-4e19-81e2-2909b758d3a3 for instance efa580ad-d56a-47df-9a5c-089b23fb4c4c on nch2-master-1 Aug 06 21:54:43.512270 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-db0ca683-5631-4538-985c-c2d96aa1f8f9 req-0983af2a-eef6-44e9-8822-f75c95fe1eb5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035284 Aug 06 21:54:43.515689 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3563/6942] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:54:44.137708 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:44.138276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] [instance: efa580ad-d56a-47df-9a5c-089b23fb4c4c] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:44.144281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:44.144762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:44.145203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:44.145893 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:44.146349 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:44.146807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:44.160390 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] HTTP exception thrown: Instance efa580ad-d56a-47df-9a5c-089b23fb4c4c could not be found. Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Request method failure captured: Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c HTTP/1.1 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uLfI7abSKkYmS43c-dKJHSCiWnYXjJcHvC7zs1tk59G1fgcQLIRwbxTS6XWwg-rv9N6p0-IHhBYpNw_Mb3qjpN9cNGz8H9gnVXKuLwm1UlizhoUUH2v4f43YRI1rJ_TApMhgUor85hQbXuhexnkbzKZmtc8TLz2FpU6Q3EcJNPGw24 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 429e90fa99b8422db34aff5fe9d28430 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestMinimumBasicScenario-1499479873 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/429e90fa99b8422db34aff5fe9d28430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_429e90fa99b8422db34aff5fe9d28430", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/429e90fa99b8422db34aff5fe9d28430"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/429e90fa99b8422db34aff5fe9d28430"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestMinimumBasicScenario-1499479873 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 429e90fa99b8422db34aff5fe9d28430 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1499479873 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestMinimumBasicScenario-1499479873-project Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: a4d571e08f5a4eb6a79cc1ef853e53a9 Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestMinimumBasicScenario-1499479873-project Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance efa580ad-d56a-47df-9a5c-089b23fb4c4c could not be found. Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'efa580ad-d56a-47df-9a5c-089b23fb4c4c'} Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efa580ad-d56a-47df-9a5c-089b23fb4c4c could not be found. Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efa580ad-d56a-47df-9a5c-089b23fb4c4c could not be found. Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:54:44.162019 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efa580ad-d56a-47df-9a5c-089b23fb4c4c could not be found. Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Returning 404 to user: Instance efa580ad-d56a-47df-9a5c-089b23fb4c4c could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a8b03ebb-e782-4865-b0bf-a3e0707ed82e tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c" status: 404 len: 111 microversion: 2.1 time: 0.031315 Aug 06 21:54:44.167623 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3380/6943] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:44 2022] GET /compute/v2.1/servers/efa580ad-d56a-47df-9a5c-089b23fb4c4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:54:44.176738 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2f7bc12d-29ff-46b9-a8ae-0eb6ec9743bd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] Calling method '.version_select at 0x7f729c471160>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:44.195696 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2f7bc12d-29ff-46b9-a8ae-0eb6ec9743bd tempest-TestMinimumBasicScenario-1499479873 tempest-TestMinimumBasicScenario-1499479873-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-528833158" status: 202 len: 0 microversion: 2.1 time: 0.026573 Aug 06 21:54:44.196284 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3564/6944] 10.222.0.33 () {58 vars in 1269 bytes} [Sat Aug 6 21:54:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-528833158 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:54:52.911957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:53.096121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-247d4078-0ed1-4ba5-88ad-4e2308e1c1fe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: .version_select at 0x7f72a347eaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2069532647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQIHK+iYebkIkYL8iwE8FfaSQQOfL3UxOLcRr33JUnrlE5iIOdeSu5I29ojkpxqMUt6zHnubdB0iSA0yUiW7ZQ4q2KLHsI+cmUPiJdTn/bIRLcbzAJBVF7HUB17uXVFkA=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:53.102605 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:53.116127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-247d4078-0ed1-4ba5-88ad-4e2308e1c1fe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:54:53.121687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-247d4078-0ed1-4ba5-88ad-4e2308e1c1fe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:54:53.144940 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-247d4078-0ed1-4ba5-88ad-4e2308e1c1fe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.240064 Aug 06 21:54:53.145540 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3381/6945] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:54:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:54:58.823179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1905504569", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "8a75cd43-a713-4fc4-95e8-fd0b77b6adbe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2069532647", "security_groups": [{"name": "tempest-secgroup-smoke-1577249744"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:54:58.834028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=68 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:58.834947 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:58.954873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] validate_networks() for [('8a75cd43-a713-4fc4-95e8-fd0b77b6adbe', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:54:59.488717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:54:59.489157 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:54:59.489643 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:54:59.490067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:54:59.490493 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:54:59.500136 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:59.500630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:59.501305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:59.502053 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:54:59.502521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:54:59.502986 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:54:59.521617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:54:59.527856 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:54:59.542631 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:54:59.545065 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:54:59.599870 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c921041f-2359-4e5a-aeb1-d709208d36de tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.781434 Aug 06 21:54:59.602898 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3565/6946] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:54:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:54:59.609592 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:54:59.618780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-25ada836-0944-46e3-9022-9abb5e7fca8a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:54:59.619574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-25ada836-0944-46e3-9022-9abb5e7fca8a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:54:59.695104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-25ada836-0944-46e3-9022-9abb5e7fca8a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:54:59.705487 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-25ada836-0944-46e3-9022-9abb5e7fca8a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1267 microversion: 2.1 time: 0.097312 Aug 06 21:54:59.706442 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3382/6947] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:54:59 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:00.731021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:00.731571 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:00.748816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:00.749327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:00.753686 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:00.755356 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:00.758259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:00.759104 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:00.859786 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:00.876546 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-632d4f90-b50b-4f92-8750-a458919d0279 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1337 microversion: 2.1 time: 0.149231 Aug 06 21:55:00.887189 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3566/6948] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:00 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1337 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:01.898769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:01.899438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:01.906663 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:01.907389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:01.908026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:01.909179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:01.909811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:01.910277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:02.127599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:02.136304 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2688177d-abe2-4c52-9733-6435dbc0dfd6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1393 microversion: 2.1 time: 0.241447 Aug 06 21:55:02.137033 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3383/6949] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:01 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1393 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:02.386150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f097e79e-3667-4a81-8475-694521f1e060 req-52f686bf-96dc-420b-b6e8-c3640b999312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2797114c-19d5-4bdf-931f-ec1517a53ce2", "tag": "5711b617-995b-4fe0-bae0-820aef9270bc"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:02.400090 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f097e79e-3667-4a81-8475-694521f1e060 req-52f686bf-96dc-420b-b6e8-c3640b999312 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:02.400607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f097e79e-3667-4a81-8475-694521f1e060 req-52f686bf-96dc-420b-b6e8-c3640b999312 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:02.401044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f097e79e-3667-4a81-8475-694521f1e060 req-52f686bf-96dc-420b-b6e8-c3640b999312 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:02.414502 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f097e79e-3667-4a81-8475-694521f1e060 req-52f686bf-96dc-420b-b6e8-c3640b999312 service nova] Creating event network-changed:5711b617-995b-4fe0-bae0-820aef9270bc for instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 on nch2-master-1 Aug 06 21:55:02.420339 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f097e79e-3667-4a81-8475-694521f1e060 req-52f686bf-96dc-420b-b6e8-c3640b999312 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038420 Aug 06 21:55:02.421360 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3567/6950] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:55:03.157499 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:03.158031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:03.166272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:03.166794 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:03.167279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:03.168089 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:03.168571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:03.169041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:03.305168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:03.312756 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9d0125de-e5f7-4642-82bf-c7e5bd7432bb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1393 microversion: 2.1 time: 0.159360 Aug 06 21:55:03.313323 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3384/6951] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:03 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:04.334143 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:04.334790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:04.341998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:04.342483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:04.343069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:04.343795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:04.344258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:04.344687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:04.481653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:04.489206 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-263a4696-0c0e-437a-8e27-86f0fd185b1c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1393 microversion: 2.1 time: 0.159721 Aug 06 21:55:04.489779 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3568/6952] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:04 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:05.512239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:05.512897 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:05.520122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:05.520615 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:05.521062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:05.521772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:05.522236 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:05.522720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:05.663351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:05.671983 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8f65dacb-8db3-419a-b790-439c3a56534f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1393 microversion: 2.1 time: 0.163854 Aug 06 21:55:05.672672 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3385/6953] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:05 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:06.693440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:06.694062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:06.701791 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:06.702276 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:06.702762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:06.703452 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:06.703907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:06.704331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:06.836360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:06.843878 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ed824dbf-5c8d-4a2b-a8c3-e2dd96e03b3f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1393 microversion: 2.1 time: 0.154385 Aug 06 21:55:06.844445 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3569/6954] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:06 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:55:07.323048 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-1c6487da-b434-468e-bc43-6f8d00c8e12a req-950813c0-137f-4357-8265-f0bc9c65d280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2797114c-19d5-4bdf-931f-ec1517a53ce2", "name": "network-vif-plugged", "status": "completed", "tag": "5711b617-995b-4fe0-bae0-820aef9270bc"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:07.333713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1c6487da-b434-468e-bc43-6f8d00c8e12a req-950813c0-137f-4357-8265-f0bc9c65d280 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:07.334196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1c6487da-b434-468e-bc43-6f8d00c8e12a req-950813c0-137f-4357-8265-f0bc9c65d280 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:07.334657 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-1c6487da-b434-468e-bc43-6f8d00c8e12a req-950813c0-137f-4357-8265-f0bc9c65d280 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:07.346297 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-1c6487da-b434-468e-bc43-6f8d00c8e12a req-950813c0-137f-4357-8265-f0bc9c65d280 service nova] Creating event network-vif-plugged:5711b617-995b-4fe0-bae0-820aef9270bc for instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 on nch2-master-1 Aug 06 21:55:07.351802 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-1c6487da-b434-468e-bc43-6f8d00c8e12a req-950813c0-137f-4357-8265-f0bc9c65d280 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032657 Aug 06 21:55:07.352556 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3386/6955] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:55:07.864075 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:07.864685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:07.871985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:07.872464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:07.872898 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:07.873684 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:07.874145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:07.874594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:08.009987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:08.017530 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-af4d5804-dca9-4bb6-b4f0-6725853903d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1393 microversion: 2.1 time: 0.157379 Aug 06 21:55:08.018102 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3570/6956] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:07 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:09.040084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:09.040789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:09.047169 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:09.047653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:09.048093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:09.048797 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:09.049261 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:09.049687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:09.191386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:09.199237 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-abf52cae-36c5-4866-aa19-3b293a9c9edf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1565 microversion: 2.1 time: 0.165025 Aug 06 21:55:09.199841 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3387/6957] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:09 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:09.219969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:09.220596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:09.228146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:09.228640 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:09.229109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:09.229812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:09.230310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:09.230785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:09.364995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:09.373110 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a47e6ab-d33a-4725-9b1f-5b7e609b97d7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1565 microversion: 2.1 time: 0.157204 Aug 06 21:55:09.373700 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3571/6958] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:09 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:10.969562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:10.970298 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:10.972687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:10.979775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:10.981039 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:10.981487 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:10.982363 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:10.982870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:10.983301 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:11.012721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:11.013885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:11.075208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-34e98c40-cfe6-4676-8b39-23179f4f281c req-fcea8170-c06c-46af-ac3a-d0141ea1381a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2797114c-19d5-4bdf-931f-ec1517a53ce2", "tag": "5711b617-995b-4fe0-bae0-820aef9270bc"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:11.086227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-34e98c40-cfe6-4676-8b39-23179f4f281c req-fcea8170-c06c-46af-ac3a-d0141ea1381a service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:11.086766 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-34e98c40-cfe6-4676-8b39-23179f4f281c req-fcea8170-c06c-46af-ac3a-d0141ea1381a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:11.087209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-34e98c40-cfe6-4676-8b39-23179f4f281c req-fcea8170-c06c-46af-ac3a-d0141ea1381a service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:11.101769 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-34e98c40-cfe6-4676-8b39-23179f4f281c req-fcea8170-c06c-46af-ac3a-d0141ea1381a service nova] Creating event network-changed:5711b617-995b-4fe0-bae0-820aef9270bc for instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 on nch2-master-1 Aug 06 21:55:11.108907 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-34e98c40-cfe6-4676-8b39-23179f4f281c req-fcea8170-c06c-46af-ac3a-d0141ea1381a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100953 Aug 06 21:55:11.109669 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3572/6959] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:55:11.137968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:11.147573 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f0a56a79-dff7-46a5-b896-2680d8a2190b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1565 microversion: 2.1 time: 0.182286 Aug 06 21:55:11.149320 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3388/6960] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:10 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:34.405606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:34.406366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=36 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:34.410992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-34538bc2-f373-4df8-8521-debb9eec762e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:34.413952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-34538bc2-f373-4df8-8521-debb9eec762e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:34.422377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34538bc2-f373-4df8-8521-debb9eec762e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:34.422963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34538bc2-f373-4df8-8521-debb9eec762e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:34.423406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34538bc2-f373-4df8-8521-debb9eec762e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:34.424100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34538bc2-f373-4df8-8521-debb9eec762e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:34.424560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34538bc2-f373-4df8-8521-debb9eec762e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:34.425006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-34538bc2-f373-4df8-8521-debb9eec762e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:34.479471 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-34538bc2-f373-4df8-8521-debb9eec762e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action" status: 200 len: 24572 microversion: 2.1 time: 0.075648 Aug 06 21:55:34.480157 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3573/6961] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:55:34 2022] POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:55:40.858475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-54c78112-479e-48dd-8e04-f94b2406f9c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:40.859052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-54c78112-479e-48dd-8e04-f94b2406f9c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:40.861455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:40.862188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=32 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:40.868601 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54c78112-479e-48dd-8e04-f94b2406f9c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:40.869096 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54c78112-479e-48dd-8e04-f94b2406f9c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:40.869548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54c78112-479e-48dd-8e04-f94b2406f9c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:40.870285 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54c78112-479e-48dd-8e04-f94b2406f9c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:40.870760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54c78112-479e-48dd-8e04-f94b2406f9c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:40.871197 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-54c78112-479e-48dd-8e04-f94b2406f9c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:40.939534 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-54c78112-479e-48dd-8e04-f94b2406f9c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action" status: 202 len: 0 microversion: 2.1 time: 0.084728 Aug 06 21:55:40.940096 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3389/6962] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:55:40 2022] POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:55:40.950346 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:40.951096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:40.958985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:40.959490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:40.960591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:40.961317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:40.961781 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:40.962217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:41.106011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:41.113945 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b14f0151-accf-4990-a91d-d7690dcb5db9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1688 microversion: 2.1 time: 0.168132 Aug 06 21:55:41.114527 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3574/6963] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:40 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:42.138723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:42.139432 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:42.145711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:42.146200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:42.146667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:42.148099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:42.148562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:42.149000 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:42.281739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:42.289859 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0ca675c4-f85e-40a8-a092-24bc50138f59 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1668 microversion: 2.1 time: 0.156323 Aug 06 21:55:42.290437 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3390/6964] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:42 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:43.386032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-974dd340-cb3b-4b92-800e-34c080ce4cf9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:43.388304 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-974dd340-cb3b-4b92-800e-34c080ce4cf9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:43.395909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-974dd340-cb3b-4b92-800e-34c080ce4cf9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:43.396399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-974dd340-cb3b-4b92-800e-34c080ce4cf9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:43.397194 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-974dd340-cb3b-4b92-800e-34c080ce4cf9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:43.397921 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-974dd340-cb3b-4b92-800e-34c080ce4cf9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:43.398381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-974dd340-cb3b-4b92-800e-34c080ce4cf9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:43.398840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-974dd340-cb3b-4b92-800e-34c080ce4cf9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:43.448465 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-974dd340-cb3b-4b92-800e-34c080ce4cf9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action" status: 200 len: 32639 microversion: 2.1 time: 0.066514 Aug 06 21:55:43.449109 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3575/6965] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:55:43 2022] POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action => generated 32639 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:55:43.461174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d23152fb-7a92-4246-a181-ad49e127d031 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:43.461711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d23152fb-7a92-4246-a181-ad49e127d031 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:43.468603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d23152fb-7a92-4246-a181-ad49e127d031 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:43.469088 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d23152fb-7a92-4246-a181-ad49e127d031 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:43.469530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d23152fb-7a92-4246-a181-ad49e127d031 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:43.470218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d23152fb-7a92-4246-a181-ad49e127d031 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:43.470709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d23152fb-7a92-4246-a181-ad49e127d031 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:43.471145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d23152fb-7a92-4246-a181-ad49e127d031 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:43.537228 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d23152fb-7a92-4246-a181-ad49e127d031 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action" status: 202 len: 0 microversion: 2.1 time: 0.079929 Aug 06 21:55:43.538630 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3391/6966] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:55:43 2022] POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:55:43.547264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:43.548036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:43.556685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:43.557174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:43.557630 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:43.558497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:43.558988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:43.559417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:43.709000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:43.718134 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-87114c92-6ee8-40b7-8940-34ca51a43820 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1675 microversion: 2.1 time: 0.175001 Aug 06 21:55:43.718761 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3576/6967] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:43 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:44.742984 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:44.743683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:44.749924 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:44.750410 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:44.750870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:44.751560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:44.752016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:44.752445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:44.889212 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:44.896949 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d31d869f-b49a-470b-a306-2f5118c47c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1683 microversion: 2.1 time: 0.159600 Aug 06 21:55:44.897530 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3392/6968] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:44 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:44.988400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d518cd46-fe8f-4362-b77d-ce31349da3a1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:44.991282 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d518cd46-fe8f-4362-b77d-ce31349da3a1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:44.999015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d518cd46-fe8f-4362-b77d-ce31349da3a1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:44.999503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d518cd46-fe8f-4362-b77d-ce31349da3a1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:44.999944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d518cd46-fe8f-4362-b77d-ce31349da3a1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:45.000635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d518cd46-fe8f-4362-b77d-ce31349da3a1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:45.001120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d518cd46-fe8f-4362-b77d-ce31349da3a1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:45.001547 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d518cd46-fe8f-4362-b77d-ce31349da3a1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:45.049676 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d518cd46-fe8f-4362-b77d-ce31349da3a1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action" status: 200 len: 35836 microversion: 2.1 time: 0.065025 Aug 06 21:55:45.050302 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3577/6969] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:55:44 2022] POST /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2/action => generated 35836 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:55:46.067295 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:46.067832 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:46.070066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-f5767904-4340-4b0f-a854-c77d8f3e7010 req-779f490b-6d8a-4ee0-b0cd-e2bd1551e562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2797114c-19d5-4bdf-931f-ec1517a53ce2", "tag": "5711b617-995b-4fe0-bae0-820aef9270bc"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:46.075850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:46.076672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:46.077488 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:46.078215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:46.078726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:46.079167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:46.082442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f5767904-4340-4b0f-a854-c77d8f3e7010 req-779f490b-6d8a-4ee0-b0cd-e2bd1551e562 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:46.083030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f5767904-4340-4b0f-a854-c77d8f3e7010 req-779f490b-6d8a-4ee0-b0cd-e2bd1551e562 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:46.083546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-f5767904-4340-4b0f-a854-c77d8f3e7010 req-779f490b-6d8a-4ee0-b0cd-e2bd1551e562 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:46.095198 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-f5767904-4340-4b0f-a854-c77d8f3e7010 req-779f490b-6d8a-4ee0-b0cd-e2bd1551e562 service nova] Creating event network-changed:5711b617-995b-4fe0-bae0-820aef9270bc for instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 on nch2-master-1 Aug 06 21:55:46.100473 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-f5767904-4340-4b0f-a854-c77d8f3e7010 req-779f490b-6d8a-4ee0-b0cd-e2bd1551e562 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034755 Aug 06 21:55:46.101249 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3578/6970] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:55:46.110930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:55:46.196526 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d076347f-34dc-4903-b964-68ad1d657e45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 204 len: 0 microversion: 2.1 time: 0.133110 Aug 06 21:55:46.197288 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3393/6971] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:55:46 2022] DELETE /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 21:55:46.207307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:46.208156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:46.214710 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:46.215404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:46.216021 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:46.216732 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:46.217185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:46.217828 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:46.364924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:46.373168 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-16333a2e-165b-4228-867d-ee8c09bb6807 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1689 microversion: 2.1 time: 0.171045 Aug 06 21:55:46.373758 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3579/6972] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:46 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:47.395709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:47.396433 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:47.403400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:47.403892 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:47.404340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:47.405050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:47.405517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:47.405953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:47.944402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:47.952564 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-35e69f1d-c105-49a3-8b0e-6bc4f5b25034 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 200 len: 1689 microversion: 2.1 time: 0.561111 Aug 06 21:55:47.962657 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3394/6973] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:47 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 1689 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:55:48.261869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-014ede22-8a7b-4d78-8b61-62f2738eb584 req-f9e59626-9da1-445a-8f5d-99d8f0cc9144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2797114c-19d5-4bdf-931f-ec1517a53ce2", "name": "network-vif-deleted", "tag": "5711b617-995b-4fe0-bae0-820aef9270bc"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:48.272904 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-014ede22-8a7b-4d78-8b61-62f2738eb584 req-f9e59626-9da1-445a-8f5d-99d8f0cc9144 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:48.273489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-014ede22-8a7b-4d78-8b61-62f2738eb584 req-f9e59626-9da1-445a-8f5d-99d8f0cc9144 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:48.274000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-014ede22-8a7b-4d78-8b61-62f2738eb584 req-f9e59626-9da1-445a-8f5d-99d8f0cc9144 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:48.289065 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-014ede22-8a7b-4d78-8b61-62f2738eb584 req-f9e59626-9da1-445a-8f5d-99d8f0cc9144 service nova] Creating event network-vif-deleted:5711b617-995b-4fe0-bae0-820aef9270bc for instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 on nch2-master-1 Aug 06 21:55:48.294156 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-014ede22-8a7b-4d78-8b61-62f2738eb584 req-f9e59626-9da1-445a-8f5d-99d8f0cc9144 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036052 Aug 06 21:55:48.294818 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3580/6974] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:55:48.975782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:48.976437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 2797114c-19d5-4bdf-931f-ec1517a53ce2] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:48.983419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:48.983917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:48.984396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:48.985104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:48.985564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:48.985997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:49.000377 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] HTTP exception thrown: Instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 could not be found. Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Request method failure captured: Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 HTTP/1.1 Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uMs0B8_RHECMxpaZJs_l0UEFe-aoVTDGJpCsB0TiKK8kj0fiDPR9yg9WqmB1OR0T7Ale_WwM5zuhySElwjcHWq6Lmwjuw_uw3gaFLCF4CuTDC1YUGN7NaYCjWOPCFBD7riN54CmADb9nlPxtX3At2GzHpR0Elxyx2iuS5EQ1LGTmBg Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ac47bb71e6e4ecf9f5197f217a159da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1f605e9c98464387b21755ec13a52070 Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 could not be found. Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '2797114c-19d5-4bdf-931f-ec1517a53ce2'} Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 could not be found. Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 could not be found. Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:55:49.002026 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 could not be found. Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Returning 404 to user: Instance 2797114c-19d5-4bdf-931f-ec1517a53ce2 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3d19e571-5282-4a24-936f-07582795fd84 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2" status: 404 len: 111 microversion: 2.1 time: 0.032099 Aug 06 21:55:49.007854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3395/6975] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:48 2022] GET /compute/v2.1/servers/2797114c-19d5-4bdf-931f-ec1517a53ce2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:55:51.987241 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ffe5bf65-14a4-4402-9d67-2f695a2cdc9f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '.version_select at 0x7f729c75dc10>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:52.007547 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ffe5bf65-14a4-4402-9d67-2f695a2cdc9f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2069532647" status: 202 len: 0 microversion: 2.1 time: 0.025837 Aug 06 21:55:52.008252 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3581/6976] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Aug 6 21:55:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2069532647 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 21:55:52.032778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2189e71d-b9c5-4e53-a9bb-08176663a05c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: .version_select at 0x7f729cf09d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1158052601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2UIZmhf02pve9XM9qGCMLFouMxqAJRTmy1LO1CMvlyzCc96mhI9uzKRj/ZnWFW+GsfX6lHi3GzFJXfWa55SXKMmF04pVZtVIeUFEac+3vKUElfct8dzf0MgbqhI445Nw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:52.049580 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-2189e71d-b9c5-4e53-a9bb-08176663a05c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:55:52.055769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-2189e71d-b9c5-4e53-a9bb-08176663a05c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:55:52.078892 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2189e71d-b9c5-4e53-a9bb-08176663a05c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050108 Aug 06 21:55:52.079489 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3396/6977] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:55:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:55:57.980419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1698422288", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "bad2f684-e6ef-4ff1-8a81-a485bda94ceb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1158052601", "security_groups": [{"name": "tempest-secgroup-smoke-1516111704"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:55:58.097774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] validate_networks() for [('bad2f684-e6ef-4ff1-8a81-a485bda94ceb', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:55:58.287258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=34 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:55:58.502664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:55:58.503099 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:55:58.503581 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:55:58.504024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:55:58.504444 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:55:58.514234 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:58.514868 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:58.515316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:58.515960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:58.516423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:58.516860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:58.534836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:55:58.540560 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:55:58.553512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:55:58.556027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:55:58.602496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d93b114f-9461-4c7a-9190-71bd439557d9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.627848 Aug 06 21:55:58.603391 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3582/6978] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:55:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:55:58.614210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5cf67cd3-8996-4e36-8b91-7be362e3c4ed tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:58.614884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5cf67cd3-8996-4e36-8b91-7be362e3c4ed tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:58.676010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5cf67cd3-8996-4e36-8b91-7be362e3c4ed tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:58.683266 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5cf67cd3-8996-4e36-8b91-7be362e3c4ed tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1267 microversion: 2.1 time: 0.073042 Aug 06 21:55:58.685165 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3397/6979] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:58 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:55:59.706220 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:55:59.707111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:55:59.715166 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:59.715725 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:59.716358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:59.717775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:55:59.718249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:55:59.718711 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:55:59.811982 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:55:59.820256 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-810de19d-1907-420d-ba59-8431b796f6fd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1325 microversion: 2.1 time: 0.119181 Aug 06 21:55:59.820853 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3583/6980] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:55:59 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1325 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:00.842180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:00.843003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:00.849022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:00.853311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:00.854026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:00.854866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:00.855711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:00.856624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:00.857163 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:01.311397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:01.319988 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2f280d5d-92e3-41a1-951d-408a8f3ce77c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1393 microversion: 2.1 time: 0.482443 Aug 06 21:56:01.320581 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3398/6981] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:00 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1393 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:01.401391 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ad61c672-a409-4211-811e-8eca0af4c354 req-4bcb2fda-f239-4c20-9257-726476663ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c050ef48-7665-49e8-b03e-a579e061ba47", "tag": "6f28675a-3209-4efe-a656-f6659d634c68"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:56:01.429825 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ad61c672-a409-4211-811e-8eca0af4c354 req-4bcb2fda-f239-4c20-9257-726476663ee0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:01.430306 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ad61c672-a409-4211-811e-8eca0af4c354 req-4bcb2fda-f239-4c20-9257-726476663ee0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:01.430842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ad61c672-a409-4211-811e-8eca0af4c354 req-4bcb2fda-f239-4c20-9257-726476663ee0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:01.445509 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ad61c672-a409-4211-811e-8eca0af4c354 req-4bcb2fda-f239-4c20-9257-726476663ee0 service nova] Creating event network-changed:6f28675a-3209-4efe-a656-f6659d634c68 for instance c050ef48-7665-49e8-b03e-a579e061ba47 on nch1-master-1 Aug 06 21:56:01.450908 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ad61c672-a409-4211-811e-8eca0af4c354 req-4bcb2fda-f239-4c20-9257-726476663ee0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055530 Aug 06 21:56:01.451637 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3584/6982] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:56:02.341123 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:02.341755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:02.349024 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:02.350063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:02.350928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:02.351827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:02.352306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:02.352753 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:02.487347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:02.494960 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0d709947-a2a0-4c00-ae9a-11fd959805e2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1393 microversion: 2.1 time: 0.157957 Aug 06 21:56:02.495533 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3399/6983] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:02 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:03.515817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:03.516515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:03.523797 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:03.524305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:03.524744 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:03.525433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:03.525887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:03.526335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:03.674333 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:03.682836 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-972d218a-7337-492a-b194-8f817411af45 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1393 microversion: 2.1 time: 0.171256 Aug 06 21:56:03.683420 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3585/6984] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:03 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:04.703045 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:04.703662 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:04.711544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:04.712030 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:04.712465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:04.713164 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:04.713618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:04.714049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:04.855945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:04.863552 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-66ed49a3-c217-44f2-a299-e19923694fdf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1393 microversion: 2.1 time: 0.164462 Aug 06 21:56:04.864122 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3400/6985] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:04 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:05.884008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:05.884626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:05.887433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:05.892907 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:05.893394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:05.893835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:05.894527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:05.895009 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:05.895436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:06.029457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:06.037765 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bd37c2d3-78c4-45c8-9e7a-c37e27c50db5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1393 microversion: 2.1 time: 0.157678 Aug 06 21:56:06.038343 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3586/6986] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:05 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:06.733064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-bdbef22f-bc2a-4f90-b5e8-03891f38482b req-47abb80d-3ae3-453a-976d-e8ddb2462771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c050ef48-7665-49e8-b03e-a579e061ba47", "name": "network-vif-plugged", "status": "completed", "tag": "6f28675a-3209-4efe-a656-f6659d634c68"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:56:06.746065 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bdbef22f-bc2a-4f90-b5e8-03891f38482b req-47abb80d-3ae3-453a-976d-e8ddb2462771 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:06.746638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bdbef22f-bc2a-4f90-b5e8-03891f38482b req-47abb80d-3ae3-453a-976d-e8ddb2462771 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:06.747078 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bdbef22f-bc2a-4f90-b5e8-03891f38482b req-47abb80d-3ae3-453a-976d-e8ddb2462771 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:06.761814 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-bdbef22f-bc2a-4f90-b5e8-03891f38482b req-47abb80d-3ae3-453a-976d-e8ddb2462771 service nova] Creating event network-vif-plugged:6f28675a-3209-4efe-a656-f6659d634c68 for instance c050ef48-7665-49e8-b03e-a579e061ba47 on nch1-master-1 Aug 06 21:56:06.767343 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-bdbef22f-bc2a-4f90-b5e8-03891f38482b req-47abb80d-3ae3-453a-976d-e8ddb2462771 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038129 Aug 06 21:56:06.767957 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3401/6987] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:56:07.058358 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:07.059014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:07.066000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:07.066496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:07.066979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:07.067716 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:07.068998 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:07.069440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:07.198979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:07.206794 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bfd0e83e-dd26-4137-8b20-b76715e08a35 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1393 microversion: 2.1 time: 0.152407 Aug 06 21:56:07.207394 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3587/6988] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:07 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:08.229647 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:08.230387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:08.236668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:08.237151 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:08.237596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:08.238297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:08.238791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:08.239222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:08.378673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:08.386476 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-58317b44-339d-4877-95f9-e7acd56038cb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1565 microversion: 2.1 time: 0.162289 Aug 06 21:56:08.387093 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3402/6989] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:08 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:08.406492 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:08.407162 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:08.414854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:08.415352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:08.415801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:08.416510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:08.416976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:08.417414 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:08.525067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:08.547371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:08.562129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:08.570478 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b37e415-3053-4641-bdfe-9187a6e9864a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1565 microversion: 2.1 time: 0.167906 Aug 06 21:56:08.571101 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3588/6990] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:08 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:10.149331 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:10.149953 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:10.152245 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-537ae905-ff0c-4f21-8179-861a947f5d01 req-b63fb922-1491-4d1a-afa3-fece45954efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c050ef48-7665-49e8-b03e-a579e061ba47", "tag": "6f28675a-3209-4efe-a656-f6659d634c68"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:56:10.153336 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:10.157814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:10.158312 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:10.158790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:10.159508 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:10.160257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:10.160767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:10.164685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-537ae905-ff0c-4f21-8179-861a947f5d01 req-b63fb922-1491-4d1a-afa3-fece45954efd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:10.165490 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-537ae905-ff0c-4f21-8179-861a947f5d01 req-b63fb922-1491-4d1a-afa3-fece45954efd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:10.165927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-537ae905-ff0c-4f21-8179-861a947f5d01 req-b63fb922-1491-4d1a-afa3-fece45954efd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:10.178858 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-537ae905-ff0c-4f21-8179-861a947f5d01 req-b63fb922-1491-4d1a-afa3-fece45954efd service nova] Creating event network-changed:6f28675a-3209-4efe-a656-f6659d634c68 for instance c050ef48-7665-49e8-b03e-a579e061ba47 on nch1-master-1 Aug 06 21:56:10.184813 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-537ae905-ff0c-4f21-8179-861a947f5d01 req-b63fb922-1491-4d1a-afa3-fece45954efd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036115 Aug 06 21:56:10.186001 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3589/6991] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:56:10.402632 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:10.410785 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7a78f30f-5dc2-4daf-986a-1a4203b9f65e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1565 microversion: 2.1 time: 0.265597 Aug 06 21:56:10.426082 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3403/6992] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:10 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1565 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:56:31.653048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fef62e98-f667-4d42-aa1f-3dff99fe638d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:56:31.655351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fef62e98-f667-4d42-aa1f-3dff99fe638d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:31.657810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=7 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:31.658454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=36 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:31.665198 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fef62e98-f667-4d42-aa1f-3dff99fe638d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:31.665682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fef62e98-f667-4d42-aa1f-3dff99fe638d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:31.666124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fef62e98-f667-4d42-aa1f-3dff99fe638d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:31.666848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fef62e98-f667-4d42-aa1f-3dff99fe638d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:31.667305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fef62e98-f667-4d42-aa1f-3dff99fe638d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:31.667745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fef62e98-f667-4d42-aa1f-3dff99fe638d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:31.721714 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fef62e98-f667-4d42-aa1f-3dff99fe638d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47/action" status: 200 len: 24566 microversion: 2.1 time: 0.072851 Aug 06 21:56:31.722373 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3590/6993] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:56:31 2022] POST /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47/action => generated 24566 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:56:42.789726 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2e71a4ab-c44a-42c1-9a17-172c28389df0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:56:42.792124 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2e71a4ab-c44a-42c1-9a17-172c28389df0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:42.794322 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:42.795225 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=32 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:42.804550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e71a4ab-c44a-42c1-9a17-172c28389df0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:42.807259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e71a4ab-c44a-42c1-9a17-172c28389df0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:42.809890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e71a4ab-c44a-42c1-9a17-172c28389df0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:42.810637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e71a4ab-c44a-42c1-9a17-172c28389df0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:42.811117 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e71a4ab-c44a-42c1-9a17-172c28389df0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:42.811561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2e71a4ab-c44a-42c1-9a17-172c28389df0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:42.886426 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2e71a4ab-c44a-42c1-9a17-172c28389df0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47/action" status: 202 len: 0 microversion: 2.1 time: 0.101054 Aug 06 21:56:42.887099 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3404/6994] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:56:42 2022] POST /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:56:42.896310 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:42.897025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:42.900111 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:42.900899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:56:42.907377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:42.908041 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:42.908570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:42.909284 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:42.909749 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:42.910183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:43.051541 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:43.060484 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-160e1f4e-7b8b-49a9-9194-174457e0f97e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1676 microversion: 2.1 time: 0.168919 Aug 06 21:56:43.061071 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3591/6995] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:42 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:44.086435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:44.087246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:44.093577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:44.094051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:44.094494 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:44.095216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:44.095677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:44.096110 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:44.231795 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:44.240276 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-68e3c417-3665-4c32-b195-4dced28a48f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.159035 Aug 06 21:56:44.240858 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3405/6996] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:44 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:45.261361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:45.261976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:45.268905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:45.269389 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:45.269831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:45.271314 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:45.271782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:45.272215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:45.406293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:45.413972 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a2dc7ef3-1e63-4a02-b915-a323fb0fe2ca tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.156549 Aug 06 21:56:45.414536 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3592/6997] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:45 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:46.434942 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:46.435558 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:46.443038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:46.443542 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:46.443983 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:46.444678 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:46.445136 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:46.445566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:46.576505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:46.585041 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-53ef01a0-31d9-4ad2-842e-f95a21b184a3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.153938 Aug 06 21:56:46.585665 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3406/6998] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:46 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:47.606164 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:47.606844 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:47.613908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:47.615018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:47.615468 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:47.616180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:47.616646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:47.617084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:47.802142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:47.809943 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65a73582-d3af-44ae-bf46-19d96020e492 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.207736 Aug 06 21:56:47.810515 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3593/6999] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:47 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:48.831792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:48.832408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:48.839837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:48.840313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:48.840754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:48.841444 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:48.841902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:48.842329 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:49.031122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:49.039554 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e8bc918c-bb54-42dd-99df-66cb1bae2bbc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.211962 Aug 06 21:56:49.040137 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3407/7000] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:48 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:50.061149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:50.061757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:50.068849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:50.069359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:50.069801 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:50.070496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:50.070983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:50.071415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:50.202184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:50.211831 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c0bdc513-e73d-4143-8e74-3daa79f88412 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.154517 Aug 06 21:56:50.212464 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3594/7001] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:50 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:51.233728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:51.234343 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:51.242480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:51.243002 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:51.243446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:51.244153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:51.244612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:51.245072 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:51.375880 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:51.384073 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7bbc40a7-ac73-49e3-823a-db2dc42b8dcb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.154457 Aug 06 21:56:51.384653 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3408/7002] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:51 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:52.404960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:52.405575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:52.412578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:52.413057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:52.413499 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:52.414188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:52.414676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:52.415107 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:52.550914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:52.559166 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9708c206-ac56-4951-9564-ec07e9fb5895 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.158171 Aug 06 21:56:52.559747 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3595/7003] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:52 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:53.581194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:53.581813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:53.589904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:53.590392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:53.590865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:53.591560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:53.592019 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:53.592446 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:53.724217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:53.731844 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-03401fba-b890-4975-80b5-fe13df99d99b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.154923 Aug 06 21:56:53.732410 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3409/7004] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:53 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:54.753360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:54.753979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:54.761654 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:54.762139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:54.762606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:54.763308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:54.763770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:54.764200 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:54.895387 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:54.903056 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b2599c22-3313-4faf-93fc-2e1cef82cee9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.153821 Aug 06 21:56:54.903630 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3596/7005] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:54 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:55.924973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:55.925531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:55.933179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:55.933659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:55.934095 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:55.934815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:55.935270 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:55.935698 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:56.072527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:56.080828 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e87493ea-ccf8-45ce-acd3-2ea8d0c7b1d3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.159271 Aug 06 21:56:56.081407 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3410/7006] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:55 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:57.102761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:57.103382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:57.110235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:57.110753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:57.111202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:57.111895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:57.112352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:57.112775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:57.249208 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:57.257037 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-65a0a6a9-71f5-4f18-881a-a8c730e273b6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.158384 Aug 06 21:56:57.257609 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3597/7007] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:57 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:58.278076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:58.278731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:58.286785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:58.287321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:58.287773 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:58.288483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:58.288949 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:58.289386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:58.423289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:58.430927 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-69972f7d-c8a8-457f-a1ee-e283b071028c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1681 microversion: 2.1 time: 0.156861 Aug 06 21:56:58.431509 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3411/7008] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:58 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:56:59.451941 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:56:59.452565 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:56:59.459812 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:59.460307 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:59.460757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:59.461460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:56:59.461928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:56:59.462364 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:56:59.594885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:56:59.603283 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-32f421b8-c2f6-4a86-a945-14b15e631b43 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1684 microversion: 2.1 time: 0.155348 Aug 06 21:56:59.603848 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3598/7009] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:56:59 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:07.355127 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:57:07.355746 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 21:57:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:57:23.789962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4da8867a-08de-4160-97f7-f6b00e9345f0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:57:23.792205 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4da8867a-08de-4160-97f7-f6b00e9345f0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:23.794310 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=16 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:23.795267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:23.800822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4da8867a-08de-4160-97f7-f6b00e9345f0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:23.801311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4da8867a-08de-4160-97f7-f6b00e9345f0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:23.801789 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4da8867a-08de-4160-97f7-f6b00e9345f0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:23.803166 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4da8867a-08de-4160-97f7-f6b00e9345f0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:23.803629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4da8867a-08de-4160-97f7-f6b00e9345f0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:23.804063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4da8867a-08de-4160-97f7-f6b00e9345f0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:23.858354 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4da8867a-08de-4160-97f7-f6b00e9345f0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47/action" status: 200 len: 69478 microversion: 2.1 time: 0.072898 Aug 06 21:57:23.859038 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3412/7010] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:57:23 2022] POST /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47/action => generated 69478 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:57:31.040464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:31.040995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:31.042671 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9c740afd-05f1-46bd-93b1-e8be5f20b5de req-1fe92ef1-89d0-4bfd-89ed-d2981f82029b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c050ef48-7665-49e8-b03e-a579e061ba47", "tag": "6f28675a-3209-4efe-a656-f6659d634c68"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:57:31.043374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=16 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:31.044226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=48 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:31.050527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:31.051050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:31.052258 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:31.053197 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:31.053661 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:31.054265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:31.055807 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9c740afd-05f1-46bd-93b1-e8be5f20b5de req-1fe92ef1-89d0-4bfd-89ed-d2981f82029b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:31.056288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9c740afd-05f1-46bd-93b1-e8be5f20b5de req-1fe92ef1-89d0-4bfd-89ed-d2981f82029b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:31.056723 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9c740afd-05f1-46bd-93b1-e8be5f20b5de req-1fe92ef1-89d0-4bfd-89ed-d2981f82029b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:31.069642 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9c740afd-05f1-46bd-93b1-e8be5f20b5de req-1fe92ef1-89d0-4bfd-89ed-d2981f82029b service nova] Creating event network-changed:6f28675a-3209-4efe-a656-f6659d634c68 for instance c050ef48-7665-49e8-b03e-a579e061ba47 on nch1-master-1 Aug 06 21:57:31.075004 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9c740afd-05f1-46bd-93b1-e8be5f20b5de req-1fe92ef1-89d0-4bfd-89ed-d2981f82029b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036475 Aug 06 21:57:31.075919 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3413/7011] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:57:31.083074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:57:31.174358 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2b0bae02-e7a3-44f7-94fa-6b5ad0e2afd0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 204 len: 0 microversion: 2.1 time: 0.138030 Aug 06 21:57:31.175148 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3599/7012] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:57:31 2022] DELETE /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:57:31.186308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:31.187167 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:31.195959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:31.196453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:31.196894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:31.197804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:31.198389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:31.198852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:31.365917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:31.373650 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bf006199-566a-40b1-9894-ecc27af41f3a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1690 microversion: 2.1 time: 0.193298 Aug 06 21:57:31.374247 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3414/7013] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:31 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1690 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:57:32.396483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:32.397228 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:32.404487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:32.404980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:32.405425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:32.406141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:32.406637 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:32.407069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:32.551774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:32.559720 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6d3de19a-144b-4907-9541-12e4c4dc7467 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1690 microversion: 2.1 time: 0.167522 Aug 06 21:57:32.560307 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3600/7014] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:32 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:33.244265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-8153b940-9026-47f9-bed5-9a6ae188b443 req-724a6baa-ea0e-4eb2-ae08-1790d799b7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c050ef48-7665-49e8-b03e-a579e061ba47", "name": "network-vif-deleted", "tag": "6f28675a-3209-4efe-a656-f6659d634c68"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:57:33.255835 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8153b940-9026-47f9-bed5-9a6ae188b443 req-724a6baa-ea0e-4eb2-ae08-1790d799b7f5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:33.256560 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8153b940-9026-47f9-bed5-9a6ae188b443 req-724a6baa-ea0e-4eb2-ae08-1790d799b7f5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:33.257052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-8153b940-9026-47f9-bed5-9a6ae188b443 req-724a6baa-ea0e-4eb2-ae08-1790d799b7f5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:33.272218 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-8153b940-9026-47f9-bed5-9a6ae188b443 req-724a6baa-ea0e-4eb2-ae08-1790d799b7f5 service nova] Creating event network-vif-deleted:6f28675a-3209-4efe-a656-f6659d634c68 for instance c050ef48-7665-49e8-b03e-a579e061ba47 on nch1-master-1 Aug 06 21:57:33.277196 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-8153b940-9026-47f9-bed5-9a6ae188b443 req-724a6baa-ea0e-4eb2-ae08-1790d799b7f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093602 Aug 06 21:57:33.278141 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3415/7015] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:57:33.583030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:33.583847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:33.592873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:33.593381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:33.593851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:33.594608 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:33.595487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:33.596025 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:33.642301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:33.642824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:33.643266 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:33.643724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lazy-loading 'fault' on Instance uuid c050ef48-7665-49e8-b03e-a579e061ba47 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 21:57:33.688788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:33.696464 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d47c617-0cb1-4421-9fe1-4bc101e13e20 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 200 len: 1357 microversion: 2.1 time: 0.117613 Aug 06 21:57:33.697193 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3601/7016] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:33 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 1357 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:34.719760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:34.720471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: c050ef48-7665-49e8-b03e-a579e061ba47] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:34.728379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:34.728870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:34.729316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:34.730026 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:34.730489 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:34.730956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:34.745066 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] HTTP exception thrown: Instance c050ef48-7665-49e8-b03e-a579e061ba47 could not be found. Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Request method failure captured: Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 HTTP/1.1 Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uMs0B8_RHECMxpaZJs_l0UEFe-aoVTDGJpCsB0TiKK8kj0fiDPR9yg9WqmB1OR0T7Ale_WwM5zuhySElwjcHWq6Lmwjuw_uw3gaFLCF4CuTDC1YUGN7NaYCjWOPCFBD7riN54CmADb9nlPxtX3At2GzHpR0Elxyx2iuS5EQ1LGTmBg Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ac47bb71e6e4ecf9f5197f217a159da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1f605e9c98464387b21755ec13a52070 Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance c050ef48-7665-49e8-b03e-a579e061ba47 could not be found. Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'c050ef48-7665-49e8-b03e-a579e061ba47'} Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c050ef48-7665-49e8-b03e-a579e061ba47 could not be found. Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c050ef48-7665-49e8-b03e-a579e061ba47 could not be found. Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:57:34.746740 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c050ef48-7665-49e8-b03e-a579e061ba47 could not be found. Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Returning 404 to user: Instance c050ef48-7665-49e8-b03e-a579e061ba47 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-14607da6-ad73-46b2-8c38-7bb750815592 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47" status: 404 len: 111 microversion: 2.1 time: 0.033451 Aug 06 21:57:34.751728 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3416/7017] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:34 2022] GET /compute/v2.1/servers/c050ef48-7665-49e8-b03e-a579e061ba47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:57:38.041264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-58ab2278-2382-41b3-82a9-f250db10768e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '.version_select at 0x7f729cdceaf0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:38.064736 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-58ab2278-2382-41b3-82a9-f250db10768e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1158052601" status: 202 len: 0 microversion: 2.1 time: 0.027488 Aug 06 21:57:38.065341 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3602/7018] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Aug 6 21:57:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1158052601 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:57:38.089297 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4c27422c-dda4-44de-94c1-b52b4b22e2b0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: .version_select at 0x7f729d256160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1984236037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY5ytx1YgLCyvKvVZ1GGfEAitQgiaGN5sy+kfMAWeYxfoHorNlO/0QYNe98xlE/fissbC/XsBj6wo+tMzzao1FtQSSyzUW+2GDg8u1VJb5ITYD8CieHpxMFWs73axI7sA=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:57:38.106396 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4c27422c-dda4-44de-94c1-b52b4b22e2b0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:57:38.112399 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-4c27422c-dda4-44de-94c1-b52b4b22e2b0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:57:38.137132 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4c27422c-dda4-44de-94c1-b52b4b22e2b0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051979 Aug 06 21:57:38.137669 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3417/7019] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:57:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:57:43.972118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-782622035", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "3f73bf5c-585d-488f-9d75-0e508425f634"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1984236037", "security_groups": [{"name": "tempest-secgroup-smoke-2121116597"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:57:43.989753 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:44.112579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] validate_networks() for [('3f73bf5c-585d-488f-9d75-0e508425f634', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:57:44.603084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:57:44.604231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:57:44.604951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:57:44.605481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:57:44.606002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:57:44.615961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:44.616543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:44.617733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:44.618480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:44.619138 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:44.619755 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:44.639777 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:57:44.656442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:57:44.684915 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:57:44.687612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:57:44.741828 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b030b55d-93ba-4086-8dab-3b6fc3316c36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.779088 Aug 06 21:57:44.743184 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3603/7020] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:57:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 21:57:44.751484 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=16 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:44.755866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-46e4047a-0ab0-42ae-b6a3-47059bc8d1f8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:44.756500 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-46e4047a-0ab0-42ae-b6a3-47059bc8d1f8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:44.825177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-46e4047a-0ab0-42ae-b6a3-47059bc8d1f8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:44.838197 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-46e4047a-0ab0-42ae-b6a3-47059bc8d1f8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1266 microversion: 2.1 time: 0.088539 Aug 06 21:57:44.844262 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3418/7021] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:44 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:45.864944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:45.866322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:45.876434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:45.878085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:45.878940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:45.880432 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:45.881077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:45.881676 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:45.966031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:45.976268 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ab9ba86e-44b7-43bc-a03a-7ca4e824955c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1336 microversion: 2.1 time: 0.115669 Aug 06 21:57:45.977527 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3604/7022] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:45 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:46.997338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:46.997961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:47.005982 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:47.006779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:47.007224 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:47.008199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:47.008738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:47.009244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:47.155669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:47.164802 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1399b587-2a4a-49b6-a1e0-e24aea04934d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1392 microversion: 2.1 time: 0.171215 Aug 06 21:57:47.165330 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3419/7023] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:46 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:47.293355 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-67558e9d-4595-4f4a-96ac-53ecb82f7d1c req-58fd2cee-501f-46d4-a2b9-f0f110f5966f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa75c8f-2ebf-427a-8c7f-5025d136b930", "tag": "c98870f6-0845-484d-8486-5fee262c9e35"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:57:47.308175 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-67558e9d-4595-4f4a-96ac-53ecb82f7d1c req-58fd2cee-501f-46d4-a2b9-f0f110f5966f service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:47.308862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-67558e9d-4595-4f4a-96ac-53ecb82f7d1c req-58fd2cee-501f-46d4-a2b9-f0f110f5966f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:47.309296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-67558e9d-4595-4f4a-96ac-53ecb82f7d1c req-58fd2cee-501f-46d4-a2b9-f0f110f5966f service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:47.323217 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-67558e9d-4595-4f4a-96ac-53ecb82f7d1c req-58fd2cee-501f-46d4-a2b9-f0f110f5966f service nova] Creating event network-changed:c98870f6-0845-484d-8486-5fee262c9e35 for instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 on nch2-master-1 Aug 06 21:57:47.328399 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-67558e9d-4595-4f4a-96ac-53ecb82f7d1c req-58fd2cee-501f-46d4-a2b9-f0f110f5966f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038844 Aug 06 21:57:47.329378 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3605/7024] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:57:48.185235 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:48.185854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:48.193022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:48.193505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:48.193951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:48.194681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:48.195144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:48.195578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:48.327646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:48.336306 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5d3cd44b-3c1b-4bc5-b6a5-c4813346e9d6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1392 microversion: 2.1 time: 0.154959 Aug 06 21:57:48.336891 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3420/7025] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:48 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:49.357961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:49.358613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:49.366475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:49.367070 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:49.367517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:49.368221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:49.368958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:49.369403 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:49.501270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:49.509243 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b495e935-ebce-459c-8352-3a5d5dc4af9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1392 microversion: 2.1 time: 0.155676 Aug 06 21:57:49.510029 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3606/7026] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:49 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:50.529700 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:50.530370 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:50.538149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:50.538815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:50.539271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:50.540020 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:50.540491 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:50.540930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:50.674526 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:50.682098 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-790e2c03-2cc5-451d-ab79-6777a773aca8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1392 microversion: 2.1 time: 0.156667 Aug 06 21:57:50.682699 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3421/7027] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:50 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:51.702860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:51.703481 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:51.710574 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:51.711056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:51.711497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:51.712188 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:51.712645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:51.713067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:51.850848 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:51.858455 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-55a15931-75fe-40f6-b1d9-e0a4cdda9828 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1392 microversion: 2.1 time: 0.159520 Aug 06 21:57:51.859057 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3607/7028] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:51 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:52.181291 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-98d48e7f-9886-4cad-a067-6c675f2ee049 req-a5643cba-f21d-4ac8-9a8f-1c1f8120cf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa75c8f-2ebf-427a-8c7f-5025d136b930", "name": "network-vif-plugged", "status": "completed", "tag": "c98870f6-0845-484d-8486-5fee262c9e35"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:57:52.198878 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-98d48e7f-9886-4cad-a067-6c675f2ee049 req-a5643cba-f21d-4ac8-9a8f-1c1f8120cf94 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:52.199423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-98d48e7f-9886-4cad-a067-6c675f2ee049 req-a5643cba-f21d-4ac8-9a8f-1c1f8120cf94 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:52.199814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-98d48e7f-9886-4cad-a067-6c675f2ee049 req-a5643cba-f21d-4ac8-9a8f-1c1f8120cf94 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:52.212379 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-98d48e7f-9886-4cad-a067-6c675f2ee049 req-a5643cba-f21d-4ac8-9a8f-1c1f8120cf94 service nova] Creating event network-vif-plugged:c98870f6-0845-484d-8486-5fee262c9e35 for instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 on nch2-master-1 Aug 06 21:57:52.217591 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-98d48e7f-9886-4cad-a067-6c675f2ee049 req-a5643cba-f21d-4ac8-9a8f-1c1f8120cf94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096608 Aug 06 21:57:52.218217 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3422/7029] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:57:52.880510 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:52.881133 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:52.888171 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:52.888659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:52.889103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:52.889806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:52.890301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:52.890762 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:53.026564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:53.034614 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-59cceebc-79b6-4844-971d-6659f970a5b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1392 microversion: 2.1 time: 0.158920 Aug 06 21:57:53.035762 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3608/7030] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:52 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:57:54.057957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:54.058715 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:54.061465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:54.068003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:54.068496 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:54.069007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:54.069718 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:54.070182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:54.070646 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:54.212845 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:54.220571 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0f990196-b7e2-42dd-b00c-4c51f38c69a5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1563 microversion: 2.1 time: 0.166873 Aug 06 21:57:54.221153 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3423/7031] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:54 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:54.241899 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:54.242522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:54.249028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:54.249514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:54.249988 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:54.250714 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:54.251180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:54.251612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:54.384942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:54.392500 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a16d0cd6-d52d-43a0-85a4-f79c594d41d8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1563 microversion: 2.1 time: 0.155474 Aug 06 21:57:54.393084 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3609/7032] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:54 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:57:56.290914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-9bf41b1e-f1f5-41fa-b990-d3db0c0dd948 req-885ad1e0-a375-4302-a60c-e23e9d0bc27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa75c8f-2ebf-427a-8c7f-5025d136b930", "tag": "c98870f6-0845-484d-8486-5fee262c9e35"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:57:56.296127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:56.296850 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:56.303155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:57:56.303798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:57:56.305822 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:57:56.314507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9bf41b1e-f1f5-41fa-b990-d3db0c0dd948 req-885ad1e0-a375-4302-a60c-e23e9d0bc27e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:56.315029 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9bf41b1e-f1f5-41fa-b990-d3db0c0dd948 req-885ad1e0-a375-4302-a60c-e23e9d0bc27e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:56.315467 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-9bf41b1e-f1f5-41fa-b990-d3db0c0dd948 req-885ad1e0-a375-4302-a60c-e23e9d0bc27e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:56.322780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:56.323281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:56.323734 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:56.324448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:57:56.324908 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:57:56.325346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:57:56.338269 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-9bf41b1e-f1f5-41fa-b990-d3db0c0dd948 req-885ad1e0-a375-4302-a60c-e23e9d0bc27e service nova] Creating event network-changed:c98870f6-0845-484d-8486-5fee262c9e35 for instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 on nch2-master-1 Aug 06 21:57:56.343511 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-9bf41b1e-f1f5-41fa-b990-d3db0c0dd948 req-885ad1e0-a375-4302-a60c-e23e9d0bc27e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056403 Aug 06 21:57:56.344139 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3610/7033] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:57:56.471033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:57:56.479447 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9d03fb58-c808-46eb-8bf6-6ac41aebf6b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1563 microversion: 2.1 time: 0.195452 Aug 06 21:57:56.480042 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3424/7034] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:57:56 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:17.728611 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:17.729491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=36 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:17.733688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-114ccb16-31b2-4f4d-b6e8-e1bf2498a39b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:58:17.735990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-114ccb16-31b2-4f4d-b6e8-e1bf2498a39b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:17.743836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-114ccb16-31b2-4f4d-b6e8-e1bf2498a39b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:17.744331 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-114ccb16-31b2-4f4d-b6e8-e1bf2498a39b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:17.744779 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-114ccb16-31b2-4f4d-b6e8-e1bf2498a39b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:17.745488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-114ccb16-31b2-4f4d-b6e8-e1bf2498a39b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:17.745953 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-114ccb16-31b2-4f4d-b6e8-e1bf2498a39b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:17.746388 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-114ccb16-31b2-4f4d-b6e8-e1bf2498a39b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:17.800658 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-114ccb16-31b2-4f4d-b6e8-e1bf2498a39b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930/action" status: 200 len: 24576 microversion: 2.1 time: 0.073429 Aug 06 21:58:17.801324 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3611/7035] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:58:17 2022] POST /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930/action => generated 24576 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:58:28.867709 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:58:28.870022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:28.872228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:28.872966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=32 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:28.878947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:28.879445 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:28.879903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:28.880610 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:28.881079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:28.881518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:28.923142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:28.929891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Old instance type m1.heat2, new instance type m1.heat {{(pid=142462) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 06 21:58:28.936393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:58:28.936828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:58:28.937313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:58:28.937731 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:58:28.938160 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:58:29.004265 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7144baa8-64ff-46ff-be4d-9a98dc75a6a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930/action" status: 202 len: 0 microversion: 2.1 time: 0.140568 Aug 06 21:58:29.005094 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3425/7036] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:58:28 2022] POST /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:58:29.014439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:29.015196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:29.019402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:29.020063 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=4 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:58:29.025448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:29.026000 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:29.026517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:29.027385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:29.027919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:29.028385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:29.169862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:29.178444 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e5982a17-fe37-4ada-80e0-ba29c772f173 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1691 microversion: 2.1 time: 0.168957 Aug 06 21:58:29.179126 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3612/7037] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:29 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:30.201179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:30.201804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:30.210362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:30.210898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:30.211351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:30.212057 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:30.212521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:30.212958 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:30.349233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:30.357323 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d3f8b5f8-8112-402f-8ab2-78296791ddda tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1691 microversion: 2.1 time: 0.160042 Aug 06 21:58:30.357913 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3426/7038] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:30 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:31.378415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:31.379062 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:31.386054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:31.386569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:31.387027 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:31.387742 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:31.388211 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:31.388648 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:31.525149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:31.532830 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4d9e1155-9870-47e5-893d-96ad9146b967 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1691 microversion: 2.1 time: 0.158401 Aug 06 21:58:31.533978 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3613/7039] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:31 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:32.554695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:32.555472 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:32.563729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:32.564411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:32.566479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:32.567278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:32.567768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:32.568483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:32.703353 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:32.711966 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e6d77a29-7613-4494-ad89-6eaafa7a8958 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1691 microversion: 2.1 time: 0.161174 Aug 06 21:58:32.712541 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3427/7040] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:32 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 21:58:33.732757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:33.733428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:33.740875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:33.741361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:33.741807 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:33.742506 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:33.743018 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:33.743453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:33.879288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:33.886979 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-42731d8f-923e-476a-87bd-2e74a0092829 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1691 microversion: 2.1 time: 0.158110 Aug 06 21:58:33.887565 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3614/7041] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:33 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:34.908818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:34.910046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:34.917063 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:34.917547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:34.917989 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:34.918728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:34.919187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:34.919619 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:35.062690 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:35.070940 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-642388bb-f783-409d-9c23-53952eca164b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1691 microversion: 2.1 time: 0.165951 Aug 06 21:58:35.071512 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3428/7042] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:34 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:36.092538 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:36.093167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:36.100794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:36.101288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:36.101740 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:36.102440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:36.102931 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:36.103366 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:36.240655 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:36.248275 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c16839fe-72ca-469d-b41b-8d89462e872f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.159669 Aug 06 21:58:36.248851 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3615/7043] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:36 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:37.270787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:37.271461 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:37.278466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:37.279004 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:37.279451 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:37.280158 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:37.280628 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:37.281083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:37.423498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:37.431610 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0a3b2565-ef56-48f1-a536-22661ae91bbd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.165446 Aug 06 21:58:37.432190 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3429/7044] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:37 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:38.453068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:38.453602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:38.461669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:38.462160 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:38.462633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:38.463345 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:38.463808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:38.464240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:38.601050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:38.608617 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b53163d6-c6ef-44ae-ae63-4c9157243204 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.159630 Aug 06 21:58:38.609199 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3616/7045] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:38 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:39.629452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:39.630102 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:39.636957 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:39.637437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:39.637874 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:39.638649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:39.639052 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:39.639479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:39.772241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:39.779828 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4895b3f8-a1d3-4a1d-a938-cff87bd195a4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.154470 Aug 06 21:58:39.780400 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3430/7046] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:39 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:40.801634 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:40.802265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:40.809348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:40.809840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:40.810286 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:40.811014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:40.811477 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:40.811908 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:40.948849 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:40.957389 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9b7ca3b5-9ce0-4714-9e4a-f75d277cd4c3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.160002 Aug 06 21:58:40.957954 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3617/7047] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:40 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:41.978282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:41.978927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:41.985995 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:41.986479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:41.987775 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:41.988637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:41.989099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:41.989534 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:42.125976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:42.133792 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1920a915-27af-4b33-8873-376207b6502c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.159481 Aug 06 21:58:42.134381 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3431/7048] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:41 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:43.155542 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:43.156193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:43.164132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:43.164624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:43.165069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:43.165770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:43.166235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:43.166705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:43.297840 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:43.305534 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4a25a0af-bc0c-4bc4-857c-a70ee0db0ecd tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.153947 Aug 06 21:58:43.306110 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3618/7049] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:43 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:44.326790 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:44.327414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:44.335750 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:44.336222 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:44.336668 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:44.337377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:44.337840 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:44.338278 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:44.488842 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:44.496387 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e850bfe3-c892-4919-8893-326f7d50ec9d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.173584 Aug 06 21:58:44.496969 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3432/7050] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:44 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:45.517382 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:45.518078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:45.525126 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:45.525621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:45.526073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:45.526823 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:45.527292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:45.527729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:45.659289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:45.667713 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2cccee33-d42d-429d-a141-a9eb252dcb32 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.154249 Aug 06 21:58:45.668585 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3619/7051] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:45 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:46.691107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:46.691954 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:46.699060 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:46.699539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:46.699980 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:46.700695 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:46.701147 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:46.701577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:46.863642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:46.871390 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8b1a146e-7409-4115-ab7d-c9c02ff209f1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1696 microversion: 2.1 time: 0.185601 Aug 06 21:58:46.871977 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3433/7052] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:46 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:47.255047 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c13520e8-135f-460b-9d83-5230370ada62 req-3916480c-46f3-4683-88e7-3cd572632429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa75c8f-2ebf-427a-8c7f-5025d136b930", "name": "network-vif-unplugged", "status": "completed", "tag": "c98870f6-0845-484d-8486-5fee262c9e35"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:58:47.266127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c13520e8-135f-460b-9d83-5230370ada62 req-3916480c-46f3-4683-88e7-3cd572632429 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:47.266644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c13520e8-135f-460b-9d83-5230370ada62 req-3916480c-46f3-4683-88e7-3cd572632429 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:47.267084 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c13520e8-135f-460b-9d83-5230370ada62 req-3916480c-46f3-4683-88e7-3cd572632429 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:47.279931 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c13520e8-135f-460b-9d83-5230370ada62 req-3916480c-46f3-4683-88e7-3cd572632429 service nova] Creating event network-vif-unplugged:c98870f6-0845-484d-8486-5fee262c9e35 for instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 on nch1-master-1 Aug 06 21:58:47.286170 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [req-c13520e8-135f-460b-9d83-5230370ada62 req-3916480c-46f3-4683-88e7-3cd572632429 service nova] Instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:58:47.296961 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c13520e8-135f-460b-9d83-5230370ada62 req-3916480c-46f3-4683-88e7-3cd572632429 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046076 Aug 06 21:58:47.297565 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3620/7053] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:58:47.894013 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:47.894656 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:47.901648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:47.902142 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:47.902604 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:47.903316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:47.903779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:47.904211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:48.123148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:48.131410 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f66f4903-34cf-4d76-868e-1818d8a12058 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1695 microversion: 2.1 time: 0.241903 Aug 06 21:58:48.131946 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3434/7054] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:47 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1695 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:49.155309 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:49.156011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:49.163226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:49.163717 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:49.164158 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:49.164860 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:49.165322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:49.165754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:49.297878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:49.305620 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa7ecbf0-d287-4996-be8d-6a5908101b3b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1693 microversion: 2.1 time: 0.155540 Aug 06 21:58:49.306194 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3621/7055] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:49 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:49.334712 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-bba25042-2100-4f28-a12d-31847283d276 req-4c8b5c4f-165e-47c4-abf0-20e7a124754e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa75c8f-2ebf-427a-8c7f-5025d136b930", "tag": "c98870f6-0845-484d-8486-5fee262c9e35"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:58:49.345161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bba25042-2100-4f28-a12d-31847283d276 req-4c8b5c4f-165e-47c4-abf0-20e7a124754e service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:49.345667 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bba25042-2100-4f28-a12d-31847283d276 req-4c8b5c4f-165e-47c4-abf0-20e7a124754e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:49.346104 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-bba25042-2100-4f28-a12d-31847283d276 req-4c8b5c4f-165e-47c4-abf0-20e7a124754e service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:49.361059 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-bba25042-2100-4f28-a12d-31847283d276 req-4c8b5c4f-165e-47c4-abf0-20e7a124754e service nova] Creating event network-changed:c98870f6-0845-484d-8486-5fee262c9e35 for instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 on nch1-master-1 Aug 06 21:58:49.366763 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [req-bba25042-2100-4f28-a12d-31847283d276 req-4c8b5c4f-165e-47c4-abf0-20e7a124754e service nova] Instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=142462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 06 21:58:49.378744 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-bba25042-2100-4f28-a12d-31847283d276 req-4c8b5c4f-165e-47c4-abf0-20e7a124754e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048513 Aug 06 21:58:49.379447 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3435/7056] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:58:50.327587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:50.328222 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:50.335890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:50.336384 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:50.336836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:50.337549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:50.338017 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:50.338489 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:50.470712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:50.479517 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-89ae2491-c812-423d-aa9f-d92b465d24f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1690 microversion: 2.1 time: 0.156002 Aug 06 21:58:50.480097 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3622/7057] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:50 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:50.500595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ed4d60b7-dde5-4b57-996f-1be8c331d2af tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:58:50.501159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ed4d60b7-dde5-4b57-996f-1be8c331d2af tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:50.508529 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed4d60b7-dde5-4b57-996f-1be8c331d2af tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:50.509143 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed4d60b7-dde5-4b57-996f-1be8c331d2af tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:50.509631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed4d60b7-dde5-4b57-996f-1be8c331d2af tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:50.510412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed4d60b7-dde5-4b57-996f-1be8c331d2af tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:50.510916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed4d60b7-dde5-4b57-996f-1be8c331d2af tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:50.511361 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ed4d60b7-dde5-4b57-996f-1be8c331d2af tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:50.569294 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ed4d60b7-dde5-4b57-996f-1be8c331d2af tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930/action" status: 204 len: 0 microversion: 2.1 time: 0.072956 Aug 06 21:58:50.569923 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3436/7058] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:58:50 2022] POST /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:58:50.577975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:50.578628 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:50.585546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:50.586035 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:50.586474 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:50.587440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:50.588004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:50.588561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:50.804512 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:50.813331 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fce737d7-0f9d-4e0f-ae4d-73fc9bdebea9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1690 microversion: 2.1 time: 0.239162 Aug 06 21:58:50.813925 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3623/7059] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:50 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1690 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:50.836659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:50.838209 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:50.845447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:50.846554 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:50.847046 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:50.848220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:50.848759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:50.849323 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:50.995025 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:51.004485 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fce3f3b5-0abe-4138-80ea-ecded588a045 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1690 microversion: 2.1 time: 0.174084 Aug 06 21:58:51.005279 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3437/7060] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:50 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:52.024723 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:58:52.025488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:58:52.032515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:52.033007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:52.033485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:52.034325 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:52.034829 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:52.035267 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:52.168575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:58:52.176496 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8ea419bf-363f-499f-8508-859174f3883b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1682 microversion: 2.1 time: 0.155782 Aug 06 21:58:52.177057 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3624/7061] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:58:52 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:58:53.476027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-09c089d5-b60b-40ac-8f9b-e7643879bf7b req-3b43c3dd-96ee-42a0-b598-aadc61956bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa75c8f-2ebf-427a-8c7f-5025d136b930", "name": "network-vif-plugged", "status": "completed", "tag": "c98870f6-0845-484d-8486-5fee262c9e35"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:58:53.487804 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-09c089d5-b60b-40ac-8f9b-e7643879bf7b req-3b43c3dd-96ee-42a0-b598-aadc61956bd3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:58:53.489031 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-09c089d5-b60b-40ac-8f9b-e7643879bf7b req-3b43c3dd-96ee-42a0-b598-aadc61956bd3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:58:53.489532 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-09c089d5-b60b-40ac-8f9b-e7643879bf7b req-3b43c3dd-96ee-42a0-b598-aadc61956bd3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:58:53.501168 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-09c089d5-b60b-40ac-8f9b-e7643879bf7b req-3b43c3dd-96ee-42a0-b598-aadc61956bd3 service nova] Creating event network-vif-plugged:c98870f6-0845-484d-8486-5fee262c9e35 for instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 on nch1-master-1 Aug 06 21:58:53.506964 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-09c089d5-b60b-40ac-8f9b-e7643879bf7b req-3b43c3dd-96ee-42a0-b598-aadc61956bd3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034698 Aug 06 21:58:53.507766 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3438/7062] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:59:14.354161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b3be1b63-faed-414d-a137-22e1c5ae2c86 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:59:14.356399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b3be1b63-faed-414d-a137-22e1c5ae2c86 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:14.358909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=26 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:14.359585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=76 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:14.365394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3be1b63-faed-414d-a137-22e1c5ae2c86 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:14.366456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3be1b63-faed-414d-a137-22e1c5ae2c86 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:14.367213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3be1b63-faed-414d-a137-22e1c5ae2c86 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:14.367927 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3be1b63-faed-414d-a137-22e1c5ae2c86 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:14.368392 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3be1b63-faed-414d-a137-22e1c5ae2c86 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:14.368826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3be1b63-faed-414d-a137-22e1c5ae2c86 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:14.425980 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b3be1b63-faed-414d-a137-22e1c5ae2c86 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930/action" status: 200 len: 24562 microversion: 2.1 time: 0.076223 Aug 06 21:59:14.426654 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3625/7063] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 21:59:14 2022] POST /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930/action => generated 24562 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 21:59:21.483830 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:21.484430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:21.485816 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-e955b3f1-3256-4a0d-a533-cda55699614d req-128ab353-4b01-472e-ac5d-25ea6f4815d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa75c8f-2ebf-427a-8c7f-5025d136b930", "tag": "c98870f6-0845-484d-8486-5fee262c9e35"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:59:21.488138 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=32 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:21.488964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:21.494518 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:21.495042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:21.495563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:21.496194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:21.496891 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:21.497332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:21.498301 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e955b3f1-3256-4a0d-a533-cda55699614d req-128ab353-4b01-472e-ac5d-25ea6f4815d3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:21.498861 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e955b3f1-3256-4a0d-a533-cda55699614d req-128ab353-4b01-472e-ac5d-25ea6f4815d3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:21.499296 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-e955b3f1-3256-4a0d-a533-cda55699614d req-128ab353-4b01-472e-ac5d-25ea6f4815d3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:21.512971 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-e955b3f1-3256-4a0d-a533-cda55699614d req-128ab353-4b01-472e-ac5d-25ea6f4815d3 service nova] Creating event network-changed:c98870f6-0845-484d-8486-5fee262c9e35 for instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 on nch1-master-1 Aug 06 21:59:21.518183 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-e955b3f1-3256-4a0d-a533-cda55699614d req-128ab353-4b01-472e-ac5d-25ea6f4815d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036431 Aug 06 21:59:21.519983 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3626/7064] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:59:21.527292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:59:21.611745 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-f28b2578-1fbf-451f-9988-c360b3bee354 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 204 len: 0 microversion: 2.1 time: 0.132442 Aug 06 21:59:21.612586 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3439/7065] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 21:59:21 2022] DELETE /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:59:21.622993 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:21.624073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:21.631279 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:21.632064 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:21.632513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:21.633416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:21.633900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:21.634319 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:21.789600 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:21.797477 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2ccab076-4dec-44bd-b987-7a328801b5ff tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1688 microversion: 2.1 time: 0.178982 Aug 06 21:59:21.798059 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3627/7066] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:21 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:22.822259 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:22.823463 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:22.830498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:22.831005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:22.831453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:22.832187 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:22.832811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:22.833118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:23.173652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:23.182302 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a2ec0a07-50a7-4406-b8cd-72534838eab9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 200 len: 1688 microversion: 2.1 time: 0.365108 Aug 06 21:59:23.182941 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3440/7067] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:22 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 1688 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:23.528130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-2697b603-f766-4497-a285-cfa75e5c20ef req-0db38166-8146-480b-aec6-e28ddbbb03da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa75c8f-2ebf-427a-8c7f-5025d136b930", "name": "network-vif-deleted", "tag": "c98870f6-0845-484d-8486-5fee262c9e35"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:59:23.542045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2697b603-f766-4497-a285-cfa75e5c20ef req-0db38166-8146-480b-aec6-e28ddbbb03da service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:23.542527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2697b603-f766-4497-a285-cfa75e5c20ef req-0db38166-8146-480b-aec6-e28ddbbb03da service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:23.542983 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-2697b603-f766-4497-a285-cfa75e5c20ef req-0db38166-8146-480b-aec6-e28ddbbb03da service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:23.556425 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-2697b603-f766-4497-a285-cfa75e5c20ef req-0db38166-8146-480b-aec6-e28ddbbb03da service nova] Creating event network-vif-deleted:c98870f6-0845-484d-8486-5fee262c9e35 for instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 on nch1-master-1 Aug 06 21:59:23.562335 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-2697b603-f766-4497-a285-cfa75e5c20ef req-0db38166-8146-480b-aec6-e28ddbbb03da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037747 Aug 06 21:59:23.562983 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3628/7068] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:59:24.204194 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:24.204998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 6aa75c8f-2ebf-427a-8c7f-5025d136b930] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:24.212412 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:24.212896 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:24.213342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:24.214041 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:24.214501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:24.214968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:24.229060 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] HTTP exception thrown: Instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 could not be found. Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Request method failure captured: Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 HTTP/1.1 Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uMs0B8_RHECMxpaZJs_l0UEFe-aoVTDGJpCsB0TiKK8kj0fiDPR9yg9WqmB1OR0T7Ale_WwM5zuhySElwjcHWq6Lmwjuw_uw3gaFLCF4CuTDC1YUGN7NaYCjWOPCFBD7riN54CmADb9nlPxtX3At2GzHpR0Elxyx2iuS5EQ1LGTmBg Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ac47bb71e6e4ecf9f5197f217a159da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1f605e9c98464387b21755ec13a52070 Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 could not be found. Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '6aa75c8f-2ebf-427a-8c7f-5025d136b930'} Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 could not be found. Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 could not be found. Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:59:24.230732 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 could not be found. Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Returning 404 to user: Instance 6aa75c8f-2ebf-427a-8c7f-5025d136b930 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e7a73ba0-7795-4963-bb02-61c7c3073849 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930" status: 404 len: 111 microversion: 2.1 time: 0.032007 Aug 06 21:59:24.235502 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3441/7069] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:24 2022] GET /compute/v2.1/servers/6aa75c8f-2ebf-427a-8c7f-5025d136b930 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:59:27.534636 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-2488f63c-e09d-4357-95ec-c78601859cbf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '.version_select at 0x7f72a365a9d0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:27.558423 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-2488f63c-e09d-4357-95ec-c78601859cbf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1984236037" status: 202 len: 0 microversion: 2.1 time: 0.027962 Aug 06 21:59:27.558984 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3629/7070] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Aug 6 21:59:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1984236037 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:59:27.587084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5f76bbbe-3dca-4604-a0a1-1be9b68c83fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: .version_select at 0x7f729d31c940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1300154867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzddpOFBav/lKm2dEi6czOsKiLjrmueu/F/a+p+LiL2isawh2lydiUesmRYsO8wRKUCZgoChRKrX16XzIrDcfhh2vyQyRvGUjvH+RyY8uXiAWXHMDmBHjVFf1rvdkCxAw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:59:27.607208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5f76bbbe-3dca-4604-a0a1-1be9b68c83fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:59:27.612386 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-5f76bbbe-3dca-4604-a0a1-1be9b68c83fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:59:27.636151 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5f76bbbe-3dca-4604-a0a1-1be9b68c83fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053812 Aug 06 21:59:27.636770 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3442/7071] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 21:59:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:59:33.188613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-470121113", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "5ce73d94-7325-4b5e-812d-2fea64181f82"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1300154867", "security_groups": [{"name": "tempest-secgroup-smoke-594179032"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:59:33.331174 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] validate_networks() for [('5ce73d94-7325-4b5e-812d-2fea64181f82', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 21:59:33.547826 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=14 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:33.769223 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 21:59:33.769664 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 21:59:33.770184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 21:59:33.770795 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 21:59:33.771833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 21:59:33.781235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:33.781733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:33.782180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:33.782964 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:33.783436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:33.783876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:33.802139 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 21:59:33.808096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 21:59:33.821768 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 21:59:33.824235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 21:59:33.870192 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-62a8b5e1-9b09-460c-93ed-28221f2a02bf tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.687030 Aug 06 21:59:33.877714 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3630/7072] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 21:59:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 21:59:33.891038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-99bf27f9-0d72-4a0e-85fd-5940676024a0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:33.892279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-99bf27f9-0d72-4a0e-85fd-5940676024a0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:33.969997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-99bf27f9-0d72-4a0e-85fd-5940676024a0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:33.980035 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-99bf27f9-0d72-4a0e-85fd-5940676024a0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1266 microversion: 2.1 time: 0.100065 Aug 06 21:59:33.981377 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3443/7073] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:33 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:35.004590 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:35.007591 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:35.016469 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:35.017154 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:35.017803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:35.018521 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:35.019180 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:35.019616 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:35.134007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:35.143327 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f93c0767-702b-47d8-8d42-0ecf2977fa04 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1336 microversion: 2.1 time: 0.146526 Aug 06 21:59:35.143920 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3631/7074] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:34 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1336 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:36.163742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:36.164372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:36.166367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:36.173421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:36.173921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:36.174372 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:36.175155 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:36.175627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:36.176100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:36.322967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:36.330940 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-55f2ad9a-3ab7-433e-b996-79a6a9d062f7 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1391 microversion: 2.1 time: 0.171226 Aug 06 21:59:36.331501 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3444/7075] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:36 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:36.426185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-a86cd2bb-51fa-4fef-97a1-b7696226b85a req-05c9e866-05d4-4b5d-abd4-2d5b02445130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd3d721-ccbf-481c-b4f7-c89a52a634b3", "tag": "5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:59:36.438968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a86cd2bb-51fa-4fef-97a1-b7696226b85a req-05c9e866-05d4-4b5d-abd4-2d5b02445130 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:36.446514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a86cd2bb-51fa-4fef-97a1-b7696226b85a req-05c9e866-05d4-4b5d-abd4-2d5b02445130 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:36.447289 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a86cd2bb-51fa-4fef-97a1-b7696226b85a req-05c9e866-05d4-4b5d-abd4-2d5b02445130 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:36.463148 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a86cd2bb-51fa-4fef-97a1-b7696226b85a req-05c9e866-05d4-4b5d-abd4-2d5b02445130 service nova] Creating event network-changed:5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd for instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 on nch2-master-1 Aug 06 21:59:36.468726 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-a86cd2bb-51fa-4fef-97a1-b7696226b85a req-05c9e866-05d4-4b5d-abd4-2d5b02445130 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046502 Aug 06 21:59:36.469592 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3632/7076] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:59:37.351915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:37.352530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:37.359696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:37.360181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:37.360625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:37.361320 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:37.361779 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:37.362208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:37.496669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:37.504410 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-56d648ba-0e51-4d1b-a461-ded073342494 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1391 microversion: 2.1 time: 0.156551 Aug 06 21:59:37.505000 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3445/7077] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:37 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:38.526810 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:38.527523 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:38.534361 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:38.534892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:38.535337 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:38.536030 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:38.536487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:38.537094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:38.671987 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:38.680814 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6f40506-0774-41e7-bd79-6d3139764c4d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1391 microversion: 2.1 time: 0.159173 Aug 06 21:59:38.681396 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3633/7078] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:38 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:39.701562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:39.702184 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:39.709992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:39.710466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:39.710934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:39.711633 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:39.712091 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:39.712550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:39.842180 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:39.850305 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b1627d3e-cac6-4fb0-9db3-8e69d88cc200 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1391 microversion: 2.1 time: 0.152797 Aug 06 21:59:39.850920 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3446/7079] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:39 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:40.569586 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-01b4fd1a-7168-4c1b-ad5d-5f9b4b946f40 req-2b02be2a-da8f-42c6-a4a4-b41f1139d4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd3d721-ccbf-481c-b4f7-c89a52a634b3", "name": "network-vif-plugged", "status": "completed", "tag": "5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:59:40.580821 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-01b4fd1a-7168-4c1b-ad5d-5f9b4b946f40 req-2b02be2a-da8f-42c6-a4a4-b41f1139d4a4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:40.581313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-01b4fd1a-7168-4c1b-ad5d-5f9b4b946f40 req-2b02be2a-da8f-42c6-a4a4-b41f1139d4a4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:40.581817 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-01b4fd1a-7168-4c1b-ad5d-5f9b4b946f40 req-2b02be2a-da8f-42c6-a4a4-b41f1139d4a4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:40.594355 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-01b4fd1a-7168-4c1b-ad5d-5f9b4b946f40 req-2b02be2a-da8f-42c6-a4a4-b41f1139d4a4 service nova] Creating event network-vif-plugged:5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd for instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 on nch2-master-1 Aug 06 21:59:40.600928 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-01b4fd1a-7168-4c1b-ad5d-5f9b4b946f40 req-2b02be2a-da8f-42c6-a4a4-b41f1139d4a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034419 Aug 06 21:59:40.602009 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3634/7080] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:59:40.871351 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:40.871964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:40.878916 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:40.879434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:40.879873 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:40.881190 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:40.881655 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:40.882085 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:41.014930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:41.022977 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-539407e0-4fd4-4f7f-83e7-9f6ed5a95de1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1391 microversion: 2.1 time: 0.155432 Aug 06 21:59:41.023558 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3447/7081] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:40 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:42.044913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:42.045651 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:42.051933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:42.052946 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:42.053399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:42.054098 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:42.054582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:42.055022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:42.185843 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:42.194155 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5cc6b97a-cba0-41c7-94fc-dcc91f34f2fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1564 microversion: 2.1 time: 0.154404 Aug 06 21:59:42.194808 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3635/7082] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:42 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:42.214090 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:42.214760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:42.221573 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:42.222054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:42.222510 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:42.223218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:42.223676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:42.224135 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:42.359976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:42.367573 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-47e000f9-a87a-487d-8e31-0cf197266f36 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1564 microversion: 2.1 time: 0.157304 Aug 06 21:59:42.368150 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3448/7083] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:42 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:59:44.300502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:59:44.300888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:59:44.304480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-9f682d4d-f24c-4e64-9e50-4741ebb3e23f req-e833e364-bb0e-4914-b78b-0d2bc98a0ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd3d721-ccbf-481c-b4f7-c89a52a634b3", "tag": "5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:59:44.305012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:44.305536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:44.312318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:44.313103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:44.313574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:59:44.313760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:44.314820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:44.315517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:44.315935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:44.321139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9f682d4d-f24c-4e64-9e50-4741ebb3e23f req-e833e364-bb0e-4914-b78b-0d2bc98a0ecc service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:59:44.321904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9f682d4d-f24c-4e64-9e50-4741ebb3e23f req-e833e364-bb0e-4914-b78b-0d2bc98a0ecc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:59:44.322574 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-9f682d4d-f24c-4e64-9e50-4741ebb3e23f req-e833e364-bb0e-4914-b78b-0d2bc98a0ecc service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:59:44.337003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-9f682d4d-f24c-4e64-9e50-4741ebb3e23f req-e833e364-bb0e-4914-b78b-0d2bc98a0ecc service nova] Creating event network-changed:5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd for instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 on nch2-master-1 Aug 06 21:59:44.345520 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-9f682d4d-f24c-4e64-9e50-4741ebb3e23f req-e833e364-bb0e-4914-b78b-0d2bc98a0ecc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047628 Aug 06 21:59:44.346410 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3449/7084] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 21:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:59:44.570992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:59:44.580311 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-f9ac9092-ff1b-4340-ae97-0959e8650c81 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1564 microversion: 2.1 time: 0.284721 Aug 06 21:59:44.594571 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3636/7085] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 21:59:44 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1564 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:05.900221 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:00:05.900956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=32 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:00:05.963012 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-993c54e5-e89a-4a8a-a94f-ce4c22f4e337 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:00:05.965376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-993c54e5-e89a-4a8a-a94f-ce4c22f4e337 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:05.971683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-993c54e5-e89a-4a8a-a94f-ce4c22f4e337 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:05.972175 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-993c54e5-e89a-4a8a-a94f-ce4c22f4e337 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:05.972618 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-993c54e5-e89a-4a8a-a94f-ce4c22f4e337 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:05.973315 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-993c54e5-e89a-4a8a-a94f-ce4c22f4e337 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:05.973774 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-993c54e5-e89a-4a8a-a94f-ce4c22f4e337 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:05.974207 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-993c54e5-e89a-4a8a-a94f-ce4c22f4e337 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:06.029727 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-993c54e5-e89a-4a8a-a94f-ce4c22f4e337 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action" status: 200 len: 24565 microversion: 2.1 time: 0.132237 Aug 06 22:00:06.030402 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3450/7086] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:00:05 2022] POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action => generated 24565 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:00:17.022221 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-be398ff7-8834-4b31-81a1-57ffa6587353 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:00:17.024847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:00:17.025620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=30 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:00:17.032141 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be398ff7-8834-4b31-81a1-57ffa6587353 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:17.032638 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be398ff7-8834-4b31-81a1-57ffa6587353 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:17.033083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-be398ff7-8834-4b31-81a1-57ffa6587353 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:17.057592 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-be398ff7-8834-4b31-81a1-57ffa6587353 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Going to try to stop instance {{(pid=142461) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 22:00:17.099983 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-be398ff7-8834-4b31-81a1-57ffa6587353 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action" status: 202 len: 0 microversion: 2.1 time: 0.081829 Aug 06 22:00:17.100581 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3637/7087] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:00:17 2022] POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:00:17.110128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:17.110915 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:17.113653 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:00:17.114375 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:00:17.122345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:17.123034 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:17.123482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:17.124271 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:17.124737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:17.125174 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:17.262531 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:17.270257 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1213176b-0bb9-4ed1-869c-a70cd4993648 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.164391 Aug 06 22:00:17.270854 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3451/7088] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:17 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:18.293715 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:18.294448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:18.300679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:18.301167 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:18.301605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:18.302300 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:18.302784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:18.303216 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:18.435620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:18.443314 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d9e5ba90-9aac-442d-9bca-1292d1adcfb5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.155507 Aug 06 22:00:18.443883 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3638/7089] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:18 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:19.466211 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:19.466864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:19.473847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:19.474333 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:19.474816 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:19.475540 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:19.476254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:19.476781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:19.614755 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:19.623090 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-60fb7908-b3b9-4db6-9d09-cf5c9db3e70e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.160852 Aug 06 22:00:19.623665 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3452/7090] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:19 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:20.645054 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:20.645603 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:20.652602 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:20.653083 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:20.653522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:20.654217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:20.654704 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:20.655132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:20.806887 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:20.814502 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8b4969bf-928c-4b4f-9eb7-90ebfc450d7c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.173456 Aug 06 22:00:20.815105 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3639/7091] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:20 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:21.837321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:21.837870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:21.844798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:21.845290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:21.845738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:21.846437 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:21.846926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:21.847368 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:21.980005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:21.987714 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b4b89d0c-ba5e-4725-8b1f-819a2bf706b5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.155550 Aug 06 22:00:21.988295 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3453/7092] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:21 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:23.008985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:23.009607 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:23.016553 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:23.017042 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:23.017502 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:23.018183 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:23.018674 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:23.019109 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:23.152496 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:23.160191 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e5ca1245-0d14-4f2f-a65a-97f537244811 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.155331 Aug 06 22:00:23.160766 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3640/7093] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:23 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:24.181244 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:24.181867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:24.188839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:24.189325 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:24.189772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:24.190474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:24.190965 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:24.191402 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:24.328638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:24.337549 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-be597bef-fda3-4bc3-ad84-4dfb0bfd5b58 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.160215 Aug 06 22:00:24.338136 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3454/7094] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:24 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:25.359219 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:25.359835 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:25.367060 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:25.367549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:25.367990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:25.368688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:25.369146 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:25.369575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:25.503265 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:25.511863 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-39877951-65ff-4cf8-ac5d-082bbf85dda1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.156668 Aug 06 22:00:25.512434 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3641/7095] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:25 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:26.533358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:26.533973 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:26.542253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:26.543099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:26.543674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:26.544391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:26.544856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:26.545290 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:26.678833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:26.686353 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bf4ab743-befa-4828-9b1b-07d6982a1f87 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.157023 Aug 06 22:00:26.686964 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3455/7096] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:26 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:27.708798 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:27.709434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:27.716960 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:27.717457 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:27.717909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:27.718644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:27.719121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:27.719562 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:27.857834 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:27.865557 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-7d87716e-e67a-4815-8f2a-f520ee4ec50f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.161557 Aug 06 22:00:27.866432 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3642/7097] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:27 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:28.887144 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:28.887759 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:28.894799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:28.895283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:28.895724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:28.896416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:28.896872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:28.897425 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:29.030701 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:29.039232 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d78770ac-fd65-43c3-87d0-5d327cbc0551 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.155984 Aug 06 22:00:29.039823 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3456/7098] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:28 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:30.060003 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:30.060635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:30.067381 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:30.067875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:30.068328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:30.069665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:30.070229 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:30.070699 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:30.199115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:30.207023 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-82169631-e4ef-4e5e-9a53-869252d04580 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.151134 Aug 06 22:00:30.207604 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3643/7099] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:30 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:31.229188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:31.229817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:31.236938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:31.237435 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:31.237925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:31.238637 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:31.239105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:31.239543 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:31.376111 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:31.383868 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3ec0d594-7fef-4769-8df3-f5b77dc21c6e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1693 microversion: 2.1 time: 0.159287 Aug 06 22:00:31.384458 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3457/7100] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:31 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:32.409483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:32.410078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:32.417055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:32.417537 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:32.417973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:32.418700 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:32.419155 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:32.419579 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:32.554357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:32.562707 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-ff4dedf8-3550-4289-b252-cce3b80bacd4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1670 microversion: 2.1 time: 0.157292 Aug 06 22:00:32.563281 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3644/7101] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:32 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:33.653193 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3d729415-9d6e-4d43-95b7-9ca3a8a9339a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:00:33.655557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3d729415-9d6e-4d43-95b7-9ca3a8a9339a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:33.662520 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d729415-9d6e-4d43-95b7-9ca3a8a9339a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:33.663064 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d729415-9d6e-4d43-95b7-9ca3a8a9339a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:33.663517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d729415-9d6e-4d43-95b7-9ca3a8a9339a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:33.664239 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d729415-9d6e-4d43-95b7-9ca3a8a9339a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:33.665201 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d729415-9d6e-4d43-95b7-9ca3a8a9339a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:33.666473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3d729415-9d6e-4d43-95b7-9ca3a8a9339a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:33.720458 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3d729415-9d6e-4d43-95b7-9ca3a8a9339a tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action" status: 200 len: 38366 microversion: 2.1 time: 0.071535 Aug 06 22:00:33.728465 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3458/7102] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:00:33 2022] POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action => generated 38366 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:00:33.733599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6b527d19-b931-4411-9c6f-d9c3514fd6d4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:00:33.740776 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b527d19-b931-4411-9c6f-d9c3514fd6d4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:33.741264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b527d19-b931-4411-9c6f-d9c3514fd6d4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:33.741708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6b527d19-b931-4411-9c6f-d9c3514fd6d4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:33.768273 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6b527d19-b931-4411-9c6f-d9c3514fd6d4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Going to try to start instance {{(pid=142461) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 22:00:33.814139 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6b527d19-b931-4411-9c6f-d9c3514fd6d4 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action" status: 202 len: 0 microversion: 2.1 time: 0.084317 Aug 06 22:00:33.815662 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3645/7103] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:00:33 2022] POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 22:00:33.824182 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:33.825226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:33.833100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:33.833603 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:33.834062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:33.834810 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:33.835276 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:33.835716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:33.980716 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:33.988550 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4c13c76e-824d-4b3d-889c-9028eaaef58c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1679 microversion: 2.1 time: 0.169155 Aug 06 22:00:33.989317 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3459/7104] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:33 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:35.011635 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:35.012348 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:35.018719 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:35.019215 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:35.019659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:35.020373 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:35.020832 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:35.021290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:35.153800 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:35.161863 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b6991d5e-ff05-4e61-bfdf-6167272404ad tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1679 microversion: 2.1 time: 0.156109 Aug 06 22:00:35.162447 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3646/7105] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:35 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:00:36.183931 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:00:36.184548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:00:36.191504 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:36.191986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:36.192424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:36.193118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:00:36.193579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:00:36.194152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:00:36.332971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:00:36.341621 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3aa456a7-6365-4009-a120-fe8c19f8bc67 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1683 microversion: 2.1 time: 0.161765 Aug 06 22:00:36.342198 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3460/7106] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:00:36 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:00.525315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-964440c2-53da-4d05-a309-fbc81fd022bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:01:00.527544 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-964440c2-53da-4d05-a309-fbc81fd022bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:00.529730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=20 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:00.530522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:00.536334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-964440c2-53da-4d05-a309-fbc81fd022bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:00.536820 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-964440c2-53da-4d05-a309-fbc81fd022bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:00.537262 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-964440c2-53da-4d05-a309-fbc81fd022bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:00.537961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-964440c2-53da-4d05-a309-fbc81fd022bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:00.538417 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-964440c2-53da-4d05-a309-fbc81fd022bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:00.538879 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-964440c2-53da-4d05-a309-fbc81fd022bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:00.593807 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-964440c2-53da-4d05-a309-fbc81fd022bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action" status: 200 len: 62926 microversion: 2.1 time: 0.072934 Aug 06 22:01:00.594463 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3647/7107] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:01:00 2022] POST /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3/action => generated 62926 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:01:07.664627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:07.665788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:07.667901 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-ca8feb7a-fb97-43b2-8041-bfe76cac81c9 req-7f2b2999-87d7-41c6-9f6f-31942c95e2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd3d721-ccbf-481c-b4f7-c89a52a634b3", "tag": "5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:01:07.673927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=20 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:07.675548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=58 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:07.677208 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:07.677697 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:07.678140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:07.679214 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:07.679838 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:07.680272 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:07.681436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ca8feb7a-fb97-43b2-8041-bfe76cac81c9 req-7f2b2999-87d7-41c6-9f6f-31942c95e2c7 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:07.682114 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ca8feb7a-fb97-43b2-8041-bfe76cac81c9 req-7f2b2999-87d7-41c6-9f6f-31942c95e2c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:07.682794 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-ca8feb7a-fb97-43b2-8041-bfe76cac81c9 req-7f2b2999-87d7-41c6-9f6f-31942c95e2c7 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:07.699227 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-ca8feb7a-fb97-43b2-8041-bfe76cac81c9 req-7f2b2999-87d7-41c6-9f6f-31942c95e2c7 service nova] Creating event network-changed:5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd for instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 on nch2-master-1 Aug 06 22:01:07.709052 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-ca8feb7a-fb97-43b2-8041-bfe76cac81c9 req-7f2b2999-87d7-41c6-9f6f-31942c95e2c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045874 Aug 06 22:01:07.709685 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3648/7108] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:01:07.716483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:01:07.803585 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-30c20711-cf46-478b-b33b-62a72b1e2ef5 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 204 len: 0 microversion: 2.1 time: 0.143008 Aug 06 22:01:07.810638 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3461/7109] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 22:01:07 2022] DELETE /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:01:07.816913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:07.817934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:07.825357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:07.825870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:07.826322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:07.827080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:07.827554 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:07.828203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:07.988741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:07.997320 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-79c63ef0-9ac4-4516-8489-873839b42e49 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1689 microversion: 2.1 time: 0.186619 Aug 06 22:01:07.997895 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3649/7110] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:07 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:09.020332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:09.021054 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:09.028287 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:09.028877 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:09.029330 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:09.030042 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:09.030509 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:09.030971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:09.172148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:09.179917 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-6bc968d0-5b40-4d05-9e34-bc1dbc9d0404 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 200 len: 1689 microversion: 2.1 time: 0.164216 Aug 06 22:01:09.180627 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3462/7111] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:09 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:09.753824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-b24fd038-efdd-4893-94a1-fddd19dd3d18 req-074dd001-173a-4eff-a62a-153e51b32475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd3d721-ccbf-481c-b4f7-c89a52a634b3", "name": "network-vif-deleted", "tag": "5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:01:09.768362 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b24fd038-efdd-4893-94a1-fddd19dd3d18 req-074dd001-173a-4eff-a62a-153e51b32475 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:09.768847 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b24fd038-efdd-4893-94a1-fddd19dd3d18 req-074dd001-173a-4eff-a62a-153e51b32475 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:09.769385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-b24fd038-efdd-4893-94a1-fddd19dd3d18 req-074dd001-173a-4eff-a62a-153e51b32475 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:09.782920 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-b24fd038-efdd-4893-94a1-fddd19dd3d18 req-074dd001-173a-4eff-a62a-153e51b32475 service nova] Creating event network-vif-deleted:5abbcdd1-870a-40c5-b0f5-b36ba07fd8bd for instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 on nch2-master-1 Aug 06 22:01:09.788996 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-b24fd038-efdd-4893-94a1-fddd19dd3d18 req-074dd001-173a-4eff-a62a-153e51b32475 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038558 Aug 06 22:01:09.789657 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3650/7112] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:01:10.201218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:10.202452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: 9dd3d721-ccbf-481c-b4f7-c89a52a634b3] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:10.210079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:10.210979 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:10.211436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:10.212233 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:10.212813 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:10.213288 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:10.227923 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] HTTP exception thrown: Instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 could not be found. Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Request method failure captured: Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 HTTP/1.1 Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uMs0B8_RHECMxpaZJs_l0UEFe-aoVTDGJpCsB0TiKK8kj0fiDPR9yg9WqmB1OR0T7Ale_WwM5zuhySElwjcHWq6Lmwjuw_uw3gaFLCF4CuTDC1YUGN7NaYCjWOPCFBD7riN54CmADb9nlPxtX3At2GzHpR0Elxyx2iuS5EQ1LGTmBg Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ac47bb71e6e4ecf9f5197f217a159da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1f605e9c98464387b21755ec13a52070 Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 could not be found. Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '9dd3d721-ccbf-481c-b4f7-c89a52a634b3'} Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 could not be found. Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 could not be found. Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:01:10.229737 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 could not be found. Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Returning 404 to user: Instance 9dd3d721-ccbf-481c-b4f7-c89a52a634b3 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2baec31d-cfc8-40d4-94af-c7ec3a11ebb3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3" status: 404 len: 111 microversion: 2.1 time: 0.034097 Aug 06 22:01:10.234829 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3463/7113] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:10 2022] GET /compute/v2.1/servers/9dd3d721-ccbf-481c-b4f7-c89a52a634b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:01:13.549619 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5634f205-f030-4d06-9503-8d9bb07b10c0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '.version_select at 0x7f729c5815e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:13.570681 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5634f205-f030-4d06-9503-8d9bb07b10c0 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1300154867" status: 202 len: 0 microversion: 2.1 time: 0.025306 Aug 06 22:01:13.572563 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3651/7114] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Aug 6 22:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1300154867 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 22:01:13.604332 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0c6b1e08-bbb4-4674-ab5e-d701a6a4ba5f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: .version_select at 0x7f72a353a310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1380864437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHI5ouTbxVsPKUyPhk8UmCKjdtxleiv+OFUrl/euQjLRbIOebVdzHleDCuONGHPsNNQEei0FqVLOfErYuqgyWIsJ+rZAhYK+JsDCTnDJ7eKVym4qwRuLKAd+OkgKXQm0Q=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:01:13.621300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0c6b1e08-bbb4-4674-ab5e-d701a6a4ba5f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:01:13.627420 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-0c6b1e08-bbb4-4674-ab5e-d701a6a4ba5f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:01:13.651730 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0c6b1e08-bbb4-4674-ab5e-d701a6a4ba5f tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051497 Aug 06 22:01:13.652338 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3464/7115] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 22:01:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:01:19.311754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1351880075", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "networks": [{"uuid": "77553f69-c562-4ac1-add3-dd7d46e887c7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1380864437", "security_groups": [{"name": "tempest-secgroup-smoke-1927262605"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:01:19.439415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] validate_networks() for [('77553f69-c562-4ac1-add3-dd7d46e887c7', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:01:19.774759 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=14 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:19.845838 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:01:19.846405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:01:19.847145 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:01:19.847784 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:01:19.848270 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:01:19.858869 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:19.859365 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:19.859802 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:19.860536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:19.860995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:19.861418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:19.885937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:01:19.892071 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Getting quotas for user 1f605e9c98464387b21755ec13a52070 and project 1ac47bb71e6e4ecf9f5197f217a159da. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:01:19.908217 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:01:19.913484 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:01:19.970969 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9f669f2b-9cbd-4229-885a-143f2a42c53b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.664052 Aug 06 22:01:19.979573 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3652/7116] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 22:01:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:01:19.986128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-87442945-ea04-444d-bd1a-bdab33e38aa8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:19.986814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-87442945-ea04-444d-bd1a-bdab33e38aa8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:20.060536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-87442945-ea04-444d-bd1a-bdab33e38aa8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:20.068564 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-87442945-ea04-444d-bd1a-bdab33e38aa8 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1267 microversion: 2.1 time: 0.087949 Aug 06 22:01:20.072458 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3465/7117] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:19 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:21.095232 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:21.096601 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:21.104633 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:21.106097 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:21.106979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:21.108094 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:21.108760 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:21.109884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:21.221974 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:21.237007 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c06efa02-744f-4d94-a20b-21b4051a38b9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1327 microversion: 2.1 time: 0.147975 Aug 06 22:01:21.238471 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3653/7118] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:21 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1327 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:22.260778 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:22.263627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:22.265910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:22.273397 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:22.273928 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:22.274455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:22.275902 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:22.276922 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:22.277300 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:22.543868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:22.551947 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fd2d504c-b6ec-4679-93ac-ae206e8e8d5c tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1393 microversion: 2.1 time: 0.295691 Aug 06 22:01:22.567225 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3466/7119] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:22 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1393 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:22.674483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-311578a8-a78e-4add-a522-82f947b0af16 req-69fe7655-4b62-48f0-b36c-a61ff6a24243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d", "tag": "3289a77c-8e76-4409-ab13-4db22f9ce4bb"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:01:22.689660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-311578a8-a78e-4add-a522-82f947b0af16 req-69fe7655-4b62-48f0-b36c-a61ff6a24243 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:22.690378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-311578a8-a78e-4add-a522-82f947b0af16 req-69fe7655-4b62-48f0-b36c-a61ff6a24243 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:22.690859 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-311578a8-a78e-4add-a522-82f947b0af16 req-69fe7655-4b62-48f0-b36c-a61ff6a24243 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:22.707641 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-311578a8-a78e-4add-a522-82f947b0af16 req-69fe7655-4b62-48f0-b36c-a61ff6a24243 service nova] Creating event network-changed:3289a77c-8e76-4409-ab13-4db22f9ce4bb for instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d on nch2-master-1 Aug 06 22:01:22.715211 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-311578a8-a78e-4add-a522-82f947b0af16 req-69fe7655-4b62-48f0-b36c-a61ff6a24243 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044519 Aug 06 22:01:22.716125 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3654/7120] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:01:23.576196 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:23.576811 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:23.583943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:23.584423 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:23.584860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:23.585555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:23.586016 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:23.586482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:23.724599 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:23.733205 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2eef9a93-fb3b-4086-a9ac-43dc2863576e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1393 microversion: 2.1 time: 0.161187 Aug 06 22:01:23.733783 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3467/7121] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:23 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:24.756285 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:24.756996 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:24.763842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:24.764330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:24.764775 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:24.765476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:24.765940 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:24.766371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:24.896924 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:24.905180 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-fa9b7495-653a-4317-b0d8-0ab127816b40 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1393 microversion: 2.1 time: 0.154083 Aug 06 22:01:24.905656 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3655/7122] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:24 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:25.925768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:25.926398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:25.933308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:25.933791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:25.934234 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:25.934959 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:25.935561 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:25.935994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:26.070415 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:26.078985 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9a230808-a5a0-471e-a406-3abd346533bc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1393 microversion: 2.1 time: 0.157041 Aug 06 22:01:26.079577 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3468/7123] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:25 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:27.099257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:27.099888 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:27.107903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:27.108400 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:27.108851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:27.109570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:27.110039 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:27.110479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:27.245796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:27.253315 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-26b622ea-b642-40a4-9d6f-29fa2df5b667 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1393 microversion: 2.1 time: 0.158071 Aug 06 22:01:27.253923 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3656/7124] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:27 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:01:28.273856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:28.274482 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:28.281660 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:28.282159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:28.282638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:28.283346 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:28.283809 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:28.284246 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:28.415156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:28.423262 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-29bac5ff-f309-4694-94ec-c93df5d5db7e tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1393 microversion: 2.1 time: 0.153513 Aug 06 22:01:28.423842 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3469/7125] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:28 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:29.035890 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-5a871450-89a6-4f78-a223-7bd11262163c req-dc98324f-9dd9-4cf0-b5c2-06702ceae072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d", "name": "network-vif-plugged", "status": "completed", "tag": "3289a77c-8e76-4409-ab13-4db22f9ce4bb"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:01:29.047196 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5a871450-89a6-4f78-a223-7bd11262163c req-dc98324f-9dd9-4cf0-b5c2-06702ceae072 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:29.047790 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5a871450-89a6-4f78-a223-7bd11262163c req-dc98324f-9dd9-4cf0-b5c2-06702ceae072 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:29.048396 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-5a871450-89a6-4f78-a223-7bd11262163c req-dc98324f-9dd9-4cf0-b5c2-06702ceae072 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:29.062395 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-5a871450-89a6-4f78-a223-7bd11262163c req-dc98324f-9dd9-4cf0-b5c2-06702ceae072 service nova] Creating event network-vif-plugged:3289a77c-8e76-4409-ab13-4db22f9ce4bb for instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d on nch2-master-1 Aug 06 22:01:29.067724 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-5a871450-89a6-4f78-a223-7bd11262163c req-dc98324f-9dd9-4cf0-b5c2-06702ceae072 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035894 Aug 06 22:01:29.068552 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3657/7126] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:01:29.443900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:29.444530 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:29.452328 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:29.452823 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:29.453269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:29.454241 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:29.454736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:29.455177 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:29.590258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:29.597853 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d323a17f-98a9-421d-9d24-a4f2f2a832fb tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1393 microversion: 2.1 time: 0.157937 Aug 06 22:01:29.598446 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3470/7127] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:29 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:30.620378 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:30.621011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:30.623045 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:30.623872 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:30.625227 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:30.632055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:30.632580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:30.633055 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:30.633729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:30.634244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:30.634785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:30.767096 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:30.775223 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8a82af63-5626-4a33-8e7e-6a0e7fe1c7f3 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1565 microversion: 2.1 time: 0.158697 Aug 06 22:01:30.775884 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3658/7128] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:30 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:01:30.795411 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:30.796036 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:30.798005 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:30.804544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:30.805264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:30.805762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:30.806819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:30.807439 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:30.807868 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:30.948669 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:30.956862 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d43bb510-6634-4015-95c8-c2215322f1a6 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1565 microversion: 2.1 time: 0.165278 Aug 06 22:01:30.957455 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3471/7129] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:30 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:32.821012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:01:32.821644 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:32.836620 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:32.837118 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:32.838653 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:32.839377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:32.840016 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:32.840460 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:32.880017 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-ee2c8e6e-b03b-40dd-9c05-b51faab62349 req-82bed65e-dfd9-4b89-9771-4602f308e261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d", "tag": "3289a77c-8e76-4409-ab13-4db22f9ce4bb"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:01:32.890837 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ee2c8e6e-b03b-40dd-9c05-b51faab62349 req-82bed65e-dfd9-4b89-9771-4602f308e261 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:32.891501 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ee2c8e6e-b03b-40dd-9c05-b51faab62349 req-82bed65e-dfd9-4b89-9771-4602f308e261 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:32.892264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-ee2c8e6e-b03b-40dd-9c05-b51faab62349 req-82bed65e-dfd9-4b89-9771-4602f308e261 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:32.904684 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-ee2c8e6e-b03b-40dd-9c05-b51faab62349 req-82bed65e-dfd9-4b89-9771-4602f308e261 service nova] Creating event network-changed:3289a77c-8e76-4409-ab13-4db22f9ce4bb for instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d on nch2-master-1 Aug 06 22:01:32.910361 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-ee2c8e6e-b03b-40dd-9c05-b51faab62349 req-82bed65e-dfd9-4b89-9771-4602f308e261 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086489 Aug 06 22:01:32.911085 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3472/7130] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:01:32.989963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:01:33.001693 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1ce8dcd6-cec1-491c-ba93-9e39cecbf0a9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1565 microversion: 2.1 time: 0.184571 Aug 06 22:01:33.003252 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3659/7131] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:01:32 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1565 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:01:54.267345 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:54.268100 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=38 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:01:54.272817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cba20f06-1ee6-4324-a780-df4c04d0710b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:01:54.275130 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cba20f06-1ee6-4324-a780-df4c04d0710b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:01:54.283799 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cba20f06-1ee6-4324-a780-df4c04d0710b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:54.284286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cba20f06-1ee6-4324-a780-df4c04d0710b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:54.284728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cba20f06-1ee6-4324-a780-df4c04d0710b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:54.285427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cba20f06-1ee6-4324-a780-df4c04d0710b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:01:54.285884 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cba20f06-1ee6-4324-a780-df4c04d0710b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:01:54.286317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cba20f06-1ee6-4324-a780-df4c04d0710b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:01:54.339034 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cba20f06-1ee6-4324-a780-df4c04d0710b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action" status: 200 len: 24570 microversion: 2.1 time: 0.072986 Aug 06 22:01:54.339903 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3473/7132] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:01:54 2022] POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action => generated 24570 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:02:05.271968 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:05.272552 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:05.274599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:05.275293 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=36 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:05.281624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:05.282122 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:05.282582 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:05.283290 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:05.283752 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:05.284187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:05.307334 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lazy-loading 'flavor' on Instance uuid a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:02:05.379522 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d8f56b29-daab-48aa-9d18-a9ff065c3ac9 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action" status: 202 len: 0 microversion: 2.1 time: 0.111630 Aug 06 22:02:05.380203 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3660/7133] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:02:05 2022] POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:02:05.388974 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:05.389694 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:05.392639 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:05.393316 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:05.399094 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:05.399596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:05.400049 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:05.400767 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:05.401238 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:05.401685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:05.920362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:05.928582 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b4dafb39-e6eb-40bc-99e8-e90d58969dfe tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1691 microversion: 2.1 time: 0.543909 Aug 06 22:02:05.929166 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3474/7134] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:05 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1691 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:06.953120 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:06.954015 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:06.960263 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:06.960751 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:06.961192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:06.961892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:06.962351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:06.962806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:07.141997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:07.149706 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9e41f42b-61d4-4758-901c-b8391f4c6f15 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1674 microversion: 2.1 time: 0.202009 Aug 06 22:02:07.150281 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3661/7135] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:06 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:08.239966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7915d109-7a48-403e-a231-7f1d92c50a14 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:08.242264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7915d109-7a48-403e-a231-7f1d92c50a14 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:08.250389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7915d109-7a48-403e-a231-7f1d92c50a14 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:08.250905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7915d109-7a48-403e-a231-7f1d92c50a14 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:08.251348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7915d109-7a48-403e-a231-7f1d92c50a14 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:08.252044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7915d109-7a48-403e-a231-7f1d92c50a14 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:08.252503 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7915d109-7a48-403e-a231-7f1d92c50a14 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:08.252935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7915d109-7a48-403e-a231-7f1d92c50a14 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:08.302273 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7915d109-7a48-403e-a231-7f1d92c50a14 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action" status: 200 len: 38371 microversion: 2.1 time: 0.066083 Aug 06 22:02:08.302989 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3475/7136] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:02:08 2022] POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action => generated 38371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:02:08.315464 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d3e9399b-4845-46d2-8aed-0f14252b9bb1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:08.316006 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d3e9399b-4845-46d2-8aed-0f14252b9bb1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:08.322870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3e9399b-4845-46d2-8aed-0f14252b9bb1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:08.323354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3e9399b-4845-46d2-8aed-0f14252b9bb1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:08.324422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3e9399b-4845-46d2-8aed-0f14252b9bb1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:08.325110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3e9399b-4845-46d2-8aed-0f14252b9bb1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:08.325594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3e9399b-4845-46d2-8aed-0f14252b9bb1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:08.326028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d3e9399b-4845-46d2-8aed-0f14252b9bb1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:08.391927 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d3e9399b-4845-46d2-8aed-0f14252b9bb1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action" status: 202 len: 0 microversion: 2.1 time: 0.080040 Aug 06 22:02:08.392938 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3662/7137] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:02:08 2022] POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:02:08.402480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:08.403257 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:08.411055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:08.411566 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:08.412010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:08.412735 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:08.413202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:08.413638 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:08.639672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:08.647797 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8afd14b8-b6c3-40f6-922d-4772d05eb44d tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1680 microversion: 2.1 time: 0.250314 Aug 06 22:02:08.648375 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3476/7138] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:08 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1680 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:09.670288 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:09.670948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:09.678058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:09.678578 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:09.679020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:09.679729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:09.680193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:09.680624 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:09.817161 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:09.825164 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-54f88750-b672-4986-b62b-668e911bc98b tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1680 microversion: 2.1 time: 0.159055 Aug 06 22:02:09.826018 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3663/7139] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:09 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:10.847661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:10.848283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:10.858793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:10.859292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:10.859738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:10.860456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:10.860920 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:10.861358 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:10.997081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:11.005396 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fe4a2157-fd26-4413-805e-3004c5e3ba72 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1683 microversion: 2.1 time: 0.161691 Aug 06 22:02:11.005984 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3477/7140] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:10 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:11.100360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-18fbae3c-5f03-433b-9de5-b1f52167b698 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:11.102599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-18fbae3c-5f03-433b-9de5-b1f52167b698 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:11.110351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18fbae3c-5f03-433b-9de5-b1f52167b698 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:11.110865 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18fbae3c-5f03-433b-9de5-b1f52167b698 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:11.111313 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18fbae3c-5f03-433b-9de5-b1f52167b698 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:11.112013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18fbae3c-5f03-433b-9de5-b1f52167b698 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:11.112479 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18fbae3c-5f03-433b-9de5-b1f52167b698 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:11.112912 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-18fbae3c-5f03-433b-9de5-b1f52167b698 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:11.152754 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-18fbae3c-5f03-433b-9de5-b1f52167b698 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action" status: 200 len: 38371 microversion: 2.1 time: 0.056188 Aug 06 22:02:11.153378 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3664/7141] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:02:11 2022] POST /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d/action => generated 38371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 22:02:12.136185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:12.136994 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:12.138320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-aa18152c-0d86-4ee3-ab50-2fc08f8464b5 req-ff2f9c12-e604-4b63-9425-3889608810b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d", "tag": "3289a77c-8e76-4409-ab13-4db22f9ce4bb"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:12.144611 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:12.145424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:12.145930 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:12.146889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:12.147414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:12.148107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:12.150159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-aa18152c-0d86-4ee3-ab50-2fc08f8464b5 req-ff2f9c12-e604-4b63-9425-3889608810b1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:12.151476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-aa18152c-0d86-4ee3-ab50-2fc08f8464b5 req-ff2f9c12-e604-4b63-9425-3889608810b1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:12.151925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-aa18152c-0d86-4ee3-ab50-2fc08f8464b5 req-ff2f9c12-e604-4b63-9425-3889608810b1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:12.164271 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-aa18152c-0d86-4ee3-ab50-2fc08f8464b5 req-ff2f9c12-e604-4b63-9425-3889608810b1 service nova] Creating event network-changed:3289a77c-8e76-4409-ab13-4db22f9ce4bb for instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d on nch2-master-1 Aug 06 22:02:12.169555 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-aa18152c-0d86-4ee3-ab50-2fc08f8464b5 req-ff2f9c12-e604-4b63-9425-3889608810b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035398 Aug 06 22:02:12.170316 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3665/7142] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:02:12.179539 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:02:12.266299 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8e4e4f07-128e-43c0-9fa1-6f147e4c7bd1 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 204 len: 0 microversion: 2.1 time: 0.133886 Aug 06 22:02:12.267510 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3478/7143] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 22:02:12 2022] DELETE /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:02:12.277764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:12.281617 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:12.288486 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:12.289236 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:12.289905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:12.291022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:12.291806 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:12.292507 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:12.434231 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:12.443055 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b0c97f1b-22ab-4212-91b1-8e348909e0fc tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1689 microversion: 2.1 time: 0.170545 Aug 06 22:02:12.443673 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3666/7144] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:12 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:13.466629 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:13.467352 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:13.474467 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:13.474996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:13.475447 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:13.476156 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:13.476617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:13.477050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:13.649853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f605e9c98464387b21755ec13a52070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ac47bb71e6e4ecf9f5197f217a159da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:13.658230 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b08475c6-24b3-42a7-a8c7-80ad95d934c2 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 200 len: 1689 microversion: 2.1 time: 0.195935 Aug 06 22:02:13.658869 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3479/7145] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:13 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:14.228397 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c1c7e54a-c1dc-421d-906f-cc7a94d642e6 req-b39819db-8bd7-4e69-be80-faa2c2de3863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d", "name": "network-vif-deleted", "tag": "3289a77c-8e76-4409-ab13-4db22f9ce4bb"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:14.239951 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1c7e54a-c1dc-421d-906f-cc7a94d642e6 req-b39819db-8bd7-4e69-be80-faa2c2de3863 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:14.240447 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1c7e54a-c1dc-421d-906f-cc7a94d642e6 req-b39819db-8bd7-4e69-be80-faa2c2de3863 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:14.240889 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c1c7e54a-c1dc-421d-906f-cc7a94d642e6 req-b39819db-8bd7-4e69-be80-faa2c2de3863 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:14.256389 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c1c7e54a-c1dc-421d-906f-cc7a94d642e6 req-b39819db-8bd7-4e69-be80-faa2c2de3863 service nova] Creating event network-vif-deleted:3289a77c-8e76-4409-ab13-4db22f9ce4bb for instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d on nch2-master-1 Aug 06 22:02:14.261251 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c1c7e54a-c1dc-421d-906f-cc7a94d642e6 req-b39819db-8bd7-4e69-be80-faa2c2de3863 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036691 Aug 06 22:02:14.261871 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3667/7146] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:02:14.680740 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:14.681366 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] [instance: a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:14.689455 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:14.689946 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:14.690392 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:14.691409 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:14.691872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:14.692306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:14.706522 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] HTTP exception thrown: Instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d could not be found. Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Request method failure captured: Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d HTTP/1.1 Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uMs0B8_RHECMxpaZJs_l0UEFe-aoVTDGJpCsB0TiKK8kj0fiDPR9yg9WqmB1OR0T7Ale_WwM5zuhySElwjcHWq6Lmwjuw_uw3gaFLCF4CuTDC1YUGN7NaYCjWOPCFBD7riN54CmADb9nlPxtX3At2GzHpR0Elxyx2iuS5EQ1LGTmBg Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1ac47bb71e6e4ecf9f5197f217a159da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1ac47bb71e6e4ecf9f5197f217a159da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 1ac47bb71e6e4ecf9f5197f217a159da Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2065714547 Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 1f605e9c98464387b21755ec13a52070 Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2065714547-project Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d could not be found. Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d'} Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d could not be found. Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d could not be found. Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:02:14.708231 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d could not be found. Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Returning 404 to user: Instance a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8155e59f-b7d8-462c-8c97-949e3a846735 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d" status: 404 len: 111 microversion: 2.1 time: 0.033098 Aug 06 22:02:14.713254 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3480/7147] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:14 2022] GET /compute/v2.1/servers/a6380f8d-c9dd-4a56-96ec-ea6b6a83d86d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:02:18.035135 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8efe9d75-f927-46eb-b6fd-2de9091eb070 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] Calling method '.version_select at 0x7f729d7a1940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:18.057001 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8efe9d75-f927-46eb-b6fd-2de9091eb070 tempest-TestNetworkAdvancedServerOps-2065714547 tempest-TestNetworkAdvancedServerOps-2065714547-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1380864437" status: 202 len: 0 microversion: 2.1 time: 0.028461 Aug 06 22:02:18.058225 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3668/7148] 10.222.0.33 () {58 vars in 1284 bytes} [Sat Aug 6 22:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1380864437 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:02:29.063992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:29.064768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:29.301929 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e9f51cdd-ae74-4d50-b4a7-69c8b7eedc83 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Action: 'create', calling method: .version_select at 0x7f729d232e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-824350367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAHa5YLMvylgR7RFSWdrMZL9MGVarkHwBo+6085tfFfAKCWEQDj4JT5dzUpzabX+UB8XaC6Rq96MI+186JkKHUaKNEabBR/nP3gtARczXgJpJ/L02S+UD9f+OJOHAQ43g=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:29.322521 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e9f51cdd-ae74-4d50-b4a7-69c8b7eedc83 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Getting quotas for project 169cc994a698408ba8bc2297e0b92fc7. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:02:29.331729 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-e9f51cdd-ae74-4d50-b4a7-69c8b7eedc83 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Getting quotas for user 7ace3bf8975f45cb8b454d637cc4e917 and project 169cc994a698408ba8bc2297e0b92fc7. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:02:29.369903 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e9f51cdd-ae74-4d50-b4a7-69c8b7eedc83 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.312551 Aug 06 22:02:29.370902 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3481/7149] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 22:02:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:02:30.718134 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:30.719540 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:30.723660 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1211696543", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-824350367", "security_groups": [{"name": "tempest-secgroup-smoke-1474237550"}], "networks": [{"uuid": "7e77d807-2cb1-4990-be16-1ff4e3bf1c75"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:30.837926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] validate_networks() for [('7e77d807-2cb1-4990-be16-1ff4e3bf1c75', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:02:31.237007 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:02:31.237516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:02:31.238129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:02:31.238765 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:02:31.239259 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:02:31.248874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:31.249383 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:31.249925 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:31.250767 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:31.251302 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:31.251803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:31.269202 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Getting quotas for project 169cc994a698408ba8bc2297e0b92fc7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:02:31.274757 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Getting quotas for user 7ace3bf8975f45cb8b454d637cc4e917 and project 169cc994a698408ba8bc2297e0b92fc7. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:02:31.288132 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:02:31.290561 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:02:31.336460 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5b1baa44-6c5a-42b2-8327-c6396f61c1f0 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.619974 Aug 06 22:02:31.337106 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3669/7150] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 22:02:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:02:31.349728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-47cff074-3b0f-495d-809f-b194a39d4d13 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:31.350341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-47cff074-3b0f-495d-809f-b194a39d4d13 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:31.414417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-47cff074-3b0f-495d-809f-b194a39d4d13 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:31.422077 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-47cff074-3b0f-495d-809f-b194a39d4d13 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1246 microversion: 2.1 time: 0.077000 Aug 06 22:02:31.422691 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3482/7151] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:31 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:32.443536 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:32.444952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:32.454238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:32.455127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:32.455854 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:32.457067 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:32.457902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:32.458584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:32.526969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:32.536585 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e9dcab43-183e-433e-84c9-377bad62629a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1306 microversion: 2.1 time: 0.096949 Aug 06 22:02:32.538046 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3670/7152] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:32 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:33.558939 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:33.560887 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:33.568741 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:33.569317 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:33.569839 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:33.570683 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:33.571219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:33.571746 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:33.801099 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:33.813232 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-afeef96d-dafb-40a4-848d-6f0332ef5f8e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1372 microversion: 2.1 time: 0.258490 Aug 06 22:02:33.814034 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3483/7153] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:33 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1372 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:34.070870 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c63769b3-f8c9-4c1e-9e50-ca91cf8cc9f9 req-2d0220b8-680b-4b66-b03a-ccf6375bcc34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a13736a-1cb6-4d27-8525-651ee0f407ce", "tag": "0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:34.083505 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c63769b3-f8c9-4c1e-9e50-ca91cf8cc9f9 req-2d0220b8-680b-4b66-b03a-ccf6375bcc34 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:34.083997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c63769b3-f8c9-4c1e-9e50-ca91cf8cc9f9 req-2d0220b8-680b-4b66-b03a-ccf6375bcc34 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:34.084439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c63769b3-f8c9-4c1e-9e50-ca91cf8cc9f9 req-2d0220b8-680b-4b66-b03a-ccf6375bcc34 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:34.096459 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c63769b3-f8c9-4c1e-9e50-ca91cf8cc9f9 req-2d0220b8-680b-4b66-b03a-ccf6375bcc34 service nova] Creating event network-changed:0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a for instance 8a13736a-1cb6-4d27-8525-651ee0f407ce on nch1-master-1 Aug 06 22:02:34.101655 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c63769b3-f8c9-4c1e-9e50-ca91cf8cc9f9 req-2d0220b8-680b-4b66-b03a-ccf6375bcc34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155361 Aug 06 22:02:34.102272 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3671/7154] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:02:34.834362 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:34.835003 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:34.843761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:34.844267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:34.844724 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:34.845448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:34.845926 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:34.846365 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:35.004200 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:35.012280 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ad12334e-e213-4b7f-a335-1e0285808e3e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1372 microversion: 2.1 time: 0.181816 Aug 06 22:02:35.013618 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3484/7155] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:34 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:36.034836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:36.035550 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:36.041926 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:36.042443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:36.042929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:36.043645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:36.044625 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:36.045057 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:36.185658 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:36.193351 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-90a301e8-7e79-4fa3-a71a-8164d15e0c47 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1372 microversion: 2.1 time: 0.163709 Aug 06 22:02:36.193957 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3672/7156] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:36 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:37.213559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:37.214179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:37.221395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:37.221925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:37.222417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:37.223226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:37.223876 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:37.224311 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:37.359340 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:37.367308 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5ec14066-26d4-417c-ae77-94e155d2b757 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1372 microversion: 2.1 time: 0.157588 Aug 06 22:02:37.367878 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3485/7157] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:37 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:38.388454 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:38.389130 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:38.396330 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:38.396824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:38.397272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:38.397975 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:38.398443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:38.398902 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:38.534948 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:38.542694 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-4725751d-a66a-49ff-a8a5-77908e4833a7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1372 microversion: 2.1 time: 0.158408 Aug 06 22:02:38.543282 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3673/7158] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:38 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:39.564568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:39.565149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:39.571833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:39.572324 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:39.572772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:39.573475 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:39.573943 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:39.574380 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:39.707818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:39.715927 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e1a81547-c188-4f7a-9e05-2afc1057460f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1372 microversion: 2.1 time: 0.154976 Aug 06 22:02:39.717072 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3486/7159] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:39 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:40.678322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-30fea948-40b2-42ff-8a4a-4691c5b169b2 req-4e5c3d72-d7d7-4ffe-b39c-7982e14687a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a13736a-1cb6-4d27-8525-651ee0f407ce", "name": "network-vif-plugged", "status": "completed", "tag": "0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:40.689448 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-30fea948-40b2-42ff-8a4a-4691c5b169b2 req-4e5c3d72-d7d7-4ffe-b39c-7982e14687a0 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:40.689934 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-30fea948-40b2-42ff-8a4a-4691c5b169b2 req-4e5c3d72-d7d7-4ffe-b39c-7982e14687a0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:40.690371 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-30fea948-40b2-42ff-8a4a-4691c5b169b2 req-4e5c3d72-d7d7-4ffe-b39c-7982e14687a0 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:40.702570 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-30fea948-40b2-42ff-8a4a-4691c5b169b2 req-4e5c3d72-d7d7-4ffe-b39c-7982e14687a0 service nova] Creating event network-vif-plugged:0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a for instance 8a13736a-1cb6-4d27-8525-651ee0f407ce on nch1-master-1 Aug 06 22:02:40.707945 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-30fea948-40b2-42ff-8a4a-4691c5b169b2 req-4e5c3d72-d7d7-4ffe-b39c-7982e14687a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 Aug 06 22:02:40.708569 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3674/7160] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:02:40.737339 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:40.737962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:40.745168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:40.745658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:40.746103 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:40.746934 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:40.747403 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:40.747828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:40.942376 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:40.951497 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c1658a14-d2ab-4fd6-8f05-7a4e0db3dbac tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1372 microversion: 2.1 time: 0.217892 Aug 06 22:02:40.952091 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3487/7161] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:40 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:41.969837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:41.970659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:41.976291 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:41.976997 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:41.983933 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:41.984423 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:41.984909 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:41.985606 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:41.986068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:41.986495 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:42.120429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:42.128387 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1af4cfa5-3d78-4f8d-bc94-86aa8de10d22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1555 microversion: 2.1 time: 0.159516 Aug 06 22:02:42.128954 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3675/7162] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:41 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:42.148676 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:02:42.149292 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:02:42.151210 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:02:42.157978 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:42.158465 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:42.158962 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:42.159659 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:42.160119 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:42.160581 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:42.298189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:02:42.305925 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4a8c2cdd-962a-4196-b2ac-570334ec35b2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1555 microversion: 2.1 time: 0.161114 Aug 06 22:02:42.306572 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3488/7163] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:02:42 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:02:44.041679 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-bc19d5a5-bc11-40c0-be5c-56f6cfffe244 req-4dcaddaf-e435-49b6-acc2-36667f7887dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a13736a-1cb6-4d27-8525-651ee0f407ce", "tag": "0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:02:44.055556 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bc19d5a5-bc11-40c0-be5c-56f6cfffe244 req-4dcaddaf-e435-49b6-acc2-36667f7887dd service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:02:44.056137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bc19d5a5-bc11-40c0-be5c-56f6cfffe244 req-4dcaddaf-e435-49b6-acc2-36667f7887dd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:02:44.056645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-bc19d5a5-bc11-40c0-be5c-56f6cfffe244 req-4dcaddaf-e435-49b6-acc2-36667f7887dd service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:02:44.072055 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-bc19d5a5-bc11-40c0-be5c-56f6cfffe244 req-4dcaddaf-e435-49b6-acc2-36667f7887dd service nova] Creating event network-changed:0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a for instance 8a13736a-1cb6-4d27-8525-651ee0f407ce on nch1-master-1 Aug 06 22:02:44.077331 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-bc19d5a5-bc11-40c0-be5c-56f6cfffe244 req-4dcaddaf-e435-49b6-acc2-36667f7887dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039322 Aug 06 22:02:44.078179 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3676/7164] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:03:47.366816 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:03:47.367420 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 22:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:04:39.297056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:04:39.297866 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=36 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:04:39.302289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:04:39.302900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:39.311250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:39.311738 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:39.312186 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:39.312917 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:39.313377 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:39.313803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:39.337721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.objects.instance [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lazy-loading 'flavor' on Instance uuid 8a13736a-1cb6-4d27-8525-651ee0f407ce {{(pid=142462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:04:39.513689 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-90195f3c-766b-4875-994d-ab86c95a7627 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "POST /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce/action" status: 202 len: 0 microversion: 2.1 time: 0.218365 Aug 06 22:04:39.514310 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3489/7165] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:04:39 2022] POST /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:04:39.520908 ncdv-master-1 devstack@n-api.service[142461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ab97c24-b021-4fbe-9b91-82d554fc336e] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 06 22:04:39.521828 ncdv-master-1 devstack@n-api.service[142461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [967bdc72-a34e-423a-ac85-89f52583478a] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 06 22:04:39.522436 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:04:39.523250 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=32 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:04:39.528687 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:39.529415 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:39.538172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:39.538733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:39.539179 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:39.539891 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:39.540416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:39.540851 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:39.676885 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:39.684998 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a6cfffdb-f8b1-470e-8b05-d658e0fc6f02 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.166090 Aug 06 22:04:39.685570 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3677/7166] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:39 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:40.709242 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:40.709945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:40.717390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:40.717875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:40.718313 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:40.719037 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:40.719493 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:40.719921 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:40.857218 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:40.864893 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-8bb8f428-5a4d-48d7-82be-06df78fa92ff tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.161542 Aug 06 22:04:40.865463 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3490/7167] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:40 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:41.886930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:41.887551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:41.897343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:41.898176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:41.898659 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:41.899367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:41.899837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:41.900271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:41.906483 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] [967bdc72-a34e-423a-ac85-89f52583478a] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 44090. Aug 06 22:04:41.907322 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ab97c24-b021-4fbe-9b91-82d554fc336e] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 44088. Aug 06 22:04:42.033761 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:42.042215 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aabd9686-d65b-4369-b0c8-9d80814503e6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.158743 Aug 06 22:04:42.042824 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3678/7168] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:41 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:43.064414 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:43.065040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:43.071907 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:43.072389 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:43.072944 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:43.073673 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:43.074127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:43.074570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:43.209751 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:43.218290 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-bab3f9a6-0139-4dd6-b236-dcc9281a3427 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.158490 Aug 06 22:04:43.218907 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3491/7169] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:43 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:44.239494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:44.240058 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:44.247995 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:44.248480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:44.248922 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:44.249614 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:44.250074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:44.250501 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:44.385958 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:44.393722 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-980a6127-d13f-48f9-ace9-9431680cac48 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.158362 Aug 06 22:04:44.394296 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3679/7170] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:44 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:45.415904 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:45.416570 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:45.423732 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:45.424227 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:45.424680 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:45.425393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:45.425864 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:45.426304 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:45.558424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:45.566068 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5b118484-e0ca-43ce-bdad-c7c7a4465bb9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.154418 Aug 06 22:04:45.566672 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3492/7171] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:45 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:46.589976 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:46.590609 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:46.597594 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:46.598080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:46.598519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:46.599242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:46.599701 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:46.600127 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:46.732239 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:46.740072 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9273a37e-84a9-4575-8212-1577d74eb650 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.154735 Aug 06 22:04:46.740656 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3680/7172] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:46 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:47.761711 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:47.762338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:47.769319 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:47.769814 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:47.770267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:47.771007 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:47.771485 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:47.771925 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:47.907737 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:47.915410 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-47a97869-97af-4c20-942f-5ad914882565 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.158380 Aug 06 22:04:47.916010 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3493/7173] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:47 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:48.937272 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:48.937803 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:48.944769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:48.945517 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:48.945966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:48.946688 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:48.947248 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:48.948209 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:49.085037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:49.092890 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-38ef7ea4-ae5a-4b69-ad3e-4bab7779023f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.159617 Aug 06 22:04:49.093469 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3681/7174] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:48 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:50.113768 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:50.114452 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:50.122118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:50.122635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:50.123081 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:50.123781 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:50.124243 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:50.124677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:50.256105 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:50.264128 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-94da3c18-764c-44b9-b8b6-19aa6f27a42f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1701 microversion: 2.1 time: 0.154239 Aug 06 22:04:50.264734 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3494/7175] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:50 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:51.286413 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:51.287085 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:51.295480 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:51.295985 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:51.296429 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:51.297149 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:51.297613 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:51.298056 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:51.448831 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:51.457028 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e3c0cb7d-1876-4129-8bce-ba4b7c992a22 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1701 microversion: 2.1 time: 0.174459 Aug 06 22:04:51.457667 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3682/7176] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:51 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1701 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:52.479848 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:52.480480 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:52.487635 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:52.488127 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:52.488572 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:52.489282 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:52.489749 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:52.490181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:52.635051 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:52.643808 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d91e3070-38ca-49cc-97b9-1fed7460602f tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1696 microversion: 2.1 time: 0.169005 Aug 06 22:04:52.644389 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3495/7177] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:52 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:04:53.435131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-56a62ef0-e8e5-4a27-9cb9-385b6bf1c5ed req-575fda6d-f49e-4ae3-9c3a-ba196e105369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a13736a-1cb6-4d27-8525-651ee0f407ce", "name": "network-vif-plugged", "status": "completed", "tag": "0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:04:53.445014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-56a62ef0-e8e5-4a27-9cb9-385b6bf1c5ed req-575fda6d-f49e-4ae3-9c3a-ba196e105369 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:53.445497 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-56a62ef0-e8e5-4a27-9cb9-385b6bf1c5ed req-575fda6d-f49e-4ae3-9c3a-ba196e105369 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:53.445956 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-56a62ef0-e8e5-4a27-9cb9-385b6bf1c5ed req-575fda6d-f49e-4ae3-9c3a-ba196e105369 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:53.460848 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-56a62ef0-e8e5-4a27-9cb9-385b6bf1c5ed req-575fda6d-f49e-4ae3-9c3a-ba196e105369 service nova] Creating event network-vif-plugged:0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a for instance 8a13736a-1cb6-4d27-8525-651ee0f407ce on nch1-master-1 Aug 06 22:04:53.467066 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-56a62ef0-e8e5-4a27-9cb9-385b6bf1c5ed req-575fda6d-f49e-4ae3-9c3a-ba196e105369 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134254 Aug 06 22:04:53.467828 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3683/7178] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:04:53.666033 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:53.666905 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:53.676204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:53.679856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:53.680438 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:53.681249 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:53.681800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:53.682253 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:53.837140 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:53.846733 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-13d8c9a0-3b3e-43ec-932d-9af7e02f6b23 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1696 microversion: 2.1 time: 0.185217 Aug 06 22:04:53.847411 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3496/7179] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:53 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:54.869182 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:54.870004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:54.877977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:54.878730 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:54.878963 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:54.879928 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:54.880595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:54.881256 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:55.035281 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:55.043990 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc13d142-02d3-4ff0-8a19-a92459e6d185 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1696 microversion: 2.1 time: 0.178991 Aug 06 22:04:55.044595 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3684/7180] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:54 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:56.066796 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:56.067456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:56.075391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:56.075882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:56.076337 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:56.077055 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:56.077780 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:56.078216 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:56.244900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:56.253447 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-e32de052-4740-493b-a003-a5bdb01bdcfa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1696 microversion: 2.1 time: 0.190841 Aug 06 22:04:56.265631 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3497/7181] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:56 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:57.276546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:57.277089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:57.284836 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:57.285647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:57.286385 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:57.287354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:57.287796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:57.288226 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:57.446514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:57.455941 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3189b05d-2aa8-4178-a7f1-ac0ed74f8810 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1696 microversion: 2.1 time: 0.184187 Aug 06 22:04:57.467019 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3685/7182] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:57 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:04:58.479466 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:58.480889 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:58.488056 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:58.488865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:58.489559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:58.490524 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:58.491232 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:58.491992 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:58.641736 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:58.652009 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1f5af88c-f9ec-406e-aee9-87172784b2d2 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1696 microversion: 2.1 time: 0.176985 Aug 06 22:04:58.652788 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3498/7183] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:58 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:04:59.679297 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:04:59.680529 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:04:59.687842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:59.688434 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:59.689131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:59.690013 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:04:59.690570 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:04:59.691103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:04:59.833503 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:04:59.843545 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-0e76a40d-4bbf-44c3-89c2-2c9d5856ea6d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1696 microversion: 2.1 time: 0.168603 Aug 06 22:04:59.844372 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3686/7184] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:04:59 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:00.865602 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:00.866393 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:00.875652 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:00.876394 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:00.876901 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:00.877689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:00.878220 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:00.878754 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:01.036612 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:01.045156 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fb4177d5-2480-459b-8cfa-f4d5f96a20f7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1696 microversion: 2.1 time: 0.183620 Aug 06 22:05:01.058665 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3499/7185] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:00 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:02.066308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:02.067011 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:02.074524 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:02.075046 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:02.075485 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:02.076190 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:02.076646 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:02.077073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:02.215315 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:02.223399 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-bf223e2b-5471-4aca-927a-2ac2c389ccc7 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1678 microversion: 2.1 time: 0.160959 Aug 06 22:05:02.224181 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3687/7186] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:02 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:03.244936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:03.245555 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:03.252547 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:03.253035 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:03.253479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:03.254179 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:03.254672 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:03.255109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:03.388436 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:03.397130 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-53b09acd-b673-4ef1-b208-41ef09d8769d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1678 microversion: 2.1 time: 0.156375 Aug 06 22:05:03.397942 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3500/7187] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:03 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:04.417932 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:04.418566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:04.425530 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:04.426020 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:04.426494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:04.427240 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:04.427709 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:04.428147 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:04.559461 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:04.567228 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-96d4863c-01f9-462c-85c9-1d41a9620bbd tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1621 microversion: 2.1 time: 0.153464 Aug 06 22:05:04.567817 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3688/7188] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:04 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1621 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:04.588850 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:05:04.589464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:04.596367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:04.596859 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:04.597308 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:04.598014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:04.598478 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:04.598947 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:04.687277 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=142462) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 22:05:04.753670 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36a789a7-f006-450d-8499-0022088c7b5a tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "POST /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce/action" status: 202 len: 0 microversion: 2.1 time: 0.169236 Aug 06 22:05:04.754454 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3501/7189] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:05:04 2022] POST /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:05:04.762726 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:04.763446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:04.769610 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:04.770110 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:04.770577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:04.771292 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:04.771764 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:04.772233 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:04.915080 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:04.923090 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-6f59a2f6-24f6-4eed-a93a-87c1d6081405 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1629 microversion: 2.1 time: 0.164348 Aug 06 22:05:04.923609 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3689/7190] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:04 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1629 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:05.944798 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:05.945416 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:05.958586 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:05.959152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:05.959594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:05.960306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:05.960761 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:05.961188 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:05.982819 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:06.127550 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:06.136546 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-fc100a9f-d9e4-402b-b01a-7c5a68261c86 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.196354 Aug 06 22:05:06.147909 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3502/7191] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:05 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:06.501359 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-22b0d243-bc28-4379-a3e2-0557a9db5bee req-ccdc3c8c-c8c7-4bbd-9487-6b2bfa96daea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a13736a-1cb6-4d27-8525-651ee0f407ce", "name": "network-vif-unplugged", "status": "completed", "tag": "0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:05:06.513488 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-22b0d243-bc28-4379-a3e2-0557a9db5bee req-ccdc3c8c-c8c7-4bbd-9487-6b2bfa96daea service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:06.514176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-22b0d243-bc28-4379-a3e2-0557a9db5bee req-ccdc3c8c-c8c7-4bbd-9487-6b2bfa96daea service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:06.514647 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-22b0d243-bc28-4379-a3e2-0557a9db5bee req-ccdc3c8c-c8c7-4bbd-9487-6b2bfa96daea service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:06.527378 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-22b0d243-bc28-4379-a3e2-0557a9db5bee req-ccdc3c8c-c8c7-4bbd-9487-6b2bfa96daea service nova] Creating event network-vif-unplugged:0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a for instance 8a13736a-1cb6-4d27-8525-651ee0f407ce on nch2-master-1 Aug 06 22:05:06.532451 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-22b0d243-bc28-4379-a3e2-0557a9db5bee req-ccdc3c8c-c8c7-4bbd-9487-6b2bfa96daea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034897 Aug 06 22:05:06.533064 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3690/7192] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:05:07.157391 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:07.158014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:07.167593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:07.167593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:07.167593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:07.167593 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:07.168062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:07.168355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:07.304289 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:07.312840 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-272cbd8d-ad71-4a7c-9238-a708472714e8 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.159416 Aug 06 22:05:07.313418 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3503/7193] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:07 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:08.336799 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:08.337641 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:08.344498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:08.344992 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:08.345439 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:08.346150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:08.346621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:08.347050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:08.499471 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:08.507563 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-78a8b753-75fd-4c1b-a59b-3923b7b50a95 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.175838 Aug 06 22:05:08.508144 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3691/7194] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:08 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:08.552641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-aa4c91ad-ad25-4886-8b9e-6c6a4ce5bb2e req-5dd2217b-76b8-4c74-a36c-a47a4eccc0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a13736a-1cb6-4d27-8525-651ee0f407ce", "tag": "0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:05:08.569092 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-aa4c91ad-ad25-4886-8b9e-6c6a4ce5bb2e req-5dd2217b-76b8-4c74-a36c-a47a4eccc0d4 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:08.569578 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-aa4c91ad-ad25-4886-8b9e-6c6a4ce5bb2e req-5dd2217b-76b8-4c74-a36c-a47a4eccc0d4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:08.570217 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-aa4c91ad-ad25-4886-8b9e-6c6a4ce5bb2e req-5dd2217b-76b8-4c74-a36c-a47a4eccc0d4 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:08.584750 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-aa4c91ad-ad25-4886-8b9e-6c6a4ce5bb2e req-5dd2217b-76b8-4c74-a36c-a47a4eccc0d4 service nova] Creating event network-changed:0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a for instance 8a13736a-1cb6-4d27-8525-651ee0f407ce on nch2-master-1 Aug 06 22:05:08.592003 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-aa4c91ad-ad25-4886-8b9e-6c6a4ce5bb2e req-5dd2217b-76b8-4c74-a36c-a47a4eccc0d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043473 Aug 06 22:05:08.592731 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3504/7195] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:05:09.530079 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:09.530705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:09.537754 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:09.538599 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:09.539059 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:09.539774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:09.540498 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:09.541052 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:09.557737 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=83 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:09.694525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:09.710292 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3242b66c-d70d-42d7-8c43-6ee19b4678aa tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.184454 Aug 06 22:05:09.722818 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3692/7196] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:09 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:10.734408 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:10.735401 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:10.738255 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:10.744355 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:10.744967 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:10.745407 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:10.746118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:10.746596 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:10.747029 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:10.897421 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:10.906177 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-7c0ac27c-39dd-4681-af82-d99c4f9fc831 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.176136 Aug 06 22:05:10.907011 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3505/7197] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:10 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:11.927796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:11.928404 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:11.930360 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=33 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:05:11.936247 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:11.936741 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:11.937186 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:11.937884 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:11.938351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:11.938819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:12.094177 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:12.102734 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dc04d947-ce29-4507-855c-f77de9f5b00b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.178957 Aug 06 22:05:12.103365 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3693/7198] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:11 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:13.125199 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:13.125825 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:13.133281 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:13.134338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:13.134818 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:13.135642 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:13.136283 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:13.136739 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:13.282047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:13.291706 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4735f010-0ca8-416d-a375-dcf19bec1b98 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.170301 Aug 06 22:05:13.292403 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3506/7199] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:13 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:14.314073 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:14.315416 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:14.325621 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:14.326115 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:14.326645 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:14.327564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:14.328026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:14.328458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:14.499504 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:14.507798 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9afda181-fce7-45a5-a986-04e9eb5523c9 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.198003 Aug 06 22:05:14.508812 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3694/7200] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:14 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:15.529658 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:15.530275 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:15.537134 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:15.537627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:15.538073 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:15.538898 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:15.539357 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:15.539785 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:15.676827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:15.685668 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-475a5262-7a94-4876-b546-b82e95dcfe70 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.159958 Aug 06 22:05:15.686249 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3507/7201] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:15 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:16.707116 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:16.707745 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:16.715037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:16.715527 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:16.715978 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:16.716685 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:16.717150 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:16.717587 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:16.847622 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:16.855859 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-523fa4c4-afff-4c63-a847-654b14d48449 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.152697 Aug 06 22:05:16.856445 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3695/7202] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:16 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:17.877269 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:17.877935 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:17.885171 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:17.885654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:17.886093 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:17.886833 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:17.887286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:17.887717 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:18.029084 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:18.037323 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4012144a-bbf0-4ad9-94c9-d36657f8ebc6 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.163881 Aug 06 22:05:18.037935 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3508/7203] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:17 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:19.059857 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:19.060519 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:19.067575 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:19.068068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:19.068514 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:19.069218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:19.069681 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:19.070112 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:19.204827 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:19.212931 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-785e9f85-9dcd-4c31-9614-854ffe6d500c tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.157133 Aug 06 22:05:19.213512 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3696/7204] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:19 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:05:20.013688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-89453436-06b8-4fb2-9dad-ab601fb15ed9 req-52cc42a8-2607-489f-82cf-f8434e4577f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a13736a-1cb6-4d27-8525-651ee0f407ce", "name": "network-vif-plugged", "status": "completed", "tag": "0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:05:20.025371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-89453436-06b8-4fb2-9dad-ab601fb15ed9 req-52cc42a8-2607-489f-82cf-f8434e4577f5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:20.025865 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-89453436-06b8-4fb2-9dad-ab601fb15ed9 req-52cc42a8-2607-489f-82cf-f8434e4577f5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:20.026419 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-89453436-06b8-4fb2-9dad-ab601fb15ed9 req-52cc42a8-2607-489f-82cf-f8434e4577f5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:20.038200 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-89453436-06b8-4fb2-9dad-ab601fb15ed9 req-52cc42a8-2607-489f-82cf-f8434e4577f5 service nova] Creating event network-vif-plugged:0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a for instance 8a13736a-1cb6-4d27-8525-651ee0f407ce on nch2-master-1 Aug 06 22:05:20.044245 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-89453436-06b8-4fb2-9dad-ab601fb15ed9 req-52cc42a8-2607-489f-82cf-f8434e4577f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034623 Aug 06 22:05:20.045267 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3509/7205] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:05:20.234100 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:20.234788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:20.241585 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:20.242076 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:20.242522 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:20.243407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:20.243873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:20.244305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:20.381639 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:20.389468 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b551a6d4-c49c-4987-917b-6d212607937b tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.159431 Aug 06 22:05:20.390038 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3697/7206] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:20 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:21.411044 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:21.411788 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:21.419853 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:21.420348 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:21.420784 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:21.421495 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:21.422038 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:21.422367 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:21.574112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:21.582770 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cc46c30d-b213-41ef-80b7-1e200fb6bd46 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1687 microversion: 2.1 time: 0.175965 Aug 06 22:05:21.583369 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3510/7207] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:21 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:22.604367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:05:22.604980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:05:22.612068 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:22.612546 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:22.612981 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:22.613665 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:05:22.614131 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:05:22.614567 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:05:22.752156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:05:22.760607 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b7081ccf-ddc0-4be0-a76e-4881384ba6bf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1674 microversion: 2.1 time: 0.160162 Aug 06 22:05:22.761197 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3698/7208] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:05:22 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:05:23.688575 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:05:23.689160 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 22:05:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:05:24.081204 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:05:24.081423 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 22:05:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:06:34.780494 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=11 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:34.781128 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:06:34.781544 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:06:34.783428 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=41 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:34.784076 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=11 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:34.784826 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=42 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:34.788425 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-52c1febb-4ab9-4c31-ac2f-5e76b5fd1a30 req-f4204362-92ca-47a2-b4ca-8d9a7d23b603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a13736a-1cb6-4d27-8525-651ee0f407ce", "tag": "0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:06:34.791153 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:34.791685 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:34.792185 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:34.792996 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:34.793641 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:34.794087 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:34.801876 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-52c1febb-4ab9-4c31-ac2f-5e76b5fd1a30 req-f4204362-92ca-47a2-b4ca-8d9a7d23b603 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:34.802458 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-52c1febb-4ab9-4c31-ac2f-5e76b5fd1a30 req-f4204362-92ca-47a2-b4ca-8d9a7d23b603 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:34.803317 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-52c1febb-4ab9-4c31-ac2f-5e76b5fd1a30 req-f4204362-92ca-47a2-b4ca-8d9a7d23b603 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:34.816057 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-52c1febb-4ab9-4c31-ac2f-5e76b5fd1a30 req-f4204362-92ca-47a2-b4ca-8d9a7d23b603 service nova] Creating event network-changed:0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a for instance 8a13736a-1cb6-4d27-8525-651ee0f407ce on nch2-master-1 Aug 06 22:06:34.822012 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-52c1febb-4ab9-4c31-ac2f-5e76b5fd1a30 req-f4204362-92ca-47a2-b4ca-8d9a7d23b603 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043442 Aug 06 22:06:34.822853 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3699/7209] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:06:34.823791 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Going to try to terminate instance {{(pid=142462) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:06:34.911456 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-906b8881-44d1-4421-8932-2db2e64e6145 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 204 len: 0 microversion: 2.1 time: 0.135956 Aug 06 22:06:34.912325 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3511/7210] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 22:06:34 2022] DELETE /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:06:34.923705 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:06:34.925320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:06:34.932769 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:34.933569 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:34.934418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:34.935713 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:34.936187 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:34.937032 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:35.110534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:06:35.118621 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-abc7f9e7-3849-4029-be03-df1e88034796 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.200112 Aug 06 22:06:35.119197 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3700/7211] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:06:34 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:06:36.140693 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:06:36.141426 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:06:36.149168 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:36.149654 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:36.150098 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:36.151009 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:36.151519 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:36.151970 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:36.365689 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ace3bf8975f45cb8b454d637cc4e917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169cc994a698408ba8bc2297e0b92fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:06:36.373884 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-ea14682d-2ff0-4200-9509-7c90c3f4493d tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 200 len: 1680 microversion: 2.1 time: 0.237462 Aug 06 22:06:36.374662 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3512/7212] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:06:36 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 1680 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:06:36.838351 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-235fcf3a-9d19-4e8f-b865-e792e058b06d req-19dbe0cd-ee74-4617-9742-f47265cfe924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a13736a-1cb6-4d27-8525-651ee0f407ce", "name": "network-vif-deleted", "tag": "0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:06:36.848979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-235fcf3a-9d19-4e8f-b865-e792e058b06d req-19dbe0cd-ee74-4617-9742-f47265cfe924 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:36.849466 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-235fcf3a-9d19-4e8f-b865-e792e058b06d req-19dbe0cd-ee74-4617-9742-f47265cfe924 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:36.849905 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-235fcf3a-9d19-4e8f-b865-e792e058b06d req-19dbe0cd-ee74-4617-9742-f47265cfe924 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:36.861459 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-235fcf3a-9d19-4e8f-b865-e792e058b06d req-19dbe0cd-ee74-4617-9742-f47265cfe924 service nova] Creating event network-vif-deleted:0d7ae9d0-bca0-4c24-b270-bc6de6b31f6a for instance 8a13736a-1cb6-4d27-8525-651ee0f407ce on nch2-master-1 Aug 06 22:06:36.866246 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-235fcf3a-9d19-4e8f-b865-e792e058b06d req-19dbe0cd-ee74-4617-9742-f47265cfe924 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033844 Aug 06 22:06:36.866997 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3701/7213] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:06:37.395719 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:06:37.396258 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] [instance: 8a13736a-1cb6-4d27-8525-651ee0f407ce] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:06:37.403787 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:37.404286 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:37.404728 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:37.405430 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:06:37.405894 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:06:37.406356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:06:37.419775 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] HTTP exception thrown: Instance 8a13736a-1cb6-4d27-8525-651ee0f407ce could not be found. Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Request method failure captured: Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce HTTP/1.1 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uTwBxZzaJfZIbiJv2oXbyPp8DEXrgF39rJ1NlGjB9wsc2VLy7mzhTwnyrLAlNKGt4K38O1fmEKqfTvdpBVOUr7cnwTONs50PhMvUvHzS5pM2AQhNJiVpDci1-2-2NQkXagbuF68d9BXavLJlB8rw2C-I4MlWaOM0yvtab2UA4_WsVc Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 169cc994a698408ba8bc2297e0b92fc7 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestShelveInstance-1549763135 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/169cc994a698408ba8bc2297e0b92fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_169cc994a698408ba8bc2297e0b92fc7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/169cc994a698408ba8bc2297e0b92fc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/169cc994a698408ba8bc2297e0b92fc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestShelveInstance-1549763135 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 169cc994a698408ba8bc2297e0b92fc7 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestShelveInstance-1549763135 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestShelveInstance-1549763135-project Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 7ace3bf8975f45cb8b454d637cc4e917 Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestShelveInstance-1549763135-project Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance 8a13736a-1cb6-4d27-8525-651ee0f407ce could not be found. Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': '8a13736a-1cb6-4d27-8525-651ee0f407ce'} Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a13736a-1cb6-4d27-8525-651ee0f407ce could not be found. Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a13736a-1cb6-4d27-8525-651ee0f407ce could not be found. Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:06:37.421387 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a13736a-1cb6-4d27-8525-651ee0f407ce could not be found. Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Returning 404 to user: Instance 8a13736a-1cb6-4d27-8525-651ee0f407ce could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-188c4010-ccc7-439e-897f-1250e5ea1d76 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce" status: 404 len: 111 microversion: 2.1 time: 0.031097 Aug 06 22:06:37.426595 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3513/7214] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:06:37 2022] GET /compute/v2.1/servers/8a13736a-1cb6-4d27-8525-651ee0f407ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 22:06:37.589213 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e5f4d5ee-0053-401b-8001-31ef97da5faf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '.version_select at 0x7f72a365adc0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:06:37.613462 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e5f4d5ee-0053-401b-8001-31ef97da5faf tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-824350367" status: 202 len: 0 microversion: 2.1 time: 0.028998 Aug 06 22:06:37.613978 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3702/7215] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 22:06:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-824350367 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 22:06:37.636577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d6d673c3-1e40-4665-ae88-21ee5820e274 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Action: 'create', calling method: .version_select at 0x7f729d31cc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-567327318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5fcNpR0cAYIoYpMz78tZB4MQH9j3lps++oQvzvEuiQKDMFo38PA1BYOetXN4ERJdo4CZBeyZrIzFgeOWbGJ6Rfm1xQVzAgIGzFvsaL4f0VNowL9uXj9W+xtSHqXqaqDg=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:06:37.652116 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d6d673c3-1e40-4665-ae88-21ee5820e274 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Getting quotas for project 169cc994a698408ba8bc2297e0b92fc7. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:06:37.657964 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-d6d673c3-1e40-4665-ae88-21ee5820e274 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Getting quotas for user 7ace3bf8975f45cb8b454d637cc4e917 and project 169cc994a698408ba8bc2297e0b92fc7. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:06:37.682913 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d6d673c3-1e40-4665-ae88-21ee5820e274 tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.050853 Aug 06 22:06:37.683526 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3514/7216] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 22:06:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:06:40.431192 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1a4dd5be-6562-4786-b08f-1255f8dfb55e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] Calling method '.version_select at 0x7f729d6da940>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:06:40.456029 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1a4dd5be-6562-4786-b08f-1255f8dfb55e tempest-TestShelveInstance-1549763135 tempest-TestShelveInstance-1549763135-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-567327318" status: 202 len: 0 microversion: 2.1 time: 0.029558 Aug 06 22:06:40.456979 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3703/7217] 10.222.0.33 () {58 vars in 1251 bytes} [Sat Aug 6 22:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-567327318 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:06:58.028191 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:58.029616 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=4 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:58.030398 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:58.247688 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cc98aea0-0d2e-4d5b-8fbf-7939edff9f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Action: 'create', calling method: .version_select at 0x7f72a34d8310>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-881328954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYPibeDp5PTtAzl7Vlq3N7ZaGge9vk0aZw6hxw/NJeFfjWFNLhUvkLqjAnvgXE/nr21/dPYAPxeYr+THV01wFlILe046xmSt5SKTvmFxUc/LaZunn4KZWzkfFJx39eQmw=="}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:06:58.264721 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-cc98aea0-0d2e-4d5b-8fbf-7939edff9f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Getting quotas for project 78afe718095c4863be33305daa8eefdc. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:06:58.270006 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-cc98aea0-0d2e-4d5b-8fbf-7939edff9f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Getting quotas for user 25a65a3d3d7440bf83d44c5bd567ecd0 and project 78afe718095c4863be33305daa8eefdc. Resources: {'key_pairs'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:06:58.297045 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cc98aea0-0d2e-4d5b-8fbf-7939edff9f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.274900 Aug 06 22:06:58.297678 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3515/7218] 10.222.0.33 () {60 vars in 1159 bytes} [Sat Aug 6 22:06:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:06:59.347980 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1152867637", "imageRef": "5135514a-af3f-4057-893c-38dd4d85e4cd", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-881328954", "security_groups": [{"name": "tempest-secgroup-smoke-631504966"}], "networks": [{"uuid": "1bd2e342-51f8-4c44-926f-903ec631865c"}]}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:06:59.359322 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=10 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:59.360117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:06:59.475050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.network.neutron [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] validate_networks() for [('1bd2e342-51f8-4c44-926f-903ec631865c', None, None, None, None, None)] {{(pid=142461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:06:59.987430 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Flavor limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:06:59.987867 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Image limits 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:06:59.988357 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Flavor pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:06:59.988780 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Image pref 0:0:0 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:06:59.989203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.virt.hardware [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:06:59.999957 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:00.000443 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:00.000913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:00.001770 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:00.002264 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:00.002724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:00.020446 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Getting quotas for project 78afe718095c4863be33305daa8eefdc. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:07:00.026026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.quota [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Getting quotas for user 25a65a3d3d7440bf83d44c5bd567ecd0 and project 78afe718095c4863be33305daa8eefdc. Resources: {'instances', 'cores', 'ram'} {{(pid=142461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:07:00.039034 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Going to run 1 instances... {{(pid=142461) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:07:00.041440 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5135514a-af3f-4057-893c-38dd4d85e4cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:07:00.089338 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1dd7f53f-a4b8-4a54-b7d2-bb9d1c846f21 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.745588 Aug 06 22:07:00.090234 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3704/7219] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 22:06:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:07:00.100968 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-9080482c-ed8a-4a5a-ae65-1d8d7748d458 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:00.101710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-9080482c-ed8a-4a5a-ae65-1d8d7748d458 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:00.164812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-9080482c-ed8a-4a5a-ae65-1d8d7748d458 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:00.173341 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-9080482c-ed8a-4a5a-ae65-1d8d7748d458 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1248 microversion: 2.1 time: 0.076394 Aug 06 22:07:00.173911 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3516/7220] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:00 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:01.198969 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:01.200002 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:01.209176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:01.209796 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:01.210455 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:01.211422 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:01.212028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:01.212533 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:01.308350 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:01.327332 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-80c1b5f9-7449-4ca9-b2a9-9c1ede9c42fc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1300 microversion: 2.1 time: 0.131594 Aug 06 22:07:01.328025 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3705/7221] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:01 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:02.348870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:02.349498 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:02.356364 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:02.356861 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:02.357305 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:02.358018 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:02.358513 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:02.359050 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:02.580674 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:02.588986 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-4982da0f-3970-43a4-9a5a-82b2cf5b8427 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1373 microversion: 2.1 time: 0.244375 Aug 06 22:07:02.589583 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3517/7222] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:02 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1373 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:02.776257 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-a3e3a478-869e-40cb-ba9b-6c9a18a70776 req-3d47d403-0c06-4a9f-ae2a-7e63aec8c902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef32b2fb-69e0-446a-abe1-4a85662aed58", "tag": "3c6a84f4-b0f6-4769-aaea-e6397c77f2fa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:07:02.790412 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a3e3a478-869e-40cb-ba9b-6c9a18a70776 req-3d47d403-0c06-4a9f-ae2a-7e63aec8c902 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:02.790930 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a3e3a478-869e-40cb-ba9b-6c9a18a70776 req-3d47d403-0c06-4a9f-ae2a-7e63aec8c902 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:02.791367 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-a3e3a478-869e-40cb-ba9b-6c9a18a70776 req-3d47d403-0c06-4a9f-ae2a-7e63aec8c902 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:02.806249 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-a3e3a478-869e-40cb-ba9b-6c9a18a70776 req-3d47d403-0c06-4a9f-ae2a-7e63aec8c902 service nova] Creating event network-changed:3c6a84f4-b0f6-4769-aaea-e6397c77f2fa for instance ef32b2fb-69e0-446a-abe1-4a85662aed58 on nch2-master-1 Aug 06 22:07:02.811832 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-a3e3a478-869e-40cb-ba9b-6c9a18a70776 req-3d47d403-0c06-4a9f-ae2a-7e63aec8c902 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041418 Aug 06 22:07:02.813178 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3706/7223] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:07:03.611109 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:03.611772 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:03.619677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:03.620176 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:03.620624 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:03.621359 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:03.621827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:03.622265 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:03.767903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:03.775677 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-91700387-4364-48c7-9715-94872c5ce422 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1373 microversion: 2.1 time: 0.168511 Aug 06 22:07:03.776271 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3518/7224] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:03 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:04.798037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:04.798805 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:04.805193 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:04.805689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:04.806142 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:04.806886 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:04.807352 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:04.807785 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:04.941513 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:04.949709 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-3c911992-f735-4e36-9ac8-34e7e6cbacbc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1373 microversion: 2.1 time: 0.156812 Aug 06 22:07:04.950286 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3707/7225] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:04 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:05.972827 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:05.973441 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:05.980627 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:05.981112 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:05.981557 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:05.982279 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:05.982769 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:05.983198 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:06.174122 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:06.182185 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-1cf3d009-4caf-4ffa-92c3-9dbe6ef57245 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1373 microversion: 2.1 time: 0.213754 Aug 06 22:07:06.182794 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3519/7226] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:05 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1373 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:07.202862 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:07.203406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:07.210473 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:07.210991 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:07.211433 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:07.212124 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:07.212584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:07.213012 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:07.398343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:07.405855 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-341b57b8-43a8-450f-9897-c7dad46b87ff tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1373 microversion: 2.1 time: 0.207281 Aug 06 22:07:07.406419 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3708/7227] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:07 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1373 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:08.427230 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:08.427847 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:08.434870 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:08.435321 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:08.435867 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:08.436579 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:08.437107 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:08.437625 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:08.442977 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-fb3a7b80-5c5d-475a-baca-01a3834be03a req-67ad458b-9da4-45c5-b045-6599ff24e2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32b2fb-69e0-446a-abe1-4a85662aed58", "name": "network-vif-plugged", "status": "completed", "tag": "3c6a84f4-b0f6-4769-aaea-e6397c77f2fa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:07:08.454605 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fb3a7b80-5c5d-475a-baca-01a3834be03a req-67ad458b-9da4-45c5-b045-6599ff24e2de service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:08.455338 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fb3a7b80-5c5d-475a-baca-01a3834be03a req-67ad458b-9da4-45c5-b045-6599ff24e2de service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:08.455782 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-fb3a7b80-5c5d-475a-baca-01a3834be03a req-67ad458b-9da4-45c5-b045-6599ff24e2de service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:08.468943 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-fb3a7b80-5c5d-475a-baca-01a3834be03a req-67ad458b-9da4-45c5-b045-6599ff24e2de service nova] Creating event network-vif-plugged:3c6a84f4-b0f6-4769-aaea-e6397c77f2fa for instance ef32b2fb-69e0-446a-abe1-4a85662aed58 on nch2-master-1 Aug 06 22:07:08.474078 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-fb3a7b80-5c5d-475a-baca-01a3834be03a req-67ad458b-9da4-45c5-b045-6599ff24e2de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035121 Aug 06 22:07:08.474703 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3709/7228] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:07:08.632562 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:08.640371 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-a1b16cb9-b5f1-4b95-8e38-c61bb9cdf1aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1373 microversion: 2.1 time: 0.217215 Aug 06 22:07:08.640948 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3520/7229] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:08 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1373 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:09.662839 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:09.668944 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:09.675669 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:09.677156 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:09.677261 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:09.677952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:09.678515 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:09.679176 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:09.814137 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:09.822386 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-8d9c4d23-dabe-488f-99f8-33b86e44d40f tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1558 microversion: 2.1 time: 0.164812 Aug 06 22:07:09.822994 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3710/7230] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:09 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:09.843374 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:07:09.843991 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:07:09.851512 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:09.852014 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:09.852681 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:09.853139 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:09.853594 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:09.854047 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:09.991961 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:07:10.000063 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-d791bd86-b597-4adb-9821-0b21e4492f15 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1558 microversion: 2.1 time: 0.160573 Aug 06 22:07:10.000648 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3521/7231] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:07:09 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:07:11.660883 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-566b4635-5bb0-489f-be02-4646624dde27 req-3453dd29-b22d-4f22-afc1-cfb5a7f880e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef32b2fb-69e0-446a-abe1-4a85662aed58", "tag": "3c6a84f4-b0f6-4769-aaea-e6397c77f2fa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:07:11.666036 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:07:11.666903 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=6 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:07:11.674892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-566b4635-5bb0-489f-be02-4646624dde27 req-3453dd29-b22d-4f22-afc1-cfb5a7f880e3 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:07:11.675733 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-566b4635-5bb0-489f-be02-4646624dde27 req-3453dd29-b22d-4f22-afc1-cfb5a7f880e3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:07:11.676453 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-566b4635-5bb0-489f-be02-4646624dde27 req-3453dd29-b22d-4f22-afc1-cfb5a7f880e3 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:07:11.687652 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-566b4635-5bb0-489f-be02-4646624dde27 req-3453dd29-b22d-4f22-afc1-cfb5a7f880e3 service nova] Creating event network-changed:3c6a84f4-b0f6-4769-aaea-e6397c77f2fa for instance ef32b2fb-69e0-446a-abe1-4a85662aed58 on nch2-master-1 Aug 06 22:07:11.692750 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-566b4635-5bb0-489f-be02-4646624dde27 req-3453dd29-b22d-4f22-afc1-cfb5a7f880e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035782 Aug 06 22:07:11.693432 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3711/7232] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:09:09.196542 ncdv-master-1 devstack@n-api.service[142462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c1704f3-a3fc-4388-9fad-6648f362ba1c] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 06 22:09:09.197522 ncdv-master-1 devstack@n-api.service[142462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ab5efab0-de38-4f56-b194-450b1af3079e] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 06 22:09:09.197890 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:09.198817 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:09.199630 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=30 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:09.204335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-0e5901ba-e63e-4108-8456-5338d5f8b3aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1838586706"}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:09:09.206952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-0e5901ba-e63e-4108-8456-5338d5f8b3aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:09.216449 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e5901ba-e63e-4108-8456-5338d5f8b3aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:09.216948 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e5901ba-e63e-4108-8456-5338d5f8b3aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:09.217395 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e5901ba-e63e-4108-8456-5338d5f8b3aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:09.218106 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e5901ba-e63e-4108-8456-5338d5f8b3aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:09.218600 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e5901ba-e63e-4108-8456-5338d5f8b3aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:09.219040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-0e5901ba-e63e-4108-8456-5338d5f8b3aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:09.408957 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-0e5901ba-e63e-4108-8456-5338d5f8b3aa tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "POST /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58/action" status: 202 len: 0 microversion: 2.1 time: 0.214313 Aug 06 22:09:09.409518 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3522/7233] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:09:09 2022] POST /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 22:09:15.202020 ncdv-master-1 devstack@n-api.service[142461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ab97c24-b021-4fbe-9b91-82d554fc336e] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 22:09:15.203795 ncdv-master-1 devstack@n-api.service[142461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [967bdc72-a34e-423a-ac85-89f52583478a] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 22:09:15.204380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:15.205283 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=32 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:15.212238 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-c2347221-53a2-4dc7-8807-df578b75ff29 req-dc5e860a-9b58-408e-93de-00742adc9532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32b2fb-69e0-446a-abe1-4a85662aed58", "name": "network-vif-plugged", "status": "completed", "tag": "3c6a84f4-b0f6-4769-aaea-e6397c77f2fa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:09:15.227121 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c2347221-53a2-4dc7-8807-df578b75ff29 req-dc5e860a-9b58-408e-93de-00742adc9532 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:15.228026 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c2347221-53a2-4dc7-8807-df578b75ff29 req-dc5e860a-9b58-408e-93de-00742adc9532 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:15.229008 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-c2347221-53a2-4dc7-8807-df578b75ff29 req-dc5e860a-9b58-408e-93de-00742adc9532 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:15.246279 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-c2347221-53a2-4dc7-8807-df578b75ff29 req-dc5e860a-9b58-408e-93de-00742adc9532 service nova] Creating event network-vif-plugged:3c6a84f4-b0f6-4769-aaea-e6397c77f2fa for instance ef32b2fb-69e0-446a-abe1-4a85662aed58 on nch2-master-1 Aug 06 22:09:15.252214 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-c2347221-53a2-4dc7-8807-df578b75ff29 req-dc5e860a-9b58-408e-93de-00742adc9532 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054659 Aug 06 22:09:15.253498 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3712/7234] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:09:22.951527 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:22.952356 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:22.957215 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-394618939", "imageRef": "5b8403bf-3f5e-438d-ad48-f33d00cf37f8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-881328954", "security_groups": [{"name": "tempest-secgroup-smoke-631504966"}], "networks": [{"uuid": "1bd2e342-51f8-4c44-926f-903ec631865c"}]}} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:09:22.985211 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c1704f3-a3fc-4388-9fad-6648f362ba1c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 44762. Aug 06 22:09:22.988149 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] [ab5efab0-de38-4f56-b194-450b1af3079e] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 44764. Aug 06 22:09:23.075725 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.network.neutron [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] validate_networks() for [('1bd2e342-51f8-4c44-926f-903ec631865c', None, None, None, None, None)] {{(pid=142462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 22:09:23.464976 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Flavor limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 22:09:23.465424 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Image limits 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 22:09:23.465900 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Flavor pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 22:09:23.466309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Image pref 0:0:0 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 22:09:23.466752 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.virt.hardware [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=142462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 22:09:23.476548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:23.477032 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:23.477471 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:23.478202 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:23.478687 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:23.479148 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:23.495938 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Getting quotas for project 78afe718095c4863be33305daa8eefdc. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 22:09:23.501149 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.quota [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Getting quotas for user 25a65a3d3d7440bf83d44c5bd567ecd0 and project 78afe718095c4863be33305daa8eefdc. Resources: {'instances', 'cores', 'ram'} {{(pid=142462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 22:09:23.513782 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Going to run 1 instances... {{(pid=142462) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 22:09:23.516267 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b8403bf-3f5e-438d-ad48-f33d00cf37f8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=142462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 22:09:23.562492 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-645bca98-3749-4fce-816b-c8413fe0cfb3 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.613029 Aug 06 22:09:23.563191 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3523/7235] 10.222.0.33 () {60 vars in 1147 bytes} [Sat Aug 6 22:09:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 22:09:23.580743 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ab97c24-b021-4fbe-9b91-82d554fc336e] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 44776. Aug 06 22:09:23.590955 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d09aa8aa-4439-4150-8295-02d06a228be0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:23.591682 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d09aa8aa-4439-4150-8295-02d06a228be0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:23.595661 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] [967bdc72-a34e-423a-ac85-89f52583478a] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 44778. Aug 06 22:09:23.650756 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d09aa8aa-4439-4150-8295-02d06a228be0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:23.658348 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d09aa8aa-4439-4150-8295-02d06a228be0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1247 microversion: 2.1 time: 0.088060 Aug 06 22:09:23.658933 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3713/7236] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:23 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:24.682793 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:24.684011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:24.693145 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:24.693966 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:24.694417 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:24.695342 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:24.695808 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:24.696247 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:24.775969 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:24.785228 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-36036f7a-deb3-47c7-afab-c5f4c385171c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1305 microversion: 2.1 time: 0.107603 Aug 06 22:09:24.790715 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3524/7237] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:24 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:25.806680 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:25.807918 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:25.811103 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:25.817037 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:25.817564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:25.818772 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:25.819678 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:25.820463 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:25.821066 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:25.985074 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:25.993593 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-e176db6e-4456-4e49-8be1-ce4c3e131f47 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.191881 Aug 06 22:09:25.994205 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3714/7238] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:25 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:27.017062 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:27.017828 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:27.026456 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:27.026936 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:27.027371 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:27.028097 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:27.028563 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:27.028999 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:27.195854 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:27.214405 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-4762d7a3-1d81-49b6-b7de-6f531d1266b8 req-9ddf3903-39cf-4c17-8dff-6006c41fd51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32b2fb-69e0-446a-abe1-4a85662aed58", "name": "network-vif-unplugged", "status": "completed", "tag": "3c6a84f4-b0f6-4769-aaea-e6397c77f2fa"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:09:27.217715 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-5983faa4-3971-45a8-88d4-0b3d10988e8a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.205301 Aug 06 22:09:27.236101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4762d7a3-1d81-49b6-b7de-6f531d1266b8 req-9ddf3903-39cf-4c17-8dff-6006c41fd51b service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:27.240962 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4762d7a3-1d81-49b6-b7de-6f531d1266b8 req-9ddf3903-39cf-4c17-8dff-6006c41fd51b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:27.241290 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3525/7239] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:27 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:27.241875 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-4762d7a3-1d81-49b6-b7de-6f531d1266b8 req-9ddf3903-39cf-4c17-8dff-6006c41fd51b service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:27.261206 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-4762d7a3-1d81-49b6-b7de-6f531d1266b8 req-9ddf3903-39cf-4c17-8dff-6006c41fd51b service nova] Creating event network-vif-unplugged:3c6a84f4-b0f6-4769-aaea-e6397c77f2fa for instance ef32b2fb-69e0-446a-abe1-4a85662aed58 on nch2-master-1 Aug 06 22:09:27.272170 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-4762d7a3-1d81-49b6-b7de-6f531d1266b8 req-9ddf3903-39cf-4c17-8dff-6006c41fd51b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060487 Aug 06 22:09:27.276324 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3715/7240] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:09:28.247074 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:28.247699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:28.254846 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:28.255882 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:28.256338 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:28.257040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:28.257505 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:28.257945 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:28.391181 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:28.399536 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-b108906c-f8e9-4986-b99b-164a6bd0c7e4 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.156245 Aug 06 22:09:28.400382 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3526/7241] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:28 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:29.424022 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:29.425936 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:29.434689 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:29.435837 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:29.436750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:29.438024 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:29.438873 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:29.439612 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:29.579813 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:29.587908 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-d794e95a-7fd2-4752-a642-a1a6d58502af tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.169719 Aug 06 22:09:29.588486 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3716/7242] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:29 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:30.608951 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:30.609613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:30.617910 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:30.618661 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:30.619069 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:30.619812 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:30.620307 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:30.620742 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:30.761872 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:30.770230 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-c6a5a621-f2a7-4bec-aaee-8719b8f34809 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.165117 Aug 06 22:09:30.771645 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3527/7243] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:30 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:31.795374 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:31.796308 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:31.806534 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:31.807172 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:31.807652 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:31.808399 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:31.808895 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:31.809377 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:31.954088 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:31.962989 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-282be002-44b4-456e-a618-7f82ee20c608 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.173190 Aug 06 22:09:31.966589 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3717/7244] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:31 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:32.984956 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:32.985568 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:32.993150 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:32.993631 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:32.994067 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:32.994792 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:32.995250 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:32.995677 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:33.144856 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:33.154047 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-42efe87c-5eb5-478d-93e2-886dfdbb406c tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.172741 Aug 06 22:09:33.155391 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3528/7245] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:32 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:34.180778 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:34.181402 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:34.184249 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell0:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:34.189852 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:34.190342 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:34.190824 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:34.191526 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:34.191990 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:34.192419 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:34.323724 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:34.331317 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-1e028c36-3353-49e8-a060-5d335b2c0806 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.155500 Aug 06 22:09:34.331904 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3718/7246] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:34 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:35.352998 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:35.353648 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:35.355863 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=2 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:35.356536 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell0:SELECT=6 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:09:35.363613 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:35.364141 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:35.364588 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:35.365997 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:35.366464 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:35.366927 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:35.752852 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:35.760448 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-62070279-3c97-47c2-b486-1bd696c8cbd0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.411600 Aug 06 22:09:35.761233 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3529/7247] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:35 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:36.142380 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [req-843be039-46f0-4b3c-a23c-7c4e2e0d08e1 req-34f1c22f-4fc0-4434-ac00-220afddbfc39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf1b2bf-0f52-4d78-ab65-41b4df49175d", "tag": "0e3da188-4b69-43b5-9278-f7822ffa58a9"}]} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:09:36.152549 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-843be039-46f0-4b3c-a23c-7c4e2e0d08e1 req-34f1c22f-4fc0-4434-ac00-220afddbfc39 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:36.153044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-843be039-46f0-4b3c-a23c-7c4e2e0d08e1 req-34f1c22f-4fc0-4434-ac00-220afddbfc39 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:36.154275 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [req-843be039-46f0-4b3c-a23c-7c4e2e0d08e1 req-34f1c22f-4fc0-4434-ac00-220afddbfc39 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:36.167166 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.compute.server_external_events [req-843be039-46f0-4b3c-a23c-7c4e2e0d08e1 req-34f1c22f-4fc0-4434-ac00-220afddbfc39 service nova] Creating event network-changed:0e3da188-4b69-43b5-9278-f7822ffa58a9 for instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d on nch1-master-1 Aug 06 22:09:36.172585 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [req-843be039-46f0-4b3c-a23c-7c4e2e0d08e1 req-34f1c22f-4fc0-4434-ac00-220afddbfc39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102128 Aug 06 22:09:36.173262 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3719/7248] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:09:36.781189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:36.781803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:36.790400 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:36.790986 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:36.791427 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:36.792121 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:36.792577 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:36.793008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:36.924469 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:36.932613 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cc6e4231-4638-4689-a702-3547e59c3fc0 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.155364 Aug 06 22:09:36.933188 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3530/7249] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:36 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:37.953913 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:37.954584 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:37.963442 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:37.963942 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:37.964390 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:37.965101 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:37.965566 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:37.966031 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:38.100441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:38.108247 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-499b665a-7426-4076-bf12-3b565d1f589a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.158781 Aug 06 22:09:38.108834 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3720/7250] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:37 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:39.129347 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:39.129972 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:39.137228 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:39.137720 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:39.138189 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:39.139022 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:39.139479 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:39.139971 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:39.278993 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:39.286502 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-cdcdfc5b-527f-47ee-a4b5-dc6f5b0c4d63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.161121 Aug 06 22:09:39.287826 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3531/7251] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:39 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:40.307774 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:40.308398 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:40.315487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:40.315973 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:40.316418 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:40.317117 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:40.317580 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:40.318014 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:40.459937 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:40.467894 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-41a2d3dd-2501-415f-a226-27edc652395a tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.164078 Aug 06 22:09:40.468483 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3721/7252] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:40 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:40.680219 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-5e7791dd-0ff8-46bd-8428-b139c90ff3e9 req-ae39cd25-adec-4b0c-acc1-9aa7ee84fb98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf1b2bf-0f52-4d78-ab65-41b4df49175d", "name": "network-vif-plugged", "status": "completed", "tag": "0e3da188-4b69-43b5-9278-f7822ffa58a9"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:09:40.692252 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5e7791dd-0ff8-46bd-8428-b139c90ff3e9 req-ae39cd25-adec-4b0c-acc1-9aa7ee84fb98 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:40.692762 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5e7791dd-0ff8-46bd-8428-b139c90ff3e9 req-ae39cd25-adec-4b0c-acc1-9aa7ee84fb98 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:40.693204 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-5e7791dd-0ff8-46bd-8428-b139c90ff3e9 req-ae39cd25-adec-4b0c-acc1-9aa7ee84fb98 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:40.705636 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-5e7791dd-0ff8-46bd-8428-b139c90ff3e9 req-ae39cd25-adec-4b0c-acc1-9aa7ee84fb98 service nova] Creating event network-vif-plugged:0e3da188-4b69-43b5-9278-f7822ffa58a9 for instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d on nch1-master-1 Aug 06 22:09:40.711902 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-5e7791dd-0ff8-46bd-8428-b139c90ff3e9 req-ae39cd25-adec-4b0c-acc1-9aa7ee84fb98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036481 Aug 06 22:09:40.712520 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3532/7253] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:09:41.488476 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:41.489089 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:41.496702 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:41.497184 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:41.497626 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:41.498316 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:41.498808 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:41.499235 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:41.631531 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:41.638981 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-c1449518-7080-4dff-a6d7-9afdb93da1c7 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1372 microversion: 2.1 time: 0.154358 Aug 06 22:09:41.639557 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3722/7254] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:41 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:09:42.660869 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:42.661582 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:42.670829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:42.670829 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:42.671159 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:42.671875 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:42.672341 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:42.672776 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:42.860203 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:42.868157 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-2857354e-71cc-4f42-8acb-daecffff5199 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1556 microversion: 2.1 time: 0.211605 Aug 06 22:09:42.878766 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3533/7255] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:42 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1556 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:42.888595 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:09:42.889224 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:09:42.896394 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:42.897395 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:42.897842 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:42.898596 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:42.899061 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:42.899491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:43.039588 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:09:43.047508 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-b3c44d57-ba86-4ad5-902b-77a64318382b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1556 microversion: 2.1 time: 0.162760 Aug 06 22:09:43.048088 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3723/7256] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:09:42 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:09:45.019696 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-30b20f89-45ad-4fd4-96cd-56d88523fe47 req-dd1b38e6-a6fb-4ce8-85c2-0d73a4da0725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf1b2bf-0f52-4d78-ab65-41b4df49175d", "tag": "0e3da188-4b69-43b5-9278-f7822ffa58a9"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:09:45.030161 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-30b20f89-45ad-4fd4-96cd-56d88523fe47 req-dd1b38e6-a6fb-4ce8-85c2-0d73a4da0725 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:09:45.030803 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-30b20f89-45ad-4fd4-96cd-56d88523fe47 req-dd1b38e6-a6fb-4ce8-85c2-0d73a4da0725 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:09:45.031299 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-30b20f89-45ad-4fd4-96cd-56d88523fe47 req-dd1b38e6-a6fb-4ce8-85c2-0d73a4da0725 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:09:45.043053 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-30b20f89-45ad-4fd4-96cd-56d88523fe47 req-dd1b38e6-a6fb-4ce8-85c2-0d73a4da0725 service nova] Creating event network-changed:0e3da188-4b69-43b5-9278-f7822ffa58a9 for instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d on nch1-master-1 Aug 06 22:09:45.048567 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-30b20f89-45ad-4fd4-96cd-56d88523fe47 req-dd1b38e6-a6fb-4ce8-85c2-0d73a4da0725 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091238 Aug 06 22:09:45.049120 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3534/7257] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:14.165406 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=26 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:14.166165 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=52 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:14.170833 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-cc9f0e19-b01e-4f9f-9845-ebc463614694 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-844995015"}} {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:14.173246 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-cc9f0e19-b01e-4f9f-9845-ebc463614694 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:14.180788 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc9f0e19-b01e-4f9f-9845-ebc463614694 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:14.181271 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc9f0e19-b01e-4f9f-9845-ebc463614694 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:14.181708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc9f0e19-b01e-4f9f-9845-ebc463614694 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:14.182407 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc9f0e19-b01e-4f9f-9845-ebc463614694 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:14.182892 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc9f0e19-b01e-4f9f-9845-ebc463614694 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:14.183318 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-cc9f0e19-b01e-4f9f-9845-ebc463614694 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:14.377650 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-cc9f0e19-b01e-4f9f-9845-ebc463614694 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "POST /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d/action" status: 202 len: 0 microversion: 2.1 time: 0.214067 Aug 06 22:11:14.378305 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3724/7258] 10.222.0.33 () {60 vars in 1278 bytes} [Sat Aug 6 22:11:14 2022] POST /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 06 22:11:19.234335 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:19.235118 ncdv-master-1 devstack@n-api.service[142462]: DEBUG dbcounter [-] [142462] Writing DB stats nova_cell1:SELECT=60 {{(pid=142462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:19.324379 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-fd74e1e4-49f9-4811-a8aa-5761ab5042c8 req-214f1a84-3599-4528-a4dc-a137d4b486d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf1b2bf-0f52-4d78-ab65-41b4df49175d", "name": "network-vif-plugged", "status": "completed", "tag": "0e3da188-4b69-43b5-9278-f7822ffa58a9"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:19.337226 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fd74e1e4-49f9-4811-a8aa-5761ab5042c8 req-214f1a84-3599-4528-a4dc-a137d4b486d5 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:19.337815 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fd74e1e4-49f9-4811-a8aa-5761ab5042c8 req-214f1a84-3599-4528-a4dc-a137d4b486d5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:19.338474 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-fd74e1e4-49f9-4811-a8aa-5761ab5042c8 req-214f1a84-3599-4528-a4dc-a137d4b486d5 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:19.352641 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-fd74e1e4-49f9-4811-a8aa-5761ab5042c8 req-214f1a84-3599-4528-a4dc-a137d4b486d5 service nova] Creating event network-vif-plugged:0e3da188-4b69-43b5-9278-f7822ffa58a9 for instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d on nch1-master-1 Aug 06 22:11:19.357977 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-fd74e1e4-49f9-4811-a8aa-5761ab5042c8 req-214f1a84-3599-4528-a4dc-a137d4b486d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125596 Aug 06 22:11:19.358906 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3535/7259] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:28.034475 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:28.035320 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:28.037919 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_api:SELECT=2 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:28.038571 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-61690e37-5e9d-46d1-82f2-3ba0bb8d5643 req-283e80b2-f903-4b8a-839f-2e786ba0f544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf1b2bf-0f52-4d78-ab65-41b4df49175d", "tag": "0e3da188-4b69-43b5-9278-f7822ffa58a9"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:28.039028 ncdv-master-1 devstack@n-api.service[142461]: DEBUG dbcounter [-] [142461] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=142461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 22:11:28.045159 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.045874 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.046327 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.047077 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.047543 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.047979 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.048623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-61690e37-5e9d-46d1-82f2-3ba0bb8d5643 req-283e80b2-f903-4b8a-839f-2e786ba0f544 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.049406 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-61690e37-5e9d-46d1-82f2-3ba0bb8d5643 req-283e80b2-f903-4b8a-839f-2e786ba0f544 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.050077 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-61690e37-5e9d-46d1-82f2-3ba0bb8d5643 req-283e80b2-f903-4b8a-839f-2e786ba0f544 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.063053 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-61690e37-5e9d-46d1-82f2-3ba0bb8d5643 req-283e80b2-f903-4b8a-839f-2e786ba0f544 service nova] Creating event network-changed:0e3da188-4b69-43b5-9278-f7822ffa58a9 for instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d on nch1-master-1 Aug 06 22:11:28.070155 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-61690e37-5e9d-46d1-82f2-3ba0bb8d5643 req-283e80b2-f903-4b8a-839f-2e786ba0f544 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037938 Aug 06 22:11:28.071464 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3536/7260] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:11:28.080551 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:11:28.185643 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-dd114ef2-c965-4f5c-a9ae-6997d1763a12 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 204 len: 0 microversion: 2.1 time: 0.155657 Aug 06 22:11:28.186569 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3725/7261] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 22:11:28 2022] DELETE /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:11:28.196590 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:28.197623 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:28.205903 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.206649 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.207858 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.209284 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:28.209713 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:28.210152 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:28.354745 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:28.362476 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-72a240d0-f0af-4435-97bc-ff5a8e88ff27 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1681 microversion: 2.1 time: 0.171306 Aug 06 22:11:28.363094 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3537/7262] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:28 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:29.385491 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:29.386244 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:29.393961 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:29.394450 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:29.394929 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:29.395629 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:29.396129 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:29.396557 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:29.546048 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:29.554384 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-abb56034-47ce-4dc4-919d-34575797f21b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1681 microversion: 2.1 time: 0.173943 Aug 06 22:11:29.554987 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3726/7263] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:29 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:30.237028 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-6c86a6ff-5cdb-450c-b2a9-0ec1e53222ad req-ac565907-1517-403c-9a0a-75f595dcb231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf1b2bf-0f52-4d78-ab65-41b4df49175d", "name": "network-vif-deleted", "tag": "0e3da188-4b69-43b5-9278-f7822ffa58a9"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:30.247514 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6c86a6ff-5cdb-450c-b2a9-0ec1e53222ad req-ac565907-1517-403c-9a0a-75f595dcb231 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:30.248011 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6c86a6ff-5cdb-450c-b2a9-0ec1e53222ad req-ac565907-1517-403c-9a0a-75f595dcb231 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:30.248448 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-6c86a6ff-5cdb-450c-b2a9-0ec1e53222ad req-ac565907-1517-403c-9a0a-75f595dcb231 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:30.260171 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-6c86a6ff-5cdb-450c-b2a9-0ec1e53222ad req-ac565907-1517-403c-9a0a-75f595dcb231 service nova] Creating event network-vif-deleted:0e3da188-4b69-43b5-9278-f7822ffa58a9 for instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d on nch1-master-1 Aug 06 22:11:30.265130 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-6c86a6ff-5cdb-450c-b2a9-0ec1e53222ad req-ac565907-1517-403c-9a0a-75f595dcb231 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032047 Aug 06 22:11:30.265730 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3538/7264] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:30.575203 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:30.576573 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:30.586966 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:30.587938 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:30.588564 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:30.589354 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:30.589819 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:30.590935 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:30.634487 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:30.635260 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:30.635858 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:30.636483 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lazy-loading 'fault' on Instance uuid bcf1b2bf-0f52-4d78-ab65-41b4df49175d {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:11:30.688335 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:30.697887 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-5dfccfc9-b591-42ab-b323-962bf08057be tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 200 len: 1337 microversion: 2.1 time: 0.126440 Aug 06 22:11:30.698855 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3727/7265] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:30 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 1337 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:31.721760 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:31.722473 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: bcf1b2bf-0f52-4d78-ab65-41b4df49175d] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:31.729952 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:31.730442 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:31.730913 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:31.731617 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:31.732083 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:31.732517 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:31.746925 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] HTTP exception thrown: Instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d could not be found. Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Request method failure captured: Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d HTTP/1.1 Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uX807yqp52L3azaDQT9-pv9qutWhcdVi-bEz_FWu_kCjC1AstespcUVbC-3YhW5nBPznhZJs4AbLaJOt1Sx043AICSpJZ-Geg03FHCLfUqP1gZonAGDxlZK-0-gV3rDSTlnGt1_c71Dyiu0yLs0itXIkKfAWzs9HU-PcfeGWN058Qs Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 78afe718095c4863be33305daa8eefdc Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestSnapshotPattern-841308441 Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78afe718095c4863be33305daa8eefdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78afe718095c4863be33305daa8eefdc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78afe718095c4863be33305daa8eefdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78afe718095c4863be33305daa8eefdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestSnapshotPattern-841308441 Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 78afe718095c4863be33305daa8eefdc Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestSnapshotPattern-841308441 Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestSnapshotPattern-841308441-project Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 25a65a3d3d7440bf83d44c5bd567ecd0 Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestSnapshotPattern-841308441-project Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d could not be found. Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'bcf1b2bf-0f52-4d78-ab65-41b4df49175d'} Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d could not be found. Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d could not be found. Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:11:31.748545 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d could not be found. Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Returning 404 to user: Instance bcf1b2bf-0f52-4d78-ab65-41b4df49175d could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-3bdfc149-9815-4826-aaf6-47b412a9e76d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d" status: 404 len: 111 microversion: 2.1 time: 0.033261 Aug 06 22:11:31.753206 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3539/7266] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:31 2022] GET /compute/v2.1/servers/bcf1b2bf-0f52-4d78-ab65-41b4df49175d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:11:33.412044 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:33.413218 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:33.414390 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-696a6fd7-3040-4b4f-8b3c-4010237588df req-1d14e935-7fd1-43bc-bc72-74d4a3aa1aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef32b2fb-69e0-446a-abe1-4a85662aed58", "tag": "3c6a84f4-b0f6-4769-aaea-e6397c77f2fa"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:33.419577 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.420050 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.420750 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.421456 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.421914 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.422343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.425010 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-696a6fd7-3040-4b4f-8b3c-4010237588df req-1d14e935-7fd1-43bc-bc72-74d4a3aa1aa1 service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.425564 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-696a6fd7-3040-4b4f-8b3c-4010237588df req-1d14e935-7fd1-43bc-bc72-74d4a3aa1aa1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.426256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-696a6fd7-3040-4b4f-8b3c-4010237588df req-1d14e935-7fd1-43bc-bc72-74d4a3aa1aa1 service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.438778 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-696a6fd7-3040-4b4f-8b3c-4010237588df req-1d14e935-7fd1-43bc-bc72-74d4a3aa1aa1 service nova] Creating event network-changed:3c6a84f4-b0f6-4769-aaea-e6397c77f2fa for instance ef32b2fb-69e0-446a-abe1-4a85662aed58 on nch2-master-1 Aug 06 22:11:33.444412 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-696a6fd7-3040-4b4f-8b3c-4010237588df req-1d14e935-7fd1-43bc-bc72-74d4a3aa1aa1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034383 Aug 06 22:11:33.445332 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3540/7267] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 22:11:33.450878 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Going to try to terminate instance {{(pid=142461) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 22:11:33.548974 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-eb6a274c-35e6-411a-bb0b-7ecf4f2f478e tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 204 len: 0 microversion: 2.1 time: 0.141377 Aug 06 22:11:33.552181 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3728/7268] 10.222.0.33 () {58 vars in 1239 bytes} [Sat Aug 6 22:11:33 2022] DELETE /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 22:11:33.558453 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:33.559548 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:33.565990 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.566800 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.567434 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.568855 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:33.569483 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:33.570079 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:33.735516 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.policy [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142462) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:33.743739 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-afe3157d-6a79-44da-92a7-8fc153b6f57b tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1683 microversion: 2.1 time: 0.189378 Aug 06 22:11:33.744329 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3541/7269] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:33 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:34.767712 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:34.768431 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:34.775572 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:34.776069 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:34.776516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:34.777242 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:34.777708 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:34.778144 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:34.911305 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:34.919938 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-aeceb354-cfed-46d4-8b1e-05addd9d689d tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1683 microversion: 2.1 time: 0.156588 Aug 06 22:11:34.920521 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3729/7270] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:34 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 22:11:35.560836 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [req-14920a6e-795b-4620-8a27-3d0f2429df86 req-7ab40ddc-ce06-422f-8b1f-0e94f136053c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32b2fb-69e0-446a-abe1-4a85662aed58", "name": "network-vif-deleted", "tag": "3c6a84f4-b0f6-4769-aaea-e6397c77f2fa"}]} {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 22:11:35.572710 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-14920a6e-795b-4620-8a27-3d0f2429df86 req-7ab40ddc-ce06-422f-8b1f-0e94f136053c service nova] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:35.573256 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-14920a6e-795b-4620-8a27-3d0f2429df86 req-7ab40ddc-ce06-422f-8b1f-0e94f136053c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:35.573699 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [req-14920a6e-795b-4620-8a27-3d0f2429df86 req-7ab40ddc-ce06-422f-8b1f-0e94f136053c service nova] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:35.587885 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.compute.server_external_events [req-14920a6e-795b-4620-8a27-3d0f2429df86 req-7ab40ddc-ce06-422f-8b1f-0e94f136053c service nova] Creating event network-vif-deleted:3c6a84f4-b0f6-4769-aaea-e6397c77f2fa for instance ef32b2fb-69e0-446a-abe1-4a85662aed58 on nch2-master-1 Aug 06 22:11:35.592865 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [req-14920a6e-795b-4620-8a27-3d0f2429df86 req-7ab40ddc-ce06-422f-8b1f-0e94f136053c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035928 Aug 06 22:11:35.593470 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3542/7271] 10.222.0.33 () {64 vars in 1317 bytes} [Sat Aug 6 22:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 22:11:35.941078 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:35.941729 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.compute.api [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142461) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:35.949516 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:35.950004 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:35.950721 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:35.951441 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:35.951900 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:35.952328 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:35.990739 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:35.991525 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:35.992343 ncdv-master-1 devstack@n-api.service[142461]: DEBUG oslo_concurrency.lockutils [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:35.992952 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.objects.instance [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lazy-loading 'fault' on Instance uuid ef32b2fb-69e0-446a-abe1-4a85662aed58 {{(pid=142461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 22:11:36.039185 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.policy [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a65a3d3d7440bf83d44c5bd567ecd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78afe718095c4863be33305daa8eefdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=142461) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 22:11:36.046161 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-9e07e33e-5611-436c-86fc-7c3c462c2cf1 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 200 len: 1338 microversion: 2.1 time: 0.109059 Aug 06 22:11:36.046805 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3730/7272] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:35 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 22:11:37.069309 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '>' {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:37.070027 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.compute.api [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [instance: ef32b2fb-69e0-446a-abe1-4a85662aed58] Fetching instance by UUID {{(pid=142462) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 22:11:37.076373 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:37.076860 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:37.077306 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:37.078008 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Acquiring lock "7b45003e-98b0-47bc-b1e0-e16756e87671" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 22:11:37.078476 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 22:11:37.079040 ncdv-master-1 devstack@n-api.service[142462]: DEBUG oslo_concurrency.lockutils [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Lock "7b45003e-98b0-47bc-b1e0-e16756e87671" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=142462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 22:11:37.093602 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.wsgi [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] HTTP exception thrown: Instance ef32b2fb-69e0-446a-abe1-4a85662aed58 could not be found. Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Request method failure captured: Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: request: GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 HTTP/1.1 Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: Accept: application/json Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: Accept-Encoding: identity Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: Connection: close Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: Content-Length: 0 Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: Content-Type: application/json Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: Host: 10.222.0.33 Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: Openstack-System-Scope: None Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: User-Agent: python-urllib3/1.26.11 Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Auth-Token: gAAAAABi7uX807yqp52L3azaDQT9-pv9qutWhcdVi-bEz_FWu_kCjC1AstespcUVbC-3YhW5nBPznhZJs4AbLaJOt1Sx043AICSpJZ-Geg03FHCLfUqP1gZonAGDxlZK-0-gV3rDSTlnGt1_c71Dyiu0yLs0itXIkKfAWzs9HU-PcfeGWN058Qs Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Id: None Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Domain-Name: None Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Identity-Status: Confirmed Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Is-Admin-Project: True Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Id: default Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Domain-Name: Default Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Id: 78afe718095c4863be33305daa8eefdc Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Project-Name: tempest-TestSnapshotPattern-841308441 Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Role: member,reader Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Roles: member,reader Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78afe718095c4863be33305daa8eefdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78afe718095c4863be33305daa8eefdc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78afe718095c4863be33305daa8eefdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78afe718095c4863be33305daa8eefdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant: tempest-TestSnapshotPattern-841308441 Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Id: 78afe718095c4863be33305daa8eefdc Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-Tenant-Name: tempest-TestSnapshotPattern-841308441 Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-User: tempest-TestSnapshotPattern-841308441-project Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Id: default Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-User-Domain-Name: Default Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-User-Id: 25a65a3d3d7440bf83d44c5bd567ecd0 Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: X-User-Name: tempest-TestSnapshotPattern-841308441-project Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: method: > Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: exception: Instance ef32b2fb-69e0-446a-abe1-4a85662aed58 could not be found. Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: action_args: {'id': 'ef32b2fb-69e0-446a-abe1-4a85662aed58'} Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: {{(pid=142462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef32b2fb-69e0-446a-abe1-4a85662aed58 could not be found. Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef32b2fb-69e0-446a-abe1-4a85662aed58 could not be found. Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 22:11:37.095559 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef32b2fb-69e0-446a-abe1-4a85662aed58 could not be found. Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: ERROR nova.api.openstack.wsgi Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: DEBUG nova.api.openstack.wsgi [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Returning 404 to user: Instance ef32b2fb-69e0-446a-abe1-4a85662aed58 could not be found. {{(pid=142462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: INFO nova.api.openstack.requestlog [None req-239d234c-af00-4966-a8b3-096094b4e0cc tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58" status: 404 len: 111 microversion: 2.1 time: 0.033038 Aug 06 22:11:37.101264 ncdv-master-1 devstack@n-api.service[142462]: [pid: 142462|app: 0|req: 3543/7273] 10.222.0.33 () {58 vars in 1236 bytes} [Sat Aug 6 22:11:37 2022] GET /compute/v2.1/servers/ef32b2fb-69e0-446a-abe1-4a85662aed58 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 22:11:37.261707 ncdv-master-1 devstack@n-api.service[142461]: DEBUG nova.api.openstack.wsgi [None req-a5734124-e1c4-4c9e-b970-bdfad1741e63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] Calling method '.version_select at 0x7f729d7a15e0>' {{(pid=142461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 22:11:37.266302 ncdv-master-1 devstack@n-api.service[142461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5734124-e1c4-4c9e-b970-bdfad1741e63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [c4d64f3f-2c08-4a87-8b71-e45e80e24cdd] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 22:11:38.274508 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5734124-e1c4-4c9e-b970-bdfad1741e63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] [c4d64f3f-2c08-4a87-8b71-e45e80e24cdd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 45140. Aug 06 22:11:38.293342 ncdv-master-1 devstack@n-api.service[142461]: INFO nova.api.openstack.requestlog [None req-a5734124-e1c4-4c9e-b970-bdfad1741e63 tempest-TestSnapshotPattern-841308441 tempest-TestSnapshotPattern-841308441-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-881328954" status: 202 len: 0 microversion: 2.1 time: 1.035563 Aug 06 22:11:38.293982 ncdv-master-1 devstack@n-api.service[142461]: [pid: 142461|app: 0|req: 3731/7274] 10.222.0.33 () {58 vars in 1254 bytes} [Sat Aug 6 22:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-881328954 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 22:12:04.092760 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:12:04.093472 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 22:12:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:12:07.381004 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:12:07.381563 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 22:12:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:12:37.778763 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:12:37.779370 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 22:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:13:57.014735 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:13:57.014735 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 22:13:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:15:24.100893 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:15:24.101704 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 22:15:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:15:27.389975 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:15:27.390447 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 22:15:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:15:57.786571 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:15:57.787191 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 22:15:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:17:03.707473 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:17:03.707950 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 22:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:17:17.023531 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:17:17.024156 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 22:17:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:17:29.842491 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:17:29.843038 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 22:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:18:44.109079 ncdv-master-1 devstack@n-api.service[142461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:18:44.109722 ncdv-master-1 devstack@n-api.service[142461]: Sat Aug 6 22:18:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:18:47.398492 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:18:47.399127 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 22:18:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 22:19:17.793808 ncdv-master-1 devstack@n-api.service[142462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 22:19:17.794502 ncdv-master-1 devstack@n-api.service[142462]: Sat Aug 6 22:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!